Its also about the terrain. Take this video for example...no way a bike is going to blast threw slippery, wet ground at full speed but cars can...
Bike pilots also have to deal with the fatigue from the workout compared to car drivers but the big one is they are navigating while driving as opposed to having a co pilot.
Certain stages just arent condusive to bikes being faster than cars.
My 2 cents
Tales From The Bivouac Rally Print Publications
"Rally Raid is the only surviving sport with adventure in its DNA, the rest have become fast food"