This can quite often be attributed to the camber in the road.
I've tried it on numerous roads, in both tracks, same result. Did the same test on my Futura, not even a slight pull to the right. When I took care of a friend's BMW boxer, it did the same thing. On the XC, it's a gradual but strong pull that isn't easily countered with pressure on the opposite footpeg.