I bought an XC kind of on a whim, as I had previously decided to get a roadie because I didn't believe I needed the off road version. Well long story short, I don't regret my whim one bit.
It handles highway and twisty bits just fine. I hardly ever ride my Speed Triple any more, even when I'm riding with my sportbike friends. It annoys them that a goofy looking "dirt bike" can keep up with them, and even more when I take "shortcuts" down unpaved or frost heaved roads.
If you're worried about height, the seat is adjustable, with a factory lower seat available. There are lowering links as well. I run mine with 20mm lowering links and the standard seat in the up position. I've got a 30" inseam, and have spent a lot of time riding with my 5'2" ex gf (before she was "ex", of course).