I sorta sold the street bikes. I started out on an XT225 and loved it but "out grew" it. I sold it to get a KDX 200 and then missed the license plate so I got an SV650. The SV was a good ride until a dear parted our ways. I replaced the SV with a versys and loved it but talked my self out of the street thing. So I sold it and bought a KLX450R. Again I missed the license plate and the ability to ride off road like I could with the XT. It turns out that was almost my perfect bike. So I set out on a quest for another dual sport. After much searching it was between the KLR and the DR650. Once test ride on both convinced me. The KLR was a beached whale. The DR won. The DR does anything I need to do. Its a great bike. I'm sure that within its limits the KLR is probably a great ride as well. I found it too big and heavy to want to go offroading like I want too.
Don't be scared, buy the big single, you probably wont regret it.