My femur was broken August 10, 2011, by an SUV that plowed into me. The orthopedists bolted me back together with a titanium rod that runs inside the bone from my knee to my hip. I was hobbling around on it with a walker within a week, followed soon by crutches, and after six weeks I was cleared to walk on it with a cane. The docs were pleased at how quickly the bone was remodeling. It's now fully healed and back to normal.
Obviously people heal differently. But if it's been three years and you're still having trouble with it, you might want to seek out a really good orthopedist.