I have been riding motorcycles since I was three years old. Motorcycling is as much a part of me and my life as my family so I did not give it up when I had my first or second child. In fact, when my first was two weeks old I took a week long ride out to Colorado and back for the MX of Nations.
Everyone is different but no one expected me to give up riding and I never gave it much thought. I will say though that I am more cautious now in all aspects of my life.
If it did concern me enough to really consider stop riding than I would becasue an overly cautious person is just as dangerous behind the wheel or handlebars than a total lunatic in my opinion.
Best of luck to you and your family with whatever decision you make!