In that case, may I suggest Watermark by Kits beach? the view is really quite nice, though now it may be a little too cold to go play out on the beach, but you guys can always go for a walk along there w/ a stroller after dinner?
Here's the link to their dinner menu. Let me know if this is somewhat in line with what you're looking for.
http://www.watermarkrestaurant.ca/dinner
it's not like this place is one of those super quiet places either, and I believe they section off areas for family's as this restaurant is in a two story building.