No reason to be nervous. As someone who stays at both the Disney value resorts and SOG the differences are minor for kids. Yes, you don't get big tacky statues of Disney characters, but some people like that. You still get a good resort with a great pool that is close to the action. With a family of 5 you will LOVE the fact that the rooms are larger then anything you can get at Disney resorts for the same price point. Unless you get family suites, none of the rooms at the value resorts fit 5.
You can easily take the bus to TTC every 20 minutes (for Epcot or Magic Kingdom) or take a bus to the other parks every hour. Not sure you will be walking to the monorail with an 11 month old and not sure how often you will want to use the Shady Shuttle with 5 people and strollers and such. That will vary depending on your particular habits.
IMHO the biggest disadvantages to SOG vs. Disney
* Can't use
DDP
* for the most part the staff is nice, but not quite as nice as at Disney
* Can't use Magical Express
* No free magicbands or room charges.
Beyond that, you will probably feel safer at SOG then any Disney resort. You are close to the action while still being an island away from the action.