Here’s the info from SW:
Two adults traveling with a child six years old or younger may board during Family Boarding, which occurs after the “A” group has boarded and before the “B” group begins boarding. If the child and the adult are both holding an “A” boarding pass, they should board in their assigned boarding position.
How old are the older kids? We have let DS12 board on his own at times when my mom was with us. If you comfortabl, DH could board with you and the 2 littles and the others could at their #. (assuming they are not in the A group.)