About a year ago, we saw a CM outside the Land pavilion and asked and we were told we had to bring our toddler inside for a Soarin RS. When we got in and up to the queue, that CM told us that they didn't expect parents to bring a young child in there since the pavilion doesn't accomodate strollers. We rode Soarin several other times on the trip and received RS without bringing him in without any issues.
Many people on here have posted on other threads however of having to show their little one inside, so my guess is that it used to depend on the day and the CM. If you want to try not taking the baby in, I'd suggest having them wait near the pavilion so you can call or text if the baby does need to be brought in. With them now having to scan magic bands to add the rider swap pass however, unless there is a CM standing outside the pavilion who is doing this, I would expect to have to bring the too short child in, otherwise, how would you actually get the rider swap added to your band?