How much luggage? If it's a lot, can one of you walk with the kids while the other one takes an Uber with the luggage? Can the 6 yo walk without the stroller to get to the DLH? Then the other stroller can go with the luggage. With little ones and no luggage, I would plan on a 20+ minute walk straight up
Disneyland Dr. Then you have a choice: if you have extra time, enter the PPH and let your little ones look around. You can cut right through to the back exit, go right and follow the path to the parking lot -- cross and follow the path to your left around by the DLH. You can enter any one of the paths that enter the hotel grounds (there are signs posted) or keep going until you see bag check on your right and the Sorcerer's Hat on your left. Go left! If you don't have extra time: skip the PPH by all means and stay on Disneyland Dr. until you are just past the hotel, go left into the parking lot and follow the path around the DLH (like the directions above).
Reward (and motivation for being good on the walk to the hotel): Dole Whip at the DLH coffeehouse!