That's a decision that only you can make. Some people are comfortable with debt and others are not. There are people who feel that 6 month's of living expenses is a big enough emergency fund while others want 8-12 months socked away before they feel like they can breathe.
I think that you need to set some short-term and long-term financial goals. Long term as in paying off the mortgage in 18 years, having a certain amount in retirement by age 68 or in college funds by the time each child graduates from high school. But you need short-term goals too - like building a new deck, buying another car or taking a Disney vacation. You can be working on the long-term goals while you meet the short-term ones. As long as you know that you're taking care of the long-term goals, you can give yourself permission to enjoy the short-term ones as well.
This is a great post. We went to WDW less than most people on this board because going more often would have interfered with our long term goals - mainly due to our other short term goals that we often prioritized higher. It's all about planning and prioritizing.
We are list people and have always had a list of vacations we wanted to take and home improvement projects we wanted to do. Then we prioritized from there. Once we decided it had made the list, we were usually able to make it happen.