By far, the two most common reasons why someone has not visited their dream destinations are time and money. These and potentially others are real factors that can get in the way of taking that dream vacation. The real question is where does travel fit in your priorities for your time and money.
There are no right or wrong answers because we are all different in what we value, where we are in our lives, other commitments and more. Even with other higher priorities, you can still create a plan to get you to that dream destination.
Travel is like a triangle. On one side you have budget, another side is time and the third side is your travel style. If the length of your trip increases, than budget must increase and/or the travel style decrease. If 5* hotels and budget are set, than perhaps decrease the length of the trip. If the destination is half way around the world, can you do a one week budget vacation this year to have a longer trip next year.