I'm pretty much the same way tbh. I prefer putting time and money into making my own living space nice for myself so I can enjoy it and get a longer experience out of the money. I do get wanting to see more of the world though, but guess it's just not a priority to me and I do hate the chaos of travel, I get kind of stressed.
If money was no object I probably would travel more though, my type of travel is something like showing up at a resort and be at that one resort for the week and just veg and enjoy the scenery. Something that would be nice to do near end of winter when I'm tired of the cold and darkness. Go to like Cuba or something like that. Either that, or RV travel could be fun too. It would eliminate the stress of constantly packing and unpacking stuff, finding bathrooms and hotels etc. It would basically be like your own house but it comes with you and you always have everything you need and it's organized. Doing a non schedule trip with an RV just exploring stuff could be lot of fun. National parks etc.
An RV build itself would be a fun project too. Like converting a bus. I'd probably enjoy the project more than the actual travel lol.