Been living with no car in Montreal for the past couple of years. While I love cars and I love driving, being free of the hassle, time and expense has been amazing. I don't need a car, I don't need a bus/metro or train pass and the vast majority of the time I don't even need to take public transportation, since literally everything is within walking distance. The times that I do have to take a bus, train, metro or cab are infrequent enough that the cost is negligible.
I spent years justifying the cost of vehicles as a "necessary" expense. I finally admitted that it was nothing but a personal choice when it actually came down to it, and I haven't looked back. I realized that many people seemed not to actually calculate what it really costs to purchase, own, license, insure, operate and maintain a vehicle over the long term.
When I saw a crazy cheap deal on a decent place to live in an amazing location in the city, I jumped on it. Still had my car at the time, but when it broke down, I got rid of it instead of fixing it. I've thought about getting another car so many times since then, and ended up buying a cheap motorcycle instead. When I added up the total expenditure over a year's time, it ended up costing me a fraction of the price of owning a car (in my case for a variety of reasons; obviously not always the case for motorcycles). In the end, I can afford to have a toy purely for pleasure, since I don't need a car, and still save much more money at the same time.
Since then I've vowed to continue the trend of putting myself in a position to not depend on a car. Adding up 25-30 years of vehicle expenses means I can ultimately consider housing in locations that I might otherwise overlook if the cost of a vehicle was obligatory.
When I can justify the expense of a car purely for pleasure, then I will buy one again. If I already had kids and what not, my story would probably be very different though, haha.
If you can go carless, highly recommend. Unless the money is no object of concern whatsoever, in which case there's little benefit to giving it up.