This is one of the reasons that you should always use a vpn. It's unlikely that anyone will be able to get your exact address just from your IP since your IP will cycle periodically. I've never checked with my cable modem but I think it's every couple months or so unless you reset the modem yourself. But then you have to leave it off long enough that the ip gets assigned to someone else. That could take a half an hour or longer depending on time of day and traffic.
The problem is that even when it get refreshed, it's probably still going to poin to the same general area.
The real danger is when you go online to order something. Vendors don't really have that much of an interest in keeping your data private. So every time you place an order with your real name and address, that gets entered into the vendor's database and there's nothing to stop them from sharing that info with marketers.
That's why in addition to a vpn, I have my credit card set up with 4 other 'designated users.' Almost all of these are aliases but you really only need one alias to effectively mask your online presence. Any data sharing will then have that alias associated with your street address.
The real issue comes from other bills associated with your street address like water, power, garbage collection, etc. It can be very difficult to use an alias for these since they generally want some form of id to create the account. And if you own your own home, most property records are online and easily searchable. The only way around that is to put your property into a trust and have the name of the trust appear in the public record. It's not that hard to do but more than likely you would want a lawyer to set this up for you.