Directories like this have been online and in CD form for years now. Anyone with $50 can buy a CD with the entire country's listings from phone books on it and do whatever they want with it. It's public information, for better or for worse. Paranoia is of no use when this isn't anything new. All someone has to do is get an address and punch it into Mapquest, and if someone's intent on stalking a person it's not going to matter if they can get this information from Google. They're going to find it by whatever means they need to.
Edit: In response to the email, I would submit that I, in fact, would mind getting this email. I already get enough spam and chain email, especially from well-wishing Internet users who don't have a clue. I wish I could get them to stop doing that...