Just because there's not literally some guy watching you does not mean it's not spying. They are collecting enough data to pretty much reconstruct any single person's actions on any given time span.
If you went to the store on October 30 in 2009 at 8:34pm and called up your buddy bob on your cell from the candy aisle to talk about what Halloween candy kids like these days, they can reconstruct that exact moment. They have your GPS coordinates with time stamp, phone call records, credit/debit card records and physical evidence (spy drones). This is more than enough info to prove you were at that location at that time. You may have also posted on twitter or Facebook that you were going to the store, hours before.
They can then come up to you some day and ask what you were doing at that specific date (you wont remember) and you'll either say you don't remember or guess and say something like "I don't know, sitting at home watching TV?" Then they'll now be able to arrest you for lying to an official about a murder, because that same night the guy you talked to was the friend of a guy who is in a biker gang, and someone from that biker gang knows a guy who killed a guy that same night. you are now an accessory to a crime because you are lying about information that could (somehow) lead to the prosecution of a criminal. While they're there they notice you also happen to run Linux on a device in your home so you are also a hacktivist. Boom, 10 years in jail, no trial, no parole.
This is not far from reality, shit like this can, will, and does happen.
It gets worse, Facebook is now building shadow profiles of you, even if you don't use it. NSA probably can do the same but 100 times better.
Basically with this much power, the government can pretty much pick off any person they want and throw them in jail. If you are not compliant with their standards or disagree you are pretty much thrown in the fire. I see this coming.