Overdrive is *like* another gear; by going into it, you lower your RPM and fuel consumption, but obviously your acceleration turns into crap because you're in low revs and far from the powerband.
Use it on the highway, not in the city (not saving anything, plus your tranny has to do too much shifting in and out of OD)