The answer I recall from engineering classes: if you neglect air resistance, you'll yo-yo back and forth through the center. Your gravitational potential never changes -- the energy just converts from potential to kinetic and back again, over and over. With air resistance, eventually you'll end up exactly in the center (where the gravitational force is equal on all sides). However, calculating the exact times and speeds is a huge pain.
You can calculate the gravitational pull on you at any particular point by taking the triple integral over the volume of the earth and using the formula for gravitational attraction (G * m_1 * m_2/ d^2, where d is the distance to the point in question). Then you have to integrate *that* over time, using F=MA to determine your acceleration and velocity at any given point. Air pressure is a whole other can of worms, as then you have to calculate drag, etc based on speed...
This is one of those torturous mechanics problems they make college engineering students do, and as I'm not one (anymore), I'm not going to do it.
