Wait, what?Doh. You started out so well there. Then you had to throw in that last bit. So, you claim that calories are all different, but all you need is less of them. Those two sentences are incompatible.
Lets just start out with conservation of MASS. (Mass in) - (Mass out) = (Mass gained or lost). That's really all there is to it. Not calories; science 101 states that. All scientists think that is true until you talk about food; then basic science goes out the window and people think (Calories in) - (Calories out) = (Mass gained or lost). Unless your body is a nuclear reactor, that statement violates the basis of physics and chemistry.
Now, mass in is easy to understand but it is extremely difficult to control long term for most people. Mass out is where the differences lie. Some food is easily digested, some isn't. Food types (high fiber is almost the polar opposite of high sugar; high protein helps with controlling mass in, and so on), exercise, gut bacteria, quantities above your ability to digest, general health level, etc. all affect the mass out portion.
What is the mass of a single calorie?