To keep it simple...
The relationship between the plates is attraction, the - are attractive to the +.
Forget capacitors for a minute and realize that a natural law in electromagnetism is that opposite charges attract and the force of attraction follows an inverse square function. Halving the distance quadruples the attraction force.
In a capacitor you also have a repulsion force of like charges piling up on a single plate preventing charge from accumulating normally.
The closer the opposite charged plates are together, but never touching, the stronger the attraction (due to inverse square), such that more charge on the same plate can pile up and "overcome" the repulsion of like charges on their own plate due to attraction of charge on the opposite plate.
One electron is not going to follow a path to a plate holding a million other like charge electrons. If you move the plates slightly closer, the force of attraction is higher between unlike charges and provides the motivation for that million+1 electron. Thus stored charge capacity is greater at the same potential.
It might help if you start with basic Coulomb's / Gauss's law and integrate the charge over two opposite charged plates of area pi*r*r separated by a distance d and work your way to deriving the formula for a classic parallel plate capacitor and see where the inverse square of separation distance comes in and contributes to the capacitance.
Capacitance is a measurement of charge, not voltage. Voltage is what "moves" electrons, but the actual electrons are what are stored over time at a given voltage. The potential can only be several volts, but the charge can be anything from a few picofarads to several farads, and that varies as a function of plate geometry even when voltage is held constant.
Start with a 1 Farad 1 Volt capacitor. This stores 1 Coulomb. Half the distance between the plates and you get a 4 Farad 1 volt capacitor that stores 4 Coulombs. Double the voltage as well to 2 volts and now you have a 4 Farad 2 volt capacitor that stores 8 Coulombs.
Also understand how the unit of Farad is defined and derived.
http://en.wikipedia.org/wiki/Farad
Or to keep it simple again, think of a AAA battery vs a D battery. Same 1.5 volts but there is much more "charge" in a D cell.