The efficiency of the "thermic engine" that is an air conditioner varies with the temperatures of the hot source and cold source. An air conditioner is just a kind of thermic engine in reverse.
A thermic engine transfer heat from a hot source to a cold source. A part of the heat is "lost" in the process and transformed in work at the output shaft of the motor (or engine). The best engine works on the Carnot cycle, and its efficiency is 1 - Tcold/Twarm, where T is the temprerature in Kelvin degrees (absolute temperature). So, having a hot warm source and a cold cold source improves the efficiency.
Now, a A/C unit absorbs work (power * time) and moves caloric energy ("heat") from a hot source to a cold source. If your system is reversible, then you have also a heat pump, that would take "heat" from outside and move in inside.
The efficiency of the A/C unit is also dependent on the difference of temperature between inside and outside. It works just like an engine, but with the "warm source" colder than the "cold source". The only way to make such an engine work is to inject power from exterior.
As a result, having either your inside or your outside unit clogged will decrease the efficiency of the A/C unit. You could put the inside unit in a place where to have great air flow, but the noise considerations limit the fan speed for it. So, only the exterior unit can have lots of forced airflow.
Also, the heat transfer rate between the outside air and the fins of the outside part of the unit is dependent on their temperature difference, and while the A/C unit is on "slow" you gain almost nothing with the outside on high speed
Calin