Many drugs can be absorbed through the skin.
A quick Google search on "caffiene skin absorption" led me to a few hits that make me believe that it can be absorbed through the skin.
However, this just seems like a bad idea to me. With no way to control dosage, this soap just sounds like a recipe for health problems.