When you say "same plane as the sun", same plane compared to what? The plane of our orbit is not the same as the plane formed by the earth's equator, that is true.
Relative to the plane of the equator, yes, the earth is 23.5* above the sun in December, and 23.5* below the sun in June...