GridBagLayout is probably your best option in the JDK (Not sure about what other behaviour you need, but if you set items in column 1 and 3 to have the same weight x, and items in column 2 and 4 with the same weightx should do the job).
I've been using a free 3rd party LayoutManager called FormLayout from
http://www.jgoodies.com which is way nicer to use and provides exactly what you want also.