After some more checking, I noticed that Grub (linux boot loader) does start, and it even mentions the kernel, but after that, it reboots.
Why would a fresh linux install not work? No idea, but I booted from the CD again. This works fine (perhaps there's a problem with the harddisk?), and I...