It's not quite as simple as it seems. Strictly speaking, alpha radiation does the most damage even though it's the lowest energy. But alpha is so easily blocked that you'd basically have to ingest an alpha source for it to do anything. Beta has higher energy than alpha, and so can pass through several cm's of material. Gamma is the highest energy of the three and so can pass through lead to a degree, but because it's so high energy it doesn't really interact with your tissue. So technically, alpha is the most dangerous, but beta is considered more dangerous under normal circumstances because it's powerful enough to pass through material, but lacks enough power to go through your cells without interacting. X-rays are less powerful than gamma, but more powerful than beta, so they're less dangerous than beta radiation, but more dangerous than gamma.