Better than having landfills take over the free space!
The concept of shoving all your garbage in one place and leaving it there forever clearly isn't sustainable in the long term, but we have much, MUCH bigger problems than running out of landfill space in the short term.
Better to keep the problem contained in a relatively small, stable area than to throw it all in the ocean and have it be spread around the globe. Landfills comprise a fraction of a fraction of the space that we've "ruined" around the globe.
As for incineration, it can only be "100% clean" if you are capturing 100% of the waste stream. Let's just say that I would NOT want to pick up the resulting ash with my bare hands, or inhale deeply around the smokestacks. But assuming that they do a good job of capturing particulates, heavy metals etc. before they get out into the air, and that they dispose of the ash in a geologically stable area where it won't get into the groundwater, it certainly beats coal.