You can do it that way. Just press and hold the icon in the app drawer, then drag it towards the trash and hold it until you see "Uninstall".![]()
The stock Android Launcher does not do this. LauncherPro does, however. Other Launchers and custom ROMS may support it as well, but plain Android doesn't.
