I think he has tried to push his authority beyond Constitutional limits. As BDawg noted, his actions regarding Oregon's "Death With Dignity" law are a clear example where he pushed his own moral agenda at the expense of the rights of the citizens of Oregon.
Smoking pot doesn't make you a terrorist, but IMHO, trafficking in heroin does for two reasons. First, opium derivatives were a major cash source for the Taliban in Afghanistan and the repressive regime of Myanmar. Second, heroin addiction is a tragedy in anyone's life, and anything that promotes it, especially for profit, is both a major crime and a continuing source of serious societal problems, here and in other countries.