Three things seem to stand out to me at least. There are probably exceptions to all of these though.
First brain mass to body mass ratio. Humans are high on this scale, but not the highest iirc. Size might be important here, even though it's a ratio.
Second, you've got to be a predator, probably an apex predator. Size is important here. As Gigantopithecus pointed out, you're not an apex predator if something can swallow you.
Third, some sort of social structure. i.e. The pack hunters end up being more intelligent than the solitary ones. I'm not sure how well this holds up to close examination though. But look at crows, porpoises, and maybe even velociraptors.