They lost to the Jags once already and IMO, that was a far more embarrassing loss than losing to the Jets. I couldn't believe most people seemed to be picking the Colts against the Jets. I'd say the Jets are at least mediocre, whereas the Colts are just bad.
The Browns do suck but they have been competitive and played hard in many games. When I look at the worst teams in the league, here is who I think about:
Jags
Chiefs
The Colts are probably better than those two teams (and maybe better than a couple more), but I'm not counting on many more wins this year. 5 wins at the absolute best but I tend to think they'll get 2 more at the most.