Thing is, the Ravens are really, what ... the Browns of old? The original Colts are now in Indianapolis (in case you've been under a rock for a decade) and the current Cleveland franshice is really a "new" one.
There may be a few people in the front office of the Ravens that were a part of the Colts (Modell, at least ... right?). Probably not much else after that.
-SUO