I would suggest trying something like a dab of nail polish bridging the card to the casing, that way if the card is removed the paint is broken.
That said, it seems more than a little paranoid. If you have it encrypted then I would suggest the probability that a person who finds your phone is also someone with the skill and desire to break the encryption is extraordinarily small.