Because they work in a sligthly different way.
There are no "electrons and holes" in metals, at least not in the way you mean when you discuss semiconductors.
The basic mechanism of conduction in metals is this: A perfect piece of metal (no defects or impurties) is really a crystal, the atoms arrange themselves in a highly organized pattern, in the simplest materials the atoms will sitt in the "corners" of a cube (so-called single-cubic symmetry).
The difference between a metallic element and an insulating element is simply the elecronic structure; in a metal some of the electrons in the atom can travel relatively far from the core (in an insulator they always stay close to the core). In some cases a electron in a crystal can travel so far from their "mother core" that they come very close to a neighboring atom, now they will be under the influence of the new core etc. The end result of this process is that you will have an "electron gas" with electrons moving around more or less freely in a crystal made of ions.
Since the electrons are so weakly coupled to the crystal they are easy to move around, hence metals are good conductors!
However, this is only true at zero temperature (0 K) , if you heat a piece of metal the atoms in the crystal will start to "shake" and the crystal is no longer perfect, hence the electrons that used to be free will start to interact (you could say collide) with the atoms again and they are not free to move as they want anymore, this means that the conductance decreases.
This is a simplified explanation, if you are really interested I suggest you look it up in a book about solid state physics.