Mercury in dental fillings is controversial subject, both scientifically and among activist groups.
Although, there are apparent risks to its use, so far, despite 150 years of scientific study (both epidemiological and controlled trials), there is no solid evidence that its use in dental fillings has any detectable side effects. Yes, a tiny bit of mercury leaches out over time, but 150 years experience shows amalgam fillings to be extremely stable, and an excellent material for protecting teeth.
However, this long term leaching is not the only method by which mercury can be absorbed from fillings. When fillings are inserted, or if they are advised, the disturbance to the amalgam releases mercury which can then be absorbed. The quantities released at these times are far, far higher than at any other time - for this reason, it's not recommended that amalgam fillings be inserted in women who are pregnant at the time.
The main message is that it is exceedingly unlikely that if you've already got mercury fillings that they're going to cause you any trouble. In fact, disturbing them, by attempting to remove the mercury, is only going to release a much larger quantity of mercury. If you look at the scientific literature, the existence of mercury poisoning due to the presence of fillings is controversial - however, mercury poisoning due to attempted removal of mercury fillings is a recognized side effect.
I'm somewhat surprised the mercury amalgam is still in use today. We do now have satisfactory alternatives, in the form of resin - indeed, the resin has a better cosmetic result. So, I would have thought it a no-brainer to give up the use of mercury. Indeed, in a recent document by the World Health Organisation, they mention dental amalgam as a major source of occupational exposure to mercury, and environmental pollution (due to incineration of dental waste) - although the WHO have not commented on the safety to the recipient of the amalgam. You'd even think it would be in the dentists' own interests to avoid its use, as they are the ones who get heavily exposed.
In summary:
Yes, there are alternatives. Arguably, the alternatives are better - they look better, and in the short term seem to be as good. However, amalgam has 150 years experience and it's known to have excellent reliability.
Yes, the amalgam fillings can be removed. Is this a good idea? Probably not, especially when you consider that removal involves re-drilling the tooth, further weakening it.