Which version?
I'm not sure but MS mentioned that DX9/9a/9b could not be uninstalled. However, some bright spark may have worked out a way, without using system restore that is.
Did you by any chance create a system restore point before installing DirectX?