- May 6, 2003
- 4
- 0
- 0
Hope this is the right forum for my question:
I need to build a machine that will have to toss around HUGE amounts of data (estimated 0,5 TB). The actual problem I need to solve is decompress, filter, group by on a large number of files that contain the actual data. All this has to produse results hopefully in under 4 hours.
The app developed for this machine is done in such a way that multiple instances can be run on different subsets of data making it perfect for distributed computing. There's only one problem: I don't have the budget to build a 128 processor cluster. I need to get a dual processor machine that will be able to do the trick. Since the amount of data is so huge, I ruled out xeons since they share the same bus thus halving the available bandwidth. That leaves me with opterons if Win2003 server really supports NUMA. It has to be windows server because of some other support apps so please don't recommend any unix because it just can't happen here.
Trying to built this machine I came up with TYAN Thunder K8W (S2885). Is this an adequate motherboard for my problem? Does anybody have any experience with it? I sure wish Anand compared server components more often
.
I need to build a machine that will have to toss around HUGE amounts of data (estimated 0,5 TB). The actual problem I need to solve is decompress, filter, group by on a large number of files that contain the actual data. All this has to produse results hopefully in under 4 hours.
The app developed for this machine is done in such a way that multiple instances can be run on different subsets of data making it perfect for distributed computing. There's only one problem: I don't have the budget to build a 128 processor cluster. I need to get a dual processor machine that will be able to do the trick. Since the amount of data is so huge, I ruled out xeons since they share the same bus thus halving the available bandwidth. That leaves me with opterons if Win2003 server really supports NUMA. It has to be windows server because of some other support apps so please don't recommend any unix because it just can't happen here.
Trying to built this machine I came up with TYAN Thunder K8W (S2885). Is this an adequate motherboard for my problem? Does anybody have any experience with it? I sure wish Anand compared server components more often