I don't personally own a system like that. My work has a 48-core, built with AMD Opteron 6174s, same board though. And a Cooler Master Stacker 810 case which is now being replaced (already) with a Supermicro SC748TQ-R1400B because at load, I'm tripping the overcurrent protection on the 1000 W Corsair power supply. So, we're going to 1.4 kW instead. New for the company and for x86/x64-based systems. But probably not new if they've ever ran any of the IBM POWER UNIX workstations.
We also have 32x 4 GB Kingston 4 GB DDR3-1333 (128 GB total) of RAM and an OCZ Agility 2 240 GB SATA2 SSD.
(It slated to run FEAs.) I've currently got Windows HPC Server 2008 x64 on it, minus the HPC add-ons (haven't installed Active Directory Domain Services on it yet/don't know how, but I'm pretty sure that I can probably google it).
The original tests that I ran also with P6900 WUs, but with only 4 DIMMS (16 GB), I was only getting 78913 PPD. That should change though because we're going to be pulling half the RAM out so that hopefully it'll keep the overcurrent protection in check, and drop that down to just 64 GB.
Interestingly enough though, according to IntelBurnTest, my Intel 980X CAD/FEA workstation gets I think like 75 GFLOPS, while the server only got 66 GFLOPS (at least in the original tests with just 16 GB of RAM).
I'll have to do more testing tomorrow once the system is back up and running.
@10e: Whereabouts in Markham are you?
I'm going to be in Toronto next weekend (Dec 18) so maybe you and I can meet up too?