(UPDATED) How IBM Can Provide 1,800 Processing Cores on a Single Blade Server
IBM recently announced a new addition to their BladeCenter family – the IBM BladeCenter GPU Expansion blade. This new offering provides a single HS22 with the capability of hosting up to 4 x NVIDIA Tesla M2070 or Tesla M2070Q GPUs each running 448 processing cores each. Doing the math, this equals the possibility of having 4,928 processing cores in a single 9u IBM BladeCenter H chassis. That means you could have 19,712 processing cores PER RACK. With such astonishing numbers, let’s take a deeper look at the IBM BladeCenter GPU Expansion blade.
What’s the Big Deal about GPUs?
Before you can appreciate the “wow” factor of this new GPU Expansion blade, you need some fundamental understanding on what GPUs (or Graphics Processing Units) do. GPUs are designed to perform general purpose graphical, scientific, and engineering computing and allow the offloading of compute-intensive tasks. They are commonly used in industries like atmospheric modeling, data analytics, finance, fluid dynamics, life sciences, and of course, large scale graphic rendering. These environments run applications that uses large amounts of data that can be broken into smaller chunks and processed at the same time, or in parallel. This is where the GPUs come in – they are designed to run parallel operations. The NVIDIA GPUs used on the IBM BladeCenter GPU Expansion blade have 448 cores providing a peak double-precision capacity of 515 Gigaflops (billions of floating point operations per second) . In the case of this offering, the CPU of the IBM HS22 blade server and the GPU from the expansion blade work together where the main sequential part of the application runs on the CPU, and the computationally-intensive part runs on the GPU.
Details on the IBM BladeCenter GPU Expansion Blade
IBM is offering two flavors of the GPU Expansion blade – one with an NVIDIA Tesla M2070 GPU (IBM part # 46M6740) and one with an NVIDIA Tesla M2070Q (IBM part # 68Y7466). The difference between the two is that the M2070Q adds an additional NVIDIA Quadro advanced virtualization engine in the same GPU (and it probably costs more.) For those of you who are familiar with GPUs and care about the speeds and feeds, here’s what the NVIDIA M2070 offers:
- NVIDIA Fermi GPU engine
- 448 processor cores
- 1.566 GHz clock speed
- 6 GB GDDR5 (graphics DDR) memory
- PCIe x16 host interface
- 225W (TDP) power consumption
- Double Precision floating point performance (peak): 515 Gflops
- Single Precision floating point performance (peak): 1.03 Tflops
The IBM BladeCenter GPU Expansion blade attaches to the HS22 blade server to form a “double-wide” server (60mm.) The cool thing is that you can add up to 4 GPU expansion blades together. In this configuration, the top most expansion unit offers a single CFF-h daughter card (mezzanine) slot for additional I/O useage. Combined with the HS22, an addition of 4 GPU Expansion blades would take up 5 of the IBM BladeCenter’s 14 server bays. Doing the math, that means you could put 2 x HS22 (with 4 x GPU Expansion Units) and 1 x HS22 (with 3 x GPU Expansion Units). As mentioned above, each GPU Expansion unit provides 448 cores, therefore a single IBM BladeCenter H could host 4,928 cores (11 expansion units x 448 cores.)
According to IBM, the IBM BladeCenter GPU Expansion Unit only works with the HS22 blade server however it is compatible with the IBM BladeCenter H and the IBM BladeCenter HT models as well as the IBM BladeCenter E chassis. A couple of caveats of working with the IBM BladeCenter E: the expansion unit is only supported in BladeCenter E models 8677-3xx and -4xx only AND the chassis must have the 2,320 watt AC power supplies.
- Windows Server 2008 HPC Edition (64-bit)
- Windows HPC Server 2008 (64-bit)
- Windows 2008 R2 (64-bit)
- Red Hat Enterprise Linux 5 (64-bit)
- SUSE Linux Enterprise Server Edition 11 for x86_64 (64-bit)
For more information on the IBM BladeCenter GPU Expansion blade, please visit IBM’s website at http://www-03.ibm.com/systems/bladecenter/hardware/expansion/gpu.html.
UPDATE: Image and content referenced from IBM’s Redbook titled “IBM BladeCenter GPU Expansion Blade – IBM BladeCenter at-a-glance guide” located at http://www.redbooks.ibm.com/Redbooks.nsf/RedbookAbstracts/tips0798.html?Open.
Thanks for stopping by!