From Rich's perspective, the key HPC announcement centered around new NVIDIA DGX-2 supercomputer with the NVSwitch interconnect.
The rapid growth in deep learning workloads has driven the need for a faster and more scalable interconnect, as PCIe bandwidth increasingly becomes the bottleneck at the multi-GPU system level. NVLink is a great advance to enable eight GPUs in a single server, and accelerate performance beyond PCIe. But taking deep learning performance to the next level will require a GPU fabric that enables more GPUs in a single server, and full-bandwidth connectivity between them.For more details on DGX-2, check out our insideHPC interview with NVIDIA's Marc Hamilton.
NVIDIA NVSwitch is the first on-node switch architecture to support 16 fully-connected GPUs in a single server node and drive simultaneous communication between all eight GPU pairs at an incredible 300 GB/s each. These 16 GPUs can be used as a single large-scale accelerator with 0.5 Terabytes of unified memory space and 2 petaFLOPS of deep learning compute power.”
Henry Newman and the Amazing Technicolor Dreamcoat
After that, we do our Catch of the Week.
Download the MP3 * Subscribe on iTunes * RSS Feed
No comments:
Post a Comment