Misplaced Pages

Nvidia BlueField

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Data processing hardware by Nvidia

Nvidia BlueField is a line of data processing units (DPUs) designed and produced by Nvidia. Initially developed by Mellanox Technologies, the BlueField IP was acquired by Nvidia in March 2019, when Nvidia acquired Mellanox Technologies for US$6.9 billion. The first Nvidia produced BlueField cards, named BlueField-2, were shipped for review shortly after their announcement at VMworld 2019, and were officially launched at GTC 2020. Also launched at GTC 2020 was the Nvidia BlueField-2X, an Nvidia BlueField card with an Ampere generation graphics processing unit (GPU) integrated onto the same card. BlueField-3 and BlueField-4 DPUs were first announced at GTC 2021, with the tentative launch dates for these cards being 2022 and 2024 respectively.

Nvidia BlueField cards are targeted for use in datacenters and high performance computing, where latency and bandwidth are important for efficient computation.

BlueField cards differ from network interface controllers in their offloading of functions that would normally be reserved for the CPU, and the presence of CPU cores (typically ARM or MIPS based) and memory support (typically DDR4, though Bluefield-3's release brought support for more exotic memory types such as HBM and DDR5). BlueField cards also run an operating system completely independent from the host system: this is designed to reduce software overhead, as each DPU can function independently of one another and the head unit. This also means that Bluefield cards are capable of allowing remote management of systems that may not typically support it. Bluefield cards can also configure their PCIe bus to function as a host, rather than a device, which lets Bluefield cards connect over a PCIe bridge to another card, such as a compute accelerator, to provide completely network-based, high bandwidth control of a GPU.

The Bluefield X cards are DPU-GPU hybrid cards with a 100 class Nvidia datacenter GPU integrated on the same PCB as the Bluefield DPU. These cards are intended for high power GPU clusters to allow high bandwidth communication without needing to cross the PCIe bus and create an unnecessary load on the CPU where performance may be better allocated to other types of processing. The increase in total external connectivity available to a system in this configuration allows for datasets to be utilized across multiple nodes when they may be too large for any single system to hold in memory.

Models

Model Announcement Date Release Date Networking Port Options Bandwidth Capacity Cores Core Type PCIe Generation Memory Capacity Memory Type GPU Accelerator SPECint(2k17-rate) TOPS
BlueField-2 October 5, 2020 Q2 2021 Dual QSFP56 10/25/50/100 Gb

Single QSFP56 200 Gb

200Gbit/s 8 ARM A72 4.0 16/32 GB DDR4 N/A 9 0.7
BlueField-2X Q4 2021 Nvidia A100 60
BlueField-3 April 12, 2021 Q1 2022 Quad/Dual/Single QSFP56 400Gbit/s 16 ARM A78 5.0 64 GB DDR5 N/A 42 1.5
BlueField-3X N/A Nvidia A100 75
BlueField-4 2024 N/A OSFP112 800Gbit/s TBD TBD 160 400

H100 CNX & A100 EGX

The H100 CNX and the A100 EGX are NIC/GPU hybrid cards and, while visually similar to a Bluefield-X card, are completely distinct, and do not have the Bluefield system on a chip integration. The cards are instead equipped with a generic ConnectX network interface controller.

References

  1. Clifford, Tyler (2020-04-28). "Nvidia completes 'homerun deal' after closing $7 billion acquisition of Mellanox". CNBC. Retrieved 2022-03-28.
  2. ^ servethehome (2020-10-05). "NVIDIA BlueField-2 and BlueField-2X DPU Offerings Launched". ServeTheHome. Retrieved 2022-03-28.
  3. Shilov, Anton (2021-04-12). "Nvidia Reveals BlueField-3, BlueField-4 DPUs: 400-800 Gbps, 22-64B Transistors". Tom's Hardware.
  4. "NVIDIA BLUEFIELD-2 DPU - Data Center Infrastructure on a Chip" (PDF). Nvidia.
  5. servethehome (2021-05-29). "DPU vs SmartNIC and the STH NIC Continuum Framework". ServeTheHome. Retrieved 2022-03-29.
  6. servethehome (2021-07-11). "CPU-GPU-NIC PCIe Card Realized with NVIDIA BlueField-2 A100". ServeTheHome. Retrieved 2022-04-05.
  7. ^ Mellor, Chris (2021-04-12). "Nvidia unveils BlueField 3 DPU. It's much faster". Blocks and Files. Retrieved 2023-06-28.
  8. servethehome (2020-05-14). "NVIDIA EGX A100 Launched Tesla Plus Mellanox Vision". ServeTheHome. Retrieved 2022-04-05.
  9. "NVIDIA H100 CNX". NVIDIA. Retrieved 2022-03-29.
Categories: