NVIDIA
AMD
In Stock
Memory Type: LPDDR5X, Memory Bandwidth: 900 GB/s, Interconnect: NVLink-C2C 900 GB/s
ARCHITECTURE
Grace Hopper SuperChip
CPU CORES
72 Arm Neoverse V2
GPU
NVIDIA Hopper GPU
The NVIDIA Grace Hopper SuperChip combines NVIDIA Grace CPU with NVIDIA Hopper GPU, linked by high-bandwidth NVLink-C2C, focusing on AI and HPC applications. It features up to 72 Arm Neoverse V2 CPU cores for high-performance and energy efficiency, alongside the NVIDIA Hopper GPU designed for significant advancements in AI and HPC tasks. The superchip boasts up to 512 GB of LPDDR5X memory with a bandwidth of 546 GB/s, expandable through NVLink-C2C, facilitating a total of 900 GB/s bandwidth accessible to the GPU, enhancing data access and processing efficiency.
Grace Hopper
ARCHITECTURE
72 Arm Neoverse V2
CORES
Hopper
GPU
512 GB
MEMORY
SIZE
LPDDR5X
MEMORY
TYPE
900 GB/s
MEMORY
BANDWIDTH
NVLink-C2C 900 GB/s
INTERCONNECT
24 Months
WARRANTY
Type:
NVIDIA Grace CPU
Cores:
72 Arm Neoverse V2
ISA:
Armv9.0-A
L1 Cache:
64KB i-cache + 64KB d-cache
L2 Cache:
1MB per core
L3 Cache:
117MB
LPDDR5X size:
Up to 480 GB
Memory:
Up to 512 GB LPDDR5X
Memory Bandwidth:
546 GB/s
PCIe links:
Up to 4x PCIe x16 (Gen5)
GPU Name:
Hoppper H100
FP64:
34 teraFLOPS
FP64 Tensor Core:
67 teraFLOPS
FP32:
67 teraFLOPS
TF32 Tensor Core:
989 teraFLOPS* | 494 teraFLOPS
BFLOAT16 Tensor Core:
1,979 teraFLOPS* | 990 teraFLOPS
FP16 Tensor Core:
1,979 teraFLOPS* | 990 teraFLOPS
FP8 Tensor Core:
3,958 teraFLOPS* | 1,979 teraFLOPS
INT8 Tensor Core:
3,958 TOPS* | 1,979 TOPS
High-bandwidth memory (HBM) size:
Up to 96GB | 144GB HBM3e
Memory bandwidth:
Up to 4TB/s | Up to 4.9TB/s HBM3e
NVIDIA NVLink-C2C CPU-to-GPU bandwidth:
900 GB/s bidirectional
Module thermal design power (TDP):
450W to 1000W (CPU + GPU + memory)
Form factor:
Superchip module
Thermal solution:
Air cooled or liquid cooled
In Stock
(only comes as a server)
Memory Type: LPDDR5X, Memory Bandwidth: 900 GB/s, Interconnect: NVLink-C2C 900 GB/s
*Estimated prices, not final