NVIDIA Grace Hopper SuperChip

$4.99 - $3.99/hr*

In Stock

Memory Type: LPDDR5X, Memory Bandwidth: 900 GB/s, Interconnect: NVLink-C2C 900 GB/s

ARCHITECTURE

Grace Hopper SuperChip

CPU CORES

72 Arm Neoverse V2

GPU

NVIDIA Hopper GPU

grace hopper gpu
nvidia

Overview

The NVIDIA Grace Hopper SuperChip combines NVIDIA Grace CPU with NVIDIA Hopper GPU, linked by high-bandwidth NVLink-C2C, focusing on AI and HPC applications. It features up to 72 Arm Neoverse V2 CPU cores for high-performance and energy efficiency, alongside the NVIDIA Hopper GPU designed for significant advancements in AI and HPC tasks. The superchip boasts up to 512 GB of LPDDR5X memory with a bandwidth of 546 GB/s, expandable through NVLink-C2C, facilitating a total of 900 GB/s bandwidth accessible to the GPU, enhancing data access and processing efficiency.

nvidia

Grace Hopper

ARCHITECTURE

72 Arm Neoverse V2

CORES

Hopper

GPU

512 GB

MEMORY

SIZE

LPDDR5X

MEMORY

TYPE

900 GB/s

MEMORY

BANDWIDTH

NVLink-C2C 900 GB/s

INTERCONNECT

24 Months

WARRANTY

Specifications

CPU

Type:

NVIDIA Grace CPU

Cores:

72 Arm Neoverse V2

ISA:

Armv9.0-A

L1 Cache:

64KB i-cache + 64KB d-cache

L2 Cache:

1MB per core

L3 Cache:

117MB

LPDDR5X size:

Up to 480 GB

Memory:

Up to 512 GB LPDDR5X

Memory Bandwidth:

546 GB/s

PCIe links:

Up to 4x PCIe x16 (Gen5)

GRAPHICS CARD

GPU Name:

Hoppper H100

FP64:

34 teraFLOPS

FP64 Tensor Core:

67 teraFLOPS

FP32:

67 teraFLOPS

TF32 Tensor Core:

989 teraFLOPS* | 494 teraFLOPS

BFLOAT16 Tensor Core:

1,979 teraFLOPS* | 990 teraFLOPS

FP16 Tensor Core:

1,979 teraFLOPS* | 990 teraFLOPS

FP8 Tensor Core:

3,958 teraFLOPS* | 1,979 teraFLOPS

INT8 Tensor Core:

3,958 TOPS* | 1,979 TOPS

High-bandwidth memory (HBM) size:

Up to 96GB | 144GB HBM3e

Memory bandwidth:

Up to 4TB/s | Up to 4.9TB/s HBM3e

NVIDIA NVLink-C2C CPU-to-GPU bandwidth:

900 GB/s bidirectional

Module thermal design power (TDP):

450W to 1000W (CPU + GPU + memory)

Form factor:

Superchip module

Thermal solution:

Air cooled or liquid cooled

Interested in buying this GPU?

NVIDIA Grace Hopper SuperChip

$34K - $40K*

In Stock

(only comes as a server)

Memory Type: LPDDR5X, Memory Bandwidth: 900 GB/s, Interconnect: NVLink-C2C 900 GB/s

*Estimated prices, not final

grace hopper gpu
nvidia

Similar GPUs