NVIDIA H100 SXM5 80 GB

$4.20 - $2.10/hr*

In Stock

Memory Size: 80 GB, Memory Type: HBM3, Bus Width: 5120 bit

GRAPHICS PROCESSOR

GH100

CORES

16896

TMUS

528

a100-gpu
nvidia

Overview

NVIDIA introduced the H100 SXM5 80 GB professional graphics card on March 21st, 2023. This card, fabricated with a 4 nm process and utilizing the GH100 graphics processor, lacks DirectX support. Consequently, the H100 SXM5 80 GB may not be fully compatible with the newest video game releases. The GH100 is a significant processor, encompassing an 814 mm² die size and housing 80 billion transistors. This model is outfitted with 16896 shading units, 528 texture mapping units, and 24 ROPs, alongside 528 tensor cores that are designed to enhance machine learning workflows. NVIDIA has equipped the card with 80 GB of HBM3 memory, which communicates through a 5120-bit interface. The GPU operates at a standard frequency of 1590 MHz, with the capability to boost up to 1980 MHz, while the memory operates at 1313 MHz. As an sxm module, the H100 SXM5 80 GB uses an 8-pin EPS power connector and has a total power consumption of 700 W. It lacks any form of display output, indicating its primary function is computational. The card interfaces with the system via a PCI-Express 5.0 x16 connection.

nvidia

GH100

GRAPHICS

PROCESSOR

16896

CORES

528

TMUS

24

ROPS

80 GB

MEMORY

SIZE

HBM3

MEMORY

TYPE

5120 bit

BUS

WIDTH

24 Months

WARRANTY

Specifications

GRAPHIC PROCESSOR

GPU Name:

GH100

Architecture:

Hopper

Foundry:

TSMC

Process Size:

4 nm

Transistors:

80,000 million

Density:

98.3M / mm²

Die Size:

814 mm²

GRAPHICS CARD

Release Date:

Mar 21st, 2023

Generation:

Tesla Hopper (Hxx)

Predecessor:

Tesla Ada

Production:

Active

Bus Interface:

PCIe 5.0 x16

CLOCK SPEEDS

Base Clock:

1590 MHz

Boost Clock:

1980 MHz

Memory Clock:

1313 MHz 2.6 Gbps effective

MEMORY

Memory Size:

80 GB

Memory Type:

HBM3

Memory Bus:

5120 bit

Bandwidth:

1,681 GB/s

RENDER CONFIG

Shading Units:

16896

TMUs:

528

ROPs:

24

SM Count:

132

Tensor Cores:

528

L1 Cache:

256 KB (per SM)

L2 Cache:

50 MB

THEORETICAL PERFORMANCE

Pixel Rate:

47.52 GPixel/s

Texture Rate:

1,045 GTexel/s

FP16 (half):

267.6 TFLOPS (4:1)

FP32 (float):

66.91 TFLOPS

FP64 (double):

33.45 TFLOPS (1:2)

BOARD DESIGN

Slot Width:

SXM Module

TDP:

700 W

Suggested PSU:

1100 W

Outputs:

No outputs

Power Connectors:

8-pin EPS

Board Number:

PG520

GRAPHIC FEATURES

DirectX:

N/A

OpenGL:

N/A

OpenCL:

3.0

Vulkan:

N/A

CUDA:

9.0

Shader Model:

N/A

Interested in buying this GPU?

NVIDIA H100 SXM5 80 GB

$265K - $310K per server*

In Stock

(These come only in systems, not per card)

Memory Size: 80 GB, Memory Type: HBM3, Bus Width: 5120 bit

*Estimated prices, not final

a100-gpu
nvidia

Similar GPUs