NVIDIA
H100
H200
A100
RTX
Grace Hopper
AMD
Radeon Instinct
Overview
NVIDIA launched the L40, a high-end professional graphics card, on October 13th, 2022. This card is crafted using the 5 nm technology and features the AD102 graphics processor in the AD102-895-A1 variant, supporting DirectX 12 Ultimate. The AD102 chip is substantial, with a 609 mm² die area and 76.3 billion transistors. Unlike the TITAN Ada, which is a fully unlocked version with the same GPU but all 18432 shaders enabled, the L40 has a reduced number of active shading units to meet its specific target, featuring 18176 shading units, 568 texture mapping units, and 192 ROPs. Additionally, the card includes 568 tensor cores for enhanced machine learning application performance and 142 cores dedicated to ray tracing acceleration. NVIDIA has equipped the L40 with 48 GB of GDDR6 memory, utilizing a 384-bit interface for connectivity. The GPU operates at a base frequency of 735 MHz with the capability to boost up to 2490 MHz, while the memory has an effective speed of 18 Gbps (2250 MHz). As a dual-slot graphics card, the L40 uses a single 16-pin power connector and has a power consumption rated at 300 W maximum. It comes with 4x DisplayPort 1.4a outputs and connects to the system via a PCI-Express 4.0 x16 interface. The card's physical dimensions are 267 mm in length and 111 mm in width, incorporating a dual-slot cooling design.
AD102
GRAPHICS
PROCESSOR
18176
CORES
568
TMUS
192
ROPS
48 GB
MEMORY
SIZE
GDDR6
MEMORY
TYPE
384 bit
BUS
WIDTH
24 Months
WARRANTY
Specifications
GRAPHIC PROCESSOR
GPU Name:
AD102
GPU Variant:
AD102-895-A1
Architecture:
Ada Lovelace
Foundry:
TSMC
Process Size:
5 nm
Transistors:
76,300 million
Density:
125.3M / mm²
Die Size:
609 mm²
GRAPHICS CARD
Release Date:
Oct 13th, 2022
Generation:
Tesla Ada (Lxx)
Predecessor:
Tesla Ampere
Successor:
Tesla Hopper
Production:
Active
Bus Interface:
PCIe 4.0 x16
CLOCK SPEEDS
Base Clock:
735 MHz
Boost Clock:
2490 MHz
Memory Clock:
2250 MHz 18 Gbps effective
MEMORY
Memory Size:
48 GB
Memory Type:
GDDR6
Memory Bus:
384 bit
Bandwidth:
864 GB/s
RENDER CONFIG
Shading Units:
18176
TMUs:
568
ROPs:
192
SM Count:
142
Tensor Cores:
568
RT Cores:
142
L1 Cache:
128 KB (per SM)
L2 Cache:
96 MB
THEORETICAL PERFORMANCE
Pixel Rate:
478.1 GPixel/s
Texture Rate:
1,414 GTexel/s
FP16 (half):
90.52 TFLOPS (1:1)
FP32 (float):
90.52 TFLOPS
FP64 (double):
1,414 GFLOPS (1:64)
BOARD DESIGN
Slot Width:
Dual-slot
Length:
267 mm 10.5 inches
Width:
111 mm 4.4 inches
TDP:
300 W
Suggested PSU:
700 W
Outputs:
4x DisplayPort 1.4a
Power Connectors:
1x 16-pin
Board Number:
PG133 SKU 250
GRAPHIC FEATURES
DirectX:
12 Ultimate (12_2)
OpenGL:
4.6
OpenCL:
3.0
Vulkan:
1.3
CUDA:
8.9
Shader Model:
6.7
Relative Performance
GeForce 210
0%
GeForce 9400 GT
0%
Radeon HD 4550
0%
Radeon HD 5450
1%
Radeon HD 6450
1%
GeForce GT 520
1%
GeForce GT 220
1%
GeForce GT 430
1%
Radeon HD 5570
1%
Radeon HD 4670
1%
GeForce GT 440
1%
GeForce GT 240
1%
GeForce 9600 GT
2%
Radeon HD 5670
2%
GeForce GT 640
2%
GeForce 9800 GT
2%
Radeon HD 6670
2%
Radeon HD 4830
2%
Radeon HD 4770
2%
Radeon HD 4850
2%
GeForce GTS 250
2%
GeForce GTS 450
2%
Radeon HD 5750
2%
Radeon HD 7750
3%
Radeon HD 5770
3%
GeForce GTX 260
3%
Radeon HD 4870
3%
Radeon Vega 8
3%
GeForce GTX 550 Ti
3%
GeForce GTX 650
3%
Radeon HD 5830
3%
Radeon HD 6790
3%
Radeon HD 4890
3%
GeForce GTX 460
3%
Radeon RX Vega 11
3%
GeForce GT 1030
3%
GeForce GTX 275
3%
Radeon HD 7770 GHz Edition
3%
GeForce GTX 280
3%
GeForce GTX 465
4%
Radeon HD 6850
4%
GeForce GTX 285
4%
Radeon HD 5850
4%
GeForce GTX 650 Ti
4%
Radeon HD 7790
4%
Radeon RX 550
4%
GeForce GTX 470
4%
Radeon HD 6870
5%
Radeon HD 5870
5%
GeForce GTX 560 Ti
5%
Radeon HD 4870 X2
5%
GeForce GTX 750 Ti
5%
Radeon HD 6950
5%
GeForce GTX 295
5%
GeForce GTX 650 Ti Boost
5%
Radeon HD 7850
5%
GeForce GTX 480
5%
Radeon HD 6970
6%
Radeon R7 265
6%
Radeon RX 460
6%
Radeon R7 370
6%
GeForce GTX 660
6%
GeForce GTX 570
6%
Radeon RX 560
6%
GeForce GTX 950
6%
Radeon HD 7870 GHz Edition
6%
Radeon R9 270X
7%
GeForce GTX 660 Ti
7%
GeForce GTX 580
7%
GeForce GTX 1050
7%
Radeon HD 7950
7%
GeForce GTX 1630
7%
Radeon HD 5970
7%
GeForce GTX 760
7%
GeForce GTX 670
8%
GeForce GTX 960
8%
Radeon R9 380
8%
Radeon R9 285
8%
Radeon HD 7970
8%
GeForce GTX 680
8%
GeForce GTX 1050 Ti
9%
GeForce GTX 770
9%
Radeon HD 6990
9%
Radeon R9 280X
9%
GeForce GTX 590
9%
Radeon HD 7970 GHz Edition
9%
GeForce GTX 780
10%
Arc A380
10%
Radeon RX 6400
10%
GeForce GTX 1650
11%
Radeon RX 470
11%
Radeon R9 290
11%
Radeon RX 570
12%
Radeon R9 390
12%
Radeon R9 290X
12%
GeForce GTX 970
12%
GeForce GTX TITAN
13%
GeForce GTX 780 Ti
13%
Radeon R9 390X
13%
Radeon HD 7990
13%
Radeon RX 480
13%
GeForce GTX 690
13%
GeForce GTX 1060 6 GB
14%
Radeon RX 5500 OEM
14%
Radeon RX 580
14%
Radeon RX 5500 XT
14%
Radeon RX 6500 XT
14%
GeForce GTX 980
14%
GeForce GTX 1650 SUPER
14%
Radeon R9 FURY
14%
Radeon RX 590
15%
Radeon R9 295X2
16%
GeForce GTX 1660
16%
Radeon R9 FURY X
16%
GeForce GTX 980 Ti
16%
GeForce GTX TITAN X
17%
GeForce GTX 1660 SUPER
17%
GeForce GTX 1660 Ti
18%
GeForce GTX 1070
18%
GeForce RTX 3050 8 GB
19%
Radeon RX Vega 56
20%
GeForce GTX 1070 Ti
21%
Radeon RX 5600 XT
21%
Radeon RX Vega 64
21%
GeForce GTX 1080
22%
GeForce RTX 2060
22%
Radeon RX 5700
22%
Arc A580
23%
Radeon RX 6600
23%
GeForce RTX 2060 SUPER
24%
GeForce RTX 2070
25%
Radeon RX 5700 XT
25%
GeForce RTX 3060 12 GB
25%
Arc A750
26%
Radeon VII
26%
TITAN X Pascal
27%
Radeon RX 6600 XT
27%
GeForce GTX 1080 Ti
27%
Arc A770
28%
GeForce RTX 2070 SUPER
28%
Radeon RX 6650 XT
29%
Radeon RX 7600
30%
GeForce RTX 4060
30%
GeForce RTX 2080
30%
Radeon RX 7600 XT
30%
GeForce RTX 2080 SUPER
31%
GeForce RTX 3060 Ti
32%
Radeon RX 6700 XT
33%
Radeon RX 6750 XT
35%
GeForce RTX 4060 Ti 8 GB
36%
GeForce RTX 2080 Ti
36%
GeForce RTX 3070
38%
GeForce RTX 3070 Ti
40%
Radeon RX 7700 XT
41%
Radeon RX 6800
41%
GeForce RTX 4070
46%
Radeon RX 6800 XT
47%
GeForce RTX 3080
49%
Radeon RX 7800 XT
49%
Radeon RX 6900 XT
51%
GeForce RTX 4070 SUPER
53%
GeForce RTX 3080 Ti
55%
Radeon RX 6950 XT
55%
GeForce RTX 3090
56%
GeForce RTX 4070 Ti
57%
GeForce RTX 4070 Ti SUPER
62%
Radeon RX 7900 XT
64%
GeForce RTX 3090 Ti
65%
GeForce RTX 4080
73%
GeForce RTX 4080 SUPER
74%
Radeon RX 7900 XTX
74%
GeForce RTX 4090
91%
L40
100%
