NVIDIA A100 PCIe vs NVIDIA A40 PCIe

What is the difference between NVIDIA A100 PCIe and NVIDIA A40 PCIe. Find out which graphics card has better performance.

Graphics Processor (GPU)

GA100GPU NameGA102
AmpereArchitectureAmpere
TSMCFoundrySamsung
7 nmProcess Size8 nm
54,200 millionTransistors28,300 million
826 mm²Die Size628 mm²

Graphics Card

Jun 22nd, 2020Release DateOct 5th, 2020
Tesla
(Axx)
FamilyTesla
(Axx)
ActiveProductionActive
PCIe 4.0 x16Bus InterfacePCIe 4.0 x16

Memory

40 GBMemory Size48 GB
HBM2eMemory TypeGDDR6
5120 bitMemory Bus384 bit
1,555 GB/sBandwidth695.8 GB/s

Performance

225.6 GPixel/sPixel fillrate194.9 GPixel/s
609.1 GTexel/sTexture fillrate584.6 GTexel/s
77.97 TFLOPS (4:1)FP16 (half) performance37.42 TFLOPS (1:1)
19.49 TFLOPSFP32 (float) performance37.42 TFLOPS
9.746 TFLOPS (1:2)FP64 (double) performance1,169 GFLOPS (1:32)

Clock Speeds

765 MHzBase Clock1305 MHz
1410 MHzBoost Clock1740 MHz
1215 MHz
2.4 Gbps effective
Memory Clock1812 MHz
14.5 Gbps effective

Render Config

6912Shading Units10752
432TMUs336
160ROPs112
192 KB (per SM)L1 Cache128 KB (per SM)
40 MBL2 Cache6 MB
108SM Count84
432Tensor Cores336

Board Design

Dual-slotSlot WidthDual-slot
267 mm
10.5 inches
Length267 mm
10.5 inches
250 WThermal design power (TDP)300 W
600 WSuggested PSU700 W
No outputsDisplay Connectors3x DisplayPort
8-pin EPSPower Connectors8-pin EPS

API support

N/ADirectX12 Ultimate (12_2)
N/AOpenGL4.6
3.0OpenCL3.0
N/AVulkan1.2
N/AShader Model6.6
8.0CUDA8.6