Sign up

NVIDIA A100 Tensor Core GPU

Featured

Technical Specifications

  • GPU Memory: 80GB HBM2e
  • Memory Bandwidth: 2 TB/s
  • Core Frequency: 1065 MHz (Boost: 1410 MHz)
  • TDP: 400W (PCIe), 500W (SXM4)
  • Transistors: 54.2 billion
  • Manufacturing Process: 7nm TSMC N7 FinFET
  • PCIe: Gen4 x16
  • NVLink: 600 GB/s (bidirectional)

Key Highlights

  • Third-Generation Tensor Cores with enhanced architecture for accelerated AI workloads
  • Up to 20x performance improvement over previous generation in specific AI workloads
  • Double the memory capacity than the previous 40GB version (80GB vs 40GB)
  • 1.7x higher memory bandwidth than Tesla V100 enabling faster data processing for AI models
  • Advanced Ampere Architecture optimized for the most demanding AI and HPC applications

Ideal Use Cases

Large Language Models

Designed to accelerate training and inference of large AI models with its expanded memory capacity

High Performance Computing

Delivers exceptional performance for complex scientific simulations and research applications

Enterprise AI

Powers NVIDIA DGX A100 systems delivering outstanding AI performance for enterprise applications

Data Analytics

Enhanced memory bandwidth and capacity make it ideal for large-scale data analytics applications

Deploy

Enterprise-Grade GPU Comparison

Model Memory Memory Type Memory Bandwidth FP16 TFLOPS INT8 TOPS TDP Price/Hour
NVIDIA H20 H20
96GB HBM3 4.0 TB/s 148 TFLOPS 296 TOPS 400W $0.75/hr
NVIDIA H100
141 GB HBM3 3.35 TB/s 1979 3958 700W $1.80/hr
NVIDIA L20 L20
48GB GDDR6 HBM3 864 GB/s 59.35 TFLOPS 239T 275W $0.65/hr
NVIDIA H200 Latest
141 GB HBM3E 4.8 TB/s 2000 4000 700W $2.50/hr
NVIDIA A6000
48GB GDDR6 768 GB/s 75.6 TFLOPS 38.7TFLOPS 300W $1.19/hr
NVIDIA A100
80 GB HBM2E 1555GB/s 624 1248 400W $0.9/hr

Consumer GPU Comparison

Model Memory Memory Type Memory Bandwidth CUDA Cores Boost Clock TDP Price/Hour
RTX 5090 RTX 5090
32GB Other 1792 GB/s 18874 2.7 GHz 575W $1/hr
RTX 4090 RTX 4090
24GB GDDR6X 1008 GB/s 16384 2.52 GHz 450W $0.35/hr
RTX 3090 RTX 3090
24 GB GDDR6X 1TB/s 10752 2 GHz 350W $0.25/hr