NVIDIA
NVIDIA GeForce RTX 4080
Ada Lovelace • 16GB GDDR6X • 320W TDP
14 Fair Value
AI Performance
SDXL 1024x1024 16 images/min
LLM 7B Inference 92 tokens/sec
LLM 13B Inference 52 tokens/sec
Max Model Size 20B parameters
Source: Tom's Hardware (2024-06-15)
Specifications
- Architecture
- Ada Lovelace
- VRAM
- 16GB GDDR6X
- Memory Bandwidth
- 716 GB/s
- CUDA Cores
- 9,728
- Tensor Cores
- 304
- Base Clock
- 2,205 MHz
- Boost Clock
- 2,505 MHz
- TDP
- 320W
- Release Date
- Nov 2022
- MSRP
- $1,199