NVIDIA
NVIDIA GeForce RTX 3080 Ti
Ampere • 12GB GDDR6X • 350W TDP
16 Fair Value
AI Performance
SDXL 1024x1024 11 images/min
LLM 7B Inference 68 tokens/sec
LLM 13B Inference 36 tokens/sec
Max Model Size 13B parameters
Source: Tom's Hardware (2024-06-15)
Specifications
- Architecture
- Ampere
- VRAM
- 12GB GDDR6X
- Memory Bandwidth
- 912 GB/s
- CUDA Cores
- 10,240
- Tensor Cores
- 320
- Base Clock
- 1,365 MHz
- Boost Clock
- 1,665 MHz
- TDP
- 350W
- Release Date
- Jun 2021
- MSRP
- $1,199