NVIDIA
NVIDIA GeForce RTX 3090
Ampere • 24GB GDDR6X • 350W TDP
17 Fair Value
AI Performance
SDXL 1024x1024 12 images/min
LLM 7B Inference 75 tokens/sec
LLM 13B Inference 42 tokens/sec
Max Model Size 30B parameters
Source: Tom's Hardware (2024-06-15)
Specifications
- Architecture
- Ampere
- VRAM
- 24GB GDDR6X
- Memory Bandwidth
- 936 GB/s
- CUDA Cores
- 10,496
- Tensor Cores
- 328
- Base Clock
- 1,395 MHz
- Boost Clock
- 1,695 MHz
- TDP
- 350W
- Release Date
- Sep 2020
- MSRP
- $1,499