NVIDIA

NVIDIA GeForce RTX 3080 12GB

Ampere • 12GB GDDR6X • 350W TDP

17 Fair Value

AI Performance

SDXL 1024x1024 10 images/min
LLM 7B Inference 62 tokens/sec
LLM 13B Inference 34 tokens/sec
Max Model Size 13B parameters

Source: Tom's Hardware (2024-06-15)

Specifications

Architecture
Ampere
VRAM
12GB GDDR6X
Memory Bandwidth
912 GB/s
CUDA Cores
8,960
Tensor Cores
280
Base Clock
1,260 MHz
Boost Clock
1,710 MHz
TDP
350W
Release Date
Jan 2022
MSRP
$799

Similar GPUs