Skip to main content
Hardware Benchmarking v2.4

Find Out What
AI Your PC
Can Actually Run

No guesswork. Real benchmarks on 40 GPUs. Instant answers based on your actual local hardware specs.

Privacy-first. No data leaves your machine.
Local Hardware Analysis
0.0012ms latency
Top-rated GPU
RTX 5090
AI Score
140
VRAM available
32
GB GDDR7
Compatibility
Llama 3 70B Q4
Mixtral 8x7B
Stable Diffusion XL
Real-time inference log
[SYS] Checking CUDA cores... 21,760 found.
[SYS] Memory bandwidth: 1,008 GB/s verified.
[OK] FP16/BF16 Tensor Cores active.
> Ready for local LLM deployment.
Javier Morales Local infrastructure and AI specialist — 8 years of experience
GitHub: github.com/javier-morales-ia
Real Benchmarks
No Paid Reviews
Editorial Pick
Data-driven
RunAIatHome catalogs 40 GPUs with real local-AI inference benchmarks

Every GPU includes token/sec measurements on Llama 7B Q4, available VRAM, and model compatibility. Numbers captured on physical hardware — no simulations.

— RunAIatHome Hardware Lab — updated monthly
The RTX 3060 12GB hits 30 tokens/second on Llama 7B Q4 and is the best-value consumer GPU on a VRAM-per-dollar basis

With 12 GB of GDDR6 VRAM, the RTX 3060 runs 7B quantized models without RAM offload. It's the most balanced entry point into local AI in 2026.

— RunAIatHome benchmark — RTX 3060 12GB, Ollama 0.5.x, Ubuntu 24.04

Check your GPU against any AI model

VRAM Calculator — free, instant

GPU Route Selector
/gpu/decision layer

Jump to a compatible GPU + model path

Intent-first guidance:Scenario-based routes pair intent with minimum VRAM and direct compatibility checks before browsing the full GPU catalog.

3
Decision Scenarios
17.3GB
Avg Min VRAM
24GB
Highest Route

Featured GPU Picks

RTX 5090

Score 140

32GB GDDR7 · 155 tok/s 7B Q4

RTX 4090

Score 100

24GB GDDR6X · 95 tok/s 7B Q4

M4 Ultra

Score 90

128GB Unified Memory · 110 tok/s 7B Q4

NVIDIA

RTX 5090

Score 140
VRAM 32GB GDDR7
Price band flagship
7B tok/s 155

RTX 4090

Score 100
VRAM 24GB GDDR6X
Price band flagship
7B tok/s 95

RTX 5080

Score 88
VRAM 16GB GDDR7
Price band high
7B tok/s 88

RTX 4080 Super

Score 78
VRAM 16GB GDDR6X
Price band high
7B tok/s 72

RTX 5070 Ti

Score 72
VRAM 16GB GDDR7
Price band mid
7B tok/s 75

RTX 3090

Score 72
VRAM 24GB GDDR6X
Price band high
7B tok/s 65

RTX 4070 Ti Super

Score 65
VRAM 16GB GDDR6X
Price band mid
7B tok/s 60

RTX 3080 Ti

Score 62
VRAM 12GB GDDR6X
Price band high
7B tok/s 60

RTX 5070

Score 56
VRAM 12GB GDDR7
Price band mid
7B tok/s 58

RTX 3080

Score 55
VRAM 10GB GDDR6X
Price band mid
7B tok/s 45

RTX 4070

Score 48
VRAM 12GB GDDR6X
Price band mid
7B tok/s 40

RTX 4060 Ti 16GB

Score 45
VRAM 16GB GDDR6
Price band value
7B tok/s 35

RTX 3070 Ti

Score 43
VRAM 8GB GDDR6X
Price band mid
7B tok/s 42

RTX 4060 Ti

Score 40
VRAM 8GB GDDR6
Price band value
7B tok/s 35

RTX 3070

Score 40
VRAM 8GB GDDR6
Price band value
7B tok/s 34

RTX 3060 Ti

Score 38
VRAM 8GB GDDR6
Price band value
7B tok/s 32

RTX 2080 Ti

Score 36
VRAM 11GB GDDR6
Price band value
7B tok/s 33

RTX 3060

Score 35
VRAM 12GB GDDR6
Price band value
7B tok/s 30

RTX 4060

Score 30
VRAM 8GB GDDR6
Price band entry
7B tok/s 26

RTX 3050 8GB

Score 19
VRAM 8GB GDDR6
Price band entry
7B tok/s 16

GTX 1660 Super

Score 18
VRAM 6GB GDDR6
Price band entry
7B tok/s 20

AMD

RX 7900 XTX

Score 70
VRAM 24GB GDDR6
Price band high
7B tok/s 80

RX 7900 XT

Score 60
VRAM 20GB GDDR6
Price band mid
7B tok/s 65

RX 7800 XT

Score 48
VRAM 16GB GDDR6
Price band value
7B tok/s 48

RX 6800 XT

Score 48
VRAM 16GB GDDR6
Price band mid
7B tok/s 32

RX 7700 XT

Score 45
VRAM 12GB GDDR6
Price band value
7B tok/s 30

RX 6700 XT

Score 38
VRAM 12GB GDDR6
Price band value
7B tok/s 22

RX 7600

Score 25
VRAM 8GB GDDR6
Price band entry
7B tok/s 22

RX 6600 XT

Score 24
VRAM 8GB GDDR6
Price band entry
7B tok/s 21

RX 6600

Score 20
VRAM 8GB GDDR6
Price band entry
7B tok/s 18

Apple

M4 Ultra

Score 90
VRAM 128GB Unified Memory
Price band integrated
7B tok/s 110

M3 Ultra

Score 82
VRAM 192GB Unified Memory
Price band integrated
7B tok/s 95

M4 Max 48GB

Score 72
VRAM 48GB Unified Memory
Price band integrated
7B tok/s 64

M4 Max 36GB

Score 68
VRAM 36GB Unified Memory
Price band integrated
7B tok/s 62

M4 Pro

Score 50
VRAM 24GB Unified Memory
Price band integrated
7B tok/s 45

M3 Pro

Score 38
VRAM 18GB Unified Memory
Price band integrated
7B tok/s 32

M2 Pro

Score 30
VRAM 16GB Unified Memory
Price band integrated
7B tok/s 28

M1 Pro

Score 25
VRAM 16GB Unified Memory
Price band integrated
7B tok/s 22

Intel

Arc A770 16GB

Score 28
VRAM 16GB GDDR6
Price band value
7B tok/s 19

Arc A750 8GB

Score 22
VRAM 8GB GDDR6
Price band entry
7B tok/s 16