Skip to main content
Local Engine Ready

Qwen3 235B-A22B

1 consumer GPUs can run Qwen3 235B-A22B at Q4 natively. Precise VRAM thresholds and benchmarks below.

1 Compatible GPUs
1 with offloading
235B params
131K context
Top pick
M3 Ultra · 192 GB VRAM runs Q4 natively

Prices and availability may change · affiliate link

Javier Morales
Javier Morales AI hardware specialist — 8 years of experience
GitHub: github.com/javier-morales-ia

llama.cpp 0.2.x · CUDA 12 · ROCm 6 · updated monthly · methodology →

Execution Context

ARCHITECTURE TRANSFORMER
CONTEXT 131K TOKENS
QUANTIZATION 4-BIT GGUF
PROVIDER Alibaba
LICENSE Apache 2.0
VRAM REQUIREMENT
129.3 GB
4GB 8GB 12GB 16GB 24GB+
Hardware Decision

This model requires aFlagship GPU (48 GB+ VRAM)

Minimum

M3 Ultra

Runs at Q4 — functional, some wait

192 GB VRAM
View compatible setup
Balanced

M4 Ultra

Best value for daily use

128 GB VRAM offload
View compatible setup
Optimal

M3 Ultra

Full quality, fastest inference

192 GB VRAM
View compatible setup

Compatible GPUs for Qwen3 235B-A22B

Best picks by compatibility, VRAM headroom, and value — prices and availability may change.

M3 Ultra
192 GB VRAM · Q4 native Amazon

M3 Ultra

0.0 (0 reviews)

Pros

  • Runs Qwen3 235B-A22B at Q4 natively
  • 192 GB VRAM — adequate headroom
See M3 Ultra on Amazon →
M4 Ultra
128 GB VRAM · Offloading Amazon

M4 Ultra

0.0 (0 reviews)

Pros

  • Works via CPU offloading
  • 128 GB VRAM — adequate headroom

Some links are Amazon affiliate links. We may earn a commission at no extra cost to you. Amazon cookies may last up to 24 hours after your click.

*Prices and availability may change. Some links are affiliate links.

System Requirements

GPU VRAM 129.3 GB High-end GPU
System RAM 194 GB 64 GB or more
Storage 117.5 GB Q4 · SSD recommended
CPU Any modern CPU GPU required

VRAM by Quantization

Quantization VRAM needed Disk space Quality
FP16 (max quality) 517 GB 470 GB Maximum
Q8 (high quality) 258.5 GB 235 GB Near-lossless
Q4 (recommended) Best balance 129.3 GB 117.5 GB Recommended
Q2 (minimum) 64.6 GB 58.8 GB Quality loss

Model Details

Developer Alibaba
Parameters 235B
Context window 131,072 tokens
License Apache 2.0
Use cases chat, reasoning, coding, analysis
Released 2025-04

Install with Ollama

ollama run qwen3:235b-a22b

Hugging Face

Qwen/Qwen3-235B-A22B
View on HF →
Technical Requirements

Can your GPU run Qwen3 235B-A22B?

Qwen3 235B-A22B requires <strong class="text-primary-container">129.3 GB VRAM</strong> at Q4. 1 consumer GPUs meet this threshold. Below 8 GB or 127.30000000000001 GB you'll hit significant offload latency.

64.6GB Critical min
129.3GB Optimal Q4
258.5GB High Quality Q8
517GB Max FP16

Hardware Performance Matrix

1 Q4 native · 1 offload

GPU Unit VRAM Compatibility Est. Speed Action
M3 Ultra 192GB Optimal 38 tok/s Calculate →
M4 Ultra 128GB Offload 45 tok/s Calculate →

Recommended GPUs for Qwen3 235B-A22B

Real Benchmarks
No Paid Reviews
Editorial Pick
Data-driven

Best picks by compatibility, VRAM headroom, and value — prices and availability may change.

Some links are Amazon affiliate links. We may earn a commission at no extra cost to you. Amazon cookies may last up to 24 hours after your click.

Qwen3 235B-A22B — Compatibility guide

Qwen3 235B-A22B with 235B parameters only runs fully in multi-GPU or server configurations. Consider distilled versions if available. The VRAM calculator can help you find compatible alternatives.

Compatible Hardware

GPUs that run Qwen3 235B-A22B at Q4 — sorted by AI performance score.

Real Benchmarks
No Paid Reviews
Data-driven
M3 Ultra

Apple · 192 GB VRAM

Q4 OK
38 tok/s > $1000

Some links are Amazon affiliate links. We may earn a commission at no extra cost to you. Amazon cookies may last up to 24 hours after your click.

More Practical Alternatives

Similar models in the chat category with comparable VRAM footprints.

Not sure which GPU you need for Qwen3 235B-A22B?

The VRAM Calculator tells you exactly which quantization your hardware can handle.

M3 Ultra

Check availability

Prices change daily