Why 24 GB Is the Sweet Spot
Model fitting has a cliff at 24 GB. The two strongest newest models that run on consumer hardware — Gemma 3 27B (Jul 2026) and GLM-4.7-Flash (30B-A3B, Jan 2026) — both fit a 24 GB card at Q4 with context to spare. On 16 GB they fall to Q3, which visibly hurts quality. So 24 GB is the first tier where "the best local models at their best quality" is true — and the used 4090 is the only sane way to get there in 2026.
💡 The 2026 inversion: two years ago this was a ~$1,500 machine. The GDDR7 shortage and the used-market scarcity of 24 GB cards pushed it to ~$3,000. If you can wait for memory prices to normalize (analysts say 2027+), the same machine will cost far less — but if you want the full-Q4 experience now, this is the price.
The Build (August 2026 street prices)
| Part | Pick | Price |
|---|---|---|
| GPU | Used RTX 4090 24 GB (used ~$2,200–2,400) | $2,300 |
| CPU | Ryzen 5 7600 (plenty for inference) | $200 |
| Motherboard | B650 | $130 |
| RAM | 32 GB DDR5-6000 — RAMpocalypse pricing | $420 |
| SSD | 1 TB NVMe | $170 |
| PSU | 850 W (4090 wants headroom) | $110 |
| Case | mid-tower with good airflow (4090 runs hot) | $80 |
| Total | ~$3,100 |
Used-card checklist: check the 12VHPWR connector for scorching, budget for repaste, verify the card isn't a mining card that was memory-strapped. The GPU is the flexible line — if it's over ~$2,400, this build stops making sense.
What It Runs (newest models only)
| Model | Quant | Speed |
|---|---|---|
| Gemma 3 27B (Jul 2026, multimodal) | Q4 · ~16.5 GB | 40–55 tok/s |
| GLM-4.7-Flash (30B-A3B, Jan 2026) | Q4 · ~19 GB | 35–50 tok/s |
| Devstral 2 (24B coding, Dec 2025) | Q4 | 45–60 tok/s |
| Ministral 3 14B · Qwen3.5 · Gemma 4 sub-12B | Q4 | 60–120 tok/s |
| Qwen Image 3.0 / Muse Spark 1.2 | — | comfortable |
| Qwen2.5-VL-32B (vision fallback) | Q4 | good |
The honest limit: 70B-class models (Mistral Medium 3, gpt-oss-120B) only fit at Q2/Q3 with offload — quality suffers. For those you need 48 GB+, which is DGX Spark territory.
Buy It If / Skip It If
Buy it if: full-Q4 quality on the newest 27–30B models is your goal and you're willing to buy used — this is the quality-per-dollar peak of 2026 local AI.
Skip it if: $3,000 is the whole budget and speed matters more than Q4 quality — the $1,465 tower runs the same models at Q3. Or if you want the biggest models at all, not the best quality on mid-size ones — then it's the DGX Spark.