Qwen3.8-27B VRAM Requirements & Cheapest Live GPU Rates

Exact VRAM math for Qwen3.8-27B at FP16, FP8 and INT4 across 8K to 131K context, matched with live RunPod and Vast.ai rates for the cheapest fitting GPU rigs.

Architecture truth card — Qwen3.8-27B

Exact safetensors params27,781,427,952 (27.8B)
Hidden layers64
KV heads (GQA)4
Head dim256
Data snapshot (UTC)2026-11-18T18:29:13+00:00
Snapshot SHA-256d89025de2d15…

← Open the interactive VRAM & cost calculator on the homepage

Exact VRAM matrix — 3 precisions × 3 context lengths

Precision8192 tokens ctx32768 tokens ctx131072 tokens ctx
FP16/BF16 16-bit51.75 / 2.00 / 4.09
Total 57.83 GiB
51.75 / 8.00 / 4.09
Total 63.83 GiB
51.75 / 32.00 / 4.09
Total 87.83 GiB
FP8/INT8 8-bit25.87 / 2.00 / 2.79
Total 30.67 GiB
25.87 / 8.00 / 2.79
Total 36.67 GiB
25.87 / 32.00 / 2.79
Total 60.67 GiB
INT4/AWQ 4.5-bit14.55 / 2.00 / 2.23
Total 18.78 GiB
14.55 / 8.00 / 2.23
Total 24.78 GiB
14.55 / 32.00 / 2.23
Total 48.78 GiB

Each cell: Weights GiB / GQA KV Cache GiB / Runtime Overhead GiB; bold line = Total VRAM GiB. Concurrency = 1, FP16 KV cache (2 bytes), overhead = 1.5 + 0.05 × weights GiB.

Terminal speed-math — no install needed

Re-run this exact sizing from your own terminal:

curl -fsSL https://gpuvram.pages.dev/vram-cli.py | python3 - qwen3-8-27b --ctx 32768

Live cheapest GPU configurations

ScenarioCheapest fitting rig (top 3)Total VRAMLowest $/hr730 h/moDeploy
INT4 @ 32K ctx2x RTX A4000 16GB32 GiB$0.18$129.94Deploy on RunPodCheck Vast.ai Verified
INT4 @ 32K ctx2x RTX A5000 24GB48 GiB$0.32$233.60Deploy on RunPodCheck Vast.ai Verified
INT4 @ 32K ctx1x RTX A6000 48GB48 GiB$0.33$240.90Deploy on RunPodCheck Vast.ai Verified
FP8 @ 32K ctx2x RTX A5000 24GB48 GiB$0.32$233.60Deploy on RunPodCheck Vast.ai Verified
FP8 @ 32K ctx1x RTX A6000 48GB48 GiB$0.33$240.90Deploy on RunPodCheck Vast.ai Verified
FP8 @ 32K ctx1x A40 48GB48 GiB$0.35$255.50Deploy on RunPodCheck Vast.ai Verified
FP16 @ 32K ctx4x RTX A4000 16GB64 GiB$0.36$259.88Deploy on RunPodCheck Vast.ai Verified
FP16 @ 32K ctx1x H200 NVL 143GB143 GiB$0.50$365.00Deploy on RunPodCheck Vast.ai Verified
FP16 @ 32K ctx1x MI300X 192GB192 GiB$0.50$365.00Deploy on RunPodCheck Vast.ai Verified

What over-provisioning costs you

Running Qwen3.8-27B production traffic at INT4 / 32K context on the cheapest fitting rig (2x RTX A4000 16GB) bills $129.94 per month (730 h). Defaulting to full FP16 forces a larger rig — 4x RTX A4000 16GB at $259.88/mo. Paying $259.88 instead of $129.94 every single month is the price of skipping 4-bit AWQ quantization; if your quality budget allows INT4, that gap is pure waste.