How much regular system RAM and SSD storage do I need alongside VRAM?
Aim for at least 32GB of regular system RAM and a 1TB NVMe SSD (2TB if you plan to keep several large models on disk). Even when an AI model runs entirely on your graphics card, your PC still depends on system memory and storage speed to stage, load, and manage files behind the scenes.
1. How much regular system RAM do you need?
Your system RAM runs your operating system, browser, and local AI apps—and acts as the staging buffer before a model transfers onto your GPU. It also catches any overflow layers if you load a model slightly larger than your VRAM capacity.
- 16GB RAM (Bare Minimum): Usable for small 7B–8B models on an 8GB–12GB GPU, though you will need to close heavy browser tabs and background apps to prevent slowdowns.
- 32GB RAM (The Sweet Spot): The ideal baseline for most local AI rigs. It leaves plenty of headroom for Windows or Linux, Docker and coding tools, and smooth loading of 14B–32B models.
- 64GB+ RAM (Heavy Multitasking and Hybrid Offloading): Worth getting if you own a 24GB GPU (such as an RTX 3090 or RTX 4090) and want to run massive 70B models by splitting layers between your VRAM and system RAM.
The golden rule of RAM: Keep your system RAM at least equal to—and ideally 1.5x to 2x larger than—your GPU's VRAM. Pairing a 24GB graphics card with only 16GB of system RAM starves the OS during model staging and leads to heavy disk swapping or crashes when loading large weights.
2. How much SSD storage (and speed) do you need?
Storage speed does not increase tokens-per-second once a model is running in VRAM, but it directly controls how long you wait when launching an app or switching between models.
- Capacity — 1TB minimum (2TB recommended): Model weights are huge, and most people keep multiple models around for different tasks. A single 8B model takes ~5GB, a 32B model takes ~20GB, and a 70B model takes ~40GB+. Add 5 to 10 models, Python or Docker environments, and your operating system, and a 512GB drive fills up in weeks.
- Speed — NVMe SSD (
Gen 3orGen 4): Never store AI models on a mechanical hard drive (HDD). Reading a 20GB model off a spinning hard drive takes 3 to 5 minutes; on a modern NVMe SSD (3,500–7,000 MB/s), that same file loads into memory in just a few seconds.
Upgrade tip: System RAM and NVMe SSDs are far cheaper than graphics cards. Skip extreme
DDR5overclocking kits and overpricedGen 5SSDs—put that saved budget straight toward extra GPU VRAM instead.
Looking for verified hardware rigs?
Check our real-time £/GB VRAM index to find systems optimized for local model inference.