Home/FAQ & Glossary/Context Window
GLOSSARY DEFINITIONConcepts
← Back to FAQ & Glossary

Context Window

The context window is an AI model's short-term working memory. Measured in tokens (roughly ¾ of a word), it defines the maximum amount of text the model can read, hold in mind, and reference at one time during a single conversation.

Think of it like the size of your desk. A small 4,096-token context window holds about 3,000 words—enough for a casual chat, but paste in a long PDF or a couple of code files and the model immediately starts pushing your earliest instructions off the edge of the desk and forgetting them. Modern local models often support 32,000 to 128,000 tokens, letting you feed in entire documentation folders or long transcripts at once.

Just remember that advertised context limits and usable local limits are two different things. Even if a model supports a massive 128K context window, cranking the slider all the way up on a home rig consumes huge amounts of extra VRAM and slows down response times.

Looking for verified hardware rigs?

Check our real-time £/GB VRAM index to find systems optimized for local model inference.

Explore VRAM Index →
Rent Cloud GPU Power

Not Ready to Buy a Full Rig?

Don't want to spend £3,500+ upfront? Rent the GPU power instead.

Buying a dedicated AI workstation is a serious investment—and if you aren't ready to spend that much right now, you don't have to. Renting cloud GPUs gives you instant access to high-VRAM hardware like RTX 4090s and H100s on demand. Spin up an instance for fine-tuning or running massive 70B+ models, pay strictly for the minutes you use, and avoid the upfront hardware cost, electricity bills, and maintenance.

Vast.ai Global GPU Marketplace

Lowest $/hr
Unbeatable $/hr rates on community-hosted RTX 4090 & 3090 rigs
Deploy Pod →

RunPod Community & Secure Cloud

Community & Secure Cloud
RTX 4090 from $0.34/hr • H100 SXM from $1.99/hr (Billed in USD)
Deploy Pod →

FindBestRig independently benchmarks cloud GPU providers to compare rental economics against physical hardware.