Tagged “context”
-
Feeding Web Pages to a Local Model Without Wrecking the Context
Raw HTML is mostly not content, and locally every token costs VRAM and wall-clock time. Why markdown is the format a small model can actually read.
-
What a Long Context Window Costs on Local Hardware
Context isn't free locally — it takes memory for the KV cache and time on every turn. How to size a context window to what you actually use.