Tagged “ollama”
-
Choosing a Local LLM Runtime: Ollama, LM Studio, or llama.cpp
How the main local LLM runtimes differ in practice — packaging, control, and API surface — and a decision framework for picking one and moving on.
-
Why Your Local Model Is Slow: A Diagnostic Order
Local inference feels sluggish for a handful of reasons. Check them in this order — memory spill first — and you'll find the cause without guessing.
-
Serving a Local Model Over HTTP to Your Own Apps
How local LLM runtimes expose an HTTP endpoint, why the OpenAI-compatible shape matters, and how to wire your own scripts and tools into a local model.
-
Run Your First Local LLM with Ollama
A hands-on getting-started guide to running an open-weight LLM locally with Ollama — install, pull a model, chat, and call the local API.
-
Running a GGUF Your Runtime's Library Doesn't Offer
Curated model libraries are a subset. How to find, vet, and load an arbitrary GGUF file yourself when the quant or model you want isn't listed.
-
Model Load Time, Cold Starts, and Keeping a Model Warm
The first request after an idle period pays to read gigabytes from disk. Why that happens, when to prevent it, and what keeping a model resident costs.
-
Updating Models and Runtimes Without Breaking What Works
Local LLM tooling moves fast, and updates change behaviour. How to upgrade deliberately, verify nothing regressed, and keep a way back.