Tagged “model-selection”
-
What a Tool Call Looks Like From the Model's Side
Local models don't run code or reach the network. Tool calling is a text protocol plus a loop you write — and small models fail at it in specific ways.
-
How to Pick a Local Model for the Job You Have
A repeatable way to choose an open-weight model for a specific task — filter by what fits, shortlist by design intent, then decide on your own work.
-
Is That Quantization Good Enough? Test It, Don't Guess
Stepping down a quant level to fit your GPU is usually worth it — but the only way to know for your work is a small repeatable check you run yourself.
-
Running a GGUF Your Runtime's Library Doesn't Offer
Curated model libraries are a subset. How to find, vet, and load an arbitrary GGUF file yourself when the quant or model you want isn't listed.
-
Keeping a Local Model Library From Eating Your Disk
Model files accumulate fast and quietly. Where runtimes store them, how to audit what you have, and a simple policy for what to keep.
-
Updating Models and Runtimes Without Breaking What Works
Local LLM tooling moves fast, and updates change behaviour. How to upgrade deliberately, verify nothing regressed, and keep a way back.