Tech Articles
Curated developer articles, tutorials, and guides – auto-updated hourly
Guatu6d ago • 9 min read
Moving Scheduled LLM Curation from Cloud APIs to Local Models
A comparison of cloud APIs vs local models for scheduled agent memory curation, and the headless-cro...
#aiagents#localllm#ollama#kubernetes
0 0
uehara4d ago • 10 min read
Cloud bills kept climbing from 24/7 AI development — I moved the decisions and the implementation to my own local LLMs and cut the cost
From late June into July 2026, I rebuilt the execution backbone of my development onto my own local....
#ai#llm#localllm#costoptimization
0 0
the kilted dev1d ago • 7 min read
What really fits in 8GB VRAM
Four VRAM numbers that looked wrong on an 8GB laptop, none of them a bug: what dxdiag...
#localllm#vram#gpu#buildinpublic
0 0
Syed Masood Shah1d ago • 2 min read
The meeting-notes app my boss wanted us to trial uploaded every word. I said no.
My boss wanted me to trial a cloud meeting-notes app. Then I read the privacy policy. What I set up ...
#productivity#ai#localllm#windows
0 0
Syed Masood Shah1d ago • 2 min read
A Local Video Dubber, Fully Running, in About Ten Minutes
A short, honest walkthrough for real-time local video dubbing on Windows. No cloud, no API keys, no ...
#localllm#whisper#python#ai
0 0
Syed Masood Shah1d ago • 3 min read
I moved my drafting off ChatGPT to a local model. Here's where it's actually good
A month of running a local LLM for real work — what it nails, what still makes me reach for cloud, a...
#localllm#selfhosted#ai#privacy
0 0
Syed Masood Shah6d ago • 2 min read
I stopped sending my meeting audio to the cloud — here’s what I built instead
I work in IT for a mid-size company. Last year our legal team asked me to audit how we handle meetin...
#productivity#localllm#windows#privacy
0 0
Patrick Hughes6d ago • 5 min read
When a 4B Local LLM Beats 26B on One Task
On one RTX 5090 workshop, a 4B model beat a 26B model on speed while both passed four code checks. H...
#localllm#modelselection#rtx5090#ollama
0 0
Patrick Hughes4d ago • 4 min read
How I Benchmark Local LLMs Before I Trust Them
A local LLM benchmark should end with a decision. I record task quality, tokens per second, VRAM, po...
#localllm#benchmarking#rtx5090#5090reports
0 0
Patrick Hughes1d ago • 4 min read
My Local LLM Writer Failed Its Own Word-Count Gate
Gemma 4 26B wrote a 535-word draft against a 550-word floor. The gate blocked it, both rescue engine...
#localllm#ollama#gemma#evalgates
0 0
Owen2d ago • 19 min read
Run Qwen 3.8 27B Locally (2026): 17 GB Total, Not 17 GB VRAM
The 17 GB figure for Qwen 3.8 27B is RAM plus VRAM, not a 16 GB card. Real GGUF sizes: 9.01 GB at 2-...
#ai#qwen#localllm#gguf
0 0
Patrick Hughes1d ago • 5 min read
A 27B Model Fit on an 8 GB GPU. It Was Slow.
Qwen3.8-27B Q3_K_S loaded on an RTX 3070. VRAM used 7,435 of 8,192 MiB. Decode ran 2.07 tok/s. Fit o...
#localllm#ollama#qwen#vram
0 0
Patrick Hughes2d ago • 4 min read
Unload Local LLMs After Every Test
A local model test is not over when text appears. I unload the model, read idle VRAM, and record the...
#localllm#ollama#rtx3070#5090reports
0 0
Patrick Hughes10h ago • 4 min read
The 26B Model Hit the Cap. The 8B Finished.
Same code task, same 512-token cap. Ollama's done_reason showed one local model finished and one got...
#localllm#ollama#benchmarking#rtx5090
0 0
![Local LLM Break-Even Math [2026]: Power, Idle, Depreciation](https://media2.dev.to/dynamic/image/width=1200,height=627,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fxu41dc8hr4ni50kxhn4e.png)
Kunal6d ago • 10 min read
Local LLM Break-Even Math [2026]: Power, Idle, Depreciation
Most “GPU price ÷ tokens” break-even math is wrong. Here’s a spreadsheetable local LLM total-cost mo...
#localllm#cost#finops#hardware
0 0
Patrick Hughes4d ago • 5 min read
How I Test a 30B Local Model Before I Load It
A 30B local model can fit on paper and still fail the job. This test plan checks memory, tool use, s...
#localai#localllm#rtx5090#ollama
0 0