Local Models
6 articles about local models.
Hybrid AI Agent Architectures - Local Models for Sensitive Data
Why the best AI agent setup uses local models for sensitive data and cloud models for everything else, with practical patterns for routing between them.
M4 Pro with 48GB Memory for Local Coding Models?
48GB of unified memory on an M4 Pro fits 70B parameter models at Q4 quantization. Local inference for privacy-sensitive work and overnight batch processing.
macOS Dictation With Your Own Model - Accessibility API for Text Insertion
How bring-your-own-key dictation apps on macOS use the Accessibility API for text insertion - local models, privacy, and real-time transcription.
How Much Are You Actually Spending on LLMs Every Month?
A breakdown of typical developer LLM spending, where the money goes, and how local models and context pruning can cut costs dramatically.
Private AI Setup with Local Models - Going Beyond Terminal and Code
Private plus local is great for coding. But what about email, browser, and documents? Desktop agents take the same privacy-first approach and extend it to
My AI Automation Costs $0 per Month - Here's How
How to run browser tasks, CRM updates, and document automation on your Mac with local models and zero API costs.