Local Ai
5 articles about local ai.
DSM and Provable Memory for AI Agents - Why Relevance Beats Proof
Why provable memory systems like DSM are less useful than locally relevant AI profiles - agents need contextual memory, not cryptographically verified memories.
First Speculative Decoding Across GPU and Neural Engine on Apple Silicon
Running two models on the same Apple Silicon chip - a 1B draft model on the Neural Engine and a larger model on GPU for faster local inference.
Tiny AI Models for Game NPCs - What Works Under 1B Parameters
Using small language models (500M-1.1B parameters) for game NPC dialogue in survival games. Benchmark data, what tiny models handle well, where they break, and why this matters for desktop agents.
385ms Tool Selection Running Fully Local - No Pixel Parsing Needed
Local agents using macOS accessibility APIs skip the screenshot-parse-click cycle. Structured app data means instant element targeting and sub-second tool
Local Voice Synthesis for Desktop Agents - Why Latency Matters More Than Quality
System TTS is robotic. Cloud TTS has 2+ second latency. For conversational AI agents on Mac, local synthesis on Apple Silicon hits the sweet spot - under 2
Browse by Topic
How did this page land for you?
React to reveal totals
Comments (••)
Leave a comment to see what others are saying.Public and anonymous. No signup.