Building a Personal AI Agent Operating System with Skills and MCP Servers
Building a Personal AI Agent Operating System
The most productive AI setups are not single tools. They are harnesses - a central orchestrator connected to dozens of specialized capabilities. Think of it as building a personal operating system where the AI agent is the kernel and your skills and MCP servers are the system calls.
What the Harness Looks Like
A fully built-out setup includes three layers:
1. The Orchestrator (Claude Code)
The central agent that receives your instructions, plans execution, and delegates to specialized tools. It maintains context across tasks and knows which skill or server to invoke for each subtask.
2. Custom Skills (30+)
Skills are reusable prompt-and-tool bundles for specific workflows:
deploy- Handles your specific deployment pipelinesend-email- Composes and sends via your email provider's APIsocial-post- Formats and publishes across platformscode-review- Runs your team's specific review checklistdb-migrate- Handles database migrations with your specific safety checks
Each skill encapsulates domain knowledge that would be expensive to re-explain every time. Instead of telling the agent how your deploy process works every session, the skill contains all of that context.
3. MCP Servers (6+)
MCP servers provide structured tool access to external systems:
- Browser automation - Navigate, click, fill forms via Playwright
- Google Workspace - Read/write docs, sheets, email
- macOS control - Accessibility API access for native app automation
- Database - Direct query access with guardrails
- Git/GitHub - PR creation, issue management, code search
Why This Architecture Works
The power is in composition. "Research this topic, draft a blog post, create a PR, and post it on social media" hits four different skills and two MCP servers. The orchestrator handles the sequencing and context passing between them.
Building Your Own
Start small. Add one skill for your most repetitive task. Connect one MCP server for your most-used external tool. The harness grows organically as you identify patterns in your daily work that can be automated.
The goal is not to automate everything. It is to build a system where the mechanical parts of your work are handled reliably so you can focus on the parts that require human judgment.
Fazm is an open source macOS AI agent. Open source on GitHub.