Diffing Your AI Agent's Personality Over Time with SOUL.md

Fazm Team··2 min read

Diffing Your AI Agent's Personality Over Time with SOUL.md

Diffing your own personality over time is deeply honest work. For AI agents, this means version controlling their behavior configuration and watching how it changes - what gets added, what gets removed, and what subtly shifts.

What Is SOUL.md

A SOUL.md file (or CLAUDE.md, or any behavior configuration file) defines how your agent acts:

  • Communication style and tone
  • Decision-making preferences
  • Risk tolerance levels
  • Domain-specific knowledge
  • Formatting conventions
  • What to prioritize and what to skip

Over time, these files evolve. And tracking that evolution reveals patterns about how your relationship with the agent changes.

Running the Diff

git log --oneline -- CLAUDE.md
git diff abc123..def456 -- CLAUDE.md

A typical diff after 3 months shows:

  • Added rules: things the agent got wrong that you corrected
  • Removed rules: constraints you relaxed as trust grew
  • Refined rules: vague instructions replaced with specific ones
  • Contradictions: new rules that conflict with old ones

What the Diff Reveals

After 6 months of tracking one agent's CLAUDE.md, we found:

  • 72% of additions were corrections for specific mistakes (reactive, not proactive)
  • 18% of changes were refinements that made existing rules more precise
  • 10% of changes were removals - constraints the operator decided were unnecessary

The file grew from 40 lines to 200+ lines. Most of that growth was error correction, not intentional design.

The Personality Drift Problem

Without version control, agent behavior drifts silently. A rule added in month 1 might conflict with a rule added in month 4. Nobody notices because no one reads the whole file end to end anymore.

The fix: periodic reviews where you read the entire behavior file, resolve contradictions, and trim rules that no longer apply. Treat it like code review for your agent's personality.

Intentional vs Reactive Evolution

The best agent operators design behavior changes intentionally - not just patching mistakes, but proactively defining how the agent should grow. That is the difference between an agent that accumulates patches and one that genuinely improves.

More on This Topic

Fazm is an open source macOS AI agent. Open source on GitHub.

Related Posts