Accessibility
9 articles about accessibility.
The accessibility Crate: Using AXUIElement from Rust on macOS
How to use the accessibility crate in Rust to interact with macOS AXUIElement APIs. Read UI trees, query attributes, perform actions, and build desktop automation tools.
5 Tiny SwiftUI Utilities for AI Agent Accessibility
Enforcing accessibility labels on custom SwiftUI views makes your app compatible with AI agents. Five small utilities that bridge the gap between UI and
Building a Universal macOS Automation API
AppleScript, accessibility APIs, and shell commands each solve part of macOS automation. A unified API layer combines them into one consistent interface for
Browser Automation: Accessibility Snapshots vs Screenshots - Saving Tokens by Skipping Pixels
Switching from screenshots to accessibility snapshots for browser automation saved us massive token costs. Here is why structured data beats pixel analysis
File Access Is Just the Beginning for Desktop Agents
The migration from cloud to desktop starts with file access. But the real unlock is controlling actual apps - reading the accessibility tree, interacting
AI Assistants That Control Your Apps vs Ones That Just Chat About Them
Voice plus file support is solid. But actually controlling your apps through the accessibility layer - clicking buttons, filling forms, navigating menus
Using MCP to Let AI Agents Control macOS via Accessibility APIs
MCP servers that expose macOS accessibility APIs give AI agents structured control over any application. Add voice input and you get hands-free desktop
Using MCP Servers for Desktop Automation, Not Just Chat
Most people use MCP to add tools to chat interfaces. The real power is chained workflows across native apps - browser automation, accessibility tree
Desktop Agents Need Native OS APIs, Not Just Terminal Commands
A CLI is useful but the real unlock for desktop agents is accessibility APIs that let you interact with any app's actual UI - buttons, text fields, menus