Beyond API automation
Traditional workflow automation relies on APIs — structured interfaces that let systems talk to each other. But many business tools, especially older or niche software, don't have APIs. Employees interact with them through a graphical interface: clicking buttons, filling fields, navigating menus.
Computer use lets an AI model do exactly that. The model sees a screenshot of the screen, understands the interface layout, and performs actions — clicking, typing, scrolling — just as a human would. This unlocks automation for tools that were previously impossible to integrate.
Practical use cases
Legacy system data entry: Entering data from emails or spreadsheets into old CRM or ERP systems that lack modern APIs.
Government portals: Filling tax forms, filing regulatory submissions, or checking application statuses on portals designed for humans only.
Cross-application workflows: Copying data between applications that don't integrate — reading from one tool's interface and entering into another.
Current limitations
Computer use is slower than API-based automation and more brittle — interface changes can break the workflow. It's best used as a last resort when no API exists, not as a replacement for proper integrations. Platforms like OpenClaw include screen control capabilities for exactly these edge cases.