OpenAdapt
I’ve been working on OpenAdapt: https://github.com/OpenAdaptAI It’s an open source attempt at making GUI automation reliable enough for things like EHRs, ERPs, Citrix apps, etc. A lot of agent approaches basically keep looking at the screen and asking a model what to do next. We’ve gone in a different direction. We use models to learn or repair a workflow, but once it works we try to compile it down into something deterministic. On a normal run there can be zero model calls. Lately I’ve been working on figuring out how to know that an action actually had the intended effect, rather than just that the click/keystroke happened. So workflows have preconditions, postconditions/evidence checks, and halt if the state is ambiguous. We also recently added a way to send those halted decisions to a phone for a human to approve/reject.