ui-automation

Painless E2E Automation for Mobile and Web

Windows GUI Automation with Python (based on text properties)

UI automation library for .Net

AXe is a CLI tool for interacting with Simulators using Apple's Private Accessibility APIs.

For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.

Flutter-first UI testing framework. Ready for action!

让 Claude、Codex、Cursor 等 AI 助手看懂 iPhone 屏幕并直接操作手机的 iOS 自动化工具与 MCP Server，支持 UI 树获取、元素定位、截图与 OCR 识别、点击滑动、文字输入、应用管理和日志读取，适用于自动化测试与 iOS 逆向调试

🤖 Bring your Figma design & development pipeline to the next level - with design to code, in-design-content-management, component management, tools for faster design

Browser automation and computer use for AI agents. One CLI and MCP server for your signed-in browser, native macOS apps, and real iPhones.

Android automation from code. Test your apps on real phones, script the tasks you repeat, run a shelf of phones, or let an AI agent use one, from Python, Node.js, the CLI, HTTP or Appium clients. No ADB, no USB cable, no root.

DeepSeek Harness (DSH) plugin: a live iOS Simulator — and a USB-connected iPhone — inside the conversation. 22 agent tools for booting, building, driving the UI by accessibility identity, OCR text or list rows, plus a streaming sidebar panel you can tap and drag on.

C# script editor and automation library for Windows

Open-Source Testing, Monitoring, and AI SRE — as Code

DeepSeek Harness plugin for Android — build, run, and interact with a live emulator or USB device stream inside a conversation, driven entirely through adb.

A record-replay tool to automate GUI via pywinauto

这是一个使用纯Rust编写的读屏（Screen Reader）项目，用于视力有障碍的人群操作电脑，软件会将屏幕上的各种信息转换成语音输出。

MCP server for computer use & browser automation - screenshot, OCR, click, type, find_text, Chrome/Electron CDP, template matching. macOS, Windows & Android. Works with Claude, Cursor, and any MCP client.

If it's on the screen, it's an API. Control any desktop app via REST + MCP. Rust.

iOS / Android / HarmonyOS 三端真机 + 三端虚拟机 AI 自动化中台 · 自然语言驱动纯视觉执行，开箱即用的设备调度、多设备并发与报告回传

The first open-source, cross-platform library for text selection monitoring and global mouse/keyboard event hooks — production-grade, for Node.js and Electron.