CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
multi-agent-systems gui-automation large-language-models language-model-agent visual-language-models
-
Updated
Feb 20, 2026 - Python
#
gui-automation
Here are 78 public repositories matching this topic...
Language: All
Filter by language
Sort: Most stars
Sort options
The Open Framework for autonomous virtual computer agents at scale, fully open-source, safe, auditable, and production-ready.
agent ai full-stack openai google-api gui-automation ai-agents claude gemini-api cli-tools computer-control saas-application llm anthropic llm-agents gemini-ai agentic-framework computer-use claude-code computer-use-agent
-
Updated
Mar 1, 2026 - TypeScript
AutoNode: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation
machine-learning artificial-intelligence knowledge-graph artificial-neural-networks gui-automation robotic-process-automation llm
-
Updated
Jun 29, 2024 - Python
AutomationIDE , Python IDE creare by Python, Include [WEB, API, GUI, Load & Stress] automation.
python testing chat gui automation ide chatbot selenium load-testing test-automation text-editor python-ide gui-automation web-automation gui-testing api-automation api-automation-testing chatgpt binggpt
-
Updated
Feb 10, 2026 - Python
A framework for GUI automation
python testing windows macos linux gui automation test-automation automatic testing-tools gui-automation testing-framework keyword-driven-testing report-generator gui-testing test-automation-framework python-automation auto-control
-
Updated
Feb 2, 2026 - Python
Fully localized Robot Framework library for automating the SAP GUI using text locators
-
Updated
Feb 19, 2026 - Python
Nim GUI Automation Linux, simulate user interaction, mouse and keyboard.
linux keyboard nim x11 mouse ui-automation autohotkey xdotool nim-lang gui-automation keyboard-input xdo mouse-movement
-
Updated
Jan 26, 2022 - Nim
Command Line telepathy. An Autonomous Al Agent for your Terminal that turns intent into Execution (Windows/Linux/Mac)
python devops natural-language-processing gui-automation cli-tool autonomous-agent ai-agent local-llm terminal-ai offline-ai agentic-ai agentic-devops autonomous-terminal-agent p2p-sysadmin self-healing-agent intent-based-p2p sovereign-autoops autonomous-sysadmin
-
Updated
Feb 7, 2026 - Python
Official repository for paper: OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents
-
Updated
Feb 9, 2026 - Python
Desktop automation library for Ruby
-
Updated
May 25, 2024 - Ruby
Windows backend input automation library in Go (Message + HID). A Go wrapper over Interception for reliable Windows input automation. Ji Yu Nei He Qu Dong Ji De Windows RPA Zi Dong Hua Shu Ru Zhu Ru Ku
go windows golang automation hid dpi win32 interception gui-automation input-automation rpa backend-input hw-input
-
Updated
Feb 9, 2026 - Go
This project automates the conversion of Figma designs into code, supporting frameworks like Tkinter, Kivy, PyQt5, Java Swing, and C++ QT. It streamlines UI development by transforming design files into fully functional, customizable code while preserving the original layout, colors, fonts, and components.
developer-tools code-generation gui-automation ui-generator figma-api design-to-code figma-to-code figma-to-tkinter design-to-app figma-to-tk figma-to-kivy figma-pyqt5 design-to-kivy design-to-pyqt5 design-to-tkinter design-to-tk
-
Updated
Nov 25, 2025 - Python
Computer Use Protocol is a universal schema for AI agents to perceive and interact with any desktop UI.
cross-platform json-schema accessibility mcp protocol aria ui-automation desktop-automation gui-automation ai-agents computer-use model-context-protocol
-
Updated
Mar 1, 2026
V-Zen: Efficient GUI Understanding and Precise Grounding With A Novel Multimodal LLM Resources
gui agi llama gpt mistral gui-automation vicuna large-language-models llm chatgpt grounding-dino superagi multimodal-large-language-models
-
Updated
Jul 21, 2024
Selenium WebDriver with Java from LetsKodeIt
-
Updated
Apr 8, 2020 - Java
Google Chrome offline game (T Rex) bot using Python.
-
Updated
Oct 3, 2023 - Python
Official Repo of "AI Agents for Computer Use: A Review of Instruction-based Computer Control, GUI Automation, and Operator Assistants"
-
Updated
Jun 4, 2025 - HTML
Mouse Robot C#
-
Updated
Dec 8, 2022 - C#
Advanced MCP server for AI agents, computer use automation, and desktop operator control: Intelligent Window Management , Multi-Action Chaining , AI-Optimized Screenshots , macOS and Retina Display Support . Ideal for testing apps, games, and running desktop tasks locally with AI agents through Model Context Protocol.
mcp screen-capture robotjs desktop-automation gui-automation automation-testing keyboard-automation mouse-control mouse-automation ai-agent computer-use model-context-protocol mcp-server ai-operator screenshot-automation multi-action-sequences desktop-operator
-
Updated
Jun 10, 2025 - JavaScript
Improve this page
Add a description, image, and links to the gui-automation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the gui-automation topic, visit your repo's landing page and select "manage topics."