UFO
UFO³: Weaving the Digital Agent Galaxy
UFO is an open-source AI agent framework developed by Microsoft that automates GUI interactions on Windows desktops and orchestrates tasks across multiple devices. The project includes UFO² (Desktop AgentOS) for single-device Windows automation using hybrid GUI and API actions, and UFO³ Galaxy for coordinating complex workflows across heterogeneous platforms (Windows, Linux, Android) using DAG-based task orchestration. It leverages large language models to execute natural-language requests through direct OS-level control, visual detection, and the Model Context Protocol (MCP) for tool augmentation. Developers can use UFO for cross-platform automation, testing, and building multi-device intelligent workflows.
Key Features
Use Cases
- 01Automating repetitive Windows desktop tasks like data entry, form filling, and application navigation
- 02Orchestrating cross-device workflows such as collecting data on Linux, processing on Windows, and deploying to Android
- 03Building complex multi-step automation pipelines with parallel task execution across heterogeneous platforms
- 04Testing GUI applications across different operating systems with coordinated device agents
- 05Creating intelligent assistants that control multiple applications simultaneously using natural language
- 06Developing cross-platform automation solutions that adapt dynamically to execution feedback
Related Agents
View morehermes-agent
The agent that grows with you
agency-agents
A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy injectors to reality checkers. Each agent is a specialized expert with personality, processes, and proven deliverables.
openinterpreter
A coding agent for open models like Kimi K3
cline
Autonomous coding agent as an SDK, IDE extension, or CLI assistant.
UFO — FAQ
What is UFO and what are the differences between UFO² and UFO³?+
UFO is Microsoft's open-source AI agent framework for GUI automation. UFO² (Desktop AgentOS) is a stable, single-device Windows automation agent, while UFO³ Galaxy is a multi-device orchestration framework that coordinates agents across Windows, Linux, and Android platforms using DAG-based workflows. UFO² can operate standalone or serve as a Windows device agent within Galaxy.
How do I install and set up UFO?+
Install dependencies with 'pip install -r requirements.txt'. For UFO², copy 'config/ufo/agents.yaml.template' to 'config/ufo/agents.yaml' and configure your LLM API keys (OpenAI, Azure OpenAI, etc.). For UFO³ Galaxy, additionally configure 'config/galaxy/agent.yaml' and 'config/galaxy/devices.yaml', then start device agents on each platform before launching Galaxy with 'python -m galaxy --interactive'.
What are the prerequisites and do I need API keys?+
UFO requires Python 3.10 or 3.11 and access to large language model APIs (OpenAI, Azure OpenAI, Qwen, Gemini, Claude, etc.). You must provide API keys in the configuration files. UFO² specifically requires Windows OS, while Galaxy supports Windows, Linux, and Android devices.
Is UFO free to use?+
Yes, UFO is open-source under the MIT License and free to use. However, you'll incur costs from the LLM API services you configure (OpenAI, Azure, etc.) based on their usage pricing.
Which AI clients or platforms does UFO work with?+
UFO is a standalone agent framework, not a plugin for other AI assistants. It integrates with various LLM providers including OpenAI, Azure OpenAI, Qwen, Gemini, and Claude for its reasoning capabilities. UFO³ Galaxy can coordinate with MCP-compatible tools for augmentation.
Should I use UFO² or UFO³ Galaxy for my project?+
Use UFO² for simple Windows-only automation with quick setup and proven stability (LTS status). Choose UFO³ Galaxy for cross-device coordination, complex multi-step workflows, or when you need DAG-based task orchestration across heterogeneous platforms. You can also use both in a hybrid approach.
How do I install UFO?+
Open the source repository on GitHub and follow its README. UFO is a agent — MCP Agents Market links you directly to the official repo.
Is UFO free?+
UFO is an open-source project hosted on GitHub. Check the repository for its license and any usage requirements.