Cradle
The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.
Cradle is an AI agent framework designed for General Computer Control (GCC), enabling foundation models to perform complex computer tasks using screenshots as input and keyboard/mouse operations as output. The framework supports autonomous control of games like Red Dead Redemption 2, Stardew Valley, Cities: Skylines, and Dealer's Life 2, as well as productivity software including Chrome, Outlook, CapCut, and Feishu. Built with reasoning capabilities, self-improvement mechanisms, and skill curation, Cradle provides a standardized environment for training agents to master diverse computer tasks with minimal configuration requirements.
Key Features
Use Cases
- 01Training AI agents to complete open-ended missions in AAA video games
- 02Automating complex workflows across desktop productivity applications
- 03Researching General Computer Control and foundation model capabilities
- 04Building autonomous agents for game testing and quality assurance
- 05Developing benchmark environments for evaluating multimodal AI reasoning
- 06Creating adaptive agents that learn and improve task performance over time
Related Agents
View morehermes-agent
The agent that grows with you
agency-agents
A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy injectors to reality checkers. Each agent is a specialized expert with personality, processes, and proven deliverables.
openinterpreter
A coding agent for open models like Kimi K3
cline
Autonomous coding agent as an SDK, IDE extension, or CLI assistant.
Cradle — FAQ
What is Cradle and what does it do?+
Cradle is an AI agent framework for General Computer Control that enables foundation models to autonomously perform computer tasks using visual input (screenshots) and executing keyboard/mouse actions. It supports controlling games and productivity software through reasoning, self-improvement, and skill curation.
How do I install Cradle?+
Clone the repository, create a Python 3.10 conda environment, install dependencies from requirements.txt, and download the spaCy OCR model (en_core_web_lg). You'll also need to create a .env file with API keys for OpenAI, Claude, or Azure OpenAI.
What API keys are required to use Cradle?+
You need at least one of the following: OpenAI API key (OA_OPENAI_KEY), Azure OpenAI key (AZ_OPENAI_KEY), Anthropic Claude key (OA_CLAUDE_KEY), or AWS credentials for Claude (RF_CLAUDE_AK and RF_CLAUDE_SK). These are configured in a .env file at the repository root.
Which AI clients or models does Cradle work with?+
Cradle integrates with OpenAI's GPT-4o, Anthropic's Claude, and Azure OpenAI services. It uses these foundation models as the reasoning engine for action planning, self-reflection, and task inference.
Is Cradle free to use?+
The Cradle framework is open-source under the MIT license, but you'll incur costs from API usage with OpenAI, Claude, or Azure OpenAI services. The games and software it controls must be separately purchased or licensed.
Can I extend Cradle to work with new games or applications?+
Yes, Cradle is designed to be extensible. You'll need to create environment-specific configurations, define atomic and composite skills, implement UI control functions, and set up skill registries following the migration guide provided in the documentation.
How do I install Cradle?+
Open the source repository on GitHub and follow its README. Cradle is a agent — MCP Agents Market links you directly to the official repo.
Is Cradle free?+
Cradle is an open-source project hosted on GitHub. Check the repository for its license and any usage requirements.