py-xiaozhi
Open-source AI assistant ecosystem with MCP integrations, multimodal workflows, IoT support, and cross-platform voice interaction.
py-xiaozhi is an open-source, cross-platform AI assistant framework built on Python's async architecture, supporting real-time voice streaming, vision-language tasks, and IoT device control. The AI sub-agent integrates MCP (Model Context Protocol) tools for music playback, camera capture, screenshots, app management, weather queries, and volume control, all accessible through voice commands. Designed for deployment on Windows, macOS, Linux desktops, and ARM embedded platforms like Raspberry Pi and Jetson Nano, it bridges large language models with physical hardware. Developers can extend functionality through a plugin system and connect via WebSocket or MQTT protocols.
Key Features
Use Cases
- 01Building voice-controlled AI assistants for desktop environments with GUI interaction
- 02Deploying embedded AI agents on Raspberry Pi or ARM boards for smart home automation
- 03Creating multimodal assistants that combine voice, vision, and camera input for scene understanding
- 04Integrating AI voice control into robotics projects via GPIO interfaces
- 05Developing headless AI agents for server environments using CLI or MQTT protocols
- 06Extending AI assistants with custom MCP tools for domain-specific workflows
Related Agents
View morehermes-agent
The agent that grows with you
agency-agents
A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy injectors to reality checkers. Each agent is a specialized expert with personality, processes, and proven deliverables.
openinterpreter
A coding agent for open models like Kimi K3
cline
Autonomous coding agent as an SDK, IDE extension, or CLI assistant.
py-xiaozhi — FAQ
What is py-xiaozhi?+
py-xiaozhi is a lightweight, cross-platform AI assistant framework supporting real-time voice streaming, vision-language tasks, and IoT device control through an event-driven async architecture. It includes an MCP tool ecosystem for music, camera, weather, and system management.
How do I install py-xiaozhi?+
Clone the repository, ensure Python 3.10-3.12 is installed, then run 'uv sync' (or 'pip install -e .') for CLI/GPIO mode or 'uv sync --extra gui' for the graphical interface. Configure device activation and protocol settings before first run.
Which AI clients does py-xiaozhi work with?+
py-xiaozhi is a standalone AI assistant framework that connects to AI services via API keys (Claude, GPT, Gemini). It does not integrate as a plugin into existing clients but operates independently with its own GUI, CLI, or GPIO interface.
What are the prerequisites and API key requirements?+
You need Python 3.10-3.12, at least 4GB RAM, microphone and speaker devices, and a stable internet connection. API keys for AI services (Claude, GPT, or Gemini) are required; sponsors like GitDo.net provide aggregated API access.
Is py-xiaozhi free to use?+
Yes, py-xiaozhi is open-source under the MIT License. However, you will need to pay for AI API services from providers like OpenAI, Anthropic, or Google, or use sponsored relay platforms mentioned in the documentation.
Can I run py-xiaozhi on embedded devices?+
Yes, py-xiaozhi is optimized for ARM platforms including Raspberry Pi, Horizon Robotics RDK, and Jetson Nano. It supports headless operation via CLI or GPIO interfaces for robotics and IoT projects.
How do I install py-xiaozhi?+
Open the source repository on GitHub and follow its README. py-xiaozhi is a agent — MCP Agents Market links you directly to the official repo.
Is py-xiaozhi free?+
py-xiaozhi is an open-source project hosted on GitHub. Check the repository for its license and any usage requirements.