README / README.md
NatalieY's picture
Update README.md
4ed72de verified
|
Raw
History Blame Contribute Delete
5.18 kB
---
title: Aiden Hardware Demo
emoji: πŸ€–
colorFrom: gray
colorTo: green
sdk: static
pinned: true
license: apache-2.0
short_description: AI agent hardware β€” HDMI capture, USB HID control
---
# Aiden Hardware Demo
**Aiden Hardware is a physical AI agent device that plugs into any smartphone or computer via USB, captures the screen through HDMI, listens and speaks through full-duplex audio, and controls the connected device autonomously through keyboard, mouse, and touch inputs β€” driven by an on-device Go-based LLM agent runtime.**
No app install on the host device. No API required. No admin permissions. The host sees a keyboard and a mouse. The intelligence is in the Aiden device.
---
## What This Is
This Space documents the Aiden Hardware demo β€” an open-source AI agent hardware platform built on the **Luckfox Pico Zero (RV1106)**.
Aiden Hardware is a **mobile AI agent device** and **phone AI agent** platform: it turns any phone or computer into an agent-controlled device by connecting as a standard USB peripheral. While OpenAI is building an AI agent phone for 2028, Aiden works on the phone you already have β€” today, no new hardware required.
---
## Hardware Platform
| Component | Details |
|---|---|
| **Chip** | Luckfox Pico Zero (RV1106) |
| **Screen capture** | HDMI input β€” continuous frame capture |
| **Audio** | Full-duplex recording and playback |
| **Device control** | USB HID gadget β€” keyboard, mouse, touch |
| **Connectivity** | USB (power + data + HID), USB networking |
| **Agent runtime** | Go-based LLM agent |
| **Voice detection** | Silero VAD (on-device) |
| **Updates** | OTA firmware update system |
| **Configuration** | Web management portal + agent.toml |
---
## System Architecture
The stack has two layers separated by Unix Domain Sockets:
**C++ Hardware Services**
- Frame Service β€” HDMI capture β†’ raw frames via UDS socket
- Audio Service β€” full-duplex recording + playback
- HID Server β€” USB HID gadget β†’ keyboard / mouse / touch output
**Go Agent Runtime**
- LLM-powered agent loop
- Tool set: keyboard, mouse, touch, shell, web search
- Memory system β€” context across sessions
- Skills system β€” structured task routines
- Voice pipeline β€” VAD β†’ STT β†’ agent β†’ TTS
- Web UI β€” local management at aiden.local
---
## Agent Capabilities
- **Autonomous device operation** β€” navigate apps, fill forms, complete multi-step workflows
- **Voice control** β€” full-duplex listen + speak, on-device VAD
- **Screen understanding** β€” HDMI frame capture feeds the agent's perception loop
- **Memory** β€” remembers context across sessions
- **Skills** β€” acquires new task routines without reprogramming
- **OTA updates** β€” firmware improves over time
- **Universal compatibility** β€” works with any device that has USB + HDMI
---
## Links
- **GitHub Repository:** [github.com/AidenAI-IO/aiden-hardware-demo](https://github.com/AidenAI-IO/aiden-hardware-demo)
- **Full Technical Documentation:** [deepwiki.com/AidenAI-IO/aiden-hardware-demo](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo)
- **Website:** [aidenai.io](https://aidenai.io)
---
## Documentation Sections
The full DeepWiki documentation covers:
- [Hardware Platform and Connections](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/1.1-hardware-platform-and-connections)
- [System Architecture and Data Flows](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/1.2-system-architecture-and-data-flows)
- [C++ Hardware Services](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/3-c++-hardware-services)
- [Frame Service (HDMI Capture)](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/3.2-frame-service-(hdmi-capture))
- [Audio Service](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/3.3-audio-service-(recording-and-playback))
- [USB HID Gadget and HID Server](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/3.4-usb-hid-gadget-and-hid-server)
- [Go Agent Runtime](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/4-go-agent)
- [Agent Tools](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/4.3-agent-tools)
- [Voice Pipeline (VAD, STT, TTS)](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/4.4-voice-pipeline-(vad-stt-tts))
- [Memory System](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/4.6-memory-system)
- [Skills System](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/4.7-skills-system)
- [Agent Configuration](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/5-agent-configuration)
- [OTA Update System](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/6.3-ota-update-system)
- [VAD Model and Silero Integration](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/7-vad-model-and-silero-integration)
- [Benchmark Framework](https://deepwiki.com/AidenAI-IO/aiden-hardware-demo/8-benchmark-framework)
---
## Status
Aiden Hardware is currently in the **demo and development phase**. Core capabilities are functional. Building toward production for US and Europe markets.
---
## About Aiden
[Aiden](https://aidenai.io) builds AI agent hardware and software systems β€” products built for the AI-Native era.
*Built for the AI-Native Era β€” aidenai.io*