Aiden: a physical AI agent that controls phones over USB HID
Most GUI agent work assumes the agent lives inside the device or drives it through a debugging interface. We went the other way.
Aiden is a small board that sits outside the host. It captures the screen over HDMI-to-CSI, runs the agent loop on-device, and sends actions back as a standard USB HID device — the host sees a keyboard and a mouse, nothing else. No app install, no root, no ADB, no cloud.
Runtime is Go. Frame capture, full-duplex audio with VAD, the agent loop, and HID output all run as independent goroutines. There's no backend — nothing leaves the device, which is the only defensible design when the input is a live feed of someone's phone screen.
Open questions we haven't solved: · Action verification — inferring success from a re-read of the screen breaks when loading states lie · Prompt injection — an agent that reads screens reads whatever an attacker puts on them · iOS pointer control requires AssistiveTouch
Repo, including the HID gadget config and capture pipeline: github.com/AidenAI-IO/aiden-hardware-demo
Aiden: a physical AI agent that controls phones over USB HID
Most GUI agent work assumes the agent lives inside the device or drives it through a debugging interface. We went the other way.
Aiden is a small board that sits outside the host. It captures the screen over HDMI-to-CSI, runs the agent loop on-device, and sends actions back as a standard USB HID device — the host sees a keyboard and a mouse, nothing else. No app install, no root, no ADB, no cloud.
Runtime is Go. Frame capture, full-duplex audio with VAD, the agent loop, and HID output all run as independent goroutines. There's no backend — nothing leaves the device, which is the only defensible design when the input is a live feed of someone's phone screen.
Open questions we haven't solved: · Action verification — inferring success from a re-read of the screen breaks when loading states lie · Prompt injection — an agent that reads screens reads whatever an attacker puts on them · iOS pointer control requires AssistiveTouch
Repo, including the HID gadget config and capture pipeline: github.com/AidenAI-IO/aiden-hardware-demo
This is a short office demo showing how Aiden works in practice.
Aiden is a physical mobile AI agent device that plugs into any phone or computer via USB. It sees the screen, hears your voice, and operates the device for you — no app install required.
In this video Aiden is receiving a voice command and completing a multi-step task
Built for the AI-Native Era. Works on the phone you already have.
thanks for the feedback! let me know what kind of use cases you personally would like to have on such a device, we're trying to explore as many as possible
AidenAgent We built a physical AI agent device. It plugs into any phone or computer via USB. It watches the screen through HDMI. It listens, speaks, and controls the connected device autonomously. No app install, no API, no permissions required. The host just sees a keyboard and a mouse, the intelligence is in the device. Full builder story + technical architecture at huggingface.co/blog/NatalieY/aiden-hardware-ai-agent-device