I open-sourced Phone Use: let an AI agent browse and operate your Android apps

Wait 5 sec.

One of the examples in my Phone Use README is an AI agent browsing Xianyu, checking item details and organizing 29 secondhand RAM offers. Another is the agent exploring a roguelike and clearing its first floor. I've now open-sourced the tool behind these examples. Phone Use connects the AI agent you already use to your Android phone through a Skill or MCP. It can read the screen, tap, swipe, type and switch apps, without root, ADB or an integration for each app. The latest setup starts on the phone: install the APK, enable Accessibility, copy the app's setup prompt to your agent, then compare the pairing code and approve the connection on the phone. You'll need Android 11+, Python 3.10+ on the agent's computer, network access between them, and an awake, unlocked phone. The code is MIT licensed and the APK is free; your chosen AI service's usage costs are separate. Source, download and screenshots: https://github.com/nidhoggfgg/PhoneUse I'm interested in which phone task you'd actually want to hand to an agent, and whether the setup makes sense to someone seeing it for the first time. Author disclosure: this is my project; this introduction was prepared with AI assistance.   submitted by   /u/381654729fuck [link]   [comments]