Understand iphone-use in One Minute: Helping AI Use Your iPhone More Smoothly

iphone-use is an open-source tool that helps AI like Claude Code and Codex use your iPhone more smoothly. Apps do not need to expose APIs; it looks at the screen and taps buttons, just like a person using a phone.

All the phone footage in the video was recorded on a real device, and the terminal on the right shows the tool’s actual output.

It first reads the screen into text, taking about 0.1 seconds each time, then taps buttons by their names. If it misses, it reports the error directly and explains whether it can retry. Tasks that have run successfully can be saved as workflows, so next time they can be replayed without calling the model or spending tokens. Plug in a cable once, then it works over Wi-Fi afterward; even older phones running iOS 15 can use it. In the browser, you can remotely tap the phone screen, and after pairing by scanning a QR code with the iPhone app, you can also control other phones.

Install with one line:

curl -fsSL https://raw.githubusercontent.com/leeguooooo/iphone-use/main/install.sh | sh

The code is on GitHub: leeguooooo/iphone-use, and a fuller introduction is available on the iphone-use project page.

The video was made with the open-source tool motion-use, and the voiceover was AI-generated.