Product
One toolset for AI
to read and operate a real computer.
Computer use lets AI work through a user interface. Mu-AI can use the screen, keyboard, mouse or interface controls to operate existing websites, desktop apps and phones. Available actions depend on the environment.
47 tools in 8 families
Content reviewed on
capture_screen · read_screen · locate · crop · wait_forclick · drag · scroll · click_attype_text · key · hotkeyui_tree · ui_find · ui_press · ui_set_valueweb_eval · web_list_tabs · web_cropfocus_window · read_grid · clipboard_getmobile_list_devices · mobile_shelldiagnose · enumerate_elementsMachine vision
Mu looks at the screen the way a person does, so it can operate software that has no interface to connect to. With a vision model connected, AI can find "the Save button at the top right" from one description. Without a vision model, the UI structure, web and coordinate tools still work.
- On-premises
Connect a compatible vision model running in your own data center. - Mix and match
Click targeting, screen description and region recognition can each use the model that suits it best. - Managed
If you would rather not host a model, use a managed vision model service.
Know if each action worked
An optional change feed reports what happened on screen after each action: the page changed, focus moved, a field value changed, a dialog opened. The AI can confirm an action took effect without taking another screenshot.
Connect through MCP
Mu uses a standard protocol. 15 AI clients can use it directly, and you are not tied to one model vendor.
Common questions
- Do we need a vision model?
- Not always. The UI structure and web tools work without one. You need a vision model only to find targets by description or to read the screen.
- Does data leave our organization?
- Mu runs on the local machine. Whether screens leave your network depends on the model you connect: a cloud model receives screen content, while a vision model in your own data center keeps it inside.
Want to see these tools
operate your systems?
翔耀實業股份有限公司 × 賀舟有限公司