Android Remote Control MCP

Android Remote Control MCP transforms an Android device into a powerful MCP (Model Context Protocol) server, allowing for seamless remote control via accessibility services and screenshot capabilities. Designed to cater to AI models, this application enables full interaction with any installed application on the device. Users can implement UI element reading, button pressing, text entry, app launching, and much more, all through a versatile HTTP server that the app hosts, complete with optional HTTPS support.

Key Features

• MCP Server Capabilities: Operates an HTTP server directly on Android, utilizing Ktor and Netty, allowing for robust communication with AI models like Claude. The server specifications include:

  • Streamable HTTP transport adhering to MCP standards.
  • Multi-layered authentication options, including a static bearer token and a self-contained OAuth 2.1 server.
  • Auto-generated TLS certificates with optional custom uploads.
  • Configurable server binding options, supporting localhost or network access.
  • Automated tunnel configurations via services like Cloudflare Quick Tunnels or ngrok.

• Extensive MCP Tool Support: The server provides access to 57 MCP tools across 14 categories, including:

  • Screen introspection, input management, gesture operations, file manipulations, and more. Each tool can be customized based on device specifications.

• User-Friendly Android App: Features a responsive Material Design 3 interface that facilitates easy server management and monitoring, including:

  • Status dashboards, permission settings, server logs, and more.
  • Configurable tool permissions (per tool and parameter) for enhanced security.
  • Supports remote access tunnel configurations and storage management.

• Privacy Mode: Protects sensitive user data by hiding personal information in the outputs generated by MCP tools before any data leaves the device, utilizing efficient detection mechanisms running entirely on-device. Configurable settings for anonymization or redaction enhance user data security.

• Robust Integration Support: The application is compatible with external AI services such as Claude.ai and ChatGPT, allowing for easy integration through OAuth 2.1 workflows. Tools can connect via easily configurable JSON-based authentication setups.

Demonstration

Each functionality can be viewed through various demos available in the repository, showcasing interactions like posting on social platforms, installing applications, and conducting flight searches.

Security Considerations

The application prioritizes security, supporting multiple authentication layers, coupled with clearly defined scopes for tool permissions. Ensuring safe access through configurable networking options allows users to maintain control over their devices.

Summary

Android Remote Control MCP provides an efficient, token-optimized platform that enables users to script and control their Android devices remotely with ease. Ideal for research and educational uses, it lays the groundwork for innovative interactions between AI models and mobile technology, all while keeping privacy considerations at its core.