Sanna: Voice-First AI Assistant for Android

Sanna is an innovative open-source voice-first AI assistant specifically designed for Android devices. Unlike conventional assistants, Sanna takes control of the phone’s features through a powerful LLM (Large Language Model) agent loop, enabling a seamless multi-step interaction that integrates voice commands, reasoning, and action execution.

Key Features:

• Voice Control: Sanna responds to the wake word "Hey Sanna" and performs tasks through natural voice commands without the need for any physical interaction.
• Markdown-Based Skills: Expand Sanna’s capabilities effortlessly by adding new skills as Markdown files. This allows users to customize the assistant's functionalities without requiring code changes.
• Personal Memory: Sanna creates a personalized experience by remembering user preferences and facts like names, anniversaries, and important events. This memory enhances task execution and interaction relevance.
• Hands-Free Driving Mode: Activate a driving mode that allows for short, precise responses while auto-reading incoming notifications, ensuring safety and concentration on the road.
• Robust Task Automation: Sanna schedules background tasks and manages notifications intelligently by employing sub-agents that act autonomously based on predefined rules.
• Local Storage Management: Maintain various lists (shopping, to-dos) offline, ensuring the data remains private and accessible without internet connectivity.
• UI Automation Learning: Sanna employs learning mechanisms to navigate and interact with other applications on the device via Android Accessibility Services, improving reliability with each use.

Built-in Skills Include:

• Email Management: Functionality for reading, composing, and replying to emails via Gmail.
• Calendar Scheduling: Query and create events with simple voice commands.
• Messaging: Send messages and make calls through various applications like WhatsApp and SMS seamlessly.
• Media Playback: Control music and podcasts with simple directives.

Example Usages:

• For Email: "Read my last 3 emails" or "Reply to the last email: sounds good, thanks."
• For Calendar: "Create an appointment for the dentist Friday at 10 AM."
• For Lists: "Add milk and bread to my shopping list."
• For Navigation: "Navigate to the airport."

Watch Sanna in Action:

A demo of Sanna's capabilities can be viewed through this Streamable link.

Sanna combines advanced conversational AI with practical mobile functionality, offering a hands-free, intuitive way to manage everyday tasks.