blurr

blurr

AI agents can now use real Android, just like a human.

Stars: 456

Visit
 screenshot

Panda is a proactive, on-device AI agent for Android that autonomously understands natural language commands and operates your phone's UI to achieve them. It acts as a personal operator, handling complex, multi-step tasks across different applications. With intelligent UI automation, high-quality voice, and personalized local memory, Panda simplifies interactions with technology. Built on Kotlin, Panda's architecture includes Eyes & Hands for physical device connection, The Brain for reasoning, and The Agent for execution. The project is a proof-of-concept aiming to become an indispensable assistant.

README:

๐Ÿผ Panda: Your Personal AI Phone Operator

You touch grass. I'll touch your glass.
Join Discord Apply for Internal Test Ask DeepWiki

Apply for the closed test: google form

Demos:

Sending Welcome message to all the new Connections on Linkedin

Watch the video

5 task demo:

https://github.com/user-attachments/assets/cf76bb00-2bf4-4274-acad-d9f4c0d47188

Panda is a proactive, on-device AI agent for Android that autonomously understands natural language commands and operates your phone's UI to achieve them. Inspired by the need to make modern technology more accessible, Panda acts as your personal operator, capable of handling complex, multi-step tasks across different applications.

Project Status: WIP License: Personal Use Kotlin Version

Core Capabilities

  • ๐Ÿง  Intelligent UI Automation: Panda sees the screen, understands the context of UI elements, and performs actions like tapping, swiping, and typing to navigate apps and complete tasks.
  • ๐Ÿ“ข High Qaulity voice: Panda have high quality voice by GCS's Chirp
  • ๐Ÿ’พ Persistent & Personalized local Memory: โš ๏ธ Temporarily Disabled - Panda memory is turned off as of yet. Memory functionality will be restored in a future update.

Architecture Overview

Panda is built on a sophisticated multi-agent system written entirely in Kotlin. This architecture separates responsibilities, allowing for more complex and reliable reasoning.

  • Eyes & Hands (The Actuator): The Android Accessibility Service serves as the agent's physical connection to the device, providing the low-level ability to read the screen element hierarchy and programmatically perform touch gestures.
  • The Brain (The LLM): All high-level reasoning, planning, and analysis are powered by LLM models. This is where decisions are made.
  • The Agent:
    • Operator: This is executor with Notepad.

๐Ÿš€ Getting Started

Prerequisites

  • Android Studio (latest version recommended)
  • An Android device or emulator with API level 26+
  • Some Gemini keys, sample ENV
sdk.dir=
GEMINI_API_KEYS=

Installation

  1. Clone the repository:

    git clone [https://github.com/ayush0chaudhary/blurr.git](https://github.com/ayush0chaudhary/blurr.git)
    cd blurr
  2. Set up API Keys: This project uses a local.properties file to securely handle API keys. This file is included in .gitignore and should never be committed.

    • Create a file named local.properties in the root directory of the project.
    • Add your API keys to this file in the following format:
       sdk.dir=
       GEMINI_API_KEYS=
  3. Build & Run:

    • Open the project in Android Studio.
    • Let Gradle sync all the dependencies.
    • Run the app on your selected device or emulator.
  4. Enable Accessibility Service:

    • On the first run, the app will prompt you to grant Accessibility permission.
    • Click "Grant Access" and enable the "Panda" service in your phone's settings. This is required for the agent to see and control the screen.

๐Ÿ—บ๏ธ What's Next for Panda (Roadmap)

Panda is currently a powerful proof-of-concept, and the roadmap is focused on making it a truly indispensable assistant.

  • [ ] NOT UPDATED: List not updated

๐Ÿค Contributing

Contributions are welcome! If you have ideas for new features or improvements, feel free to open an issue or submit a pull request.

๐Ÿ“œ License

This project is licensed under a Personal Use License - see the LICENSE file for details.

Personal & Educational Use: Free to use, modify, and distribute for personal, educational, and non-commercial purposes.

Commercial Use: Requires a separate commercial license. Please contact Panda AI for commercial licensing terms.

A small video to help you understand what the project is about.

https://github.com/user-attachments/assets/b577072e-2f7f-42d2-9054-3a11160cf87d

Write you api key in in local.properties, more keys you use, better is the speed ๐Ÿ˜‰

View logs in real-time

adb logcat | grep GeminiApi

Star History

Star History Chart

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for blurr

Similar Open Source Tools

For similar tasks

For similar jobs