off-grid-mobile

off-grid-mobile

The Swiss Army Knife of Offline AI. Chat, Speak, and Generate Images - Privacy First, Zero Internet. Download an LLM and use it on your mobile device. No data ever leaves your phone. Supports text-to-text, vision, text-to-image

Stars: 208

Visit
 screenshot

Off Grid is a complete offline AI suite that allows users to perform various tasks such as text generation, image generation, vision AI, voice transcription, and document analysis on their mobile devices without sending any data out. The tool offers high performance on flagship devices and supports a wide range of models for different tasks. Users can easily install the tool on Android by downloading the APK from GitHub Releases or build it from source with Node.js and JDK. The documentation provides detailed information on the system architecture, codebase, design system, visual hierarchy, test flows, and more. Contributions are welcome, and the tool is built with a focus on user privacy and data security, ensuring no cloud, subscription, or data harvesting.

README:

Off Grid Logo

Off Grid

The Swiss Army Knife of On-Device AI

Chat. Generate images. See. Listen. All on your phone. All offline. Zero data leaves your device.

GitHub stars License: MIT Platform Coverage


Not just another chat app

Most "local LLM" apps give you a text chatbot and call it a day. Off Grid is a complete offline AI suite — text generation, image generation, vision AI, voice transcription, and document analysis, all running natively on your phone's hardware.


What can it do?


Onboarding

Text Generation

Image Generation

Vision AI

Attachments

Text Generation — Run Qwen 3, Llama 3.2, Gemma 3, Phi-4, and any GGUF model. Streaming responses, thinking mode, 15-30 tok/s on flagship devices. Bring your own .gguf files too.

Image Generation — On-device Stable Diffusion with real-time preview. NPU-accelerated on Snapdragon (5-10s per image), Core ML on iOS. 20+ models including Absolute Reality, DreamShaper, Anything V5.

Vision AI — Point your camera at anything and ask questions. SmolVLM, Qwen3-VL, Gemma 3n — analyze documents, describe scenes, read receipts. ~7s on flagship devices.

Voice Input — On-device Whisper speech-to-text. Hold to record, auto-transcribe. No audio ever leaves your phone.

Document Analysis — Attach PDFs, code files, CSVs, and more to your conversations. Native PDF text extraction on both platforms.

AI Prompt Enhancement — Simple prompt in, detailed Stable Diffusion prompt out. Your text model automatically enhances image generation prompts.


Performance

Task Flagship Mid-range
Text generation 15-30 tok/s 5-15 tok/s
Image gen (NPU) 5-10s
Image gen (CPU) ~15s ~30s
Vision inference ~7s ~15s
Voice transcription Real-time Real-time

Tested on Snapdragon 8 Gen 2/3, Apple A17 Pro. Results vary by model size and quantization.


Install

Android — Download APK

Grab the latest APK from GitHub Releases, install, and start chatting in under 2 minutes.

Build from source

git clone https://github.com/alichherawalla/off-grid-mobile.git
cd off-grid-mobile
npm install

# Android
cd android && ./gradlew clean && cd ..
npm run android

# iOS
cd ios && pod install && cd ..
npm run ios

Requires Node.js 20+, JDK 17 / Android SDK 36 (Android), Xcode 15+ (iOS). See full build guide.


Documentation

Document Description
Architecture & Technical Reference System architecture, design patterns, native modules, performance tuning
Codebase Guide Comprehensive code walkthrough
Design System Brutalist design philosophy, theme system, tokens
Visual Hierarchy Standard Visual hierarchy and layout standards
Test Flows End-to-end test flows
Test Coverage Report Current test coverage status
Test Priority Map Test prioritization guide
Test Spec Format Test specification format reference

Contributing

Contributions welcome! Fork, branch, PR. See development guidelines for code style and the codebase guide for patterns.


Acknowledgments

Built on the shoulders of giants: llama.cpp | whisper.cpp | llama.rn | whisper.rn | local-dream | ml-stable-diffusion | MNN | Hugging Face


Off Grid — Your AI, your device, your data.

No cloud. No subscription. No data harvesting. Just AI that works anywhere.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for off-grid-mobile

Similar Open Source Tools

For similar tasks

For similar jobs