airi

airi

アイリ VTuber. LLM powered Live2D/VRM living character, near by you. 💖

Stars: 65

Visit
 screenshot

Airi is a VTuber project heavily inspired by Neuro-sama. It is capable of various functions such as playing Minecraft, chatting in Telegram and Discord, audio input from browser and Discord, client side speech recognition, VRM and Live2D model support with animations, and more. The project also includes sub-projects like unspeech, hfup, Drizzle ORM driver for DuckDB WASM, and various other tools. Airi uses models like whisper-large-v3-turbo from Hugging Face and is similar to projects like z-waif, amica, eliza, AI-Waifu-Vtuber, and AIVTuber. The project acknowledges contributions from various sources and implements packages to interact with LLMs and models.

README:

アイリ VTuber

[Try it] [简体中文文档]

Heavily inspired by Neuro-sama

Current progress

Capable of

  • [x] Brain
  • [x] Ears
    • [x] Audio input from browser
    • [x] Audio input from Discord
    • [x] Client side speech recognition
    • [x] Client side talking detection
  • [x] Mouth
    • [x] ElevenLabs voice synthesis
  • [x] Body
    • [x] VRM support
      • [x] Control VRM model
    • [x] VRM model animations
      • [x] Auto blink
      • [x] Auto look at
      • [x] Idle eye movement
    • [x] Live2D support
      • [x] Control Live2D model
    • [x] Live2D model animations
      • [x] Auto blink
      • [x] Auto look at
      • [x] Idle eye movement

Development

pnpm i
pnpm dev

Sub-projects born from this project

%%{ init: { 'flowchart': { 'curve': 'catmullRom' } } }%%

flowchart TD

  CORE("Core")
  UNSPEECH["unspeech"]
  DB1["@proj-airi/drizzle-duckdb-wasm"]
  DB2["[WIP] Memory Alaya"]
  DB0["@proj-airi/duckdb-wasm"]
  ICONS["@proj-airi/lobe-icons"]
  UI("UI")
  Stage("Stage")
  ELEVENLABS{{"@proj-airi/elevenlabs"}}
  F_AGENT("Factorio Agent")
  F_API["Factorio RCON API"]
  F_MOD1["autorio"]
  SVRT["@proj-airi/server-runtime"]
  MC_AGENT("Minecraft Agent")
  XSAI["xsai"]
  
  subgraph airi-vtuber
    DB0 --> DB1 --> DB2 --> CORE
    ICONS --> UI --> Stage --> CORE
    CORE --> ELEVENLABS
    CORE --> SVRT
  end
  ELEVENLABS --> |Speaking|UNSPEECH
  SVRT --> |Playing Factorio|F_AGENT

  subgraph Airi-Factorio
    F_AGENT --> F_API -..- factorio-server
    subgraph factorio-server-wrapper
      subgraph factorio-server
        F_MOD1
      end
    end
  end

  SVRT --> |Playing Minecraft|MC_AGENT -..- minecraft-server

  XSAI --> CORE
  XSAI --> F_AGENT
  XSAI --> MC_AGENT
%%{ init: { 'flowchart': { 'curve': 'catmullRom' } } }%%

flowchart TD
  subgraph deploy&bundle
    direction LR
    HFUP["hfup"]
    HF[/"HuggingFace Spaces"\]
    HFUP -...- UI -...-> HF
    HFUP -...- whisper-webgpu -...-> HF
    HFUP -...- moonshine-web -...-> HF
  end

Models used

Similar Projects

Acknowledgements

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for airi

Similar Open Source Tools

For similar tasks

For similar jobs