ai-dj

ai-dj

๐ŸŽง AI-powered VST plugin for real-time music generation using LLM contextual prompts and Stable Audio Open

Stars: 117

Visit
 screenshot

OBSIDIAN-Neural is a real-time AI music generation VST3 plugin designed for live performance. It allows users to type words and instantly receive musical loops, enhancing creative flow. The plugin features an 8-track sampler with MIDI triggering, 4 pages per track for easy variation switching, perfect DAW sync, real-time generation without pre-recorded samples, and stems separation for isolated drums, bass, and vocals. Users can generate music by typing specific keywords and trigger loops with MIDI while jamming. The tool offers different setups for server + GPU, local models for offline use, and a free API option with no setup required. OBSIDIAN-Neural is actively developed and has received over 110 GitHub stars, with ongoing updates and bug fixes. It is dual licensed under GNU Affero General Public License v3.0 and offers a commercial license option for interested parties.

README:

OBSIDIAN-Neural

๐ŸŽต Real-time AI music generation VST3 plugin for live performance

๐Ÿ“„ Late Breaking Paper - AIMLA 2025 - Presented at the first AES International Conference on Artificial Intelligence and Machine Learning for Audio (Queen Mary University London, Sept 8-10, 2025)
๐ŸŽ“ Tutorial - From DAW setup to live performance (French + English subtitles)


What it does

Type words โ†’ Get musical loops instantly. No stopping your creative flow.

  • 8-track sampler with MIDI triggering (C3-B3)
  • 4 pages per track (A/B/C/D) - Switch variations instantly by clicking page buttons
  • Perfect DAW sync - Auto time-stretch to project tempo
  • Real-time generation - No pre-recorded samples
  • Stems separation - Isolated drums, bass, vocals

Example: Type "dark techno kick" โ†’ AI generates techno loop โ†’ Trigger with MIDI while jamming


Quick Start

๐Ÿ”ต Server + GPU (Recommended)

Best quality for live performance and production.

  1. Get Stability AI access
  2. Follow build from source instructions
  3. Run server interface: python server_interface.py
  4. Download VST3 from Releases
  5. Configure VST with server URL and API key

Benefits: Variable duration, STEMS separation, better timing, GPU acceleration

๐ŸŸข Local Models (Offline)

Runs completely offline. No servers, Python, or GPU needed.

  1. Get Stability AI access
  2. Download models from innermost47/stable-audio-open-small-tflite
  3. Copy to %APPDATA%\OBSIDIAN-Neural\stable-audio\
  4. Download VST3 from Releases
  5. Choose "Local Model" in plugin

Requirements: 16GB+ RAM, Windows (macOS/Linux coming soon)

๐Ÿ”ด Free API (No Setup)

Contact [email protected] for free API key (10 slots available)


Community

๐ŸŽฏ Share your jams! I'm the only one posting OBSIDIAN videos so far. Show me how YOU use it!

๐Ÿ“ง Email: [email protected]
๐Ÿ’ฌ Discussions: GitHub Discussions
๐Ÿ“บ Examples: Community Sessions

Jungle Session


Download

VST3 Plugin:

Install to:

  • Windows: C:\Program Files\Common Files\VST3\
  • macOS: ~/Library/Audio/Plug-Ins/VST3/
  • Linux: ~/.vst3/

Status & Support

๐Ÿš€ Active development - Updates pushed regularly
โญ 110+ GitHub stars - Thanks for the support!
๐Ÿ› Issues: Report bugs here

Current limitations (local mode):

  • Fixed 10-second generation
  • Some timing/quantization issues
  • High RAM usage
  • No STEMS separation yet

Server mode still provides better quality for live performance.


License

Dual licensed:

  • ๐Ÿ†“ GNU Affero General Public License v3.0 (Open source)
  • ๐Ÿ’ผ Commercial license available (Contact: [email protected])

More Projects

๐ŸŽต YouTube - Original compositions
๐ŸŽ™๏ธ AI Harmony Radio - 24/7 experimental radio
๐ŸŽ›๏ธ Randomizer - Generative music studio


OBSIDIAN-Neural - Where artificial intelligence meets live music performance.

Developed by InnerMost47

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for ai-dj

Similar Open Source Tools

For similar tasks

For similar jobs