singulatron

singulatron

AI management and development platform. Self-host AI models and build apps with them.

Stars: 127

Visit
 screenshot

Singulatron is an AI Superplatform that runs on your computer(s) and server(s) without using third party APIs, providing complete control over data and privacy. It offers AI functionality, user management, supports different database backends, collaboration, and mini-apps. It aims to be a desktop app for local usage and a distributed daemon for servers, with a web app frontend client. The tool is stack-based on Electron, Angular, and Go, and currently dual-licensed under AGPL-3.0-or-later and a commercial license.

README:

Singulatron

AI management and development platform.
superplatform.ai

backend build frontend build

Singulatron enables you to self-host AI models, build apps that leverage those models in any language, and utilize a microservices-based communal backend designed to support a diverse range of projects.

Primary Use Cases

Run AI Models [x]

Run open-source AI models privately on your own infrastructure, ensuring that your data and operations remain fully under your control.

Quickly Build Backendless AI Apps [x]

Build backendless application by using Singulatron as a database and AI prompting API. Like Firebase, but with a focus on AI.

Develop Microservices-Based AI Applications [ ]

Build your own backend services around Singulatron, which itself is built on a microservices architecture. Run these services outside or inside the Singulatron platform.

Deploy Third-Party AI Apps Easily [ ]

Singulatron is designed to make deploying third-party AI applications straightforward. With its focus on virtualization and containers (primarily Docker) and a microservices, API-first approach (using OpenAPI), Singulatron seamlessly integrates other applications into its ecosystem.

Run On Your Servers

See this page to help you get started.

Main Services

https://superplatform.ai/docs/category/singulatron-api

Prompt Svc

Sync or async, streamed or request/response prompting. Dump tens of thousands of prompts into the system and let the prompt queue process it.

Download Svc

Start, pause, restart large file downloads to enable you to manage your AI models.

Chat Svc

Manage threads, messages, assets (generated images etc.).

User Svc

Role-based access control, JWT, fine tuned permissions and a unique ownership model that lets you build microservices based AI apps.

Node Svc

Get information about your nodes and GPUs like temperature, VRAM usage etc.

Dynamic svc

A dynamically typed (schema-free) datastore service that lets you piggyback on Singulatron's database. Lets you build backendless applications on top of Singulatorn. Think Firebase but for AI.

Run On Your Laptop/PC

We have temporarily discontinued the distribution of binaries. Please refer to this page for alternative methods to run the software.

Stack

It is an Electron application, with Angular on the frontend and Go on the backend. It becomes a simple web app without electron when hosted over the network.

License

Singulatron is licensed under AGPL-3.0.

Status

Fairly early phase but there are quite a few installations chugging along nicely already. Why don't you join them?

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for singulatron

Similar Open Source Tools

For similar tasks

For similar jobs