ragapp

ragapp

The easiest way to use Agentic RAG in any enterprise

Stars: 3035

Visit
 screenshot

RAGapp is a tool designed for easy deployment of Agentic RAG in any enterprise. It allows users to configure and deploy RAG in their own cloud infrastructure using Docker. The tool is built using LlamaIndex and supports hosted AI models from OpenAI or Gemini, as well as local models using Ollama. RAGapp provides endpoints for Admin UI, Chat UI, and API, with the option to specify the model and Ollama host. The tool does not come with an authentication layer, requiring users to secure the '/admin' path in their cloud environment. Deployment can be done using Docker Compose with customizable model and Ollama host settings, or in Kubernetes for cloud infrastructure deployment. Development setup involves using Poetry for installation and building frontends.

README:

Logo - RAGapp

The easiest way to use Agentic RAG in any enterprise.

As simple to configure as OpenAI's custom GPTs, but deployable in your own cloud infrastructure using Docker. Built using LlamaIndex.

Get Started · Endpoints · Deployment · Contact


Screenshot

Get Started

To run, start a docker container with our image:

docker run -p 8000:8000 ragapp/ragapp

Then, access the Admin UI at http://localhost:8000/admin to configure your RAGapp.

You can use hosted AI models from OpenAI or Gemini, and local models using Ollama.

Note: To avoid running into any errors, we recommend using the latest version of Docker and (if needed) Docker Compose.

Endpoints

The docker container exposes the following endpoints:

Note: The Chat UI and API are only functional if the RAGapp is configured.

Security

Authentication

Just the RAGapp container doesn't come with any authentication layer by design. This is the task of an API Gateway routing the traffic to RAGapp. This step heavily depends on your cloud provider and the services you use. For a pure Docker Compose environment, you can look at our RAGapp with management UI deployment.

Authorization

Later versions of RAGapp will support restricting access based on access tokens forwarded from an API Gateway or similar.

Deployment

Using Docker Compose

You can easily deploy RAGapp to your own infrastructure with one of these Docker Compose deployments:

  1. RAGapp with Ollama and Qdrant
  2. Multiple RAGapps with a management UI

Kubernetes

It's easy to deploy RAGapp in your own cloud infrastructure. Customized K8S deployment descriptors are coming soon.

Development

RAGApp:

Move to src/ragapp directory and start with these commands:

export ENVIRONMENT=dev
poetry install --no-root
make build-frontends
make dev

Then, to check out the admin UI, go to http://localhost:3000/admin.

Note: Make sure you have Poetry installed.

Contact

Questions, feature requests or found a bug? Open an issue or reach out to marcusschiesser.

Star History

Star History Chart

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for ragapp

Similar Open Source Tools

For similar tasks

For similar jobs