unstract

unstract

No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents

Stars: 5808

Visit
 screenshot

Unstract is a no-code platform that enables users to launch APIs and ETL pipelines to structure unstructured documents. With Unstract, users can go beyond co-pilots by enabling machine-to-machine automation. Unstract's Prompt Studio provides a simple, no-code approach to creating prompts for LLMs, vector databases, embedding models, and text extractors. Users can then configure Prompt Studio projects as API deployments or ETL pipelines to automate critical business processes that involve complex documents. Unstract supports a wide range of LLM providers, vector databases, embeddings, text extractors, ETL sources, and ETL destinations, providing users with the flexibility to choose the best tools for their needs.

README:

Unstract

No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents

Python Version from PEP 621 TOML uv GitHub License Docker Pulls CLA assistant pre-commit.ci status Quality Gate Status Bugs Code Smells Coverage Duplicated Lines (%)

๐Ÿค– Prompt Studio

Prompt Studio's primary reason for existence is so you can develop the necessary prompts for document data extraction super efficiently. It is a purpose-built environment that makes this not just easy for youโ€”but, lot of fun! The document sample, its variants, the prompts you're developing, outputs from different LLMs, the schema you're developing, costing details of the extraction and various tools that let you measure the effectiveness of your prompts are just a click away and easily accessible. Prompt Studio is designed for effective and high speed development and iteration of prompts for document data extraction. Welcome to IDP 2.0!

img Prompt Studio

๐Ÿง˜โ€โ™€๏ธ Three step nirvana with Workflow Studio

Automate critical business processes that involve complex documents with a human in the loop. Go beyond RPA with the power of Large Language Models.

๐ŸŒŸ Step 1: Add documents to no-code Prompt Studio and do prompt engineering to extract required fields
๐ŸŒŸ Step 2: Configure Prompt Studio project as API deployment or configure input source and output destination for ETL Pipeline
๐ŸŒŸ Step 3: Deploy Workflows as unstructured data APIs or unstructured data ETL Pipelines!

img Using Unstract

๐Ÿš€ Getting started

System Requirements

  • 8GB RAM (recommended)

Prerequisites

  • Linux or MacOS (Intel or M-series)
  • Docker
  • Docker Compose (if you need to install it separately)
  • Git

Next, either download a release or clone this repo and do the following:

โœ… ./run-platform.sh
โœ… Now visit http://frontend.unstract.localhost in your browser
โœ… Use username and password unstract to login

That's all there is to it!

Follow these steps to change the default username and password. See user guide for more details on managing the platform.

Another really quick way to experience Unstract is by signing up for our hosted version. It comes with a 14 day free trial!

๐Ÿ“„ Supported File Types

Unstract supports a wide range of file formats for document processing:

Category Format Description
Word Processing DOCX Microsoft Word Open XML
DOC Microsoft Word
ODT OpenDocument Text
Presentation PPTX Microsoft PowerPoint Open XML
PPT Microsoft PowerPoint
ODP OpenDocument Presentation
Spreadsheet XLSX Microsoft Excel Open XML
XLS Microsoft Excel
ODS OpenDocument Spreadsheet
Document & Text PDF Portable Document Format
TXT Plain Text
CSV Comma-Separated Values
JSON JavaScript Object Notation
Image BMP Bitmap Image
GIF Graphics Interchange Format
JPEG Joint Photographic Experts Group
JPG Joint Photographic Experts Group
PNG Portable Network Graphics
TIF Tagged Image File Format
TIFF Tagged Image File Format
WEBP Web Picture Format

โฉ Quick Start Guide

Unstract comes well documented. You can get introduced to the basics of Unstract, and learn how to connect various systems like LLMs, Vector Databases, Embedding Models and Text Extractors to it. The easiest way to wet your feet is to go through our Quick Start Guide where you actually get to do some prompt engineering in Prompt Studio and launch an API to structure varied credit card statements!

๐Ÿค Ecosystem support

LLM Providers

Provider Status
OpenAI โœ… Working
Google VertexAI, Gemini Pro โœ… Working
Azure OpenAI โœ… Working
Anthropic โœ… Working
Ollama โœ… Working
Bedrock โœ… Working
Google PaLM โœ… Working
Anyscale โœ… Working
Mistral AI โœ… Working

Vector Databases

Provider Status
Qdrant โœ… Working
Weaviate โœ… Working
Pinecone โœ… Working
PostgreSQL โœ… Working
Milvus โœ… Working

Embeddings

Provider Status
OpenAI โœ… Working
Azure OpenAI โœ… Working
Google PaLM โœ… Working
Ollama โœ… Working
VertexAI โœ… Working
Bedrock โœ… Working

Text Extractors

Provider Status
Unstract LLMWhisperer V2 โœ… Working
Unstructured.io Community โœ… Working
Unstructured.io Enterprise โœ… Working
LlamaIndex Parse โœ… Working

ETL Sources

Provider Status
AWS S3 โœ… Working
MinIO โœ… Working
Google Cloud Storage โœ… Working
Azure Cloud Storage โœ… Working
Google Drive โœ… Working
Dropbox โœ… Working
SFTP โœ… Working

ETL Destinations

Provider Status
Snowflake โœ… Working
Amazon Redshift โœ… Working
Google BigQuery โœ… Working
PostgreSQL โœ… Working
MySQL โœ… Working
MariaDB โœ… Working
Microsoft SQL Server โœ… Working
Oracle โœ… Working

๐Ÿ™Œ Contributing

Contributions are welcome! Please see CONTRIBUTING.md for further details to get started easily.

๐Ÿ‘‹ Join the LLM-powered automation community

๐Ÿšจ Backup encryption key

Do copy the value of ENCRYPTION_KEY config in either backend/.env or platform-service/.env file to a secure location.

Adapter credentials are encrypted by the platform using this key. Its loss or change will make all existing adapters inaccessible!

๐Ÿ“Š A note on analytics

In full disclosure, Unstract integrates Posthog to track usage analytics. As you can inspect the relevant code here, we collect the minimum possible metrics. Posthog can be disabled if desired by setting REACT_APP_ENABLE_POSTHOG to false in the frontend's .env file.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for unstract

Similar Open Source Tools

For similar tasks

For similar jobs