databend

databend

๐——๐—ฎ๐˜๐—ฎ, ๐—”๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ & ๐—”๐—œ. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

Stars: 7771

Visit
 screenshot

Databend is an open-source cloud data warehouse built in Rust, offering fast query execution and data ingestion for complex analysis of large datasets. It integrates with major cloud platforms, provides high performance with AI-powered analytics, supports multiple data formats, ensures data integrity with ACID transactions, offers flexible indexing options, and features community-driven development. Users can try Databend through a serverless cloud or Docker installation, and perform tasks such as data import/export, querying semi-structured data, managing users/databases/tables, and utilizing AI functions.

README:

Databend: The Next-Gen Cloud [Data+AI] Analytics

slack feishu
CI Status Linux Platform

databend

๐Ÿ‹ Introduction

Databend, built in Rust, is an open-source cloud data warehouse that serves as a cost-effective alternative to Snowflake. With its focus on fast query execution and data ingestion, it's designed for complex analysis of the world's largest datasets.

โšก Performance

TPC-H Benchmark: Databend Cloud vs. Snowflake

Databend vs. Snowflake

Data Ingestion Benchmark: Databend Cloud vs. Snowflake

Databend vs. Snowflake

๐Ÿš€ Why Databend

  • Cloud-Native: Integrates with AWS S3, Azure Blob, Google Cloud, and more.

  • High Performance: Rust-built, with cutting-edge, high-speed vectorized execution. ๐Ÿ‘‰ ClickBench.

  • Cost-Effective: Designed for scalable storage and computation, reducing costs while enhancing performance. ๐Ÿ‘‰ TPC-H.

  • AI-Powered Analytics: Enables advanced analytics with AI Functions.

  • Data Simplification: Streamlines data ingestion, no external ETL needed. ๐Ÿ‘‰ Data Loading.

  • Format Flexibility: Supports multiple data formats and types, including JSON, CSV, Parquet, GEO, and more.

  • ACID Transactions: Ensures data integrity with atomic, consistent, isolated, and durable operations.

  • Version Control: Provides Git-like version control for data, allowing querying, cloning, and reverting at any point.

  • Schemaless: VARIANT data type enabling schemaless data storage and flexible data modeling.

  • Flexible Indexing: Virtual Column, Aggregating Index, and Full-Text Index, for faster data retrieval.

  • Community-Driven: Join a welcoming community for a user-friendly cloud analytics experience.

๐Ÿ“ Architecture

Databend Architecture

๐Ÿš€ Try Databend

1. Databend Serverless Cloud

The fastest way to try Databend, Databend Cloud

2. Install Databend from Docker

Prepare the image (once) from Docker Hub (this will download about 170 MB data):

docker pull datafuselabs/databend

To run Databend quickly:

docker run --net=host  datafuselabs/databend

๐Ÿš€ Getting Started

Connecting to Databend
Data Import and Export
Loading Data From Other Databases
Querying Semi-structured Data
Visualize Tools with Databend
Managing Users
Managing Databases
Managing Tables
Managing Data
Managing Views
AI Functions
Data Management
Accessing Data Lake
Security
Performance

๐Ÿค Contributing

Databend thrives on community contributions! Whether it's through ideas, code, or documentation, every effort helps in enhancing our project. As a token of our appreciation, once your code is merged, your name will be eternally preserved in the system.contributors table.

Here are some resources to help you get started:

๐Ÿ‘ฅ Community

For guidance on using Databend, we recommend starting with the official documentation. If you need further assistance, explore the following community channels:

๐Ÿ›ฃ๏ธ Roadmap

Stay updated with Databend's development journey. Here are our roadmap milestones:

๐Ÿ“œ License

Databend is released under a combination of two licenses: the Apache License 2.0 and the Elastic License 2.0.

When contributing to Databend, you can find the relevant license header in each file.

For more information, see the LICENSE file and Licensing FAQs.

๐Ÿ™ Acknowledgement

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for databend

Similar Open Source Tools

For similar tasks

For similar jobs