Best AI tools for< Design Data Pipelines >

Plumb is a no-code, node-based builder that empowers product, design, and engineering teams to create AI features together. It enables users to build, test, and deploy AI features with confidence, fostering collaboration across different disciplines. With Plumb, teams can ship prototypes directly to production, ensuring that the best prompts from the playground are the exact versions that go to production. It goes beyond automation, allowing users to build complex multi-tenant pipelines, transform data, and leverage validated JSON schema to create reliable, high-quality AI features that deliver real value to users. Plumb also makes it easy to compare prompt and model performance, enabling users to spot degradations, debug them, and ship fixes quickly. It is designed for SaaS teams, helping ambitious product teams collaborate to deliver state-of-the-art AI-powered experiences to their users at scale.

Recursion is a techbio company that uses artificial intelligence to accelerate drug discovery. The company's platform combines hardware, software, and data to create a more efficient and effective drug discovery process. Recursion has a broad pipeline of drug candidates in development, and it has partnered with several leading pharmaceutical companies. The company is headquartered in Salt Lake City, Utah.

Designlab is an online platform offering UI and UX design courses and bootcamps to help individuals enhance their design skills and advance their careers in digital design. The platform provides industry-leading programs focused on data-driven design, advanced Figma usage, AI for visual design, and usability & accessibility. Designlab emphasizes mentorship, feedback, and community interaction to create a supportive learning environment for aspiring and experienced designers alike.

Luw.ai is an AI-powered architecture tool that allows users to design their dream spaces with AI prompts or redesign existing spaces by snapping a photo. It offers over 55 design styles and can assist users in enhancing design choices using data from them. Luw.ai also has a personalized AI image generator that connects to over 10 AIs to create designs tailored to the user's AI persona needs. Additionally, it offers features such as a magic wand tool for removing, adding, or replacing objects, AI rendering, and 3D to image conversion.

Giftpack is a global gifting platform that offers a smart gifting service to help businesses make a unique impression through personalized experiences. The platform leverages data and design to strengthen relationships, automate gifting operations, boost retention, and drive recurring revenue. With a diverse global catalog, Giftpack provides branded merchandise, vouchers, and experiences sourced locally and globally. The platform also offers integrated automation, intelligent gift customization powered by AI, and a reward program system. Giftpack aims to simplify gifting processes and enhance engagement and retention within organizations.

The Institute for Protein Design is a research institute at the University of Washington that uses computational design to create new proteins that solve modern challenges in medicine, technology, and sustainability. The institute's research focuses on developing new protein therapeutics, vaccines, drug delivery systems, biological devices, self-assembling nanomaterials, and bioactive peptides. The institute also has a strong commitment to responsible AI development and has developed a set of principles to guide its use of AI in research.

Oncora Medical is a healthcare technology company that provides software and data solutions to oncologists and cancer centers. Their products are designed to improve patient care, reduce clinician burnout, and accelerate clinical discoveries. Oncora's flagship product, Oncora Patient Care, is a modern, intelligent user interface for oncologists that simplifies workflow, reduces documentation burden, and optimizes treatment decision making. Oncora Analytics is an adaptive visual and backend software platform for regulatory-grade real world data analytics. Oncora Registry is a platform to capture and report quality data, treatment data, and outcomes data in the oncology space.

Datagen is a platform that provides synthetic data for computer vision. Synthetic data is artificially generated data that can be used to train machine learning models. Datagen's data is generated using a variety of techniques, including 3D modeling, computer graphics, and machine learning. The company's data is used by a variety of industries, including automotive, security, smart office, fitness, cosmetics, and facial applications.

Hermae Solutions offers an AI Assistant for Enterprise Design Systems, providing onboarding acceleration, contractor efficiency, design system adoption support, knowledge distribution, and AI documentation assistance. The platform enables users to train custom AI assistants, boost frontend productivity with Storybook integration, and continuously improve AI profiles. Hermae Solutions aims to streamline engineering processes, enhance documentation, and facilitate knowledge sharing within organizations.

Archistar is a leading property research platform in Australia that empowers users to make confident and compliant property decisions with the help of data and AI. It offers a range of features, including the ability to find and assess properties, generate 3D design concepts, and minimize risk and maximize return on investment. Archistar is trusted by over 100,000 individuals and 1,000 leading property firms.

TypeflowAI is a platform that allows users to create AI tools without coding in minutes. Users can easily build, share, and embed AI tools into their websites to enhance SEO, increase traffic, and generate more leads. The platform offers features such as creating dynamic lead magnets, AI quizzes, calculators, and more, along with customization options to fit users' branding. With flexible pricing plans and integrations with popular apps, TypeflowAI simplifies the process of creating AI tools and lead magnets for businesses and individuals.

Mobility Engineering is a website that provides news, articles, and resources on the latest developments in mobility technology. The site covers a wide range of topics, including autonomous vehicles, connected cars, electric vehicles, and more. Mobility Engineering is a valuable resource for anyone interested in staying up-to-date on the latest trends in mobility technology.

BISA AI Academy is an AI education platform offering online and offline courses with a variety of materials, professional instructors, and engaging learning paths. The platform provides over 100 free courses with certificates upon completion of quizzes and assignments. Additionally, there are premium master classes available, job training programs, and corporate training options. BISA AI Academy covers fields such as Data Science, IoT, Blockchain, and Programming, offering offline classes, special programs like Prakerja, webinars, and certification programs. The platform also provides solutions for IT services, AI intelligence, system development, and educational consulting.

Outfit AI is an AI tool that enables users to design and deploy AI models or workflows as user-ready applications in minutes. It allows users to create custom user interfaces for their AI-powered apps by dropping in an API key from Replicate or Hugging Face. With Outfit AI, users can have creative control over the design of their apps, build complex workflows without any code, and optimize prompts for better performance. The tool aims to help users launch their models faster, save time, and enhance their AI applications with a built-in product copilot.

DEUS is a data and artificial intelligence company that empowers organizations to advance value creation by unlocking the true value within their data and applying AI services. They offer services in data science, engineering, design, and strategy, partnering with organizations to benefit people, business, and society. DEUS also focuses on addressing wicked problems and societal challenges through human-centered artificial intelligence initiatives. They help organizations launch AI projects that create real value and partner across the product and service lifecycle.

Nabubit is an AI-powered tool designed to assist users in database design. It serves as a virtual copilot, providing guidance and suggestions throughout the database design process. With Nabubit, users can streamline their database creation, optimize performance, and ensure data integrity. The tool leverages artificial intelligence to analyze data requirements, suggest schema designs, and enhance overall database efficiency. Nabubit is a valuable resource for developers, data analysts, and businesses looking to improve their database management practices.

Diagramming AI is an innovative tool that allows users to instantly design and edit UML structures, workflow designs, and various other diagrams with the power of AI. It offers features such as AI-powered automated diagram creation, AI chat for discussions and suggestions, quick edit functionality, project-based diagram code storage, flexible export options, customizable color themes, URL to diagram conversion, image to diagram generation, a library of diagram templates, and more. The tool caters to professionals like software developers, project managers, data analysts, educators, technical writers, business analysts, product managers, researchers, students, and marketing professionals, enhancing their visual representation capabilities across various domains.

Creators is a website that offers a service to create pitch decks for startups and growing businesses. They specialize in creating visually stunning and impactful pitch decks that tell the story of the business and capture the attention of investors. They use a data-driven approach to storytelling, incorporating relevant data and analytics to back up the idea and prove its potential to investors. They also use artificial intelligence to identify the most compelling way to present the information, ensuring that the pitch deck is not just informative, but also engaging. Creators has a team of expert designers who excel at transforming complex ideas into clear, understandable visuals that are both stunning and highly effective in communicating the message to potential investors.

Eraser AI is an AI-powered copilot for technical design, offering an all-in-one markdown editor, collaborative canvas, and diagram-as-code builder. It enables engineering teams to create diagrams, design docs, and documentation collaboratively and efficiently. With features like robust file management, blazing fast file search, wikilinks & mentions, and GitHub integration, Eraser AI streamlines the process of visualizing infrastructure, data models, process flows, and logic flows. It provides a minimal tool design for maintaining flow and focus, version history for safety, and performance optimization for distraction-free work. Additionally, Eraser AI offers workflow integration, markdown formatting, export capabilities, and enterprise-grade security features, making it a trusted tool for technical teams worldwide.

Spectro Agency is a premier destination for cutting-edge AI and software development solutions in New York City. They specialize in harnessing the power of Artificial Intelligence (AI) to transform businesses. Their services include developing AI chatbots, AI software, API creation, AWS deployments, database management, JavaScript & Python mastery, and AI-driven solutions. Spectro Agency offers comprehensive development services, app development, and web design and development excellence. They stand out for their full-stack expertise, cutting-edge technologies, scalable and secure solutions, and seamless integrations.

Mage is an open-source data pipeline tool for transforming and integrating data. It offers an easy developer experience, engineering best practices built-in, and data as a first-class citizen. Mage makes it easy to build, preview, and launch data pipelines, and provides observability and scaling capabilities. It supports data integrations, streaming pipelines, and dbt integration.

Data Prep Kit is a community project aimed at democratizing and speeding up unstructured data preparation for LLM app developers. It provides high-level APIs and modules for transforming data (code, language, speech, visual) to optimize LLM performance across different use cases. The toolkit supports Python, Ray, Spark, and Kubeflow Pipelines runtimes, offering scalability from laptop to datacenter-scale processing. Developers can contribute new custom modules and leverage the data processing library for building data pipelines. Automation features include workflow automation with Kubeflow Pipelines for transform execution.

A repository providing basic concepts, technical challenges, and resources on data engineering in Spanish. It is a curated list of free, Spanish-language materials found on the internet to facilitate the study of data engineering enthusiasts. The repository covers programming fundamentals, programming languages like Python, version control with Git, database fundamentals, SQL, design concepts, Big Data, analytics, cloud computing, data processing, and job search tips in the IT field.

Magick is a groundbreaking visual AIDE (Artificial Intelligence Development Environment) for no-code data pipelines and multimodal agents. Magick can connect to other services and comes with nodes and templates well-suited for intelligent agents, chatbots, complex reasoning systems and realistic characters.

Indexify is an open-source engine for building fast data pipelines for unstructured data (video, audio, images, and documents) using reusable extractors for embedding, transformation, and feature extraction. LLM Applications can query transformed content friendly to LLMs by semantic search and SQL queries. Indexify keeps vector databases and structured databases (PostgreSQL) updated by automatically invoking the pipelines as new data is ingested into the system from external data sources. **Why use Indexify** * Makes Unstructured Data **Queryable** with **SQL** and **Semantic Search** * **Real-Time** Extraction Engine to keep indexes **automatically** updated as new data is ingested. * Create **Extraction Graph** to describe **data transformation** and extraction of **embedding** and **structured extraction**. * **Incremental Extraction** and **Selective Deletion** when content is deleted or updated. * **Extractor SDK** allows adding new extraction capabilities, and many readily available extractors for **PDF**, **Image**, and **Video** indexing and extraction. * Works with **any LLM Framework** including **Langchain**, **DSPy**, etc. * Runs on your laptop during **prototyping** and also scales to **1000s of machines** on the cloud. * Works with many **Blob Stores**, **Vector Stores**, and **Structured Databases** * We have even **Open Sourced Automation** to deploy to Kubernetes in production.

This repository contains examples, applications, starter code, & tutorials to help you kickstart your GenAI projects. * These are built using LanceDB, a free, open-source, serverless vectorDB that **requires no setup**. * It **integrates into python data ecosystem** so you can simply start using these in your existing data pipelines in pandas, arrow, pydantic etc. * LanceDB has **native Typescript SDK** using which you can **run vector search** in serverless functions! This repository is divided into 3 sections: - Examples - Get right into the code with minimal introduction, aimed at getting you from an idea to PoC within minutes! - Applications - Ready to use Python and web apps using applied LLMs, VectorDB and GenAI tools - Tutorials - A curated list of tutorials, blogs, Colabs and courses to get you started with GenAI in greater depth.

Geoweaver is an in-browser software that enables users to easily compose and execute full-stack data processing workflows using online spatial data facilities, high-performance computation platforms, and open-source deep learning libraries. It provides server management, code repository, workflow orchestration software, and history recording capabilities. Users can run it from both local and remote machines. Geoweaver aims to make data processing workflows manageable for non-coder scientists and preserve model run history. It offers features like progress storage, organization, SSH connection to external servers, and a web UI with Python support.

The LLM Twin Course is a free, end-to-end framework for building production-ready LLM systems. It teaches you how to design, train, and deploy a production-ready LLM twin of yourself powered by LLMs, vector DBs, and LLMOps good practices. The course is split into 11 hands-on written lessons and the open-source code you can access on GitHub. You can read everything and try out the code at your own pace.

Awesome MLOps is a curated list of tools related to Machine Learning Operations, covering areas such as AutoML, CI/CD for Machine Learning, Data Cataloging, Data Enrichment, Data Exploration, Data Management, Data Processing, Data Validation, Data Visualization, Drift Detection, Feature Engineering, Feature Store, Hyperparameter Tuning, Knowledge Sharing, Machine Learning Platforms, Model Fairness and Privacy, Model Interpretability, Model Lifecycle, Model Serving, Model Testing & Validation, Optimization Tools, Simplification Tools, Visual Analysis and Debugging, and Workflow Tools. The repository provides a comprehensive collection of tools and resources for individuals and teams working in the field of MLOps.

AI System School is a curated list of research in machine learning systems, focusing on ML/DL infra, LLM infra, domain-specific infra, ML/LLM conferences, and general resources. It provides resources such as data processing, training systems, video systems, autoML systems, and more. The repository aims to help users navigate the landscape of AI systems and machine learning infrastructure, offering insights into conferences, surveys, books, videos, courses, and blogs related to the field.

Toolio is an OpenAI-like HTTP server API implementation that supports structured LLM response generation, making it conform to a JSON schema. It is useful for reliable tool calling and agentic workflows based on schema-driven output. Toolio is based on the MLX framework for Apple Silicon, specifically M1/M2/M3/M4 Macs. It allows users to host MLX-format LLMs for structured output queries and provides a command line client for easier usage of tools. The tool also supports multiple tool calls and the creation of custom tools for specific tasks.

A curated list of Generative AI projects, tools, artworks, and models

HybridAGI is the first Programmable LLM-based Autonomous Agent that lets you program its behavior using a **graph-based prompt programming** approach. This state-of-the-art feature allows the AGI to efficiently use any tool while controlling the long-term behavior of the agent. Become the _first Prompt Programmers in history_ ; be a part of the AI revolution one node at a time! **Disclaimer: We are currently in the process of upgrading the codebase to integrate DSPy**

AiTreasureBox is a versatile AI tool that provides a collection of pre-trained models and algorithms for various machine learning tasks. It simplifies the process of implementing AI solutions by offering ready-to-use components that can be easily integrated into projects. With AiTreasureBox, users can quickly prototype and deploy AI applications without the need for extensive knowledge in machine learning or deep learning. The tool covers a wide range of tasks such as image classification, text generation, sentiment analysis, object detection, and more. It is designed to be user-friendly and accessible to both beginners and experienced developers, making AI development more efficient and accessible to a wider audience.

This repository does not provide a tool, but rather a collection of resources and strategies for academics in the field of artificial intelligence who are feeling depressed or overwhelmed by the rapid advancements in the field. The resources include articles, blog posts, and other materials that offer advice on how to cope with the challenges of working in a fast-paced and competitive environment.

Guides in data engineering tasks with a focus on practical solutions.

Optimizes data systems and designs new data architectures.

Meet Tech Guru, your go-to AI for data engineering, coding expertise, and graph databases. Combining humor, reliability, and approachability to simplify tech with a personal touch.

I'm Alice, your go-to guide for DevOps fun and detailed coding solutions!

Guides data structure design with tailored, step-by-step insights.

Assistant for all data structures and algorithms related questions

Methodical and elegant programming guide, always accurate.

Advisor for Power BI Analytics, aiding in solution planning, design, and construction. Ask Hi or type /help for how to get started.

Your digital design & verification guide. The conversation data will not be used for training.

Expert in TCG data search, strategy and card design.

A UI/UX assistant for design principles, UX research, analyzing research data, and UI layout generation.

Get into FAANG. Practice with an AI expert in algorithms, data structures, and system design. Do a mock interview and improve.

I'm the Mixed Methods Design Decision Tool, offering guidance on mixed methods research designs, their implementation, and effective communication in studies.

Your friend and helper in the database world!

Expert in physics-informed neural networks for practitioners

I can help you with healthcare UX design

Create Goa services in seconds

Database Developer assisting with SQL/NoSQL, architecture, and optimization.

Specializes in AI-evasive and human-evasive pattern design.

Big data analyst for connectors, offering insights and technical guidance.