Best AI tools for< Design Data Pipelines >

Plumb is a no-code, node-based builder that empowers product, design, and engineering teams to create AI features together. It enables users to build, test, and deploy AI features with confidence, fostering collaboration across different disciplines. With Plumb, teams can ship prototypes directly to production, ensuring that the best prompts from the playground are the exact versions that go to production. It goes beyond automation, allowing users to build complex multi-tenant pipelines, transform data, and leverage validated JSON schema to create reliable, high-quality AI features that deliver real value to users. Plumb also makes it easy to compare prompt and model performance, enabling users to spot degradations, debug them, and ship fixes quickly. It is designed for SaaS teams, helping ambitious product teams collaborate to deliver state-of-the-art AI-powered experiences to their users at scale.

Recursion is a techbio company that uses artificial intelligence to accelerate drug discovery. The company's platform combines hardware, software, and data to create a more efficient and effective drug discovery process. Recursion has a broad pipeline of drug candidates in development, and it has partnered with several leading pharmaceutical companies. The company is headquartered in Salt Lake City, Utah.

ReachInbox is an AI-powered email outreach tool designed to help users send cold emails that land directly in the inbox. It offers features such as unlimited email accounts, AI-driven prospecting, multi-channel capabilities, and personalized email sequences. With ReachInbox, users can 10x their sales pipeline, leads, meetings, and deals by streamlining cold email outreach with smart automation and unified management system. The platform ensures high email deliverability rates and provides tools for advanced campaign design, A/B testing, and automated follow-ups. ReachInbox also integrates with CRM systems, social platforms, and productivity tools for seamless user experience.

BugFree.ai is an AI-powered platform designed to help users practice system design and behavior interviews, similar to Leetcode. The platform offers a range of features to assist users in preparing for technical interviews, including mock interviews, real-time feedback, and personalized study plans. With BugFree.ai, users can improve their problem-solving skills and gain confidence in tackling complex interview questions.

Designlab is an online platform offering UI and UX design courses and bootcamps to help individuals enhance their design skills and advance their careers in digital design. The platform provides industry-leading programs focused on data-driven design, advanced Figma usage, AI for visual design, and usability & accessibility. Designlab emphasizes mentorship, feedback, and community interaction to create a supportive learning environment for aspiring and experienced designers alike.

EvolveLab is a digital solutions provider specializing in BIM management and app development for the AEC (Architecture, Engineering, and Construction) industry. They offer a range of powerful apps and services designed to empower architects, engineers, and contractors to streamline their workflows and bring their ideas to life more efficiently. With a focus on data-driven design and AI technology, EvolveLab's innovative tools help users enhance productivity and turn concepts into reality.

Luw.ai is an AI-powered architecture tool that allows users to design their dream spaces with AI prompts or redesign existing spaces by snapping a photo. It offers over 55 design styles and can assist users in enhancing design choices using data from them. Luw.ai also has a personalized AI image generator that connects to over 10 AIs to create designs tailored to the user's AI persona needs. Additionally, it offers features such as a magic wand tool for removing, adding, or replacing objects, AI rendering, and 3D to image conversion.

Giftpack is a global gifting platform that offers a smart gifting service to help businesses make a unique impression through personalized experiences. The platform leverages data and design to strengthen relationships, automate gifting operations, boost retention, and drive recurring revenue. With a diverse global catalog, Giftpack provides branded merchandise, vouchers, and experiences sourced locally and globally. The platform also offers integrated automation, intelligent gift customization powered by AI, and a reward program system. Giftpack aims to simplify gifting processes and enhance engagement and retention within organizations.

The Institute for Protein Design is a research institute at the University of Washington that uses computational design to create new proteins that solve modern challenges in medicine, technology, and sustainability. The institute's research focuses on developing new protein therapeutics, vaccines, drug delivery systems, biological devices, self-assembling nanomaterials, and bioactive peptides. The institute also has a strong commitment to responsible AI development and has developed a set of principles to guide its use of AI in research.

Infogram is an AI-powered platform that enables users to create interactive data visualizations, infographics, reports, maps, charts, tables, slides, and dashboards effortlessly. With a wide range of features such as AI chart recommendations, interactive content, embeds, custom maps, data import, and advanced editing tools, Infogram empowers users to craft compelling visual stories. The platform also offers content engagement analytics, real-time collaboration, and a brand kit for consistent branding. Trusted by over 10 million users worldwide, Infogram is a go-to tool for individuals, teams, and organizations looking to transform data into engaging visuals.

Oncora Medical is a healthcare technology company that provides software and data solutions to oncologists and cancer centers. Their products are designed to improve patient care, reduce clinician burnout, and accelerate clinical discoveries. Oncora's flagship product, Oncora Patient Care, is a modern, intelligent user interface for oncologists that simplifies workflow, reduces documentation burden, and optimizes treatment decision making. Oncora Analytics is an adaptive visual and backend software platform for regulatory-grade real world data analytics. Oncora Registry is a platform to capture and report quality data, treatment data, and outcomes data in the oncology space.

Datagen is a platform that provides synthetic data for computer vision. Synthetic data is artificially generated data that can be used to train machine learning models. Datagen's data is generated using a variety of techniques, including 3D modeling, computer graphics, and machine learning. The company's data is used by a variety of industries, including automotive, security, smart office, fitness, cosmetics, and facial applications.

Hermae Solutions offers an AI Assistant for Enterprise Design Systems, providing onboarding acceleration, contractor efficiency, design system adoption support, knowledge distribution, and various AI documentation and Storybook assistants. The platform enables users to train custom AI assistants, embed them into documentation sites, and communicate instantly with the knowledge base. Hermae's process simplifies efficiency improvements by gathering information sources, processing data for AI supplementation, customizing integration, and supporting integration success. The AI assistant helps reduce engineering costs and increase development efficiency across the board.

Archistar is a leading property research platform in Australia that empowers users to make confident and compliant property decisions with the help of data and AI. It offers a range of features, including the ability to find and assess properties, generate 3D design concepts, and minimize risk and maximize return on investment. Archistar is trusted by over 100,000 individuals and 1,000 leading property firms.

TypeflowAI is a platform that allows users to create AI tools without coding in minutes. Users can easily build, share, and embed AI tools into their websites to enhance SEO, increase traffic, and generate more leads. The platform offers features such as creating dynamic lead magnets, AI quizzes, calculators, and more, along with customization options to fit users' branding. With flexible pricing plans and integrations with popular apps, TypeflowAI simplifies the process of creating AI tools and lead magnets for businesses and individuals.

Mobility Engineering is a website that provides news, articles, and resources on the latest developments in mobility technology. The site covers a wide range of topics, including autonomous vehicles, connected cars, electric vehicles, and more. Mobility Engineering is a valuable resource for anyone interested in staying up-to-date on the latest trends in mobility technology.

BISA AI Academy is an AI education platform offering online and offline courses with a variety of materials, professional instructors, and engaging learning paths. The platform provides over 100 free courses with certificates upon completion of quizzes and assignments. Additionally, there are premium master classes available, job training programs, and corporate training options. BISA AI Academy covers fields such as Data Science, IoT, Blockchain, and Programming, offering offline classes, special programs like Prakerja, webinars, and certification programs. The platform also provides solutions for IT services, AI intelligence, system development, and educational consulting.

Outfit AI is an AI tool that enables users to design and deploy AI models or workflows as user-ready applications in minutes. It allows users to create custom user interfaces for their AI-powered apps by dropping in an API key from Replicate or Hugging Face. With Outfit AI, users can have creative control over the design of their apps, build complex workflows without any code, and optimize prompts for better performance. The tool aims to help users launch their models faster, save time, and enhance their AI applications with a built-in product copilot.

DEUS is a data and artificial intelligence company that empowers organizations to advance value creation by unlocking the true value within their data and applying AI services. They offer services in data science, engineering, design, and strategy, partnering with organizations to benefit people, business, and society. DEUS also focuses on addressing wicked problems and societal challenges through human-centered artificial intelligence initiatives. They help organizations launch AI projects that create real value and partner across the product and service lifecycle.

Nabubit is an AI-powered tool designed to assist users in database design. It serves as a virtual copilot, providing guidance and suggestions throughout the database design process. With Nabubit, users can streamline their database creation, optimize performance, and ensure data integrity. The tool leverages artificial intelligence to analyze data requirements, suggest schema designs, and enhance overall database efficiency. Nabubit is a valuable resource for developers, data analysts, and businesses looking to improve their database management practices.

Mage is an open-source data pipeline tool for transforming and integrating data. It offers an easy developer experience, engineering best practices built-in, and data as a first-class citizen. Mage makes it easy to build, preview, and launch data pipelines, and provides observability and scaling capabilities. It supports data integrations, streaming pipelines, and dbt integration.

Fueling-Ambitions-Via-Book-Discoveries is an Advanced Machine Learning & AI Course designed for students, professionals, and AI researchers. The course integrates rigorous theoretical foundations with practical coding exercises, ensuring learners develop a deep understanding of AI algorithms and their applications in finance, healthcare, robotics, NLP, cybersecurity, and more. Inspired by MIT, Stanford, and Harvard’s AI programs, it combines academic research rigor with industry-standard practices used by AI engineers at companies like Google, OpenAI, Facebook AI, DeepMind, and Tesla. Learners can learn 50+ AI techniques from top Machine Learning & Deep Learning books, code from scratch with real-world datasets, projects, and case studies, and focus on ML Engineering & AI Deployment using Django & Streamlit. The course also offers industry-relevant projects to build a strong AI portfolio.

This repository provides a hands-on workshop for developers and solution builders to build a real-life serverless LLM application using foundation models (FMs) through Amazon Bedrock and advanced design patterns such as Reason and Act (ReAct) Agent, text-to-SQL, and Retrieval Augmented Generation (RAG). It guides users through labs to explore common and advanced LLM application design patterns, helping them build a complex Agentic LLM assistant capable of answering retrieval and analytical questions on internal knowledge bases. The repository includes labs on IaC with AWS CDK, building serverless LLM assistants with AWS Lambda and Amazon Bedrock, refactoring LLM assistants into custom agents, extending agents with semantic retrieval, and querying SQL databases. Users need to set up AWS Cloud9, configure model access on Amazon Bedrock, and use Amazon SageMaker Studio environment to run data-pipelines notebooks.

A repository providing basic concepts, technical challenges, and resources on data engineering in Spanish. It is a curated list of free, Spanish-language materials found on the internet to facilitate the study of data engineering enthusiasts. The repository covers programming fundamentals, programming languages like Python, version control with Git, database fundamentals, SQL, design concepts, Big Data, analytics, cloud computing, data processing, and job search tips in the IT field.

Magick is a groundbreaking visual AIDE (Artificial Intelligence Development Environment) for no-code data pipelines and multimodal agents. Magick can connect to other services and comes with nodes and templates well-suited for intelligent agents, chatbots, complex reasoning systems and realistic characters.

Pipecat is an open-source framework designed for building generative AI voice bots and multimodal assistants. It provides code building blocks for interacting with AI services, creating low-latency data pipelines, and transporting audio, video, and events over the Internet. Pipecat supports various AI services like speech-to-text, text-to-speech, image generation, and vision models. Users can implement new services and contribute to the framework. Pipecat aims to simplify the development of applications like personal coaches, meeting assistants, customer support bots, and more by providing a complete framework for integrating AI services.

The LLM Engineer's Handbook is an official repository containing a comprehensive guide on creating an end-to-end LLM-based system using best practices. It covers data collection & generation, LLM training pipeline, a simple RAG system, production-ready AWS deployment, comprehensive monitoring, and testing and evaluation framework. The repository includes detailed instructions on setting up local and cloud dependencies, project structure, installation steps, infrastructure setup, pipelines for data processing, training, and inference, as well as QA, tests, and running the project end-to-end.

This open-source course teaches how to build an advanced RAG and LLM system using LLMOps and ML systems best practices. It helps you create an AI assistant that leverages your personal knowledge base to answer questions, summarize documents, and provide insights. The course covers topics such as LLM system architecture, pipeline orchestration, large-scale web crawling, model fine-tuning, and advanced RAG features. It is suitable for ML/AI engineers and data/software engineers & data scientists looking to level up to production AI systems. The course is free, with minimal costs for tools like OpenAI's API and Hugging Face's Dedicated Endpoints. Participants will build two separate Python applications for offline ML pipelines and online inference pipeline.

Geoweaver is an in-browser software that enables users to easily compose and execute full-stack data processing workflows using online spatial data facilities, high-performance computation platforms, and open-source deep learning libraries. It provides server management, code repository, workflow orchestration software, and history recording capabilities. Users can run it from both local and remote machines. Geoweaver aims to make data processing workflows manageable for non-coder scientists and preserve model run history. It offers features like progress storage, organization, SSH connection to external servers, and a web UI with Python support.

Julep is an advanced platform for creating stateful and functional AI apps powered by large language models. It offers features like statefulness by design, automatic function calling, production-ready deployment, cron-like asynchronous functions, 90+ built-in tools, and the ability to switch between different LLMs easily. Users can build AI applications without the need to write code for embedding, saving, and retrieving conversation history, and can connect to third-party applications using Composio. Julep simplifies the process of getting started with AI apps, whether they are conversational, functional, or agentic.

Awesome MLOps is a curated list of tools related to Machine Learning Operations, covering areas such as AutoML, CI/CD for Machine Learning, Data Cataloging, Data Enrichment, Data Exploration, Data Management, Data Processing, Data Validation, Data Visualization, Drift Detection, Feature Engineering, Feature Store, Hyperparameter Tuning, Knowledge Sharing, Machine Learning Platforms, Model Fairness and Privacy, Model Interpretability, Model Lifecycle, Model Serving, Model Testing & Validation, Optimization Tools, Simplification Tools, Visual Analysis and Debugging, and Workflow Tools. The repository provides a comprehensive collection of tools and resources for individuals and teams working in the field of MLOps.

Databend is an open-source cloud data warehouse built in Rust, offering fast query execution and data ingestion for complex analysis of large datasets. It integrates with major cloud platforms, provides high performance with AI-powered analytics, supports multiple data formats, ensures data integrity with ACID transactions, offers flexible indexing options, and features community-driven development. Users can try Databend through a serverless cloud or Docker installation, and perform tasks such as data import/export, querying semi-structured data, managing users/databases/tables, and utilizing AI functions.

AI System School is a curated list of research in machine learning systems, focusing on ML/DL infra, LLM infra, domain-specific infra, ML/LLM conferences, and general resources. It provides resources such as data processing, training systems, video systems, autoML systems, and more. The repository aims to help users navigate the landscape of AI systems and machine learning infrastructure, offering insights into conferences, surveys, books, videos, courses, and blogs related to the field.

This repository is a curated list of open-source libraries for production large language models. It includes tools for data preprocessing, training/finetuning, evaluation/benchmarking, serving/inference, application/RAG, testing/monitoring, and guardrails/security. The repository also provides a new category called LLM Cookbook/Examples for showcasing examples and guides on using various LLM APIs.

Toolio is an OpenAI-like HTTP server API implementation that supports structured LLM response generation, making it conform to a JSON schema. It is useful for reliable tool calling and agentic workflows based on schema-driven output. Toolio is based on the MLX framework for Apple Silicon, specifically M1/M2/M3/M4 Macs. It allows users to host MLX-format LLMs for structured output queries and provides a command line client for easier usage of tools. The tool also supports multiple tool calls and the creation of custom tools for specific tasks.

AITreasureBox is a comprehensive collection of AI tools and resources designed to simplify and accelerate the development of AI projects. It provides a wide range of pre-trained models, datasets, and utilities that can be easily integrated into various AI applications. With AITreasureBox, developers can quickly prototype, test, and deploy AI solutions without having to build everything from scratch. Whether you are working on computer vision, natural language processing, or reinforcement learning projects, AITreasureBox has something to offer for everyone. The repository is regularly updated with new tools and resources to keep up with the latest advancements in the field of artificial intelligence.

A curated list of Generative AI projects, tools, artworks, and models

Guides in data engineering tasks with a focus on practical solutions.

Optimizes data systems and designs new data architectures.

Meet Tech Guru, your go-to AI for data engineering, coding expertise, and graph databases. Combining humor, reliability, and approachability to simplify tech with a personal touch.

I'm Alice, your go-to guide for DevOps fun and detailed coding solutions!

Guides data structure design with tailored, step-by-step insights.

Assistant for all data structures and algorithms related questions

Methodical and elegant programming guide, always accurate.

Advisor for Power BI Analytics, aiding in solution planning, design, and construction. Ask Hi or type /help for how to get started.

Your digital design & verification guide. The conversation data will not be used for training.

Expert in TCG data search, strategy and card design.

A UI/UX assistant for design principles, UX research, analyzing research data, and UI layout generation.

Get into FAANG. Practice with an AI expert in algorithms, data structures, and system design. Do a mock interview and improve.

I'm the Mixed Methods Design Decision Tool, offering guidance on mixed methods research designs, their implementation, and effective communication in studies.

Your friend and helper in the database world!

Expert in physics-informed neural networks for practitioners

I can help you with healthcare UX design

Create Goa services in seconds

Database Developer assisting with SQL/NoSQL, architecture, and optimization.

Specializes in AI-evasive and human-evasive pattern design.

Big data analyst for connectors, offering insights and technical guidance.