Best AI tools for< Data Cleaning >

Roundtable is an AI-assisted data cleaning tool designed for enterprise survey programming. It offers an easy-to-integrate API for cleaning open-ended survey responses, saving up to 70% of time. The tool uses real-time behavioral tracking to detect unnatural typing and programmatic entries, and it provides multilingual functionality for deploying studies to various markets. Roundtable also features GPT detection to identify bots and participants, dynamic clustering to group duplicate responses, and programmatic pre-screening to auto-reject low-quality participants. The tool is trusted by leaders and innovators for improving data quality efforts and providing reliable human-generated insights.

ChartFast is an AI Data Analyzer tool that automates data visualization and analysis tasks, powered by GPT-4 technology. It allows users to generate precise and sleek graphs in seconds, process vast amounts of data, and provide interactive data queries and quick exports. With features like specialized internal libraries for complex graph generation, customizable visualization code, and instant data export, ChartFast aims to streamline data work and enhance data analysis efficiency.

DataCamp is an online learning platform that offers courses in data science, AI, and machine learning. The platform provides interactive exercises, short videos, and hands-on projects to help learners develop the skills they need to succeed in the field. DataCamp also offers a variety of resources for businesses, including team training, custom content development, and data science consulting.

Clay is an AI-powered data enrichment and outreach automation tool designed to help go-to-market teams scale personalized outbound campaigns. It combines 75+ data enrichment tools, AI capabilities, and automation features to streamline lead generation, data cleaning, and personalized messaging. With access to 50+ data providers, Clay offers comprehensive coverage of information and enables users to connect, enrich, and sync their CRM data effortlessly. The platform also features AI web scraping, personalized email building, automated inbound and outbound processes, and data formatting functionalities.

Displayr is a comprehensive data workspace designed for teams, offering a range of capabilities including survey analysis, data visualization, dashboarding, automatic updating, PowerPoint reporting, finding data stories, and data cleaning. The platform aims to streamline workflow efficiency, promote self-sufficiency through DIY analytics, enable data storytelling with compelling narratives, and ensure quality control to minimize errors. Displayr caters to statisticians, market researchers, report creators, and professionals working with data, providing a user-friendly interface for creating interactive and insightful data stories.

Mito is a low-code data app infrastructure that allows users to edit spreadsheets and automatically generate Python code. It is designed to help analysts automate their repetitive Excel work and take automation into their own hands. Mito is a Jupyter extension and Streamlit component, so users don't need to set up any new infrastructure. It is easy to get started with Mito, simply install it using pip and start using it in Jupyter or Streamlit.

ChartPixel is an AI-assisted data analysis platform that empowers users to effortlessly generate charts, insights, and actionable statistics in just 30 seconds. The platform is designed to demystify data and analysis, making it accessible to users of all skill levels. ChartPixel combines the power of AI with domain expertise to provide secure and reliable output, ensuring trustworthy results without compromising data privacy. With user-friendly features and educational tools, ChartPixel helps users clean, wrangle, visualize, and present data with ease, catering to both beginners and professionals.

Crayon Data's maya.ai platform is an AI-led revenue acceleration platform for enterprises. It helps businesses unlock the value of data to increase customer engagement and revenue. The platform offers a range of capabilities, including data cleaning and enrichment, personalized recommendations, and plug-and-play APIs. Maya.ai has been used by leading global enterprises to achieve significant results, including increased revenue, improved customer engagement, and reduced time to market.

Kanaries is an augmented analytics platform that uses AI to automate the process of data exploration and visualization. It offers a variety of features to help users quickly and easily find insights in their data, including: * **RATH:** An AI-powered engine that can automatically generate insights and recommendations based on your data. * **Graphic Walker:** A visual analytics tool that allows you to explore your data in a variety of ways, including charts, graphs, and maps. * **Data Painter:** A data cleaning and transformation tool that makes it easy to prepare your data for analysis. * **Causal Analysis:** A tool that helps you identify and understand the causal relationships between variables in your data. Kanaries is designed to be easy to use, even for users with no prior experience with data analysis. It is also highly scalable, so it can be used to analyze large datasets. Kanaries is a valuable tool for anyone who wants to quickly and easily find insights in their data. It can be used by businesses of all sizes, and it is particularly well-suited for organizations that are looking to improve their data-driven decision-making.

Raijin.ai is an AI-powered Customer Discovery and Intelligence Hub designed to help teams aggregate and extract key insights from customer conversations. It accelerates product development by prioritizing features based on customer feedback. The platform offers features like AI Thematic Analysis, Report Writing, Segmentation, and Tags to streamline qualitative research and analysis processes. Raijin.ai is ideal for user researchers, product analysts, and teams looking to integrate AI seamlessly into their workflow to create customer-centric products and data-driven marketing strategies.

Segmed's De-Id Playground is an AI tool designed for de-identification of sensitive data. The application utilizes Natural Language Processing (NLP) and language models to remove any Personal Health Information (PHI) from the provided data samples. It is a demo tool and not recommended for production use. Users can reach out to Segmed for De-Id services. The tool ensures that no data is saved or stored by Segmed.ai, providing a secure environment for data cleaning.

Airscale is a lead generation tool that helps businesses find, enrich, and export leads from various sources. It offers a range of features including lead scraping, data enrichment, AI-powered content generation, and data cleaning. Airscale integrates with popular CRMs and outbound tools, making it easy for businesses to manage their lead generation process.

Array Assistant is an AI-driven tool designed to supercharge spreadsheet productivity. It offers a wide range of features such as creating formulas, cleaning data, summarizing text, explaining problems, and designing automations. Whether you are a professional, student, or spreadsheet user, Array Assistant can help you enhance your workflow and save time. With a user-friendly interface and innovative AI technology, Array Assistant revolutionizes the way you work with spreadsheets.

nuvo is an AI-powered data import solution that offers fast, secure, and scalable data import solutions for software companies. It provides tools like nuvo Data Importer SDK and nuvo Data Pipeline to streamline manual and recurring ETL data imports, enabling users to manage data imports independently. With AI-enhanced automation, nuvo helps prepare clean data for preferred systems quickly and efficiently, reducing manual effort and improving data quality. The platform allows users to upload unlimited data in various formats, match imported data to system schemas, clean and validate data, and import clean data into target systems with just a click.

dataset.macgence is an AI-powered data analysis tool that helps users extract valuable insights from their datasets. It offers a user-friendly interface for uploading, cleaning, and analyzing data, making it suitable for both beginners and experienced data analysts. With advanced algorithms and visualization capabilities, dataset.macgence enables users to uncover patterns, trends, and correlations in their data, leading to informed decision-making. Whether you're a business professional, researcher, or student, dataset.macgence can streamline your data analysis process and enhance your data-driven strategies.

Firecrawl is an advanced web crawling and data conversion tool designed to transform any website into clean, LLM-ready markdown. It automates the collection, cleaning, and formatting of web data, streamlining the preparation process for Large Language Model (LLM) applications. Firecrawl is best suited for business websites, documentation, and help centers, offering features like crawling all accessible subpages, handling dynamic content, converting data into well-formatted markdown, and more. It is built by LLM engineers for LLM engineers, providing clean data the way users want it.

Julius AI is an advanced AI data analyst tool that allows users to analyze data with computational AI, chat with files to get expert-level insights, create sleek data visualizations, perform modeling and predictive forecasting, solve math, physics, and chemistry problems, generate polished analyses and summaries, save time by automating data work, and unlock statistical modeling without complexity. It offers features like generating visualizations, asking data questions, effortless cleaning, instant data export, creating animations, and supercharging data analysis. Julius AI is loved by over 1,200,000 users worldwide and is designed to help knowledge workers make the most out of their data.

Lettria is a no-code AI platform for text that helps users turn unstructured text data into structured knowledge. It combines the best of Large Language Models (LLMs) and symbolic AI to overcome current limitations in knowledge extraction. Lettria offers a suite of APIs for text cleaning, text mining, text classification, and prompt engineering. It also provides a Knowledge Studio for building knowledge graphs and private GPT models. Lettria is trusted by large organizations such as AP-HP and Leroy Merlin to improve their data analysis and decision-making processes.

Double is an AI tool designed to help users find and convert leads with hyper-targeted messages. It automates the process of cleaning, enriching, and qualifying leads using AI technology. By leveraging GPT, Double can research leads on the internet and provide answers to questions, saving users time and effort in manual research tasks. The platform is ideal for sales and marketing teams looking to streamline their lead generation process and improve conversion rates through personalized messaging.

Luminal is a powerful AI copilot that helps users clean, transform, and analyze spreadsheets 10x faster. It offers fast and efficient data analysis capabilities, enabling users to perform complex operations and run AI-enabled tasks using natural language. With Luminal, users can visualize data, ask complex questions, and clean and format spreadsheets effortlessly. The application supports multiple languages, provides secure data hosting with encryption, and offers simple pricing that scales with user needs.

ProX is a lm-based data refinement framework that automates the process of cleaning and improving data used in pre-training large language models. It offers better performance, domain flexibility, efficiency, and cost-effectiveness compared to traditional methods. The framework has been shown to improve model performance by over 2% and boost accuracy by up to 20% in tasks like math. ProX is designed to refine data at scale without the need for manual adjustments, making it a valuable tool for data preprocessing in natural language processing tasks.

Streamline Analyst is a cutting-edge, open-source application powered by Large Language Models (LLMs) designed to revolutionize data analysis. This Data Analysis Agent effortlessly automates tasks such as data cleaning, preprocessing, and complex operations like identifying target objects, partitioning test sets, and selecting the best-fit models based on your data. With Streamline Analyst, results visualization and evaluation become seamless. It aims to expedite the data analysis process, making it accessible to all, regardless of their expertise in data analysis. The tool is built to empower users to process data and achieve high-quality visualizations with unparalleled efficiency, and to execute high-performance modeling with the best strategies. Future enhancements include Natural Language Processing (NLP), neural networks, and object detection utilizing YOLO, broadening its capabilities to meet diverse data analysis needs.

LLMs is a Chinese large language model technology stack for practical use. It includes high-availability pre-training, SFT, and DPO preference alignment code framework. The repository covers pre-training data cleaning, high-concurrency framework, SFT dataset cleaning, data quality improvement, and security alignment work for Chinese large language models. It also provides open-source SFT dataset construction, pre-training from scratch, and various tools and frameworks for data cleaning, quality optimization, and task alignment.

Sycamore is a conversational search and analytics platform for complex unstructured data, such as documents, presentations, transcripts, embedded tables, and internal knowledge repositories. It retrieves and synthesizes high-quality answers through bringing AI to data preparation, indexing, and retrieval. Sycamore makes it easy to prepare unstructured data for search and analytics, providing a toolkit for data cleaning, information extraction, enrichment, summarization, and generation of vector embeddings that encapsulate the semantics of data. Sycamore uses your choice of generative AI models to make these operations simple and effective, and it enables quick experimentation and iteration. Additionally, Sycamore uses OpenSearch for indexing, enabling hybrid (vector + keyword) search, retrieval-augmented generation (RAG) pipelining, filtering, analytical functions, conversational memory, and other features to improve information retrieval.

LakeSoul is a cloud-native Lakehouse framework that supports scalable metadata management, ACID transactions, efficient and flexible upsert operation, schema evolution, and unified streaming & batch processing. It supports multiple computing engines like Spark, Flink, Presto, and PyTorch, and computing modes such as batch, stream, MPP, and AI. LakeSoul scales metadata management and achieves ACID control by using PostgreSQL. It provides features like automatic compaction, table lifecycle maintenance, redundant data cleaning, and permission isolation for metadata.

EDA GPT is an open-source data analysis companion that offers a comprehensive solution for structured and unstructured data analysis. It streamlines the data analysis process, empowering users to explore, visualize, and gain insights from their data. EDA GPT supports analyzing structured data in various formats like CSV, XLSX, and SQLite, generating graphs, and conducting in-depth analysis of unstructured data such as PDFs and images. It provides a user-friendly interface, powerful features, and capabilities like comparing performance with other tools, analyzing large language models, multimodal search, data cleaning, and editing. The tool is optimized for maximal parallel processing, searching internet and documents, and creating analysis reports from structured and unstructured data.

This repository is a curated list of research papers that explore the integration of Large Language Model (LLM) technology with tabular data. It aims to provide a comprehensive resource for researchers and practitioners interested in this emerging field. The repository includes papers on a wide range of topics, including table-to-text generation, table question answering, and tabular data classification. It also includes a section on related datasets and resources.

LLM Datasets is a repository containing high-quality datasets, tools, and concepts for LLM fine-tuning. It provides datasets with characteristics like accuracy, diversity, and complexity to train large language models for various tasks. The repository includes datasets for general-purpose, math & logic, code, conversation & role-play, and agent & function calling domains. It also offers guidance on creating high-quality datasets through data deduplication, data quality assessment, data exploration, and data generation techniques.

SeaLLMs are a family of language models optimized for Southeast Asian (SEA) languages. They were pre-trained from Llama-2, on a tailored publicly-available dataset, which comprises texts in Vietnamese 🇻🇳, Indonesian 🇮🇩, Thai 🇹🇭, Malay 🇲🇾, Khmer🇰🇭, Lao🇱🇦, Tagalog🇵🇭 and Burmese🇲🇲. The SeaLLM-chat underwent supervised finetuning (SFT) and specialized self-preferencing DPO using a mix of public instruction data and a small number of queries used by SEA language native speakers in natural settings, which **adapt to the local cultural norms, customs, styles and laws in these areas**. SeaLLM-13b models exhibit superior performance across a wide spectrum of linguistic tasks and assistant-style instruction-following capabilities relative to comparable open-source models. Moreover, they outperform **ChatGPT-3.5** in non-Latin languages, such as Thai, Khmer, Lao, and Burmese.

TigerBot is a cutting-edge foundation for your very own LLM, providing a world-class large model for innovative Chinese-style contributions. It offers various upgrades and features, such as search mode enhancements, support for large context lengths, and the ability to play text-based games. TigerBot is suitable for prompt-based game engine development, interactive game design, and real-time feedback for playable games.

ShortcutsBench is a project focused on collecting and analyzing workflows created in the Shortcuts app, providing a dataset of shortcut metadata, source files, and API information. It aims to study the integration of large language models with Apple devices, particularly focusing on the role of shortcuts in enhancing user experience. The project offers insights for Shortcuts users, enthusiasts, and researchers to explore, customize workflows, and study automated workflows, low-code programming, and API-based agents.

Custom AI prompt generator node for ComfyUI. With this node, you can use text generation models to generate prompts. Before using, text generation model has to be trained with prompt dataset.

DataFrame is a C++ analytical library designed for data analysis similar to libraries in Python and R. It allows you to slice, join, merge, group-by, and perform various statistical, summarization, financial, and ML algorithms on your data. DataFrame also includes a large collection of analytical algorithms in form of visitors, ranging from basic stats to more involved analysis. You can easily add your own algorithms as well. DataFrame employs extensive multithreading in almost all its APIs, making it suitable for analyzing large datasets. Key principles followed in the library include supporting any type without needing new code, avoiding pointer chasing, having all column data in contiguous memory space, minimizing space usage, avoiding data copying, using multi-threading judiciously, and not protecting the user against garbage in, garbage out.

Cleanlab helps you **clean** data and **lab** els by automatically detecting issues in a ML dataset. To facilitate **machine learning with messy, real-world data** , this data-centric AI package uses your _existing_ models to estimate dataset problems that can be fixed to train even _better_ models.

JSON Repair is a toolkit designed to address JSON anomalies that can arise from Large Language Models (LLMs). It offers a comprehensive solution for repairing JSON strings, ensuring accuracy and reliability in your data processing. With its user-friendly interface and extensive capabilities, JSON Repair empowers developers to seamlessly integrate JSON repair into their workflows.

ML Contests is a platform that provides a sortable list of public machine learning/data science/AI contests, viewable on mlcontests.com. Users can submit pull requests for any changes or additions to the competitions list by editing the competitions.json file on the GitHub repository. The platform requires mandatory fields such as competition name, URL, type of ML, deadline for submissions, prize information, platform running the competition, and sponsorship details. Optional fields include conference affiliation, conference year, competition launch date, registration deadline, additional URLs, and tags relevant to the challenge type. The platform is transitioning towards assigning multiple tags to competitions for better categorization and searchability.

This repository contains the code for LongRAG, a framework that enhances retrieval-augmented generation with long-context LLMs. LongRAG introduces a 'long retriever' and a 'long reader' to improve performance by using a 4K-token retrieval unit, offering insights into combining RAG with long-context LLMs. The repo provides instructions for installation, quick start, corpus preparation, long retriever, and long reader.

I clean and explain data.

Clean and structure your raw data with automatic file output for your Custom GPT knowledge.

Fix mismatched entries in your data

As Lt. Cmdr. Data, I explore human nature and emotions.

A chatbot expert in business data analysis and optimization.

A friendly data science coach offering practical, useful, and accurate advice.

Football Manager Data Analyst

Assistant for migrating data from Access to SQLite databases.

I create React apps with Fireproof.

I suggest data science projects and give tips on request.

A specialist in DataOps and Data Observability, aiding in data management and monitoring.

A serious interviewer

Salam mən Alas Academy-nin Data Analitika üzrə Süni İntellekt mentoruyam. Mənə istənilən sualı verə bilərsiniz :)

Your interactive data analysis expert

Hemingway-esque precision in narrative business writing

Data trend analysis expert in cannabis, also skilled in image and data analysis, document generation, and web search.

I'm the data, image, or document you uploaded, talking to you.

A Data Science interviewer

Guides data structure design with tailored, step-by-step insights.

Expert in data extraction and context-driven analysis. Can read most filetypes including PDFS, XLSX, Word, TXT, CSV, EML, Etc.