Best AI tools for< Privacy Engineer >

Privado AI is a privacy engineering tool that bridges the gap between privacy compliance and software development. It automates personal data visibility and privacy governance, helping organizations to identify privacy risks, track data flows, and ensure compliance with regulations such as CPRA, MHMDA, FTC, and GDPR. The tool provides real-time visibility into how personal data is collected, used, shared, and stored by scanning the code of websites, user-facing applications, and backend systems. Privado offers features like Privacy Code Scanning, programmatic privacy governance, automated GDPR RoPA reports, risk identification without assessments, and developer-friendly privacy guidance.

OpenVoiceOS is a community-driven, open-source voice AI platform for creating custom voice-controlled interfaces across devices with NLP, a customizable UI, and a focus on privacy and security. OpenVoiceOS is designed to provide users with a seamless and intuitive voice interface for controlling their smart home devices, playing music, setting reminders, and much more. OpenVoiceOS is open to all developers and contributors wanting to support a specific device or a platform. OpenVoiceOS is the platform to throw your ideas at if you have an experimental feature you want users to experience before landing them into any of the Linux-based open-source voice assistant projects upstream.

Storia AI is an AI tool designed to assist software engineering teams in understanding and generating code. It provides a Perplexity-like chat experience where users can interact with an AI expert that has access to the latest versions of open-source software. The tool aims to improve code understanding and generation by providing responses backed with links to implementations, API references, GitHub issues, and more. Storia AI is developed by a team of natural language processing researchers from Google and Amazon Alexa, with a mission to build the most reliable AI pair programmer for engineering teams.

Omnifact is a privacy-first generative AI platform designed for businesses. It offers secure, enterprise-grade AI solutions to boost productivity, streamline knowledge management, and drive innovation while prioritizing data security and privacy. The platform allows users to access generative AI while maintaining control over their data, making it a valuable tool for workplace environments.

Intuition Machines is a leading provider of Privacy-Preserving AI/ML platforms and research solutions. They offer products and services that cater to category leaders worldwide, focusing on AI/ML research, security, and risk analysis. Their innovative solutions help enterprises prepare for the future by leveraging AI for a wide range of problems. With a strong emphasis on privacy and security, Intuition Machines is at the forefront of developing cutting-edge AI technologies.

Sherpa.ai is a Federated Learning Platform that enables data collaborations without sharing data. It allows organizations to build and train models with sensitive data from various sources while preserving privacy and complying with regulations. The platform offers enterprise-grade privacy-compliant solutions for improving AI models and fostering collaborations in a secure manner. Sherpa.ai is trusted by global organizations to maximize the value of data and AI, improve results, and ensure regulatory compliance.

Snorkell.ai is an automated documentation generation tool that uses AI to create and update docstrings for GitHub projects. It supports multiple programming languages, including Python, JavaScript, TypeScript, Java, and Kotlin. Snorkell.ai integrates with GitHub and automatically generates docstrings whenever a pull request is merged, ensuring that documentation is always up-to-date with the codebase. It helps developers save time and effort by automating the documentation process, leading to improved code quality and reduced onboarding time.

Jan is an open-source ChatGPT-alternative that runs 100% offline. It allows users to chat with AI, download and run powerful models, connect to cloud AIs, set up a local API server, and chat with files. Highly customizable, Jan also offers features like creating personalized AI assistants, memory, and extensions. The application prioritizes local-first AI, user-owned data, and full customization, making it a versatile tool for AI enthusiasts and developers.

Granica AI is a Training Data Platform designed to make data safe for use with AI while keeping it cost-efficient. It offers state-of-the-art accuracy, cost-efficient data optimization, data visibility insights, and cloud cost savings. The platform helps in protecting data privacy, optimizing data costs, and gaining data visibility for AI teams to achieve big results while minimizing privacy risk.

SENEX is an AI-powered Blockchain company that aims to create the world's finest Intelligent Chain. It combines Artificial Intelligence with Blockchain technology to provide a privacy-compliant and secure platform for digital users and businesses. SENEX's Intelligent Chain distributes data processing across the network while keeping information private and secure, giving users the benefits of anonymity. The company's AI-powered solutions address various challenges and problems in industries such as healthcare, finance, transportation, and education.

Ocean Protocol is a tokenized AI and data platform that enables users to monetize AI models and data while maintaining privacy. It offers tools like Predictoor for running AI-powered prediction bots, Ocean Nodes for enhancing AI capabilities, and features like Data NFTs and Datatokens for protecting intellectual property and controlling data access. The platform focuses on decentralized AI, privacy, and modular architecture to empower users in the AI and data science domains.

hCaptcha Enterprise is a comprehensive AI-powered security platform designed to detect and deter human and automated threats, including bot detection, fraud protection, and account defense. It offers highly accurate bot detection, fraud protection without false positives, and account takeover detection. The platform also provides privacy-preserving abuse detection with zero personally identifiable information (PII) required. hCaptcha Enterprise is trusted by category leaders in various industries worldwide, offering universal support, comprehensive security, and compliance with global privacy standards like GDPR, CCPA, and HIPAA.

Elessar is an AI-powered platform designed to enhance engineering productivity by providing automatic documentation, reporting, and visibility for development teams. It seamlessly integrates with existing ecosystems, connects codebases, communications, and documentation tools, and offers features like AI-generated pull request changelogs, Notion documentation, Slack bot integration, VS Code extension, and issue tracking. Elessar ensures data privacy and security by following SOC II compliant policies and infrastructures, and it does not use company data for training or storage.

Sherpa.ai is a SaaS platform that enables data collaborations without sharing data. It allows businesses to build and train models with sensitive data from different parties, without compromising privacy or regulatory compliance. Sherpa.ai's Federated Learning platform is used in various industries, including healthcare, financial services, and manufacturing, to improve AI models, accelerate research, and optimize operations.

Text Generator is an AI-powered text generation tool that provides users with accurate, fast, and flexible text generation capabilities. With its advanced large neural networks, Text Generator offers a cost-effective solution for various text-related tasks. The tool's intuitive 'prompt engineering' feature allows users to guide text creation by providing keywords and natural questions, making it adaptable for tasks such as classification and sentiment analysis. Text Generator ensures industry-leading security by never storing personal information on its servers. The tool's continuous training ensures that its AI remains up-to-date with the latest events. Additionally, Text Generator offers a range of features including speech-to-text API, text-to-speech API, and code generation, supporting multiple spoken languages and programming languages. With its one-line migration from OpenAI's text generation hub and a shared embedding for multiple spoken languages, images, and code, Text Generator empowers users with powerful search, fingerprinting, tracking, and classification capabilities.

CodeGPT is a comprehensive AI-powered platform that provides a suite of tools and services designed to enhance business operations and streamline coding processes. It offers a range of AI assistants, known as Copilots, Agents, or GPTs, that can be customized and integrated into various applications. These AI assistants can automate tasks, generate content, provide insights, and assist with coding, among other functions. CodeGPT also features a marketplace where users can explore and discover a wide selection of pre-built AI assistants tailored to specific tasks and industries. Additionally, the platform offers an API for advanced users to integrate AI capabilities into their own custom projects. With its focus on customization, flexibility, and ease of use, CodeGPT empowers businesses and individuals to leverage AI technology to improve efficiency, productivity, and innovation.

The Human-Centred Artificial Intelligence Lab (Holzinger Group) is a research group focused on developing AI solutions that are explainable, trustworthy, and aligned with human values, ethical principles, and legal requirements. The lab works on projects related to machine learning, digital pathology, interactive machine learning, and more. Their mission is to combine human and computer intelligence to address pressing problems in various domains such as forestry, health informatics, and cyber-physical systems. The lab emphasizes the importance of explainable AI, human-in-the-loop interactions, and the synergy between human and machine intelligence.

CustomGPT.ai is a no-code platform that allows businesses to create their own custom ChatGPT chatbots using their own business content. The platform is powered by GPT-4 and provides a range of features, including the ability to upload documents, integrate with other systems, and customize the chatbot's appearance and behavior. CustomGPT.ai is designed to help businesses improve customer service, employee efficiency, and knowledge management.

AI SuitUp is an AI application that offers a professional headshot generator service. It allows users to upload photos from their phone and receive high-quality AI-generated headshots. The application uses the latest AI model (SDXL) to produce hyper-realistic images indistinguishable from real photos. With options for different styles and resolutions, users can create professional headshots quickly and easily without the need for expensive photo shoots or specialized equipment. The service prioritizes privacy by deleting input data after 30 days and not storing AI models trained with user pictures.

Adaptify is a platform that uses AI to help businesses with their SEO and customer support. The Adaptify SEO platform helps businesses rank higher on Google, and the Adaptify AI Chatbot can be trained on a business's own data and integrated into their customer support system.

The Awesome-LM-SSP repository is a collection of resources related to the trustworthiness of large models (LMs) across multiple dimensions, with a special focus on multi-modal LMs. It includes papers, surveys, toolkits, competitions, and leaderboards. The resources are categorized into three main dimensions: safety, security, and privacy. Within each dimension, there are several subcategories. For example, the safety dimension includes subcategories such as jailbreak, alignment, deepfake, ethics, fairness, hallucination, prompt injection, and toxicity. The security dimension includes subcategories such as adversarial examples, poisoning, and system security. The privacy dimension includes subcategories such as contamination, copyright, data reconstruction, membership inference attacks, model extraction, privacy-preserving computation, and unlearning.

TPI-LLM (Tensor Parallelism Inference for Large Language Models) is a system designed to bring LLM functions to low-resource edge devices, addressing privacy concerns by enabling LLM inference on edge devices with limited resources. It leverages multiple edge devices for inference through tensor parallelism and a sliding window memory scheduler to minimize memory usage. TPI-LLM demonstrates significant improvements in TTFT and token latency compared to other models, and plans to support infinitely large models with low token latency in the future.

PyRIT is an open access automation framework designed to empower security professionals and ML engineers to red team foundation models and their applications. It automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft). The goal is to allow researchers to have a baseline of how well their model and entire inference pipeline is doing against different harm categories and to be able to compare that baseline to future iterations of their model. This allows them to have empirical data on how well their model is doing today, and detect any degradation of performance based on future improvements.

Awesome MLOps is a curated list of tools related to Machine Learning Operations, covering areas such as AutoML, CI/CD for Machine Learning, Data Cataloging, Data Enrichment, Data Exploration, Data Management, Data Processing, Data Validation, Data Visualization, Drift Detection, Feature Engineering, Feature Store, Hyperparameter Tuning, Knowledge Sharing, Machine Learning Platforms, Model Fairness and Privacy, Model Interpretability, Model Lifecycle, Model Serving, Model Testing & Validation, Optimization Tools, Simplification Tools, Visual Analysis and Debugging, and Workflow Tools. The repository provides a comprehensive collection of tools and resources for individuals and teams working in the field of MLOps.

Academic_LLM_Sec_Papers is a curated collection of academic papers related to LLM Security Application. The repository includes papers sorted by conference name and published year, covering topics such as large language models for blockchain security, software engineering, machine learning, and more. Developers and researchers are welcome to contribute additional published papers to the list. The repository also provides information on listed conferences and journals related to security, networking, software engineering, and cryptography. The papers cover a wide range of topics including privacy risks, ethical concerns, vulnerabilities, threat modeling, code analysis, fuzzing, and more.

The OWASP AI Exchange and OWASP AI security and privacy guide are initiatives to collect and present the state of the art on AI threats, controls, security, and privacy through community collaboration. The AI Exchange is a living set of documents that collect AI threats and controls from collaboration between experts worldwide. The AI Security and Privacy Guide project has a security part that links directly to the AI Exchange, and a privacy part.

AI-Security-and-Privacy-Events is a curated list of academic events focusing on AI security and privacy. It includes seminars, conferences, workshops, tutorials, special sessions, and covers various topics such as NLP & LLM Security, Privacy and Security in ML, Machine Learning Security, AI System with Confidential Computing, Adversarial Machine Learning, and more.

**Prompt flow** is a suite of development tools designed to streamline the end-to-end development cycle of LLM-based AI applications, from ideation, prototyping, testing, evaluation to production deployment and monitoring. It makes prompt engineering much easier and enables you to build LLM apps with production quality.

An Open-Source Engineering Guide for Prompt-in-context-learning from EgoAlpha Lab. 📝 Papers | ⚡️ Playground | 🛠 Prompt Engineering | 🌍 ChatGPT Prompt | ⛳ LLMs Usage Guide > **⭐️ Shining ⭐️:** This is fresh, daily-updated resources for in-context learning and prompt engineering. As Artificial General Intelligence (AGI) is approaching, let’s take action and become a super learner so as to position ourselves at the forefront of this exciting era and strive for personal and professional greatness. The resources include: _🎉Papers🎉_: The latest papers about _In-Context Learning_ , _Prompt Engineering_ , _Agent_ , and _Foundation Models_. _🎉Playground🎉_: Large language models（LLMs）that enable prompt experimentation. _🎉Prompt Engineering🎉_: Prompt techniques for leveraging large language models. _🎉ChatGPT Prompt🎉_: Prompt examples that can be applied in our work and daily lives. _🎉LLMs Usage Guide🎉_: The method for quickly getting started with large language models by using LangChain. In the future, there will likely be two types of people on Earth (perhaps even on Mars, but that's a question for Musk): - Those who enhance their abilities through the use of AIGC; - Those whose jobs are replaced by AI automation. 💎EgoAlpha: Hello! human👤, are you ready?

last_layer is a security library designed to protect LLM applications from prompt injection attacks, jailbreaks, and exploits. It acts as a robust filtering layer to scrutinize prompts before they are processed by LLMs, ensuring that only safe and appropriate content is allowed through. The tool offers ultra-fast scanning with low latency, privacy-focused operation without tracking or network calls, compatibility with serverless platforms, advanced threat detection mechanisms, and regular updates to adapt to evolving security challenges. It significantly reduces the risk of prompt-based attacks and exploits but cannot guarantee complete protection against all possible threats.

Thread is an AI-powered Jupyter alternative that integrates an AI copilot into your editing experience. It offers a familiar Jupyter Notebook editing experience with features like natural language code edits, generating cells to answer questions, context-aware chat sidebar, and automatic error explanations or fixes. The tool aims to enhance code editing and data exploration by providing a more interactive and intuitive experience for users. Thread can be used for free with Ollama or your own API key, and it runs locally for convenience and privacy.

Hoarder is a self-hostable bookmark manager with a focus on privacy and customization. It features automatic link previews, full-text search, AI-based tagging, and a variety of import and export options. Hoarder is designed to be easy to use and extensible, with a plugin system that allows users to add their own features and integrations.

AI Agents Framework is a .NET framework built on Semantic Kernel and Orleans for creating and hosting event-driven AI Agents. It is currently in an experimental phase and not recommended for production use. The framework aims to automate requirements engineering, planning, and coding processes using event-driven agents.

The LLM course is divided into three parts: 1. 🧩 **LLM Fundamentals** covers essential knowledge about mathematics, Python, and neural networks. 2. 🧑‍🔬 **The LLM Scientist** focuses on building the best possible LLMs using the latest techniques. 3. 👷 **The LLM Engineer** focuses on creating LLM-based applications and deploying them. For an interactive version of this course, I created two **LLM assistants** that will answer questions and test your knowledge in a personalized way: * 🤗 **HuggingChat Assistant**: Free version using Mixtral-8x7B. * 🤖 **ChatGPT Assistant**: Requires a premium account. ## 📝 Notebooks A list of notebooks and articles related to large language models. ### Tools | Notebook | Description | Notebook | |----------|-------------|----------| | 🧐 LLM AutoEval | Automatically evaluate your LLMs using RunPod |  | | 🥱 LazyMergekit | Easily merge models using MergeKit in one click. |  | | 🦎 LazyAxolotl | Fine-tune models in the cloud using Axolotl in one click. |  | | ⚡ AutoQuant | Quantize LLMs in GGUF, GPTQ, EXL2, AWQ, and HQQ formats in one click. |  | | 🌳 Model Family Tree | Visualize the family tree of merged models. |  | | 🚀 ZeroSpace | Automatically create a Gradio chat interface using a free ZeroGPU. |  |

InterpretML is an open-source package that incorporates state-of-the-art machine learning interpretability techniques under one roof. With this package, you can train interpretable glassbox models and explain blackbox systems. InterpretML helps you understand your model's global behavior, or understand the reasons behind individual predictions. Interpretability is essential for: - Model debugging - Why did my model make this mistake? - Feature Engineering - How can I improve my model? - Detecting fairness issues - Does my model discriminate? - Human-AI cooperation - How can I understand and trust the model's decisions? - Regulatory compliance - Does my model satisfy legal requirements? - High-risk applications - Healthcare, finance, judicial, ...

The ai-cli-lib is a library designed to enhance interactive command-line editing programs by integrating with GPT large language model servers. It allows users to obtain AI help from servers like Anthropic's or OpenAI's, or a llama.cpp server. The library acts as a command line copilot, providing natural language prompts and responses to enhance user experience and productivity. It supports various platforms such as Debian GNU/Linux, macOS, and Cygwin, and requires specific packages for installation and operation. Users can configure the library to activate during shell startup and interact with command-line programs like bash, mysql, psql, gdb, sqlite3, and bc. Additionally, the library provides options for configuring API keys, setting up llama.cpp servers, and ensuring data privacy by managing context settings.

mllm is a fast and lightweight multimodal LLM inference engine for mobile and edge devices. It is a Plain C/C++ implementation without dependencies, optimized for multimodal LLMs like fuyu-8B, and supports ARM NEON and x86 AVX2. The engine offers 4-bit and 6-bit integer quantization, making it suitable for intelligent personal agents, text-based image searching/retrieval, screen VQA, and various mobile applications without compromising user privacy.

Notes on AI state of the art, with a focus on generative and large language models. These are the "raw materials" for the https://lspace.swyx.io/ newsletter. This repo used to be called https://github.com/sw-yx/prompt-eng, but was renamed because Prompt Engineering is Overhyped. This is now an AI Engineering notes repo.

LafTools is a privacy-first, self-hosted, fully open source toolbox designed for programmers. It offers a wide range of tools, including code generation, translation, encryption, compression, data analysis, and more. LafTools is highly integrated with a productive UI and supports full GPT-alike functionality. It is available as Docker images and portable edition, with desktop edition support planned for the future.

Specializes in AI-evasive and human-evasive pattern design.

Expert on LLM security risks, providing detailed, accurate advice.

Expert in guiding GPT creation with a focus on privacy and security.

Public transport authorities collect data on travel patterns, fares, and sometimes personal details of passengers, necessitating strong privacy measures.

A friendly cybersecurity coach offering practical privacy tips.

Explains and teaches zero-knowledge cryptography.

Use me to PROTECT ⚠️ your Custom Instructions ! Type Spell 👉 "Protect Me"

Guide on AI implementation for secure data, with a focus on best practices and tools.

Abogado especializado en gestión de datos

Expert in recommending top proxy services: Bright Data, SOAX, Smartproxy.

I explain Microsoft Product Terms.

Encrypts text based on pre-defined encryption table

Expert in Polygon ID, aiding in code writing and project building with ZK Proofs.

A guide to finding and understanding torrent magnet links, with a focus on legal and safe usage.

Security-focused GPT offering advice on personal and online safety.

I'm your personal cybersecurity advisor, here to help you stay safe online.

I'm GPTGuardian VPN, enhancing your GPT experience with top security and connectivity.

GRC Consultant focused on privacy governance, implementation, and risk management.

Privacy expert generating tailored privacy policies. Note: this is not legal advice!

Ensures safe management of sensitive data in an organization.