Best AI tools for< protect ai models from attacks >
20 - AI tool Sites
Rebuff AI
Rebuff AI is a self-hardening prompt injection detector that gets stronger as it is attacked. It is designed to protect AI models from malicious inputs and to help developers build more robust and secure AI applications.
Robust Intelligence
Robust Intelligence is an end-to-end solution for securing AI applications. It automates the evaluation of AI models, data, and files for security and safety vulnerabilities and provides guardrails for AI applications in production against integrity, privacy, abuse, and availability violations. Robust Intelligence helps enterprises remove AI security blockers, save time and resources, meet AI safety and security standards, align AI security across stakeholders, and protect against evolving threats.
Lakera
Lakera is the world's most advanced AI security platform designed to protect organizations from AI threats. It offers solutions for prompt injection detection, unsafe content identification, PII and data loss prevention, data poisoning prevention, and insecure LLM plugin design. Lakera is recognized for setting global AI security standards and is trusted by leading enterprises, foundation model providers, and startups. The platform is powered by a proprietary AI threat database and aligns with global AI security frameworks.
Protect AI
Protect AI is a comprehensive platform designed to secure AI systems by providing visibility and manageability to detect and mitigate unique AI security threats. The platform empowers organizations to embrace a security-first approach to AI, offering solutions for AI Security Posture Management, ML model security enforcement, AI/ML supply chain vulnerability database, LLM security monitoring, and observability. Protect AI aims to safeguard AI applications and ML systems from potential vulnerabilities, enabling users to build, adopt, and deploy AI models confidently and at scale.
Giskard
Giskard is a testing platform for AI models that helps protect companies against biases, performance, and security issues in AI models. It offers automated detection of performance, bias, and security issues, unifies AI testing practices, and ensures compliance with the EU AI Act. Giskard provides an open-source Python library for data scientists and a collaborative hub for enterprise AI teams to control all AI risks in one place and automate compliance. The platform aims to mitigate AI risks with a holistic approach to AI quality, security, and compliance.
Carnegie Mellon University School of Computer Science
Carnegie Mellon University's School of Computer Science (SCS) is a world-renowned institution dedicated to advancing the field of computer science and training the next generation of innovators. With a rich history of groundbreaking research and a commitment to excellence in education, SCS offers a comprehensive range of programs, from undergraduate to doctoral levels, covering various specializations within computer science. The school's faculty are leading experts in their respective fields, actively engaged in cutting-edge research and collaborating with industry partners to solve real-world problems. SCS graduates are highly sought after by top companies and organizations worldwide, recognized for their exceptional skills and ability to drive innovation.
AI Elections Accord
AI Elections Accord is a tech accord aimed at combating the deceptive use of AI in the 2024 elections. It sets expectations for managing risks related to deceptive AI election content on large-scale platforms. The accord focuses on prevention, provenance, detection, responsive protection, evaluation, public awareness, and resilience to safeguard the democratic process. It emphasizes collective efforts, education, and the development of defensive tools to protect public debate and build societal resilience against deceptive AI content.
Spin Rewriter AI
Spin Rewriter AI is an article rewriter that uses artificial intelligence to generate unique, human-quality content. It is the only rewriter that uses the power of Large Language Models (LLMs) to extract the meaning of your articles on an entirely different level. This means that Spin Rewriter AI can pinpoint the meaning of every word in your article and how each word relates to every other word in its context. This allows Spin Rewriter AI to create human-quality readable articles with ZERO machine-generated footprint at a push of a button.
Segmed's De-Id Playground
Segmed's De-Id Playground is a demo tool that uses Large Language Models (LLMs) to remove Protected Health Information (PHI) from text data. It is not intended for use in production environments where real PHI data needs to be de-identified. If you are interested in using De-Id as a service, you can contact Segmed at [email protected].
Prompt Security
Prompt Security is a platform that secures all uses of Generative AI in the organization: from tools used by your employees to your customer-facing apps.
Intellecta
Intellecta is an AI-powered customer experience platform that helps businesses improve their response time, ticket resolution, ad performance, and NPS. It uses GPT models to respond to customer inquiries across various platforms, such as chat, social media, and email. Intellecta also enhances social media presence by automatically liking, replying to comments and DMs, and moderating content to protect brand reputation. Additionally, it provides insights extraction from social networks, email, and chat to help businesses understand customer interactions and identify trends.
SafeSpeak
SafeSpeak is an AI-powered mobile security solution that protects users from phone scams, SIM swaps, and other malicious activities. It uses advanced machine learning and large language models to detect and block threats in real-time. SafeSpeak offers a range of features for both personal and business use, including malicious behavior detection, community immunity, SIM swap detection, weekly and monthly reporting, quick and easy setup, admin dashboard, extensible API, custom reporting, and visibility into tactics, techniques, and procedures (TTPs).
AiFA Labs
AiFA Labs is an AI platform that offers a comprehensive suite of generative AI products and services for enterprises. The platform enables businesses to create, manage, and deploy generative AI applications responsibly and at scale. With a focus on governance, compliance, and security, AiFA Labs provides a range of AI tools to streamline business operations, enhance productivity, and drive innovation. From AI code assistance to chat interfaces and data synthesis, AiFA Labs empowers organizations to leverage the power of AI for various use cases across different industries.
Invicta AI
Invicta AI is a provider of artificial intelligence solutions for the enterprise. The company's flagship product is a platform that enables businesses to build and deploy AI models without the need for specialized expertise. Invicta AI's platform provides a range of tools and services to help businesses with every step of the AI development process, from data preparation and model training to deployment and monitoring.
Dust
Dust is a customizable and secure AI assistant platform that helps businesses amplify their team's potential. It allows users to deploy the best Large Language Models to their company, connect Dust to their team's data, and empower their teams with assistants tailored to their specific needs. Dust is exceptionally modular and adaptable, tailoring to unique requirements and continuously evolving to meet changing needs. It supports multiple sources of data and models, including proprietary and open-source models from OpenAI, Anthropic, and Mistral. Dust also helps businesses identify their most creative and driven team members and share their experience with AI throughout the company. It promotes collaboration with shared conversations, @mentions in discussions, and Slackbot integration. Dust prioritizes security and data privacy, ensuring that data remains private and that enterprise-grade security measures are in place to manage data access policies.
Creatus.AI
Creatus.AI is an AI-powered platform that provides a range of tools and services to help businesses boost productivity and transform their workplaces. With over 35 AI models and tools, and 90+ business integrations, Creatus.AI offers a comprehensive suite of solutions for businesses of all sizes. The platform's AI-native workspace and autonomous team members enable businesses to automate tasks, improve efficiency, and gain valuable insights from data. Creatus.AI also specializes in custom AI integrations and solutions, helping businesses to tailor AI solutions to their specific needs.
Razzle
Razzle is a messaging tool designed to help you stay focused and get more done. It is minimal and distraction-free, with a focus mode that is on by default. Razzle also has a quick and easy search function from your command bar, and it comes with 2 embedded AI models that can help you with writing marketing copy or data extraction. Razzle also has first party support for Zoom and Google Meets, so you can easily call your colleagues with one click.
Echobase
Echobase is an AI tool designed to easily integrate AI into businesses by allowing teams to query, create, and analyze data from their files. It offers advanced AI models tailored to specific business needs, enabling the creation of AI agents capable of tasks like basic Q&A, data analysis, and content creation. Echobase provides a centralized workspace for uploading and querying organizational knowledge bases in real-time, along with features for collaboration and role management. The tool prioritizes data security through robust encryption, API usage, and user-controlled data access.
Voam
Voam is a productive AI platform that helps you to automate your tasks and improve your productivity. With Voam, you can create custom AI models to automate any task, from simple data entry to complex decision-making. Voam is easy to use and requires no coding experience. You can create an AI model in minutes and start automating your tasks right away.
Razzle
Razzle is a messaging tool designed to help you stay focused and get more done. It is minimal and distraction-free, with a focus mode that is on by default. Razzle also has a quick and easy search function from your command bar, and it comes with 2 embedded AI models that can help you with writing marketing copy or data extraction. Razzle also has first party support for Zoom and Google Meets, so you can easily call your colleagues with one click.
20 - Open Source AI Tools
Academic_LLM_Sec_Papers
Academic_LLM_Sec_Papers is a curated collection of academic papers related to LLM Security Application. The repository includes papers sorted by conference name and published year, covering topics such as large language models for blockchain security, software engineering, machine learning, and more. Developers and researchers are welcome to contribute additional published papers to the list. The repository also provides information on listed conferences and journals related to security, networking, software engineering, and cryptography. The papers cover a wide range of topics including privacy risks, ethical concerns, vulnerabilities, threat modeling, code analysis, fuzzing, and more.
awesome-MLSecOps
Awesome MLSecOps is a curated list of open-source tools, resources, and tutorials for MLSecOps (Machine Learning Security Operations). It includes a wide range of security tools and libraries for protecting machine learning models against adversarial attacks, as well as resources for AI security, data anonymization, model security, and more. The repository aims to provide a comprehensive collection of tools and information to help users secure their machine learning systems and infrastructure.
awesome-llm-unlearning
This repository tracks the latest research on machine unlearning in large language models (LLMs). It offers a comprehensive list of papers, datasets, and resources relevant to the topic.
hackingBuddyGPT
hackingBuddyGPT is a framework for testing LLM-based agents for security testing. It aims to create common ground truth by creating common security testbeds and benchmarks, evaluating multiple LLMs and techniques against those, and publishing prototypes and findings as open-source/open-access reports. The initial focus is on evaluating the efficiency of LLMs for Linux privilege escalation attacks, but the framework is being expanded to evaluate the use of LLMs for web penetration-testing and web API testing. hackingBuddyGPT is released as open-source to level the playing field for blue teams against APTs that have access to more sophisticated resources.
awesome-gpt-security
Awesome GPT + Security is a curated list of awesome security tools, experimental case or other interesting things with LLM or GPT. It includes tools for integrated security, auditing, reconnaissance, offensive security, detecting security issues, preventing security breaches, social engineering, reverse engineering, investigating security incidents, fixing security vulnerabilities, assessing security posture, and more. The list also includes experimental cases, academic research, blogs, and fun projects related to GPT security. Additionally, it provides resources on GPT security standards, bypassing security policies, bug bounty programs, cracking GPT APIs, and plugin security.
awesome-generative-ai
A curated list of Generative AI projects, tools, artworks, and models
nlp-llms-resources
The 'nlp-llms-resources' repository is a comprehensive resource list for Natural Language Processing (NLP) and Large Language Models (LLMs). It covers a wide range of topics including traditional NLP datasets, data acquisition, libraries for NLP, neural networks, sentiment analysis, optical character recognition, information extraction, semantics, topic modeling, multilingual NLP, domain-specific LLMs, vector databases, ethics, costing, books, courses, surveys, aggregators, newsletters, papers, conferences, and societies. The repository provides valuable information and resources for individuals interested in NLP and LLMs.
ai-notes
Notes on AI state of the art, with a focus on generative and large language models. These are the "raw materials" for the https://lspace.swyx.io/ newsletter. This repo used to be called https://github.com/sw-yx/prompt-eng, but was renamed because Prompt Engineering is Overhyped. This is now an AI Engineering notes repo.
AiTreasureBox
AiTreasureBox is a versatile AI tool that provides a collection of pre-trained models and algorithms for various machine learning tasks. It simplifies the process of implementing AI solutions by offering ready-to-use components that can be easily integrated into projects. With AiTreasureBox, users can quickly prototype and deploy AI applications without the need for extensive knowledge in machine learning or deep learning. The tool covers a wide range of tasks such as image classification, text generation, sentiment analysis, object detection, and more. It is designed to be user-friendly and accessible to both beginners and experienced developers, making AI development more efficient and accessible to a wider audience.
awesome-generative-ai-guide
This repository serves as a comprehensive hub for updates on generative AI research, interview materials, notebooks, and more. It includes monthly best GenAI papers list, interview resources, free courses, and code repositories/notebooks for developing generative AI applications. The repository is regularly updated with the latest additions to keep users informed and engaged in the field of generative AI.
llms-tools
The 'llms-tools' repository is a comprehensive collection of AI tools, open-source projects, and research related to Large Language Models (LLMs) and Chatbots. It covers a wide range of topics such as AI in various domains, open-source models, chats & assistants, visual language models, evaluation tools, libraries, devices, income models, text-to-image, computer vision, audio & speech, code & math, games, robotics, typography, bio & med, military, climate, finance, and presentation. The repository provides valuable resources for researchers, developers, and enthusiasts interested in exploring the capabilities of LLMs and related technologies.
Awesome-LLM-Survey
This repository, Awesome-LLM-Survey, serves as a comprehensive collection of surveys related to Large Language Models (LLM). It covers various aspects of LLM, including instruction tuning, human alignment, LLM agents, hallucination, multi-modal capabilities, and more. Researchers are encouraged to contribute by updating information on their papers to benefit the LLM survey community.
20 - OpenAI Gpts
Prompt Injection Detector
GPT used to classify prompts as valid inputs or injection attempts. Json output.
fox8 botnet paper
A helpful guide for understanding the paper "Anatomy of an AI-powered malicious social botnet"
AI Implementation Guide for Sensitive/Private Data
Guide on AI implementation for secure data, with a focus on best practices and tools.
Guardian AI VPN
I'm GPTGuardian VPN, enhancing your GPT experience with top security and connectivity.
ethicallyHackingspace (eHs)® METEOR™ STORM™
Multiple Environment Threat Evaluation of Resources (METEOR)™ Space Threats and Operational Risks to Mission (STORM)™ non-profit product AI co-pilot
Master of Business Incorporation in the USA
Expert in answering Business Formation and Structure Legal queries for small businesses in the USA (Powered by LegalNow, ai.legalnow.xyz)
Safari Master: Interactive Adventures
An immersive safari adventure game that takes players on a journey through the heart of Africa's wilderness. Explore diverse ecosystems, encounter a wide range of wildlife, and learn about conservation efforts while engaging in exciting safari challenges. Another AI Game by Dave Lalande
Aqua Explorer: Underwater Archaeology
Dive into the depths of the ocean in 'Aqua Explorer: Underwater Archaeology', a game that blends the excitement of underwater exploration with the discovery of ancient civilizations and marine life. Uncover hidden artifacts, learn about historical underwater. Another AI Game by Dave Lalande
GPT Auth™
This is a demonstration of GPT Auth™, an authentication system designed to protect your customized GPT.