Best AI tools for< Infer Models >
20 - AI tool Sites

Cerebras API
The Cerebras API is a high-speed inferencing solution for AI model inference powered by Cerebras Wafer-Scale Engines and CS-3 systems. It offers developers access to two models: Meta’s Llama 3.1 8B and 70B models, which are instruction-tuned and suitable for conversational applications. The API provides low-latency solutions and invites developers to explore new possibilities in AI development.

BeautifulSouls.ai
BeautifulSouls.ai is an AI-powered platform that offers spiritual guidance and support to individuals seeking clarity and insight. Users can have conversations with AI-powered spiritual advisors, receive tarot readings, and more. The platform ensures privacy and affordability, making it accessible for anyone looking for peace of mind. BeautifulSouls.ai aims to provide a kind and supportive environment without bias or judgment, allowing users to explore their inner selves and uncover hidden truths with the help of AI models known as 'beautiful souls.'

Fe/male Switch
Fe/male Switch is a women-first startup game that offers a browser-based startup simulator experience. Players can assemble a team, create a startup with an investor and mentor, gain startup experience, win prizes, and get funded. The game aims to help individuals build their first startup, validate ideas, and overcome startup challenges. It provides a platform for aspiring entrepreneurs to test their entrepreneurial potential and learn essential business skills in a risk-free environment. Fe/male Switch features a unique Gamepreneurship methodology, AI co-founder support, and educational resources to guide players through the startup building process.

AI Diary
AI Diary is a web-based platform that combines the traditional concept of a personal diary with the power of artificial intelligence (AI). It offers a unique and interactive experience where users can engage in conversations with an AI model, express their thoughts and emotions, and receive personalized insights and guidance. AI Diary is designed to enhance self-reflection, promote emotional well-being, and support personal growth. With its user-friendly interface and advanced AI capabilities, AI Diary empowers users to explore their inner selves, set and achieve goals, and unleash their creativity.

OddBooks
OddBooks is an AI tool that revolutionizes the creation of scenarios for book-based derivative works. It turns books into scenarios and scenarios into multiple contents, such as AudioBooks, Webtoon, Animation, and Movies. The tool extracts character names, emotions, spatial and sound keywords, and infers character personalities from dialogues in the text. With OddBooks, users can easily create scripts for secondary works in a cost-effective and time-efficient manner.

TalkForm AI
TalkForm AI is an AI-powered form creation and filling tool that revolutionizes the traditional form-building process. With the ability to chat to create and chat to fill forms, TalkForm AI offers a seamless and efficient solution for creating and managing forms. The application leverages AI technology to automatically infer field types, validate, clean, structure, and fill form responses, ensuring data remains structured for easy analysis. TalkForm AI also provides custom validations, complicated conditional logic, and unlimited power to cater to diverse form creation needs.

Inner AI
Inner AI is an innovative AI tool designed to help users with various tasks using artificial intelligence technology. The application offers a user-friendly interface and a wide range of features to enhance productivity and efficiency. With Inner AI, users can automate repetitive tasks, analyze data, generate insights, and streamline workflows. Whether you are a business professional, student, or researcher, Inner AI can assist you in achieving your goals faster and more effectively.

StoicGPT
StoicGPT is a digital guide to Stoic wisdom, providing timeless teachings and insights to help users discover inner peace and resilience. It offers personalized conversations, guidance, and support based on the principles of Stoicism, an ancient philosophy that emphasizes virtue, reason, and acceptance of fate.

FiveTaco
FiveTaco is an AI-powered platform designed to help solopreneurs master multiple skills and excel in the business world. The platform offers a curated toolkit of tools, tips, and tricks to assist users in wearing multiple hats with style. From AI-powered video creators to all-in-one business platforms, FiveTaco provides a comprehensive solution for solopreneurs looking to thrive in their entrepreneurial journey.

Perfect365
Perfect365 is an AI makeup application that allows users to virtually try on makeup and hairstyles through advanced augmented reality technology. With over 100 million users, the app offers a seamless way to experiment with different looks, acting as a personal beauty assistant. Users can adjust every aspect of their appearance, from skin tone to eye color, all while maintaining a natural and realistic look. The app employs artificial intelligence algorithms to let users experiment with different makeup looks virtually, without the need for physical products. Perfect365 is a pioneer in the beauty apps sector, providing users with a transformative experience in exploring e-cosmetics.

AI Rap Generator
The AI Rap Generator is a cutting-edge tool that utilizes advanced artificial intelligence to create unique rap songs. Whether you are a seasoned artist or just someone looking to have fun, the AI rap generator provides a seamless way to produce personalized rap music. Users can input their own lyrics, select instrumentals, and choose music styles to tailor their rap song precisely to their preferences. The tool offers customization options, instant creation of rap songs, creative freedom, and accessibility from any location. It is designed for accessibility, catering to users of all musical backgrounds, and empowers users to explore various styles and themes.

Country Lyrics AI
Country Lyrics AI is a website that utilizes artificial intelligence to create country music lyrics. It is a fun project developed by a group of friends to explore AI and machine learning technologies. Users can generate country music lyrics using the AI-powered tool, providing an entertaining and educational experience in the realm of music composition.

Thumbmachine
Thumbmachine is an AI-powered platform designed to help users create stunning YouTube video thumbnails quickly and easily. It offers a range of features such as AI thumbnail generation, background removal AI, palette generation, and image upscaling AI. Users can easily customize their thumbnails by selecting hero images, backgrounds, colors, and text, all with the assistance of AI technology. The platform aims to streamline the thumbnail creation process, allowing users to focus on creativity rather than manual design tasks.

Character Lingo
Character Lingo is a web application that allows users to transform their writing into the voice of popular characters such as Jack Sparrow, Yoda, Iron Man, and more. Users can unleash their inner star by creating engaging content with the help of this tool. The application provides a Chrome extension for easy access and usage. Character Lingo aims to add a fun and creative twist to writing, enabling users to embody the personalities of iconic characters in their text.

VikingPic
VikingPic is an AI application that allows users to transform themselves into Viking warriors through AI-generated images. Users can upload their photos and receive 8 Viking images in just 5 minutes, sent to their email. The application is designed for Viking enthusiasts, friends and family, and curious minds who want to experience the Viking Age through personalized images. With a focus on accuracy and user experience, VikingPic provides a fun and engaging way to explore Nordic myths and heroes of old.

Heli Naik Watercolor Classes
Heli Naik offers online watercolor classes for individuals looking to learn and improve their watercolor painting skills. With a focus on creating a fun and encouraging learning environment, Heli Naik provides monthly membership classes, single-subject classes, and top-rated classes for artists of all skill levels. The classes include step-by-step tutorials, access to various techniques, and a new theme or subject to paint in each session. Join now to unleash your creativity and explore the beauty and versatility of watercolor painting.

Cerebral AI
Cerebral AI is an AI-powered meditation app that uses AI-generated soundscapes, a simple and uncluttered app design, and tailored mindfulness recommendations to enhance the meditation experience. It is designed to help users find calm and clarity through daily meditation and relaxation exercises.

Dreamora
Dreamora is an AI-powered dream interpretation application that provides accurate and comprehensive interpretations of dreams. It utilizes advanced artificial intelligence techniques and draws upon the knowledge of renowned dream interpreters like Ibn Sirin and Al-Nabulsi. By simply entering your dream into the application, you can receive a free and instant interpretation within seconds. Dreamora's interpretations consider all aspects of your dream, including the location, characters, and emotions, to offer the most precise results possible.

Personalities.me
Personalities.me is a website that provides resources and information related to personalities. The domain seems to have expired, but it used to offer content and insights on various personality types, traits, and characteristics. Users could explore different aspects of personalities and potentially gain a better understanding of themselves and others. The website might have included articles, quizzes, and other interactive features to engage visitors in learning more about the fascinating world of personalities.

Recipeasy
Recipeasy is an AI-powered recipe generator that helps users create easy and delicious meals. The website offers a Recipe Builder where users can input what they are making, for how many people, and dietary preferences such as vegan, vegetarian, gluten-free, dairy-free, nut-free, and kosher. The AI algorithm then generates a customized recipe based on the inputs provided. Recipeasy is designed to simplify the cooking process and provide users with quick and tasty meal ideas. The platform is user-friendly and suitable for both experienced cooks and beginners.
20 - Open Source AI Tools

dl_model_infer
This project is a c++ version of the AI reasoning library that supports the reasoning of tensorrt models. It provides accelerated deployment cases of deep learning CV popular models and supports dynamic-batch image processing, inference, decode, and NMS. The project has been updated with various models and provides tutorials for model exports. It also includes a producer-consumer inference model for specific tasks. The project directory includes implementations for model inference applications, backend reasoning classes, post-processing, pre-processing, and target detection and tracking. Speed tests have been conducted on various models, and onnx downloads are available for different models.

eole
EOLE is an open language modeling toolkit based on PyTorch. It aims to provide a research-friendly approach with a comprehensive yet compact and modular codebase for experimenting with various types of language models. The toolkit includes features such as versatile training and inference, dynamic data transforms, comprehensive large language model support, advanced quantization, efficient finetuning, flexible inference, and tensor parallelism. EOLE is a work in progress with ongoing enhancements in configuration management, command line entry points, reproducible recipes, core API simplification, and plans for further simplification, refactoring, inference server development, additional recipes, documentation enhancement, test coverage improvement, logging enhancements, and broader model support.

UMOE-Scaling-Unified-Multimodal-LLMs
Uni-MoE is a MoE-based unified multimodal model that can handle diverse modalities including audio, speech, image, text, and video. The project focuses on scaling Unified Multimodal LLMs with a Mixture of Experts framework. It offers enhanced functionality for training across multiple nodes and GPUs, as well as parallel processing at both the expert and modality levels. The model architecture involves three training stages: building connectors for multimodal understanding, developing modality-specific experts, and incorporating multiple trained experts into LLMs using the LoRA technique on mixed multimodal data. The tool provides instructions for installation, weights organization, inference, training, and evaluation on various datasets.

llmc
llmc is an off-the-shell tool designed for compressing LLM, leveraging state-of-the-art compression algorithms to enhance efficiency and reduce model size without compromising performance. It provides users with the ability to quantize LLMs, choose from various compression algorithms, export transformed models for further optimization, and directly infer compressed models with a shallow memory footprint. The tool supports a range of model types and quantization algorithms, with ongoing development to include pruning techniques. Users can design their configurations for quantization and evaluation, with documentation and examples planned for future updates. llmc is a valuable resource for researchers working on post-training quantization of large language models.

AnglE
AnglE is a library for training state-of-the-art BERT/LLM-based sentence embeddings with just a few lines of code. It also serves as a general sentence embedding inference framework, allowing for inferring a variety of transformer-based sentence embeddings. The library supports various loss functions such as AnglE loss, Contrastive loss, CoSENT loss, and Espresso loss. It provides backbones like BERT-based models, LLM-based models, and Bi-directional LLM-based models for training on single or multi-GPU setups. AnglE has achieved significant performance on various benchmarks and offers official pretrained models for both BERT-based and LLM-based models.

caikit
Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs. It provides a consistent format for creating and using AI models against a wide variety of data domains and tasks.

Awesome-LLM-Robotics
This repository contains a curated list of **papers using Large Language/Multi-Modal Models for Robotics/RL**. Template from awesome-Implicit-NeRF-Robotics Please feel free to send me pull requests or email to add papers! If you find this repository useful, please consider citing and STARing this list. Feel free to share this list with others! ## Overview * Surveys * Reasoning * Planning * Manipulation * Instructions and Navigation * Simulation Frameworks * Citation

ai-reference-models
The Intel® AI Reference Models repository contains links to pre-trained models, sample scripts, best practices, and tutorials for popular open-source machine learning models optimized by Intel to run on Intel® Xeon® Scalable processors and Intel® Data Center GPUs. The purpose is to quickly replicate complete software environments showcasing the AI capabilities of Intel platforms. It includes optimizations for popular deep learning frameworks like TensorFlow and PyTorch, with additional plugins/extensions for improved performance. The repository is licensed under Apache License Version 2.0.

DecryptPrompt
This repository does not provide a tool, but rather a collection of resources and strategies for academics in the field of artificial intelligence who are feeling depressed or overwhelmed by the rapid advancements in the field. The resources include articles, blog posts, and other materials that offer advice on how to cope with the challenges of working in a fast-paced and competitive environment.

Code-Atlas
Code Atlas is a lightweight interpreter developed in C++ that supports the execution of multi-language code snippets and partial Markdown rendering. It consumes significantly lower resources compared to similar tools, making it suitable for resource-limited devices. It leverages llama.cpp for local large-model inference and supports cloud-based large-model APIs. The tool provides features for code execution, Markdown rendering, local AI inference, and resource efficiency.

dash-infer
DashInfer is a C++ runtime tool designed to deliver production-level implementations highly optimized for various hardware architectures, including x86 and ARMv9. It supports Continuous Batching and NUMA-Aware capabilities for CPU, and can fully utilize modern server-grade CPUs to host large language models (LLMs) up to 14B in size. With lightweight architecture, high precision, support for mainstream open-source LLMs, post-training quantization, optimized computation kernels, NUMA-aware design, and multi-language API interfaces, DashInfer provides a versatile solution for efficient inference tasks. It supports x86 CPUs with AVX2 instruction set and ARMv9 CPUs with SVE instruction set, along with various data types like FP32, BF16, and InstantQuant. DashInfer also offers single-NUMA and multi-NUMA architectures for model inference, with detailed performance tests and inference accuracy evaluations available. The tool is supported on mainstream Linux server operating systems and provides documentation and examples for easy integration and usage.

awesome-LLM-resourses
A comprehensive repository of resources for Chinese large language models (LLMs), including data processing tools, fine-tuning frameworks, inference libraries, evaluation platforms, RAG engines, agent frameworks, books, courses, tutorials, and tips. The repository covers a wide range of tools and resources for working with LLMs, from data labeling and processing to model fine-tuning, inference, evaluation, and application development. It also includes resources for learning about LLMs through books, courses, and tutorials, as well as insights and strategies from building with LLMs.

cellseg_models.pytorch
cellseg-models.pytorch is a Python library built upon PyTorch for 2D cell/nuclei instance segmentation models. It provides multi-task encoder-decoder architectures and post-processing methods for segmenting cell/nuclei instances. The library offers high-level API to define segmentation models, open-source datasets for training, flexibility to modify model components, sliding window inference, multi-GPU inference, benchmarking utilities, regularization techniques, and example notebooks for training and finetuning models with different backbones.

LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse is a comprehensive and curated guide designed to empower developers, researchers, and enthusiasts to harness the true capabilities of Large Language Models (LLMs) and build intelligent applications that push the boundaries of natural language understanding. This GitHub repository provides in-depth articles, codebase mastery, LLM PlayLab, and resources for cost analysis and network visualization. It covers various aspects of LLMs, including NLP, models, training, evaluation metrics, open LLMs, and more. The repository also includes a collection of code examples and tutorials to help users build and deploy LLM-based applications.

Timestamp
This repository is designed to inject backdoors into Language Model Models (LLMs) for code. The injected backdoors serve as timestamps for the training dataset of the LLMs. The code is randomly generated and includes watermark backdoors to show specific behaviors. A script automatically updates the repository with a new backdoor every month. Validating the existence of the backdoor can infer when the training dataset was collected. The backdoors are constructed in a specific format, and verifying them may require multiple tries. The repository keeps a record of backdoors injected along with associated dates.

yek
Yek is a fast Rust-based tool designed to read text-based files in a repository or directory, chunk them, and serialize them for Large Language Models (LLM) consumption. It utilizes .gitignore rules to skip unwanted files, Git history to infer important files, and additional ignore patterns. Yek splits content into chunks based on token count or byte size, supports processing multiple directories, and can stream content when output is piped. It is configurable via a 'yek.toml' file and prioritizes important files at the end of the output.

DeepPavlov
DeepPavlov is an open-source conversational AI library built on PyTorch. It is designed for the development of production-ready chatbots and complex conversational systems, as well as for research in the area of NLP and dialog systems. The library offers a wide range of models for tasks such as Named Entity Recognition, Intent/Sentence Classification, Question Answering, Sentence Similarity/Ranking, Syntactic Parsing, and more. DeepPavlov also provides embeddings like BERT, ELMo, and FastText for various languages, along with AutoML capabilities and integrations with REST API, Socket API, and Amazon AWS.
20 - OpenAI Gpts

筆圧特性評価機(Writing Pressure Characterization Machine)
デジタル テキストを除く、手書きの筆圧を分析して性格特性を推測します。(Analyzes handwriting pressure to infer personality traits, excluding digital text.)

人為的コード性格分析(Code Persona Analyst)
コードを分析し、言語ではなくスタイルに焦点を当て、プログラムを書いた人の性格を推察するツールです。( It is a tool that analyzes code, focuses on style rather than language, and infers the personality of the person who wrote the program. )

Digest Bot
I provide detailed summaries, critiques, and inferences on articles, papers, transcripts, websites, and more. Just give me text, a URL, or file to digest.

PSYCH: Your Compass to Inner Clarity (TPW.AI)
Start by sharing what’s on your mind or any emotional challenges you're facing. PSYCH will guide you through reflective dialogue, providing insights and coping mechanisms tailored to your needs.

Shreemad Bhagavad Gita
The Bhagavad Gita imparts wisdom on ethical living, duty without attachment, and mindfulness,fostering personal growth, emotional resilience, and inner peace. Its teachings encourage self-awareness, compassion,and spiritual well-being through paths like yoga and meditation, enhancing life's journey

Code Like a GOAT 🐐🧙🏻♂️
Unleash Your Inner GOAT in Coding! Be the ultimate full-stack developer with unrivaled skills in all coding languages and platforms. Write elegant, secure code, and more. Excel in cybersecurity and innovate with your comprehensive expertise. Ready to code like never before?

BeardBot
Unleash your inner Bearded Badass! Beard’s got your back (and beard) with custom humor, grooming hacks, and wisdom as unique as your facial hair!

Guru: A Mind of Simplicity
A guide to help you traverse your inner world, Guru is designed to help you navigate the complexities of life with scientific, therapeutic, and spiritual approaches grounded in simplicity and self-understanding.

Stock Guru
Mastering Stock Trading with Price Action Concepts: An Educational Guide Inspired by Michael J. Huddleston's Inner Circle Trader(ICT). Fan created for educational purpose only.

AlphaMan.ai - Code therapy: Fix yourself and code
Fix yourself, rebuild and challenge yourself with code, unleash your inner beast!