LLM4EC

LLM4EC

A list of awesome papers and resources of the intersection of Large Language Models and Evolutionary Computation.

Stars: 79

Visit
screenshot

LLM4EC is an interdisciplinary research repository focusing on the intersection of Large Language Models (LLM) and Evolutionary Computation (EC). It provides a comprehensive collection of papers and resources exploring various applications, enhancements, and synergies between LLM and EC. The repository covers topics such as LLM-assisted optimization, EA-based LLM architecture search, and applications in code generation, software engineering, neural architecture search, and other generative tasks. The goal is to facilitate research and development in leveraging LLM and EC for innovative solutions in diverse domains.

README:

Interdisciplinary Research on LLM and Evolutionary Computation

A list of awesome papers and resources of the intersection of Large Language Models and Evolutionary Computation.

🎉 News: Our survey has been accepted by IEEE Transactions on Evolutionary Computation (TEVC). Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap

The related work and projects will be updated soon and continuously.

Editor

If our work has been of assistance to you, please feel free to cite our survey. Thank you.

@article{wu2024evolutionary,
  title={Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap},
  author={Wu, Xingyu and Wu, Sheng-hao and Wu, Jibin and Feng, Liang and Tan, Kay Chen},
  journal={IEEE Transactions on Evolutionary Computation},
  year={2024}
}

Table of Contents

LLM-enhanced EA

LLM-assisted Black-box Optimization

Category Name Paper Venue Year Code
Evaluation N/A Exploring the True Potential: Evaluating the Black-Box Optimization Capability of Large Language Models arXiv 2024 N/A
Evaluation N/A Towards Optimizing with Large Language Models arXiv 2023 N/A
Evaluation N/A A Critical Examination of Large Language Model Capabilities in Iteratively Refining Differential Evolution Algorithm GECCO 2024 N/A
Evaluation N/A Can Large Language Models Be Trusted as Black-Box Evolutionary Optimizers for Combinatorial Problems? arXiv 2025 N/A
Single-objective OPRO Large Language Models as Optimizers ICLR 2024 Python
Single-objective LMX Language Model Crossover: Variation through Few-Shot Prompting arXiv 2023 N/A
Single-objective LMEA Large Language Models as Evolutionary Optimizers CEC 2024 N/A
Single-objective EvoLLM Large Language Models As Evolution Strategies arXiv 2024 N/A
Single-objective Huang et al. How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems SSCI 2025 N/A
Single-objective LEO Large Language Model-Based Evolutionary Optimizer: Reasoning with Elitism arXiv 2024 N/A
Single-objective LAEA Large Language Models as Surrogate Models in Evolutionary Algorithms: A Preliminary Study SWEVO 2024 Python
Single-objective PAIR PAIR: A Novel Large Language Model-Guided Selection Strategy for Evolutionary Algorithms arXiv 2025 Python
Single-objective (Application) Zhang et al. CUDA-Accelerated Soft Robot Neural Evolution with Large Language Model Supervision arXiv 2024 N/A
Single-objective (Application) LLM-Mutate Evolving Interpretable Visual Classifiers with Large Language Models arXiv 2024 N/A
Multi-objective QDAIF Quality-Diversity through AI Feedback Workshop at NeurIPS 2023 Python
Multi-objective LLM4MOEA Large Language Model for Multi-objective Evolutionary Optimization arXiv 2023 Python
Multi-objective In-context QD Large Language Models as In-context AI Generators for Quality-Diversity arXiv 2024 N/A
Multi-objective CMOEA-LLM Large Language Model-Aided Evolutionary Search for Constrained Multiobjective Optimization arXiv 2024 N/A
Multi-objective LLM-assisted MOEA Large Language Model Aided Multi-objective Evolutionary Algorithm: a Low-cost Adaptive Approach arXiv 2024 N/A
Multi-objective (Application) IlmPC-NSGA-II Generative Evolution Attacks Portfolio Selection CEC 2024 N/A

LLM-assisted Optimization Algorithm Generation

Name Paper Venue Year Code Generated Algorithm
Pluhacek et al. Leveraging Large Language Models for the Generation of Novel Metaheuristic Optimization Algorithms GECCO 2023 N/A Hybrid swarm intelligence optimization algorithm
OptiMUS OptiMUS: Optimization Modeling Using MIP Solvers and Large Language Models arXiv 2023 Python Mixed-integer linear programming problem
ZSO Leveraging Large Language Model to Generate a Novel Metaheuristic Algorithm with CRISPE Framework arXiv 2024 Python Zoological search optimization algorithm
AEL Evolution of Heuristics: Towards Efficient Automatic Algorithm Design using Large Language Model ICML 2024 Python Heuristic algorithm
ReEvo ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution arXiv 2024 Python Heuristic algorithm
LLM_GP Evolving Code with A Large Language Model arXiv 2024 N/A Genetic Programming
SR-EAD Evolution Transformer: In-Context Evolutionary Optimization arXiv 2024 Python Evolutionary strategy or evolution transformer
EvolCAF Evolve Cost-aware Acquisition Functions Using Large Language Models arXiv 2024 Python Cost-aware Bayesian optimization
Kramer Large Language Models for Tuning Evolution Strategies arXiv 2024 N/A Evolution Strategies
LLaMEA LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristics TEVC 2024 N/A Heuristic algorithm
Evaluation Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Models PPSN 2024 Python Combinatorial Optimization Problem
Pluhacek et al. Using LLM for Automatic Evolvement of Metaheuristics from Swarm Algorithm SOMA GECCO 2024 N/A Self-Organizing Migrating Algorithm
Pang et al. Large Language Model-Based Benchmarking Experiment Settings for Evolutionary Multi-Objective Optimization arXiv 2025 N/A Multi-Objective EA

LLM Empower EA for Other Capabilities

Name Paper Venue Year Code Enhancement Aspect
OptiChat Diagnosing Infeasible Optimization Problems Using Large Language Models arXiv 2023 Python Identify potential sources of infeasibility
AS-LLM Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representation IJCAI 2024 Python Algorithm representation and algorithm selection
GP4NLDR Explaining Genetic Programming Trees Using Large Language Models arXiv 2024 N/A Provide explainability for results of EA
Singh et al. Enhancing Decision-Making in Optimization through LLM-Assisted Inference: A Neural Networks Perspective IJCNN 2024 N/A Provide explainability for results of EA
Custode et al. An Investigation on the Use of Large Language Models for Hyperparameter Tuning in Evolutionary Algorithms GECCO 2024 Python Hyperparameter Tuning

EA-enhanced LLM

EA-based Prompt Engineering

Category Name Paper Venue Year Code
Discrete Prompt Optimization GPS GPS: Genetic Prompt Search for Efficient Few-shot Learning EMNLP 2022 Python
Discrete Prompt Optimization GrIPS GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models EACL 2023 Python
Discrete Prompt Optimization EvoPrompt Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers ICLR 2024 Python
Discrete Prompt Optimization Plum Plum: Prompt Learning Using Metaheuristic arXiv 2023 Python
Discrete Prompt Optimization PromptBreeder Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution arXiv 2023 N/A
Discrete Prompt Optimization SPELL SPELL: Semantic Prompt Evolution Based on A LLM arXiv 2023 N/A
Discrete Prompt Optimization EoT prompting Zero-Shot Chain-of-Thought Reasoning Guided by Evolutionary Algorithms in Large Language Models arXiv 2024 Python
Discrete Prompt Optimization iPrompt Explaining Patterns in Data with Language Models via Interpretable Autoprompting arXiv 2023 Python
Discrete Prompt Optimization PhaseEvo PhaseEvo: Towards Unified In-Context Prompt Optimization for Large Language Models arXiv 2024 N/A
Discrete Prompt Optimization InstOptima InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators EMNLP 2023 Python
Discrete Prompt Optimization EMO-Prompts Evolutionary Multi-Objective Optimization of Large Language Model Prompts for Balancing Sentiments EvoApplications 2024 Python
Discrete Prompt Optimization RSBench Language Model Evolutionary Algorithms for Recommender Systems: Benchmarks and Algorithm Comparisons arXiv 2024 N/A
Discrete Prompt Optimization evoPrompt Exploring the Prompt Space of Large Language Models through Evolutionary Sampling GECCO 2024 Python
Discrete Prompt Optimization PREDO Prompt Evolutionary Design Optimization with Generative Shape and Vision-Language models CEC 2024 N/A
Gradient-Free Soft Prompt Optimization BBT Black-Box Tuning for Language-Model-as-a-Service ICML 2022 Python
Gradient-Free Soft Prompt Optimization BBTv2 BBTv2: Towards a Gradient-Free Future with Large Language Models EMNLP 2022 Python
Gradient-Free Soft Prompt Optimization Clip-Tuning Clip-Tuning: Towards Derivative-free Prompt Learning with a Mixture of Rewards EMNLP 2022 N/A
Gradient-Free Soft Prompt Optimization Shen et al. Reliable Gradient-free and Likelihood-free Prompt Tuning ACL 2023 Python
Gradient-Free Soft Prompt Optimization BPT-VLM Black-box Prompt Tuning for Vision-Language Model as a Service IJCAI 2023 Python
Gradient-Free Soft Prompt Optimization Fei et al. Gradient-Free Textual Inversion MM 2023 Python
Prompt Generation for Data Augmentation Evol-Instruct WizardLM: Empowering Large Language Models to Follow Complex Instructions ICLR 2024 Python
Prompt Generation for Data Augmentation Sun et al. Dial-insight: Fine-tuning Large Language Models with High-Quality Domain-Specific Data Preventing Capability Collapse arXiv 2024 N/A
Prompt Generation for Data Augmentation Boulesnane et al. An Evolutionary Large Language Model for Hallucination Mitigation ECTE-Tech 2024 N/A
Prompt Generation for Security AutoDAN AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models ICLR 2024 Python
Prompt Generation for Security Jailbreak Attacks Open Sesame! Universal Black Box Jailbreaking of Large Language Models arXiv 2024 N/A
Prompt Generation for Security SMEA Is the System Message Really Important to Jailbreaks in Large Language Models? arXiv 2024 N/A
Prompt Generation for Security Shi et al. Red Teaming Language Model Detectors with Language Models TACL 2024 Python
Prompt Generation for Security LLM-Virus LLM-Virus: Evolutionary Jailbreak Attack on Large Language Models TACL 2024 Python

EA-based LLM Architecture Search

Note: Approaches discussed here primarily focus on LLM architecture search, and their techniques are based on EAs.

Name Paper Venue Year Code LLM
AutoBERT-Zero AutoBERT-Zero: Evolving BERT Backbone from Scratch AAAI 2022 Python BERT
SuperShaper SuperShaper: Task-Agnostic Super Pre-training of BERT Models with Variable Hidden Dimensions arXiv 2021 N/A BERT
AutoTinyBERT AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models ACL 2021 Python BERT
LiteTransformerSearch LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models NeurIPS 2022 Python GPT-2
Klein et al. Structural Pruning of Large Language Models via Neural Architecture Search AutoML 2023 N/A BERT
Choong et al. Jack and Masters of All Trades: One-Pass Learning of a Set of Model Sets from Foundation AI Models IEEE CIM 2023 N/A M2M100-418M, ResNet-18

EA-based LLM Merging

Name Paper Venue Year Code
Merging Recipes Evolutionary Optimization of Model Merging Recipes NMI 2025 Python
GENOME+ Evolutionary Optimization of Model Merging Recipes arXiv 2025 Python
EEM-TISP Evolutionary Expert Model Merging with Task-Adaptive Iterative Self-Improvement Process for Large Language Modeling on Aspect-Based Sentiment Analysis IoTaIS 2024 N/A

EA Empower LLM for Other Capabilities

Name Paper Venue Year Code Enhancement Aspect
Length-Adaptive Transformer Model Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search ACL 2021 Python Automatically adjust the sequence length according to different computational resource constraints
HexGen HexGen: Generative Inference of Large-Scale Foundation Model over Heterogeneous Decentralized Environment arXiv 2023 Python Deploy generative inference services for LLMs in a heterogeneous distributed environment
LongRoPE LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens arXiv 2023 Python Extend the context window of LLMs to 2048k tokens
BLADE BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models arXiv 2024 N/A Find soft prompts that optimizes the consistency between the outputs of two models
Self-evolution in LLM A Survey on Self-Evolution of Large Language Models arXiv 2024 Summary Some studies for LLM self-evolution also adopted the ideas of EAs
OPTISHEAR OPTISHEAR: Towards Efficient and Adaptive Pruning of Large Language Models via Evolutionary Optimization arXiv 2025 N/A An efficient evolutionary optimization framework for adaptive LLM pruning using NSGA-III

Applications Driven by Integrated Synergy of LLM and EA

Code Generation

Name Paper Venue Year Code Applicable scenarios
ELM Evolution through Large Models arXiv 2022 Python Universal code generation
OpenELM The OpenELM Library: Leveraging Progress in Language Models for Novel Evolutionary Algorithms arXiv 2024 Python Open-source Python library
Pinna et al. Enhancing Large Language Models-Based Code Generation by Leveraging Genetic Improvement ECGP 2024 Python Universal code generation
WizardCoder WizardCoder: Empowering Code Large Language Models with Evol-Instruct ICLR 2024 Python Universal code generation
SEED SEED: Domain-Specific Data Curation With Large Language Models arXiv 2023 N/A Data cleaning tasks
EUREKA Eureka: Human-Level Reward Design via Coding Large Language Models ICLR 2024 Python Design reward in reinforcement learning
EROM Evolutionary Reward Design and Optimization with Multimodal Large Language Models Workshop at ICRA 2023 N/A Design reward in reinforcement learning
Zhang et al. A Simple Framework for Intrinsic Reward-Shaping for RL using LLM Feedback Github 2024 N/A Design reward in reinforcement learning
Diffusion-ES Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following arXiv 2024 N/A Design reward in reinforcement learning
GPT4AIGChip GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models ICCAD 2023 N/A Design AI accelerator
FunSearch Mathematical discoveries from program search with large language models Nature 2023 Python For mathematical and algorithmic discovery
L-AutoDA L-AutoDA: Leveraging Large Language Models for Automated Decision-based Adversarial Attacks arXiv 2024 N/A For decision-based adversarial attacks
LLM-SR LLM-SR: Scientific Equation Discovery via Programming with Large Language Models arXiv 2024 Python For scientific equation discovery from data
Shojaee et al. Identify Critical Nodes in Complex Network with Large Language Models arXiv 2024 Python Node importance scoring functions in complex networks
DeceptPrompt DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions arXiv 2023 N/A For LLM Security
G3P with LLM Program Synthesis with Generative Pre-trained Transformers and Grammar-Guided Genetic Programming Grammar LA-CCI 2023 N/A For LLM Security

Software Engineering

Name Paper Venue Year Code Applicable scenarios
Kang et al. Towards Objective-Tailored Genetic Improvement Through Large Language Models Workshop at ICSE 2023 N/A Software Optimization
Brownlee et al. Enhancing Genetic Improvement Mutations Using Large Language Models SSBSE 2023 N/A Software Optimization
ARJA-CLM Revisiting Evolutionary Program Repair via Code Language Model arXiv 2024 N/A Software Optimization (Program Repair)
TitanFuzz Large Language Models Are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Models ISSTA 2023 N/A Software Testing
CodaMOSA CODAMOSA: Escaping Coverage Plateaus in Test Generation with Pre-trained Large Language Models ICSE 2023 Python Software Testing
SBSE Search-based Optimisation of LLM Learning Shots for Story Point Estimation SSBSE 2023 N/A Software Project Planning

Neural Architecture Search

Note: Methods reviewed here leverage the synergistic combination of EAs and LLMs, which are more versatile and not limited to LLM architecture search alone, applicable to a broader range of NAS tasks..

Name Paper Venue Year Code Role of LLM
GPT-NAS GPT-NAS: Evolutionary Neural Architecture Search with the Generative Pre-Trained Model arXiv 2023 N/A Representation Capability
LLMatic LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization GECCO 2024 Python Generation Capability
Evoprompting EvoPrompting: Language Models for Code-Level Neural Architecture Search NeurIPS 2023 Python Generation Capability
Guided Evolution LLM Guided Evolution -- The Automation of Models Advancing Models arXiv 2023 Python Generation Capability
GPTN-SS Discovering More Effective Tensor Network Structure Search Algorithms via Large Language Models (LLMs) arXiv 2024 N/A Generation Capability
GENIUS Can GPT-4 Perform Neural Architecture Search? arXiv 2023 Python Generation Capability
GPT4GNAS Graph Neural Architecture Search with GPT-4 arXiv 2023 N/A Generation Capability
Jawahar et al. LLM Performance Predictors are good initializers for Architecture Searc arXiv 2023 N/A Reasoning Capability
ReStruct Large Language Model-driven Meta-structure Discovery in Heterogeneous Information Network arXiv 2024 N/A Reasoning Capability

Others Generative Tasks

Task Name Paper Venue Year Code
Text Generation NSG Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation Journal of Intelligent and Fuzzy Systems 2024 N/A
Text Generation SCAPE SCAPE: Searching Conceptual Architecture Prompts using Evolution CEC 2024 Python
Text Generation Mario-GPT Prompt-Guided Level Generation GECCO 2024 Python
Text Generation Cai et al. Simulation of Language Evolution under Regulated Social Media Platforms: A Synergistic Approach of Large Language Models and Genetic Algorithms arXiv 2025 N/A
Text-to-image Generation StableYolo StableYolo: Optimizing Image Generation for Large Language Models SSBSE 2023 Python
Natural Science Researchers from McGill University 14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon Digital Discovery 2023 N/A
Natural Science LLM-GA Integrating Genetic Algorithms and Language Models for Enhanced Enzyme Design ChemRxiv 2024 N/A
Natural Science MLDE Protein Design by Directed Evolution Guided by Large Language Models TEVC 2024 Python
Natural Science MolLEO Efficient Evolutionary Search Over Chemical Space with Large Language Models ICML Workshop 2024 Python
Natural Science Reinhart et al. Large Language Models Design Sequence-defined Macromolecules via Evolutionary Optimization NPJ Computational Materials 2024 N/A
Social Science Suzuki et al. An Evolutionary Model of Personality Traits Related to Cooperative Behavior Using A Large Language Model Scientific Reports 2024 N/A
LLM as Agent FoA Fleet of Agents: Coordinated Problem Solving with Large Language Models using Genetic Particle Filtering arXiv 2024 N/A
LLM as Agent EvoAgnet EVOAGENT: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms NeurIPS Workshop 2024 Python
Machine Learning ELLM-FT Evolutionary Large Language Model for Automated Feature Transformation arXiv 2024 Python

Hope our conclusion can help your work.

For Tasks:

Click tags to check more tools for each tasks
generate code optimize algorithms search for architectures generate text enhance models

For Jobs:

researcher data scientist machine learning engineer software developer ai researcher

Alternative AI tools for LLM4EC

Similar Open Source Tools

LLM4EC Screenshot
LLM4EC

LLM4EC is an interdisciplinary research repository focusing on the intersection of Large Language Models (LLM) and Evolutionary Computation (EC). It provides a comprehensive collection of papers and resources exploring various applications, enhancements, and synergies between LLM and EC. The repository covers topics such as LLM-assisted optimization, EA-based LLM architecture search, and applications in code generation, software engineering, neural architecture search, and other generative tasks. The goal is to facilitate research and development in leveraging LLM and EC for innovative solutions in diverse domains.

github
: 79
Awesome-LLM4IE-Papers Screenshot
Awesome-LLM4IE-Papers

github
: 645
Awesome_LLM_System-PaperList Screenshot
Awesome_LLM_System-PaperList

Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of papers on LLMs inference and serving.

github
: 184
AudioLLM Screenshot
AudioLLM

AudioLLMs is a curated collection of research papers focusing on developing, implementing, and evaluating language models for audio data. The repository aims to provide researchers and practitioners with a comprehensive resource to explore the latest advancements in AudioLLMs. It includes models for speech interaction, speech recognition, speech translation, audio generation, and more. Additionally, it covers methodologies like multitask audioLLMs and segment-level Q-Former, as well as evaluation benchmarks like AudioBench and AIR-Bench. Adversarial attacks such as VoiceJailbreak are also discussed.

github
: 71
Awesome-Resource-Efficient-LLM-Papers Screenshot
Awesome-Resource-Efficient-LLM-Papers

A curated list of high-quality papers on resource-efficient Large Language Models (LLMs) with a focus on various aspects such as architecture design, pre-training, fine-tuning, inference, system design, and evaluation metrics. The repository covers topics like efficient transformer architectures, non-transformer architectures, memory efficiency, data efficiency, model compression, dynamic acceleration, deployment optimization, support infrastructure, and other related systems. It also provides detailed information on computation metrics, memory metrics, energy metrics, financial cost metrics, network communication metrics, and other metrics relevant to resource-efficient LLMs. The repository includes benchmarks for evaluating the efficiency of NLP models and references for further reading.

github
: 105
Awesome-Model-Merging-Methods-Theories-Applications Screenshot
Awesome-Model-Merging-Methods-Theories-Applications

A comprehensive repository focusing on 'Model Merging in LLMs, MLLMs, and Beyond', providing an exhaustive overview of model merging methods, theories, applications, and future research directions. The repository covers various advanced methods, applications in foundation models, different machine learning subfields, and tasks like pre-merging methods, architecture transformation, weight alignment, basic merging methods, and more.

github
: 333
Cool-GenAI-Fashion-Papers Screenshot
Cool-GenAI-Fashion-Papers

Cool-GenAI-Fashion-Papers is a curated list of resources related to GenAI-Fashion, including papers, workshops, companies, and products. It covers a wide range of topics such as fashion design synthesis, outfit recommendation, fashion knowledge extraction, trend analysis, and more. The repository provides valuable insights and resources for researchers, industry professionals, and enthusiasts interested in the intersection of AI and fashion.

github
: 97
Awesome-LLM-Papers-Comprehensive-Topics Screenshot
Awesome-LLM-Papers-Comprehensive-Topics

github
: 172
LLM-for-Healthcare Screenshot
LLM-for-Healthcare

The repository 'LLM-for-Healthcare' provides a comprehensive survey of large language models (LLMs) for healthcare, covering data, technology, applications, and accountability and ethics. It includes information on various LLM models, training data, evaluation methods, and computation costs. The repository also discusses tasks such as NER, text classification, question answering, dialogue systems, and generation of medical reports from images in the healthcare domain.

github
: 96
ai-game-devtools Screenshot
ai-game-devtools

github
: 735
ai-game-development-tools Screenshot
ai-game-development-tools

Here we will keep track of the AI Game Development Tools, including LLM, Agent, Code, Writer, Image, Texture, Shader, 3D Model, Animation, Video, Audio, Music, Singing Voice and Analytics. 🔥 * Tool (AI LLM) * Game (Agent) * Code * Framework * Writer * Image * Texture * Shader * 3D Model * Avatar * Animation * Video * Audio * Music * Singing Voice * Speech * Analytics * Video Tool

github
: 312
LLM4Opt Screenshot
LLM4Opt

LLM4Opt is a collection of references and papers focusing on applying Large Language Models (LLMs) for diverse optimization tasks. The repository includes research papers, tutorials, workshops, competitions, and related collections related to LLMs in optimization. It covers a wide range of topics such as algorithm search, code generation, machine learning, science, industry, and more. The goal is to provide a comprehensive resource for researchers and practitioners interested in leveraging LLMs for optimization tasks.

github
: 125
ai-reference-models Screenshot
ai-reference-models

The Intel® AI Reference Models repository contains links to pre-trained models, sample scripts, best practices, and tutorials for popular open-source machine learning models optimized by Intel to run on Intel® Xeon® Scalable processors and Intel® Data Center GPUs. The purpose is to quickly replicate complete software environments showcasing the AI capabilities of Intel platforms. It includes optimizations for popular deep learning frameworks like TensorFlow and PyTorch, with additional plugins/extensions for improved performance. The repository is licensed under Apache License Version 2.0.

github
: 676
Awesome-LLMs-for-Video-Understanding Screenshot
Awesome-LLMs-for-Video-Understanding

Awesome-LLMs-for-Video-Understanding is a repository dedicated to exploring Video Understanding with Large Language Models. It provides a comprehensive survey of the field, covering models, pretraining, instruction tuning, and hybrid methods. The repository also includes information on tasks, datasets, and benchmarks related to video understanding. Contributors are encouraged to add new papers, projects, and materials to enhance the repository.

github
: 1.8k
Awesome-LLM-Eval Screenshot
Awesome-LLM-Eval

Awesome-LLM-Eval: a curated list of tools, benchmarks, demos, papers for Large Language Models (like ChatGPT, LLaMA, GLM, Baichuan, etc) Evaluation on Language capabilities, Knowledge, Reasoning, Fairness and Safety.

github
: 280
MobileLLM Screenshot
MobileLLM

This repository contains the training code of MobileLLM, a language model optimized for on-device use cases with fewer than a billion parameters. It integrates SwiGLU activation function, deep and thin architectures, embedding sharing, and grouped-query attention to achieve high-quality LLMs. MobileLLM-125M/350M shows significant accuracy improvements over previous models on zero-shot commonsense reasoning tasks. The design philosophy scales effectively to larger models, with state-of-the-art results for MobileLLM-600M/1B/1.5B.

github
: 917

For similar tasks

cognee Screenshot
cognee

Cognee is an open-source framework designed for creating self-improving deterministic outputs for Large Language Models (LLMs) using graphs, LLMs, and vector retrieval. It provides a platform for AI engineers to enhance their models and generate more accurate results. Users can leverage Cognee to add new information, utilize LLMs for knowledge creation, and query the system for relevant knowledge. The tool supports various LLM providers and offers flexibility in adding different data types, such as text files or directories. Cognee aims to streamline the process of working with LLMs and improving AI models for better performance and efficiency.

github
: 1.4k
dataformer Screenshot
dataformer

Dataformer is a robust framework for creating high-quality synthetic datasets for AI, offering speed, reliability, and scalability. It empowers engineers to rapidly generate diverse datasets grounded in proven research methodologies, enabling them to prioritize data excellence and achieve superior standards for AI models. Dataformer integrates with multiple LLM providers using one unified API, allowing parallel async API calls and caching responses to minimize redundant calls and reduce operational expenses. Leveraging state-of-the-art research papers, Dataformer enables users to generate synthetic data with adaptability, scalability, and resilience, shifting their focus from infrastructure concerns to refining data and enhancing models.

github
: 143
LLM4EC Screenshot
LLM4EC

LLM4EC is an interdisciplinary research repository focusing on the intersection of Large Language Models (LLM) and Evolutionary Computation (EC). It provides a comprehensive collection of papers and resources exploring various applications, enhancements, and synergies between LLM and EC. The repository covers topics such as LLM-assisted optimization, EA-based LLM architecture search, and applications in code generation, software engineering, neural architecture search, and other generative tasks. The goal is to facilitate research and development in leveraging LLM and EC for innovative solutions in diverse domains.

github
: 79
ai-guide Screenshot
ai-guide

This guide is dedicated to Large Language Models (LLMs) that you can run on your home computer. It assumes your PC is a lower-end, non-gaming setup.

github
: 159
onnxruntime-genai Screenshot
onnxruntime-genai

ONNX Runtime Generative AI is a library that provides the generative AI loop for ONNX models, including inference with ONNX Runtime, logits processing, search and sampling, and KV cache management. Users can call a high level `generate()` method, or run each iteration of the model in a loop. It supports greedy/beam search and TopP, TopK sampling to generate token sequences, has built in logits processing like repetition penalties, and allows for easy custom scoring.

github
: 442
mistral.rs Screenshot
mistral.rs

Mistral.rs is a fast LLM inference platform written in Rust. We support inference on a variety of devices, quantization, and easy-to-use application with an Open-AI API compatible HTTP server and Python bindings.

github
: 5.1k
generative-ai-python Screenshot
generative-ai-python

The Google AI Python SDK is the easiest way for Python developers to build with the Gemini API. The Gemini API gives you access to Gemini models created by Google DeepMind. Gemini models are built from the ground up to be multimodal, so you can reason seamlessly across text, images, and code.

github
: 859
jetson-generative-ai-playground Screenshot
jetson-generative-ai-playground

This repo hosts tutorial documentation for running generative AI models on NVIDIA Jetson devices. The documentation is auto-generated and hosted on GitHub Pages using their CI/CD feature to automatically generate/update the HTML documentation site upon new commits.

github
: 94

For similar jobs

weave Screenshot
weave

Weave is a toolkit for developing Generative AI applications, built by Weights & Biases. With Weave, you can log and debug language model inputs, outputs, and traces; build rigorous, apples-to-apples evaluations for language model use cases; and organize all the information generated across the LLM workflow, from experimentation to evaluations to production. Weave aims to bring rigor, best-practices, and composability to the inherently experimental process of developing Generative AI software, without introducing cognitive overhead.

github
: 829
LLMStack Screenshot
LLMStack

LLMStack is a no-code platform for building generative AI agents, workflows, and chatbots. It allows users to connect their own data, internal tools, and GPT-powered models without any coding experience. LLMStack can be deployed to the cloud or on-premise and can be accessed via HTTP API or triggered from Slack or Discord.

github
: 1.5k
VisionCraft Screenshot
VisionCraft

The VisionCraft API is a free API for using over 100 different AI models. From images to sound.

github
: 94
kaito Screenshot
kaito

Kaito is an operator that automates the AI/ML inference model deployment in a Kubernetes cluster. It manages large model files using container images, avoids tuning deployment parameters to fit GPU hardware by providing preset configurations, auto-provisions GPU nodes based on model requirements, and hosts large model images in the public Microsoft Container Registry (MCR) if the license allows. Using Kaito, the workflow of onboarding large AI inference models in Kubernetes is largely simplified.

github
: 405
PyRIT Screenshot
PyRIT

PyRIT is an open access automation framework designed to empower security professionals and ML engineers to red team foundation models and their applications. It automates AI Red Teaming tasks to allow operators to focus on more complicated and time-consuming tasks and can also identify security harms such as misuse (e.g., malware generation, jailbreaking), and privacy harms (e.g., identity theft). The goal is to allow researchers to have a baseline of how well their model and entire inference pipeline is doing against different harm categories and to be able to compare that baseline to future iterations of their model. This allows them to have empirical data on how well their model is doing today, and detect any degradation of performance based on future improvements.

github
: 2.3k
tabby Screenshot
tabby

Tabby is a self-hosted AI coding assistant, offering an open-source and on-premises alternative to GitHub Copilot. It boasts several key features: * Self-contained, with no need for a DBMS or cloud service. * OpenAPI interface, easy to integrate with existing infrastructure (e.g Cloud IDE). * Supports consumer-grade GPUs.

github
: 30.4k
spear Screenshot
spear

SPEAR (Simulator for Photorealistic Embodied AI Research) is a powerful tool for training embodied agents. It features 300 unique virtual indoor environments with 2,566 unique rooms and 17,234 unique objects that can be manipulated individually. Each environment is designed by a professional artist and features detailed geometry, photorealistic materials, and a unique floor plan and object layout. SPEAR is implemented as Unreal Engine assets and provides an OpenAI Gym interface for interacting with the environments via Python.

github
: 224
Magick Screenshot
Magick

Magick is a groundbreaking visual AIDE (Artificial Intelligence Development Environment) for no-code data pipelines and multimodal agents. Magick can connect to other services and comes with nodes and templates well-suited for intelligent agents, chatbots, complex reasoning systems and realistic characters.

github
: 675