Best AI tools for< Engineering Leader >
Infographic
20 - AI tool Sites

Faros AI
Faros AI is an AI-driven platform designed to enhance engineering productivity by providing personalized insights, guidance, and recommendations. It helps technology teams reduce bottlenecks, optimize software delivery, and improve speed and quality. The platform offers a comprehensive BI solution for software engineering, with features like AI guidance, customizable analytics, and high-security data ingestion. Faros AI is built by engineers for engineers, compatible with various data sources, and tailored to meet enterprise-scale requirements.

Meibel
Meibel is an AI platform that empowers product and engineering leaders to accelerate their generative AI vision from pilot to production with explainable AI. The platform provides complete visibility, control, and confidence to quickly build and deploy production-ready AI systems that deliver measurable business value. Meibel offers intuitive tools for AI development, seamless data integration, enterprise-ready security, measurable impact tracking, and a future-proof platform that evolves alongside AI technology.

Stepsize AI
Stepsize AI is an AI-powered reporting tool for software development teams. It analyzes issue tracker activity to generate automated weekly updates on team and project progress. Stepsize AI provides metrics with automatic commentary, project-level AI insights, and intelligent delivery risk surfacing. It offers tailored insights, complete visibility, and unified focus, helping teams stay aligned and make timely decisions.

HST Solutions
HST Solutions is a trusted digital engineering and enterprise modernization partner that offers custom software development, AI applications, and data engineering services. They combine deep technical expertise and industry experience to help clients anticipate future needs and provide innovative solutions. The company focuses on delivering transformation and solving complex challenges with precision and innovation.

Supple.ai
Supple.ai is an AI-powered content generation tool that helps users create high-quality written content quickly and efficiently. By leveraging advanced natural language processing algorithms, Supple.ai can generate articles, blog posts, product descriptions, and more in a matter of minutes. The tool is designed to assist content creators, marketers, and businesses in streamlining their content creation process and improving productivity.

Spoke.ai
Spoke.ai is an AI tool designed to enhance communication and streamline workflow processes. The platform aims to help users communicate more effectively and build projects faster by leveraging artificial intelligence technology. By joining Salesforce to support Slack AI, Spoke.ai is at the forefront of revolutionizing the future of work. The tool offers various features to improve collaboration and productivity, making it a valuable asset for teams and individuals alike.

Dart
Dart is an AI project management software designed to streamline task execution, subtask generation, project planning, and duplicate detection. It offers features like intelligent task management, sprints, roadmaps, calendar views, document storage, meeting notes, and seamless integrations with other workplace tools. Dart is used by engineering teams, product managers, business leaders, designers, and sales professionals to enhance productivity and project outcomes.

Sofy
Sofy is a revolutionary no-code testing platform for mobile applications that integrates AI to streamline the testing process. It offers features such as manual and ad-hoc testing, no-code automation, AI-powered test case generation, and real device testing. Sofy helps app development teams achieve high-quality releases by simplifying test maintenance and ensuring continuous precision. With a focus on efficiency and user experience, Sofy is trusted by top industries for its all-in-one testing solution.

Promptech
Promptech is an AI teamspace designed to streamline workflows and enhance productivity. It offers a range of features including AI assistants, a collaborative teamspace, and access to large language models (LLMs). Promptech is suitable for businesses of all sizes and can be used for a variety of tasks such as streamlining tasks, enhancing collaboration, and safeguarding IP. It is a valuable resource for technology leaders and provides a cost-effective AI solution for smaller teams and startups.

Global Nodes
Global Nodes is a global leader in innovative solutions, specializing in Artificial Intelligence, Data Engineering, Cloud Services, Software Development, and Mobile App Development. They integrate advanced AI to accelerate product development and provide custom, secure, and scalable solutions. With a focus on cutting-edge technology and visionary thinking, Global Nodes offers services ranging from ideation and design to precision execution, transforming concepts into market-ready products. Their team has extensive experience in delivering top-notch AI, cloud, and data engineering services, making them a trusted partner for businesses worldwide.

Everseen
Everseen is an AI platform that offers a comprehensive suite of tools for data collection, contextualization, insight discovery, process modeling, video translation, AI reasoning, model engineering, continuous learning, governance, and more. It is designed to help businesses in the retail industry prevent losses, accelerate sales, protect inventory, improve product availability, and ensure process integrity. Everseen's Vision AI Factory supports hyper-scaled applications with value assurance and governance at its core, enabling users to combat retail shrink threats effectively.

GitStart
GitStart is an AI-powered platform that offers Elastic Engineering Capacity by assigning tickets and delivering high-quality production code. It leverages AI agents and a global developer community to increase engineering capacity without hiring more staff. GitStart is supported by top tech leaders and provides solutions for bugs, tech debt, frontend and backend development. The platform aims to empower developers, create economic opportunities, and grow the world's future software talent.

Coursera
Coursera is an online learning platform that offers courses, specializations, and degrees from top universities and companies. It provides a wide range of courses in various fields, including data science, business, computer science, health, social sciences, personal development, arts and humanities, physical science and engineering, language learning, information technology, and math and logic. Coursera also offers professional certificates and degrees that can help learners advance their careers. The platform has over 124 million users and collaborates with over 325 leading universities and companies.

PromptInterface.ai
PromptInterface.ai is an innovative prompt engineering solution that allows users to create personalized assistants for colleagues using intuitive forms with GPT-4 prompts. It revolutionizes business processes by optimizing collaborative work, boosting productivity, improving communication, and simplifying time-consuming tasks. The application offers clear and transparent pricing, secure payments, and the ability to manage subscriptions easily. With no limit to prompt templates and compatibility with smartphones, PromptInterface.ai is a powerful and user-friendly tool for businesses looking to automate processes and enhance team collaboration.

Mogul AI
Mogul AI is a global leader in AI recruitment, offering end-to-end solutions to streamline the recruitment process for inclusive workplaces. With a comprehensive candidate database, AI search and filters, and various AI-powered features, Mogul AI helps employers hire more effectively and efficiently. The platform is trusted by Fortune 1000 companies, leading startups, and top-tier firms across industries.

Wild Moose
Wild Moose is an AI-powered tool designed to streamline incident response and site reliability engineering processes. It offers fast and efficient root cause analysis by automatically gathering and analyzing logs, metrics, and code to pinpoint issues. The tool converts tribal knowledge into custom playbooks, constantly improves performance with a learning system model, and integrates seamlessly with existing observability and alerting tools. Wild Moose helps users quickly identify root causes with real-time production data, reducing downtime and empowering engineers to focus on strategic work.

Maven
Maven is an AI-powered platform offering live, online courses for professionals in various fields such as product design, engineering, marketing, business, leadership, and investing. The platform provides interactive cohorts with high student engagement, hands-on projects, and up-to-date case studies to help professionals acquire practical skills for immediate application in their jobs. Maven's curated frameworks and expert feedback aim to accelerate career growth by condensing years of operating experience into weeks. With a focus on AI-related courses, Maven offers certifications and training programs to help individuals confidently build AI products and lead AI organizations.

Kodus
Kodus is an AI-powered tool designed for agile project management. It offers automated assistance to team leaders in analyzing team performance, identifying productivity opportunities, and providing improvement suggestions. The tool keeps teams updated on progress, automates management processes, and ensures the integrity of engineering and agility metrics. Kodus aims to help teams unlock their full potential by streamlining processes and enhancing productivity within 90 days.

AMP Smart Sortation
AMP Smart Sortation™ is waste sortation's permanent solution. As the leader in AI-powered sortation, we give waste and recycling leaders the power to reduce labor costs, increase resource recovery, and deliver more reliable operations. AMP's AI-powered automation allows real-time material characterization and configuration to capture the most value from any material stream.

AMP Smart Sortation™
AMP Smart Sortation™ is the waste sortation industry's permanent solution. As the leader in AI-powered sortation, AMP gives waste and recycling leaders the power to reduce labor costs, increase resource recovery, and deliver more reliable operations. AMP's AI-powered automation allows real-time material characterization and configuration to capture the most value from any material stream.
20 - Open Source Tools

middleware
Middleware is an open-source engineering management tool that helps engineering leaders measure and analyze team effectiveness using DORA metrics. It integrates with CI/CD tools, automates DORA metric collection and analysis, visualizes key performance indicators, provides customizable reports and dashboards, and integrates with project management platforms. Users can set up Middleware using Docker or manually, generate encryption keys, set up backend and web servers, and access the application to view DORA metrics. The tool calculates DORA metrics using GitHub data, including Deployment Frequency, Lead Time for Changes, Mean Time to Restore, and Change Failure Rate. Middleware aims to provide DORA metrics to users based on their Git data, simplifying the process of tracking software delivery performance and operational efficiency.

ai-enablement-stack
The AI Enablement Stack is a curated collection of venture-backed companies, tools, and technologies that enable developers to build, deploy, and manage AI applications. It provides a structured view of the AI development ecosystem across five key layers: Agent Consumer Layer, Observability and Governance Layer, Engineering Layer, Intelligence Layer, and Infrastructure Layer. Each layer focuses on specific aspects of AI development, from end-user interaction to model training and deployment. The stack aims to help developers find the right tools for building AI applications faster and more efficiently, assist engineering leaders in making informed decisions about AI infrastructure and tooling, and help organizations understand the AI development landscape to plan technology adoption.

awesome-mobile-robotics
The 'awesome-mobile-robotics' repository is a curated list of important content related to Mobile Robotics and AI. It includes resources such as courses, books, datasets, software and libraries, podcasts, conferences, journals, companies and jobs, laboratories and research groups, and miscellaneous resources. The repository covers a wide range of topics in the field of Mobile Robotics and AI, providing valuable information for enthusiasts, researchers, and professionals in the domain.

Korean-SAT-LLM-Leaderboard
The Korean SAT LLM Leaderboard is a benchmarking project that allows users to test their fine-tuned Korean language models on a 10-year dataset of the Korean College Scholastic Ability Test (CSAT). The project provides a platform to compare human academic ability with the performance of large language models (LLMs) on various question types to assess reading comprehension, critical thinking, and sentence interpretation skills. It aims to share benchmark data, utilize a reliable evaluation dataset curated by the Korea Institute for Curriculum and Evaluation, provide annual updates to prevent data leakage, and promote open-source LLM advancement for achieving top-tier performance on the Korean CSAT.

MATLAB-Simulink-Challenge-Project-Hub
MATLAB-Simulink-Challenge-Project-Hub is a repository aimed at contributing to the progress of engineering and science by providing challenge projects with real industry relevance and societal impact. The repository offers a wide range of projects covering various technology trends such as Artificial Intelligence, Autonomous Vehicles, Big Data, Computer Vision, and Sustainability. Participants can gain practical skills with MATLAB and Simulink while making a significant contribution to science and engineering. The projects are designed to enhance expertise in areas like Sustainability and Renewable Energy, Control, Modeling and Simulation, Machine Learning, and Robotics. By participating in these projects, individuals can receive official recognition for their problem-solving skills from technology leaders at MathWorks and earn rewards upon project completion.

autoarena
AutoArena is a tool designed to create leaderboards ranking Language Model outputs against one another using automated judge evaluation. It allows users to rank outputs from different LLMs, RAG setups, and prompts to find the best configuration of their system. Users can perform automated head-to-head evaluation using judges from various platforms like OpenAI, Anthropic, and Cohere. Additionally, users can define and run custom judges, connect to internal services, or implement bespoke logic. AutoArena enables users to run the application locally, providing full control over their environment and data.

baml
BAML is a config file format for declaring LLM functions that you can then use in TypeScript or Python. With BAML you can Classify or Extract any structured data using Anthropic, OpenAI or local models (using Ollama) ## Resources  [Discord Community](https://discord.gg/boundaryml)  [Follow us on Twitter](https://twitter.com/boundaryml) * Discord Office Hours - Come ask us anything! We hold office hours most days (9am - 12pm PST). * Documentation - Learn BAML * Documentation - BAML Syntax Reference * Documentation - Prompt engineering tips * Boundary Studio - Observability and more #### Starter projects * BAML + NextJS 14 * BAML + FastAPI + Streaming ## Motivation Calling LLMs in your code is frustrating: * your code uses types everywhere: classes, enums, and arrays * but LLMs speak English, not types BAML makes calling LLMs easy by taking a type-first approach that lives fully in your codebase: 1. Define what your LLM output type is in a .baml file, with rich syntax to describe any field (even enum values) 2. Declare your prompt in the .baml config using those types 3. Add additional LLM config like retries or redundancy 4. Transpile the .baml files to a callable Python or TS function with a type-safe interface. (VSCode extension does this for you automatically). We were inspired by similar patterns for type safety: protobuf and OpenAPI for RPCs, Prisma and SQLAlchemy for databases. BAML guarantees type safety for LLMs and comes with tools to give you a great developer experience:  Jump to BAML code or how Flexible Parsing works without additional LLM calls. | BAML Tooling | Capabilities | | ----------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | BAML Compiler install | Transpiles BAML code to a native Python / Typescript library (you only need it for development, never for releases) Works on Mac, Windows, Linux  | | VSCode Extension install | Syntax highlighting for BAML files Real-time prompt preview Testing UI | | Boundary Studio open (not open source) | Type-safe observability Labeling |

learn-generative-ai
Learn Cloud Applied Generative AI Engineering (GenEng) is a course focusing on the application of generative AI technologies in various industries. The course covers topics such as the economic impact of generative AI, the role of developers in adopting and integrating generative AI technologies, and the future trends in generative AI. Students will learn about tools like OpenAI API, LangChain, and Pinecone, and how to build and deploy Large Language Models (LLMs) for different applications. The course also explores the convergence of generative AI with Web 3.0 and its potential implications for decentralized intelligence.

SWE-agent
SWE-agent is a tool that turns language models (e.g. GPT-4) into software engineering agents capable of fixing bugs and issues in real GitHub repositories. It achieves state-of-the-art performance on the full test set by resolving 12.29% of issues. The tool is built and maintained by researchers from Princeton University. SWE-agent provides a command line tool and a graphical web interface for developers to interact with. It introduces an Agent-Computer Interface (ACI) to facilitate browsing, viewing, editing, and executing code files within repositories. The tool includes features such as a linter for syntax checking, a specialized file viewer, and a full-directory string searching command to enhance the agent's capabilities. SWE-agent aims to improve prompt engineering and ACI design to enhance the performance of language models in software engineering tasks.

text-to-sql-bedrock-workshop
This repository focuses on utilizing generative AI to bridge the gap between natural language questions and SQL queries, aiming to improve data consumption in enterprise data warehouses. It addresses challenges in SQL query generation, such as foreign key relationships and table joins, and highlights the importance of accuracy metrics like Execution Accuracy (EX) and Exact Set Match Accuracy (EM). The workshop content covers advanced prompt engineering, Retrieval Augmented Generation (RAG), fine-tuning models, and security measures against prompt and SQL injections.

Bard-API
The Bard API is a Python package that returns responses from Google Bard through the value of a cookie. It is an unofficial API that operates through reverse-engineering, utilizing cookie values to interact with Google Bard for users struggling with frequent authentication problems or unable to authenticate via Google Authentication. The Bard API is not a free service, but rather a tool provided to assist developers with testing certain functionalities due to the delayed development and release of Google Bard's API. It has been designed with a lightweight structure that can easily adapt to the emergence of an official API. Therefore, using it for any other purposes is strongly discouraged. If you have access to a reliable official PaLM-2 API or Google Generative AI API, replace the provided response with the corresponding official code. Check out https://github.com/dsdanielpark/Bard-API/issues/262.

awesome-mlops
Awesome MLOps is a curated list of tools related to Machine Learning Operations, covering areas such as AutoML, CI/CD for Machine Learning, Data Cataloging, Data Enrichment, Data Exploration, Data Management, Data Processing, Data Validation, Data Visualization, Drift Detection, Feature Engineering, Feature Store, Hyperparameter Tuning, Knowledge Sharing, Machine Learning Platforms, Model Fairness and Privacy, Model Interpretability, Model Lifecycle, Model Serving, Model Testing & Validation, Optimization Tools, Simplification Tools, Visual Analysis and Debugging, and Workflow Tools. The repository provides a comprehensive collection of tools and resources for individuals and teams working in the field of MLOps.

awesome-llm-json
This repository is an awesome list dedicated to resources for using Large Language Models (LLMs) to generate JSON or other structured outputs. It includes terminology explanations, hosted and local models, Python libraries, blog articles, videos, Jupyter notebooks, and leaderboards related to LLMs and JSON generation. The repository covers various aspects such as function calling, JSON mode, guided generation, and tool usage with different providers and models.

jobs
The 'jobs' repository by comma.ai focuses on solving self-driving cars by building a robotics stack that includes state-of-the-art machine learning models, operating system design, hardware development, and manufacturing. The company aims to deliver constant incremental progress in self-driving technology to users, with a focus on practical solutions rather than hype. Job opportunities at comma.ai include technical challenges, phone screenings, and paid micro-internships, with perks such as chef-prepared meals, on-site gym access, and health insurance. The teams at comma.ai are organized into web, systems, infrastructure, product, design, and electrical engineering, with specific challenges for each team. The repository also offers opportunities for non-job seekers to participate in challenges and win prizes.

ai-notes
Notes on AI state of the art, with a focus on generative and large language models. These are the "raw materials" for the https://lspace.swyx.io/ newsletter. This repo used to be called https://github.com/sw-yx/prompt-eng, but was renamed because Prompt Engineering is Overhyped. This is now an AI Engineering notes repo.

llm-resource
llm-resource is a comprehensive collection of high-quality resources for Large Language Models (LLM). It covers various aspects of LLM including algorithms, training, fine-tuning, alignment, inference, data engineering, compression, evaluation, prompt engineering, AI frameworks, AI basics, AI infrastructure, AI compilers, LLM application development, LLM operations, AI systems, and practical implementations. The repository aims to gather and share valuable resources related to LLM for the community to benefit from.

SWE-agent
SWE-agent is a tool that allows language models to autonomously fix issues in GitHub repositories, perform tasks on the web, find cybersecurity vulnerabilities, and handle custom tasks. It uses configurable agent-computer interfaces (ACIs) to interact with isolated computer environments. The tool is built and maintained by researchers from Princeton University and Stanford University.

LLM4SE
The collection is actively updated with the help of an internal literature search engine.

MMMU
MMMU is a benchmark designed to evaluate multimodal models on college-level subject knowledge tasks, covering 30 subjects and 183 subfields with 11.5K questions. It focuses on advanced perception and reasoning with domain-specific knowledge, challenging models to perform tasks akin to those faced by experts. The evaluation of various models highlights substantial challenges, with room for improvement to stimulate the community towards expert artificial general intelligence (AGI).

bigcodebench
BigCodeBench is an easy-to-use benchmark for code generation with practical and challenging programming tasks. It aims to evaluate the true programming capabilities of large language models (LLMs) in a more realistic setting. The benchmark is designed for HumanEval-like function-level code generation tasks, but with much more complex instructions and diverse function calls. BigCodeBench focuses on the evaluation of LLM4Code with diverse function calls and complex instructions, providing precise evaluation & ranking and pre-generated samples to accelerate code intelligence research. It inherits the design of the EvalPlus framework but differs in terms of execution environment and test evaluation.
20 - OpenAI Gpts

Tech Leader Job Interview
Discusses leadership qualities in tech, offers insights and feedback.

Entrepreneurial Engineering Educator
Assists designing your engineering course for entrepreneurial learning.

Engineering Manager Coach
Guiding engineering managers with insights on team dynamics, development, and evaluations.

Engineering Thesis Generator
Delivers formal, academically rigorous engineering thesis content

Engineering Design Graphics - CATIA Tutor
Tutor for Engineering Design Graphics with CATIA expertise

Biomedical Engineering Expert
Your personal biomedical engineer. Create anything related to BME.

Mechanical Engineering Tutor
An mechanical engineering tutor, aiding with concepts and problem-solving.

Avalanche - Reverse Engineering & CTF Assistant
Assisting with reverse engineering and CTF using write ups and instructions for solving challenges

Polymer Engineering Advisor
Guides polymer selection and application in manufacturing processes.

Process Engineering Advisor
Optimizes production processes for improved efficiency and quality.

Environmental Engineering Advisor
Advises on sustainable engineering solutions to environmental challenges.

Transportation Engineering Advisor
Provides expert guidance in transportation engineering projects.

Thermal Engineering Advisor
Guides thermal management solutions for efficient system performance.