Best AI tools for< Assessment Developer >
Infographic
20 - AI tool Sites
Assessment Systems
Assessment Systems is an online testing platform that provides cost-effective, AI-driven solutions to develop, deliver, and analyze high-stakes exams. With Assessment Systems, you can build and deliver smarter exams faster, thanks to modern psychometrics and AI like computerized adaptive testing, multistage testing, or automated item generation. You can also deliver exams flexibly: paper, online testing unproctored, online proctored, and test centers (yours or ours). Assessment Systems also offers item banking software to build better tests in less time, with collaborative item development brought to life with versioning, user roles, metadata, workflow management, multimedia, automated item generation, and much more.
Questgen
Questgen is an AI-powered quiz generator that allows users to create various types of assessments, including multiple choice questions (MCQs), true/false questions, fill-in-the-blanks, and higher-order questions, from any text in one click. It is designed for teachers, schools, HR teams, publishers, and edtech companies to save time and effort in creating assessments.
Reppls
Reppls is an AI Interview Agents tool designed for data-driven hiring processes. It helps companies interview all applicants to identify the right talents hidden behind uninformative CVs. The tool offers seamless integration with daily tools, such as Zoom and MS Teams, and provides deep technical assessments in the early stages of hiring, allowing HR specialists to focus on evaluating soft skills. Reppls aims to transform the hiring process by saving time spent on screening, interviewing, and assessing candidates.
Edexia
Edexia is an AI-powered platform designed to revolutionize the assessment process in education. It offers advanced features such as AI assessment moderation and feedback, aiming to improve all aspects of assessment while saving teachers up to 80% of their time. Edexia focuses on providing better feedback, grading, insights, and efficiency, ultimately transforming the assessment experience for both teachers and students. The platform is trusted by various schools and is committed to positively impacting education by enhancing the teacher-student connection and improving student outcomes.
Yippity
Yippity is an AI-powered question generator that helps educators and trainers create engaging and interactive assessments. With Yippity, you can easily create multiple choice, true/false, fill-in-the-blank, and short answer questions. You can also add images, videos, and audio to your questions to make them more engaging. Yippity is a great tool for creating formative assessments, quizzes, and tests. It can also be used to create practice questions for students who are preparing for standardized tests.
Recognito
Recognito is a leading facial recognition technology provider, offering the NIST FRVT Top 1 Face Recognition Algorithm. Their high-performance biometric technology is used by police forces and security services to enhance public safety, manage individual movements, and improve audience analytics for businesses. Recognito's software goes beyond object detection to provide detailed user role descriptions and develop user flows. The application enables rapid face and body attribute recognition, video analytics, and artificial intelligence analysis. With a focus on security, living, and business improvements, Recognito helps create safer and more prosperous cities.
THE Journal
THE Journal is an AI-powered educational technology platform that focuses on providing the latest news, insights, and resources related to technology in education. It covers a wide range of topics such as cybersecurity, AI applications in education, STEM education, and emerging trends in educational technology. THE Journal aims to transform education through the integration of technology, offering valuable information to educators, administrators, and policymakers to enhance teaching and learning experiences.
InterviewQueue
InterviewQueue is an AI-powered online assessment software platform that revolutionizes the recruitment process. It offers customizable coding challenges, insightful AI analytics, and seamless API integration for efficient hiring. With features like custom assessments, AI evaluation, and API integration, InterviewQueue aims to streamline the recruitment process and provide objective evaluations. The platform helps in making data-driven hiring decisions, optimizing the interview process, and enhancing the candidate experience. InterviewQueue focuses on efficiency, customization, objective evaluation, data-driven decisions, and candidate-centric assessments.
EverLyn AI
EverLyn AI is a platform that allows users to build AI-powered tutors. These tutors can provide personalized and instant support to students, as well as automated assessment. This can help to create a more personalized and effective learning experience for students.
mapEDU
mapEDU is an AI-powered curriculum mapping and exam tagging software designed specifically for healthcare professions schools. It uses natural language processing and machine learning to automatically extract relevant MeSH tags from existing digital content, map events/courses/programs with outcomes, and auto-tag exam questions. This provides healthcare professions schools with objective, actionable data to improve curriculum design, validate revisions, and enhance student performance analytics.
Accessibility Desk
Accessibility Desk is an accredited research and training agency specializing in digital accessibility and the WCAG. They provide accessibility audits for websites and apps based on the WCAG-EM standard. The agency is committed to creating a digital world that is accessible to all by offering knowledge sharing, specific advice, and assistance to organizations in improving their accessibility.
DevOps Security Platform
DevOps Security Platform is an AI-native security tool designed to automate security requirements definition, enforcement, risk assessments, and threat modeling. It helps companies secure their applications by identifying risks and security requirements at the beginning of the Software Development Lifecycle and enforcing them before go-live. The platform offers innovative features, customization options, and seamless integrations with existing tools to enhance security practices.
Play2Learn
Play2Learn is an AI-powered learning platform that revolutionizes training and lifelong learning through gamification. It offers a suite of tailored games that foster skill development, virtual empowerment, and real-time insights. The platform leverages AI tools for seamless customization, creating immersive scenarios that test player knowledge through relatable analogies. With its intuitive dashboard, Play2Learn provides detailed metrics to identify knowledge gaps and make informed decisions. The platform's gamified approach engages players with levels, scores, and badges, encouraging active participation and knowledge retention.
MagicForm
MagicForm is an AI-powered tool that helps users create quizzes and tests in seconds. It utilizes AI to automatically generate questions from any text, making it easy for teachers, schools, and HR teams to create assessments at scale. MagicForm is also used by publishers and edtech companies to create assessments from compliance documents and textbooks.
NextCommit
NextCommit is an AI-driven platform designed to assist tech professionals in landing remote tech jobs. From job discovery to application support, the platform offers tools and insights to simplify the job search process and enhance the presentation of professional skills. With features like Smart Matching, Freshly-Curated Tech Jobs, Refined Search Filters, In-depth CV quality analysis, and Accurate skills assessment, NextCommit aims to streamline the job hunting experience for tech experts.
ScamMinder
ScamMinder is an AI-powered tool designed to enhance online safety by analyzing and evaluating websites in real-time. It harnesses cutting-edge AI technology to provide users with a safety score and detailed insights, helping them detect potential risks and red flags. By utilizing advanced machine learning algorithms, ScamMinder assists users in making informed decisions about engaging with websites, businesses, and online entities. With a focus on trustworthiness assessment, the tool aims to protect users from deceptive traps and safeguard their digital presence.
MobiHeals
MobiHeals is a mobile application focused on security analysis and vulnerability checks for mobile apps. It offers comprehensive security vulnerability analysis, cloud-based static and dynamic application security testing, and integrated vulnerability assessment in one platform. MobiHeals helps users comply with global cybersecurity guidelines and manage security vulnerabilities throughout the development, testing, and operation stages of mobile applications.
Odeum AI
Odeum AI is a game-based immersive learning platform revolutionizing education by creating interactive RPGs powered by AI. With Odeum Studio, educators can easily customize educational games to engage students in dynamic, game-based learning environments. The platform offers features like customizable content creation, student engagement boost, progress tracking, and integrated assessment tools. Odeum AI's flagship product, 'Hua Mulan: A Chinese Learning Adventure,' combines language learning with historical storytelling to enhance Mandarin Chinese skills, cultural understanding, engagement, and critical thinking. The platform aims to provide experiential learning experiences that captivate students' interest and improve language acquisition.
AI Teaching Assistant Pro
AI Teaching Assistant Pro is a free, private, and confidential AI-powered tool developed by Contact North | Contact Nord. It serves as a personal teaching and instructional design assistant to help instructors with various tasks related to course creation and assessment. The tool offers enhanced assessment features, including the ability to easily draft multiple-choice tests and exams with AI-powered efficiency. Instructors can also generate ideas for course descriptions, outcomes, and syllabi with just a few clicks. AI Teaching Assistant Pro aims to streamline the teaching process and provide valuable support to educators.
Breakout Learning
Breakout Learning is an AI-powered educational platform that transforms traditional case studies into engaging, multifaceted experiences. It empowers professors with AI insights into small-group discussions, enabling them to customize lectures and foster deeper student comprehension. Students benefit from rich content, peer-led discussions, and AI assessment that provides personalized feedback and tracks their progress.
20 - Open Source Tools
awesome-artificial-intelligence-guidelines
The 'Awesome AI Guidelines' repository aims to simplify the ecosystem of guidelines, principles, codes of ethics, standards, and regulations around artificial intelligence. It provides a comprehensive collection of resources addressing ethical and societal challenges in AI systems, including high-level frameworks, principles, processes, checklists, interactive tools, industry standards initiatives, online courses, research, and industry newsletters, as well as regulations and policies from various countries. The repository serves as a valuable reference for individuals and teams designing, building, and operating AI systems to navigate the complex landscape of AI ethics and governance.
fairlearn
Fairlearn is a Python package designed to help developers assess and mitigate fairness issues in artificial intelligence (AI) systems. It provides mitigation algorithms and metrics for model assessment. Fairlearn focuses on two types of harms: allocation harms and quality-of-service harms. The package follows the group fairness approach, aiming to identify groups at risk of experiencing harms and ensuring comparable behavior across these groups. Fairlearn consists of metrics for assessing model impacts and algorithms for mitigating unfairness in various AI tasks under different fairness definitions.
responsible-ai-toolbox
Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment interfaces and libraries for understanding AI systems. It empowers developers and stakeholders to develop and monitor AI responsibly, enabling better data-driven actions. The toolbox includes visualization widgets for model assessment, error analysis, interpretability, fairness assessment, and mitigations library. It also offers a JupyterLab extension for managing machine learning experiments and a library for measuring gender bias in NLP datasets.
agentUniverse
agentUniverse is a framework for developing applications powered by multi-agent based on large language model. It provides essential components for building single agent and multi-agent collaboration mechanism for customizing collaboration patterns. Developers can easily construct multi-agent applications and share pattern practices from different fields. The framework includes pre-installed collaboration patterns like PEER and DOE for complex task breakdown and data-intensive tasks.
lobe-chat-plugins
Lobe Chat Plugins Index is a repository that serves as a collection of various plugins for Function Calling. Users can submit their plugins by following specific instructions. The repository includes a wide range of plugins for different tasks such as image generation, stock analysis, web search, NFT tracking, calendar management, and more. Each plugin is tagged with relevant keywords for easy identification and usage. The repository encourages contributions and provides guidelines for submitting new plugins. It is a valuable resource for developers looking to enhance chatbot functionalities with different plugins.
code2prompt
Code2Prompt is a powerful command-line tool that generates comprehensive prompts from codebases, designed to streamline interactions between developers and Large Language Models (LLMs) for code analysis, documentation, and improvement tasks. It bridges the gap between codebases and LLMs by converting projects into AI-friendly prompts, enabling users to leverage AI for various software development tasks. The tool offers features like holistic codebase representation, intelligent source tree generation, customizable prompt templates, smart token management, Gitignore integration, flexible file handling, clipboard-ready output, multiple output options, and enhanced code readability.
ai-collective-tools
ai-collective-tools is an open-source community dedicated to creating a comprehensive collection of AI tools for developers, researchers, and enthusiasts. The repository provides a curated selection of AI tools and resources across various categories such as 3D, Agriculture, Art, Audio Editing, Avatars, Chatbots, Code Assistant, Cooking, Copywriting, Crypto, Customer Support, Dating, Design Assistant, Design Generator, Developer, E-Commerce, Education, Email Assistant, Experiments, Fashion, Finance, Fitness, Fun Tools, Gaming, General Writing, Gift Ideas, HealthCare, Human Resources, Image Classification, Image Editing, Image Generator, Interior Designing, Legal Assistant, Logo Generator, Low Code, Models, Music, Paraphraser, Personal Assistant, Presentations, Productivity, Prompt Generator, Psychology, Real Estate, Religion, Research, Resume, Sales, Search Engine, SEO, Shopping, Social Media, Spreadsheets, SQL, Startup Tools, Story Teller, Summarizer, Testing, Text to Speech, Text to Image, Transcriber, Travel, Video Editing, Video Generator, Weather, Writing Generator, and Other Resources.
llms-tools
The 'llms-tools' repository is a comprehensive collection of AI tools, open-source projects, and research related to Large Language Models (LLMs) and Chatbots. It covers a wide range of topics such as AI in various domains, open-source models, chats & assistants, visual language models, evaluation tools, libraries, devices, income models, text-to-image, computer vision, audio & speech, code & math, games, robotics, typography, bio & med, military, climate, finance, and presentation. The repository provides valuable resources for researchers, developers, and enthusiasts interested in exploring the capabilities of LLMs and related technologies.
wave-apps
Wave Apps is a directory of sample applications built on H2O Wave, allowing users to build AI apps faster. The apps cover various use cases such as explainable hotel ratings, human-in-the-loop credit risk assessment, mitigating churn risk, online shopping recommendations, and sales forecasting EDA. Users can download, modify, and integrate these sample apps into their own projects to learn about app development and AI model deployment.
aws-genai-llm-chatbot
This repository provides code to deploy a chatbot powered by Multi-Model and Multi-RAG using AWS CDK on AWS. Users can experiment with various Large Language Models and Multimodal Language Models from different providers. The solution supports Amazon Bedrock, Amazon SageMaker self-hosted models, and third-party providers via API. It also offers additional resources like AWS Generative AI CDK Constructs and Project Lakechain for building generative AI solutions and document processing. The roadmap and authors are listed, along with contributors. The library is licensed under the MIT-0 License with information on changelog, code of conduct, and contributing guidelines. A legal disclaimer advises users to conduct their own assessment before using the content for production purposes.
llm_benchmarks
llm_benchmarks is a collection of benchmarks and datasets for evaluating Large Language Models (LLMs). It includes various tasks and datasets to assess LLMs' knowledge, reasoning, language understanding, and conversational abilities. The repository aims to provide comprehensive evaluation resources for LLMs across different domains and applications, such as education, healthcare, content moderation, coding, and conversational AI. Researchers and developers can leverage these benchmarks to test and improve the performance of LLMs in various real-world scenarios.
openagi
OpenAGI is a framework designed to make the development of autonomous human-like agents accessible to all. It aims to pave the way towards open agents and eventually AGI for everyone. The initiative strongly believes in the transformative power of AI and offers developers a platform to create autonomous human-like agents. OpenAGI features a flexible agent architecture, streamlined integration and configuration processes, and automated/manual agent configuration generation. It can be used in education for personalized learning experiences, in finance and banking for fraud detection and personalized banking advice, and in healthcare for patient monitoring and disease diagnosis.
generative-ai-cdk-constructs
The AWS Generative AI Constructs Library is an open-source extension of the AWS Cloud Development Kit (AWS CDK) that provides multi-service, well-architected patterns for quickly defining solutions in code to create predictable and repeatable infrastructure, called constructs. The goal of AWS Generative AI CDK Constructs is to help developers build generative AI solutions using pattern-based definitions for their architecture. The patterns defined in AWS Generative AI CDK Constructs are high level, multi-service abstractions of AWS CDK constructs that have default configurations based on well-architected best practices. The library is organized into logical modules using object-oriented techniques to create each architectural pattern model.
MathVerse
MathVerse is an all-around visual math benchmark designed to evaluate the capabilities of Multi-modal Large Language Models (MLLMs) in visual math problem-solving. It collects high-quality math problems with diagrams to assess how well MLLMs can understand visual diagrams for mathematical reasoning. The benchmark includes 2,612 problems transformed into six versions each, contributing to 15K test samples. It also introduces a Chain-of-Thought (CoT) Evaluation strategy for fine-grained assessment of output answers.
ragas
Ragas is a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines. RAG denotes a class of LLM applications that use external data to augment the LLM’s context. There are existing tools and frameworks that help you build these pipelines but evaluating it and quantifying your pipeline performance can be hard. This is where Ragas (RAG Assessment) comes in. Ragas provides you with the tools based on the latest research for evaluating LLM-generated text to give you insights about your RAG pipeline. Ragas can be integrated with your CI/CD to provide continuous checks to ensure performance.
universal
The Universal Numbers Library is a header-only C++ template library designed for universal number arithmetic, offering alternatives to native integer and floating-point for mixed-precision algorithm development and optimization. It tailors arithmetic types to the application's precision and dynamic range, enabling improved application performance and energy efficiency. The library provides fast implementations of special IEEE-754 formats like quarter precision, half-precision, and quad precision, as well as vendor-specific extensions. It supports static and elastic integers, decimals, fixed-points, rationals, linear floats, tapered floats, logarithmic, interval, and adaptive-precision integers, rationals, and floats. The library is suitable for AI, DSP, HPC, and HFT algorithms.
BetaML.jl
The Beta Machine Learning Toolkit is a package containing various algorithms and utilities for implementing machine learning workflows in multiple languages, including Julia, Python, and R. It offers a range of supervised and unsupervised models, data transformers, and assessment tools. The models are implemented entirely in Julia and are not wrappers for third-party models. Users can easily contribute new models or request implementations. The focus is on user-friendliness rather than computational efficiency, making it suitable for educational and research purposes.
llm_aided_ocr
The LLM-Aided OCR Project is an advanced system that enhances Optical Character Recognition (OCR) output by leveraging natural language processing techniques and large language models. It offers features like PDF to image conversion, OCR using Tesseract, error correction using LLMs, smart text chunking, markdown formatting, duplicate content removal, quality assessment, support for local and cloud-based LLMs, asynchronous processing, detailed logging, and GPU acceleration. The project provides detailed technical overview, text processing pipeline, LLM integration, token management, quality assessment, logging, configuration, and customization. It requires Python 3.12+, Tesseract OCR engine, PDF2Image library, PyTesseract, and optional OpenAI or Anthropic API support for cloud-based LLMs. The installation process involves setting up the project, installing dependencies, and configuring environment variables. Users can place a PDF file in the project directory, update input file path, and run the script to generate post-processed text. The project optimizes processing with concurrent processing, context preservation, and adaptive token management. Configuration settings include choosing between local or API-based LLMs, selecting API provider, specifying models, and setting context size for local LLMs. Output files include raw OCR output and LLM-corrected text. Limitations include performance dependency on LLM quality and time-consuming processing for large documents.
awesome-mobile-robotics
The 'awesome-mobile-robotics' repository is a curated list of important content related to Mobile Robotics and AI. It includes resources such as courses, books, datasets, software and libraries, podcasts, conferences, journals, companies and jobs, laboratories and research groups, and miscellaneous resources. The repository covers a wide range of topics in the field of Mobile Robotics and AI, providing valuable information for enthusiasts, researchers, and professionals in the domain.
humanoid-gym
Humanoid-Gym is a reinforcement learning framework designed for training locomotion skills for humanoid robots, focusing on zero-shot transfer from simulation to real-world environments. It integrates a sim-to-sim framework from Isaac Gym to Mujoco for verifying trained policies in different physical simulations. The codebase is verified with RobotEra's XBot-S and XBot-L humanoid robots. It offers comprehensive training guidelines, step-by-step configuration instructions, and execution scripts for easy deployment. The sim2sim support allows transferring trained policies to accurate simulated environments. The upcoming features include Denoising World Model Learning and Dexterous Hand Manipulation. Installation and usage guides are provided along with examples for training PPO policies and sim-to-sim transformations. The code structure includes environment and configuration files, with instructions on adding new environments. Troubleshooting tips are provided for common issues, along with a citation and acknowledgment section.
20 - OpenAI Gpts
CP - Validate Assessment Methods
Helps with course design and explains assessment methods.
Essay Prompt Generator
K12 assessment expert, creating grade-level appropriate essay prompts.
EduStandard Catalog
Provides comprehensive guidance on educational standards and assessments.
Rúbricas de evaluación - ProfesTV
GPT especializado en generar rúbricas de evaluación educativas
Learning Objective Assistant
Creates measurable objectives from educational documents and suggests assessments based on those LO's. PDF's work best.
PsyItemGenerator
Generates items for psychometric instruments to measure psychological constructs.
Australian Curriculum & NAPLAN Tutor
Expert in Australian Curriculum & NAPLAN across all year levels.
🇬🇧 11+ Preparation Tutor
In-depth, friendly guide for mastering England's 11+ exams with comprehensive support
[サンプル] InterviewCat Backend Questions
問題集からバックエンドの技術質問(57+問)をランダムで出題します。回答に対して点数、評価ポイント、改善点を出し、最終的に面接に合格したかどうかを判断します。こちらはサンプルバージョンです。掲載問題数は減らしています。
WVA
Web Vulnerability Academy (WVA) is an interactive tutor designed to introduce users to web vulnerabilities while also providing them with opportunities to assess and enhance their knowledge through testing.
Web Accessibility Navigator
Expert in web design & accessibility, offering assessments and development guidance.