An open API service indexing awesome lists of open source software.

0 "evaluation" Awesome Lists

awesome-semantic-segmentation

:metal: awesome-semantic-segmentation

benchmark deeplearning evaluation semantic-segmentation

10,849 stars
2,466 forks
53 projects

Last updated: 22 Jul 2026

Awesome-LLM-Long-Context-Modeling

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

agent awsome-list benchmark blogs compress evaluation large-language-models length-extrapolation llm long-context-modeling

2,163 stars
102 forks
318 projects

Last updated: 17 Aug 2026

awesome-llm-eval

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

awsome-list awsome-lists benchmark bert chatglm chatgpt dataset evaluation gpt3 large-language-model

656 stars
87 forks
479 projects

Last updated: 30 Aug 2026

awesome-llm-unlearning

A resource repository for machine unlearning in large language models

ai-safety alignment awesome awesome-list evaluation knowledge-erasure large-language-model llm llm-safety llm-unlearning

618 stars
32 forks
770 projects

Last updated: 27 Jul 2026

Awesome-Evaluation-of-Visual-Generation

A list of works on evaluation of visual generation models, including evaluation metrics, models, and systems

awesome benchmark evaluation evaluation-metrics evaluation-system generative-models image-generation video-generation

454 stars
25 forks
2,052 projects

Last updated: 11 Jul 2026

awesome-ai-leaderboard

A curated list of awesome leaderboard-oriented resources for AI domain

ai-agent artificial-intelligence awesome-list benchmark deep-learning evaluation foundation-model large-ai-model leaderboard machine-learning

373 stars
58 forks
568 projects

Last updated: 31 Jul 2026

awesome-data-contamination

The Paper List on Data Contamination for Large Language Models Evaluation.

awesome-list data-contamination evaluation foundation-models large-language-models llm paper-list pre-trained-language-models pre-trained-model

119 stars
6 forks
268 projects

Last updated: 11 Aug 2026

awesome-ai-eval

☑️ A curated list of tools, methods & platforms for evaluating AI reliability in real applications

ai-evaluation ai-evaluation-framework ai-evaluation-metrics ai-evaluation-tools awesome awesome-list awesome-lists chatgpt claude evaluation

103 stars
28 forks
186 projects

Last updated: 07 Aug 2026

awesome-ai-agent-testing

🤖 A curated list of resources for testing AI agents - frameworks, methodologies, benchmarks, tools, and best practices for ensuring reliable, safe, and effective autonomous AI systems

agent-evaluation agentic-ai ai-agents ai-benchmark ai-safety artificial-intelligence awesome-list benchmark chaos chaos-engineering

46 stars
16 forks
168 projects

Last updated: 12 Aug 2026

awesome-datacentric-llm

Trending projects & awesome papers about data-centric llm studies.

data-centric-ai evaluation llm pre-training

40 stars
2 forks
45 projects

Last updated: 07 Feb 2026

Awesome-AI-Engineering

A full-stack LLM engineering playbook- practical guides for building, deploying, and evaluating LLM systems and AI agents.

agents ai-infrastructure deep-learning evaluation evaluation-framework fine-tuning langchain llm machine-learning mcp

13 stars
1 forks
71 projects

Last updated: 06 Aug 2026

awesome-agent-rl-environments

A curated list of training & evaluation environments for LLM/VLM agents (SWE-Gym, GEM, RAGEN, AgentGym, WebArena, OSWorld, ToolBench…). Updated weekly.

agent agent-rl agentic-ai awesome awesome-list benchmark browser-agent computer-use-agent evaluation grpo

7 stars
1 forks
70 projects

Last updated: 16 Aug 2026

Search
Keywords
awesome-list 4,514 awesome 4,011 awesome-lists 648 machine-learning 493 list 428 deep-learning 401 ai 349 resources 338 llm 311 python 235 hacktoberfest 230 lists 205 javascript 201 artificial-intelligence 190 security 186 open-source 174 ai-agents 170 programming 156 computer-vision 150 blockchain 148 large-language-models 140 curated-list 136 nlp 131 tools 126 mcp 124 data-science 114 chatgpt 114 react 110 developer-tools 105 android 99 natural-language-processing 94 learning 90 awesome-readme 90 devops 90 linux 87 cybersecurity 86 ios 83 awesome-resources 82 ai-tools 82 papers 82 reinforcement-learning 80 ethereum 78 generative-ai 77 openai 76 css 75 robotics 74 claude-code 74 rust 70 kubernetes 67 nodejs 67 computer-science 65 collection 63 survey 63 macos 61 design 61 playground 61 golang 61 claude 60 datasets 60 game-development 60 free-resources 59 java 59 web3 58 getvm 57 prompt-engineering 57 automation 57 privacy 56 php 56 hacking 56 agent 55 agentic-ai 55 bitcoin 54 frontend 53 education 52 llms 52 swift 51 tutorial 51 go 51 free 50 gpt 50 paper 50 github 49 typescript 49 research 49 agent-skills 49 web 49 dataset 48 books 48 security-tools 48 tutorials 48 agents 47 opensource 47 deep-neural-networks 46 data 46 api 46 productivity 45 cryptocurrency 45 development 45 diffusion-models 44 cloud 44 data-visualization 43 rag 43 html 42 paper-list 42 documentation 41 gamedev 41 database 41 docker 41 vue 41 software 40 open-data 40 anthropic 40 community 40 ml 39 web-development 38 collections 38 game 37 neural-network 36 cli 35 testing 35 multimodal 35 self-hosted 35 model-context-protocol 35 crypto 34 hands-on 34 labex 34 aws 34 reactjs 34 iot 34 courses 33 prompts 33 ai-agent 33 cpp 33 algorithms 33 software-engineering 33 exercises 33 video 32 defi 32 skills 32 graph-neural-networks 32 hardware 32 framework 32 flutter 32 games 31 penetration-testing 31 mlops 31 react-native 31 marketing 31 solidity 31 transformer 30 gemini 30 projects 30 saas 30 architecture 30 ruby 30 bioinformatics 30 libraries 30 dotnet 29 pentesting 29 reverse-engineering 29 mobile 29 knowledge-graph 28 image-generation 28 data-analysis 28 object-detection 28 smart-contracts 28 csharp 28 microsoft 28 best-practices 28 foundation-models 27 tensorflow 27 science 27 slam 27 llm-agents 27 osint 27 links 27 cryptography 27 music 27 video-generation 27 plugins 27 angular 27 openclaw 27 pytorch 27 windows 27 git 26 library 26 ui 26 self-supervised-learning 26 nextjs 26 serverless 26 jobs 26 mcp-server 26 markdown 26 data-mining 25 time-series 25 3d 25 kotlin 25 learning-resources 25 infosec 25 django 25 seo 24 deepseek 24 embedded 24 autonomous-agents 24 roadmap 24 langchain 24 segmentation 24 mathematics 24 computer-graphics 24 chatbot 24 neural-networks 24 chinese 24 codex 24 coding 23 awesomeness 23 interview 23 startups 23 devsecops 23 autonomous-driving 23 blog 23 unity 23 apple 23 game-engine 23 awsome-list 23 audio 23 cloud-computing 23 mcp-servers 23 reasoning 23 sql 23 vibe-coding 23 engineering 23 llama 22 startup 22 networking 22 programming-language 22 c 22 website 22 decentralized 22 benchmark 22 software-development 22 python3 22 federated-learning 22 text-to-image 22 finance 22 apps 21 r 21 deeplearning 21 blogs 21 embodied-ai 21 awsome 21 cursor 21 visualization 21 graphql 21 monitoring 21 claude-skills 21 hacktoberfest-accepted 21 gpt-3 21 terminal 20 js 20 graph 20 transformers 20 gis 20 optimization 20 azure 20 opendata 20 curated 20 youtube 20 ai-coding 20 gpt-4 19 raspberry-pi 19 machinelearning 19 ai-safety 19 cloud-native 19 big-data 19 statistics 19 telegram 19 stable-diffusion 19 speech-recognition 19 backend 19 representation-learning 19 multi-agent 19 analytics 18 prompt 18 data-structures 18 aigc 18 laravel 18 front-end 18 generative-art 18 guidelines 18 code 18 bugbounty 18 swiftui 18 vlm 18 remote-sensing 18 nerf 17 animation 17 image-processing 17 bash 17 autonomous-vehicles 17 quantization 17 containers 17 webgl 17 github-actions 17 data-engineering 17 mllm 17 command-line 17 android-development 17 cheatsheet 17 malware-analysis 17 large-language-model 17 generative-model 17 foss 17 pentest 17 reddit 16 dart 16 medical-imaging 16 distributed-systems 16 videos 16 articles 16 pose-estimation 16 llmops 16 bert 16 gaming 16 anomaly-detection 16 algorithm 16 system-design 16 performance 16 spain 16 knowledge 16 technology 16 language 16 microservices 16 readme 16 espana 16 ros 16 ecommerce 15 react-components 15 databases 15 ai-security 15 beginner-friendly 15 art 15 selfhosted 15 detection 15 resource 15 code-generation 15 npm 15 wasm 15 google 15 webassembly 15 text-to-video 15 mac 15 multimodal-deep-learning 15 students 15 vscode 15 recommender-system 15 graphics 15 vuejs 15 copilot 15 solana 15 coding-agents 15 awesome-ai 15 mysql 15 cms 15 evm 15 p2p 15 leetcode 15 multimodal-large-language-models 15 dotnet-core 14 oss 14 mobile-development 14 multimodal-learning 14 software-architecture 14 drones 14 yolo 14 android-library 14 knowledge-base 14 frameworks 14 vision-language-model 14 software-libre 14 vector-database 14 language-model 14 ui-design 14 diffusion 14 3d-graphics 14 planning 14 generative-adversarial-network 14 utilities 14 uav 14 ai-art 14 icons 14 trading 14 discord 14 node 14 wordpress 14 podcast 14 healthcare 14 observability 13 gan 13 semantic-segmentation 13 free-software 13 geospatial 13 datos-abiertos 13 sysadmin 13 developer 13 transfer-learning 13 deep-reinforcement-learning 13 ai-video 13 sre 13 automl 13 continual-learning 13 ctf 13 workflow 13 webdevelopment 13 unicorns 13 sustainability 13 programming-languages 13 open-science 13 pwa 13 infrastructure 13 microservice 13 bug-bounty 13 model-compression 13 quantum-computing 13 svelte 13 interview-questions 13 simulation 13 time-series-analysis 13 static-analysis 13 few-shot-learning 13 speech-to-text 13 dapp 13 multi-agent-systems 13 rl 13 search 13 objective-c 13 rest-api 13 threat-intelligence 13 storage 13 edge-computing 12 elasticsearch 12 privacy-tools 12 article 12 vision-and-language 12 prompt-injection 12 cyber-security 12 machine-learning-algorithms 12 question-answering 12 creative-coding 12 cuda 12 webapp 12 test-automation 12 application 12 drone 12 fintech 12 compliance 12 image 12 ros2 12 es6 12 fuzzing 12 neuroscience 12 rails 12 xai 12 static-site-generator 12 cicd 12 postgresql 12 search-engine 12 cross-platform 12 infrastructure-as-code 12 memory 12 authentication 12 ux 12 lua 12 evaluation 12 llm-security 12 graphics-programming 12 reading-list 12 vulnerabilities 12 chain-of-thought 12 social-media 12 email 12 leadership 12 guide 12 web-design 12 gpu 12 social-network 12 retrieval-augmented-generation 11 hacking-tools 11 in-context-learning 11 interpretability 11 indonesia 11 fpga 11 course 11 unity3d 11 minecraft 11 podcasts 11 classification 11 physics 11 cvpr 11 python-library 11 packages 11