An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with humaneval

A curated list of projects in awesome lists tagged with humaneval .

https://github.com/bin123apple/autocoder

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

code-generation code-interpreter humaneval llm nlp nlp-machine-learning text-generation

Last synced: 21 Apr 2025

https://github.com/bin123apple/AutoCoder

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

code-generation code-interpreter humaneval llm nlp nlp-machine-learning text-generation

Last synced: 05 Apr 2025

https://github.com/the-crypt-keeper/can-ai-code

Self-evaluating interview for AI coders

ai ggml humaneval langchain llama-cpp llm transformers

Last synced: 05 Apr 2025

https://github.com/abacaj/code-eval

Run evaluation on LLMs using human-eval benchmark

humaneval wizardcoder

Last synced: 06 Apr 2025

https://github.com/zorse-project/coboleval

Evaluate LLM-generated COBOL

cobol evaluation humaneval llm

Last synced: 13 Apr 2025

https://github.com/declare-lab/llm-reasoningtest

Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions

gsm8k humaneval reasoning

Last synced: 30 Dec 2024