{"id":51221157,"url":"https://github.com/harbor-framework/awesome-harbor","last_synced_at":"2026-06-28T07:04:36.435Z","repository":{"id":334979515,"uuid":"1143642362","full_name":"harbor-framework/awesome-harbor","owner":"harbor-framework","description":"A curated list of awesome Harbor ecosystem projects","archived":false,"fork":false,"pushed_at":"2026-05-29T17:55:44.000Z","size":21,"stargazers_count":40,"open_issues_count":1,"forks_count":2,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-05-29T19:21:36.890Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/harbor-framework.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-01-27T20:39:26.000Z","updated_at":"2026-05-29T17:55:49.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/harbor-framework/awesome-harbor","commit_stats":null,"previous_names":["harbor-framework/awesome-harbor"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/harbor-framework/awesome-harbor","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/harbor-framework%2Fawesome-harbor","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/harbor-framework%2Fawesome-harbor/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/harbor-framework%2Fawesome-harbor/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/harbor-framework%2Fawesome-harbor/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/harbor-framework","download_url":"https://codeload.github.com/harbor-framework/awesome-harbor/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/harbor-framework%2Fawesome-harbor/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34880227,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-28T02:00:05.809Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-06-28T07:04:35.857Z","updated_at":"2026-06-28T07:04:36.428Z","avatar_url":"https://github.com/harbor-framework.png","language":null,"funding_links":[],"categories":["Others"],"sub_categories":[],"readme":"# Awesome Harbor\n\nA curated list of awesome projects in the Harbor ecosystem.\n\n## Contents\n\n- [Evaluation Benchmarks](#evaluation-benchmarks)\n- [Training Datasets](#training-datasets)\n- [Training \u0026 RL](#training--rl)\n- [Tools](#tools)\n\n---\n\n## Evaluation Benchmarks\n\n- [terminal-bench-2](https://github.com/laude-institute/terminal-bench-2) - Measures agent ability to complete tasks in a terminal\n- [terminal-bench-pro](https://github.com/alibaba/terminal-bench-pro) - Extension of terminal-bench by Alibaba\n- [skillsbench](https://github.com/benchflow-ai/skillsbench) - Measures agent ability to use skills\n- [otel-bench](https://github.com/QuesmaOrg/otel-bench) - Measures agent ability to instrument code with OpenTelemetry across multiple languages\n- [CompileBench](https://github.com/QuesmaOrg/CompileBench) - Measures agent ability to build a working binary from source\n- [harbor-datasets](https://github.com/laude-institute/harbor-datasets) - Popular benchmarks (e.g. SWE-bench verified) ported to run in Harbor.\n- [RuneBench](https://github.com/MaxBittker/RuneBench) - Measures agent ability to play RuneScape and complete tasks via TypeScript SDK\n- [legacy-bench](https://github.com/Factory-AI/legacy-bench) - Evaluates agents on maintaining, debugging, and modernizing legacy code in COBOL, Java 7, Fortran, C, and Assembly\n- [SWE-Atlas](https://github.com/scaleapi/SWE-Atlas) - Evaluates agents on professional SWE tasks including codebase comprehension and test writing\n\n## Training Datasets\n\n- [SWE-gen-Java](https://github.com/abundant-ai/SWE-gen-Java) - 1000 JVM tasks generated from 16 open-source GitHub repos using [SWE-gen](https://github.com/abundant-ai/SWE-gen)\n- [SWE-gen-JS](https://github.com/abundant-ai/SWE-gen-JS) - 1000 JS/TS tasks generated from 30 open-source GitHub repos using [SWE-gen](https://github.com/abundant-ai/SWE-gen)\n- [SWE-gen-Rust](https://github.com/abundant-ai/SWE-gen-Rust) - 1000 Rust SWE tasks generated using [SWE-gen](https://github.com/abundant-ai/SWE-gen)\n- [SWE-gen-Go](https://github.com/abundant-ai/SWE-gen-Go) - 1000 Go SWE tasks generated using [SWE-gen](https://github.com/abundant-ai/SWE-gen)\n- [SWE-gen-Cpp](https://github.com/abundant-ai/SWE-gen-Cpp) - 1000 C++ SWE tasks generated using [SWE-gen](https://github.com/abundant-ai/SWE-gen)\n- [Nemotron-Terminal-Synthetic-Tasks](https://huggingface.co/datasets/nvidia/Nemotron-Terminal-Synthetic-Tasks) - Synthetic terminal tasks by NVIDIA\n- [seta-env](https://github.com/camel-ai/seta-env) - Scaling Environments for Terminal Agents: fully automated Harbor task synthesis and verification\n\n## Training \u0026 RL\n\n- [OpenThoughts-Agent](https://github.com/open-thoughts/OpenThoughts-Agent) - Generating Harbor tasks, distilling trajectories with SFT, and training with SkyRL\n- [endless-terminals](https://github.com/kanishkg/endless-terminals) - Procedurally generates terminal-use tasks and trains terminal agents with SkyRL\n- [Ares](https://github.com/withmartian/ares) - Framework for online RL training of LLM agents, built on Harbor and SkyRL\n- [SkyRL Harbor Integration](https://docs.skyrl.ai/docs/harbor) - Guide for RL training of agents with SkyRL and Harbor\n\n## Tools\n\n- [harbor-bot](https://github.com/parsewave/harbor-bot) - GitHub bot automating QA on Harbor tasks\n- [Benchmark Template](https://github.com/harbor-framework/benchmark) - Template for building benchmarks on Harbor with automated QA in CI\n- [SWE-gen](https://github.com/abundant-ai/SWE-gen) - Convert GitHub PRs into Harbor tasks\n- [Oddish](https://github.com/abundant-ai/oddish) - Eval scheduler for running Harbor tasks with provider-aware queuing and automatic retries\n- [TerminalBenchTaskGenerator](https://github.com/yipihey/TerminalBenchTaskGenerator) - Desktop app for chat-driven authoring of Harbor benchmark tasks\n- [AutoAgent](https://github.com/kevinrgu/autoagent) - Autonomous agent harness engineering driven by benchmark scores\n- [Meta-Harness](https://github.com/stanford-iris-lab/meta-harness-tbench2-artifact) - Autonomous improvement of harness code using previous iterations and Harbor evaluations\n- [ATIF Trajectory Viewer](https://github.com/Slimshilin/ATIF-trajectory-viewer) - Browser-based viewer for replaying agent trajectories and analyzing failures with an automated failure taxonomy\n\n---\n\n## Contributing\n\nContributions welcome! Open a PR to add a project you have created or love using.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fharbor-framework%2Fawesome-harbor","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fharbor-framework%2Fawesome-harbor","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fharbor-framework%2Fawesome-harbor/lists"}