{"id":38546534,"url":"https://github.com/codalab/codalab-competitions","last_synced_at":"2026-01-17T07:21:21.627Z","repository":{"id":8848929,"uuid":"10556194","full_name":"codalab/codalab-competitions","owner":"codalab","description":"CodaLab Competitions","archived":false,"fork":false,"pushed_at":"2025-07-11T14:04:48.000Z","size":75229,"stargazers_count":527,"open_issues_count":66,"forks_count":129,"subscribers_count":47,"default_branch":"develop","last_synced_at":"2025-07-11T15:52:06.696Z","etag":null,"topics":["artificial-intelligence","benchmarks","competitions","machine-learning","science"],"latest_commit_sha":null,"homepage":"https://codalab.lisn.fr","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codalab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.TXT","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2013-06-07T18:23:37.000Z","updated_at":"2025-07-11T12:18:29.000Z","dependencies_parsed_at":"2025-07-11T15:21:51.149Z","dependency_job_id":"d926b4f8-7318-458f-b816-cca5576336b4","html_url":"https://github.com/codalab/codalab-competitions","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/codalab/codalab-competitions","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codalab%2Fcodalab-competitions","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codalab%2Fcodalab-competitions/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codalab%2Fcodalab-competitions/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codalab%2Fcodalab-competitions/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codalab","download_url":"https://codeload.github.com/codalab/codalab-competitions/tar.gz/refs/heads/develop","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codalab%2Fcodalab-competitions/sbom","scorecard":{"id":295443,"data":{"date":"2025-08-11","repo":{"name":"github.com/codalab/codalab-competitions","commit":"b66732b22e5b02e602f62892d403899929c1cf45"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":4,"checks":[{"name":"Code-Review","score":2,"reason":"Found 3/14 approved changesets -- score normalized to 2","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Maintained","score":10,"reason":"0 commit(s) and 13 issue activity found in the last 90 days -- score normalized to 10","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/run-pytest.yaml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"License","score":9,"reason":"license file detected","details":["Info: project has a license file: LICENSE.TXT:0","Warn: project license file does not contain an FSF or OSI license."],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Info: Possibly incomplete results: error parsing shell code: invalid var name: codalab/config/templates/startup_env.sh:0","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/run-pytest.yaml:35: update your workflow using https://app.stepsecurity.io/secureworkflow/codalab/codalab-competitions/run-pytest.yaml/develop?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/run-pytest.yaml:37: update your workflow using https://app.stepsecurity.io/secureworkflow/codalab/codalab-competitions/run-pytest.yaml/develop?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/run-pytest.yaml:41: update your workflow using https://app.stepsecurity.io/secureworkflow/codalab/codalab-competitions/run-pytest.yaml/develop?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/run-pytest.yaml:82: update your workflow using https://app.stepsecurity.io/secureworkflow/codalab/codalab-competitions/run-pytest.yaml/develop?enable=pin","Warn: containerImage not pinned by hash: Dockerfile:1: pin your Docker image by updating python:3.8.3 to python:3.8.3@sha256:dd6cd8191ccbced2a6af5d0ddb51e6057c1444df14e14bcfd5c7b3ef78738050","Warn: containerImage not pinned by hash: docker/flower/Dockerfile:1: pin your Docker image by updating totem/celery-flower-docker to totem/celery-flower-docker@sha256:7796bf9184bd258b68bc6436aea9647dcbe76d0e659ae5b4394d144c063d7257","Warn: containerImage not pinned by hash: docker/rabbitmq/Dockerfile:1: pin your Docker image by updating rabbitmq:3.13.7-management to rabbitmq:3.13.7-management@sha256:977d4dc00b659ad1ae6445cc7e742cae526894a8dbef9aefea9d41f3951f3a09","Warn: downloadThenRun not pinned by hash: Dockerfile:4","Warn: pipCommand not pinned by hash: Dockerfile:7","Warn: pipCommand not pinned by hash: Dockerfile:9","Warn: npmCommand not pinned by hash: docker/run_django.sh:14","Warn: npmCommand not pinned by hash: docker/run_django.sh:15","Warn: pipCommand not pinned by hash: scripts/base_pip_requirements:5","Warn: pipCommand not pinned by hash: scripts/base_pip_requirements:6","Warn: pipCommand not pinned by hash: scripts/base_pip_requirements:7","Warn: pipCommand not pinned by hash: scripts/bootstrap:12","Warn: pipCommand not pinned by hash: scripts/bootstrap:13","Warn: pipCommand not pinned by hash: scripts/dev_bootstrap:6","Warn: pipCommand not pinned by hash: scripts/dev_bootstrap:7","Warn: pipCommand not pinned by hash: scripts/dev_bootstrap:8","Warn: pipCommand not pinned by hash: scripts/dev_bootstrap:9","Warn: pipCommand not pinned by hash: scripts/setup:33","Warn: pipCommand not pinned by hash: .github/workflows/run-pytest.yaml:57","Warn: pipCommand not pinned by hash: .github/workflows/run-pytest.yaml:58","Warn: pipCommand not pinned by hash: .github/workflows/run-pytest.yaml:59","Info:   0 out of   3 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   1 third-party GitHubAction dependencies pinned","Info:   0 out of   3 containerImage dependencies pinned","Info:   0 out of   1 downloadThenRun dependencies pinned","Info:   0 out of  15 pipCommand dependencies pinned","Info:   0 out of   2 npmCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 28 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":0,"reason":"44 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: GHSA-v88g-cgmw-v5xw","Warn: Project is vulnerable to: GHSA-fjxv-7rqg-78g4","Warn: Project is vulnerable to: GHSA-44pw-h2cw-w3vq","Warn: Project is vulnerable to: GHSA-jp4x-w63m-7wgm","Warn: Project is vulnerable to: GHSA-c429-5p7v-vgjp","Warn: Project is vulnerable to: GHSA-896r-f27r-55mw","Warn: Project is vulnerable to: GHSA-7wpw-2hjm-89gp","Warn: Project is vulnerable to: GHSA-vh95-rmgr-6w4m","Warn: Project is vulnerable to: GHSA-xvch-5gv4-984h","Warn: Project is vulnerable to: GHSA-hrpp-h998-j3pp","Warn: Project is vulnerable to: GHSA-p8p7-x288-28g6","Warn: Project is vulnerable to: GHSA-72xf-g2v4-qvf3","Warn: Project is vulnerable to: PYSEC-2021-858 / GHSA-q4xr-rc97-m4xx","Warn: Project is vulnerable to: PYSEC-2022-42986 / GHSA-43fp-rhv2-5gv8","Warn: Project is vulnerable to: PYSEC-2023-135 / GHSA-xqr8-7jwr-rhp7","Warn: Project is vulnerable to: PYSEC-2021-98 / GHSA-68w8-qjq3-2gfm","Warn: Project is vulnerable to: GHSA-7xr5-9hcq-chf9","Warn: Project is vulnerable to: GHSA-8x94-hmjh-97hq","Warn: Project is vulnerable to: GHSA-rrqc-c2jx-6jgv","Warn: Project is vulnerable to: PYSEC-2021-10 / GHSA-pghf-347x-c2gj","Warn: Project is vulnerable to: PYSEC-2021-64 / GHSA-x7gm-rfgv-w973","Warn: Project is vulnerable to: PYSEC-2019-19 / GHSA-vx6v-2rg6-865h","Warn: Project is vulnerable to: GHSA-9hcv-j9pv-qmph","Warn: Project is vulnerable to: GHSA-r8hm-w5f7-wj39","Warn: Project is vulnerable to: GHSA-w9jx-4g6g-rp7x","Warn: Project is vulnerable to: PYSEC-2020-263 / GHSA-fx83-3ph3-9j2q","Warn: Project is vulnerable to: GHSA-gw84-84pc-xp82","Warn: Project is vulnerable to: GHSA-hc5x-x2vx-497g","Warn: Project is vulnerable to: GHSA-w3h3-4rj7-4ph4","Warn: Project is vulnerable to: GHSA-55x5-fj6c-h6m8","Warn: Project is vulnerable to: PYSEC-2021-19 / GHSA-jq4v-f5q6-mjqq","Warn: Project is vulnerable to: PYSEC-2020-62 / GHSA-pgww-xf46-h92r","Warn: Project is vulnerable to: PYSEC-2022-230 / GHSA-wrxv-2j5q-m38w","Warn: Project is vulnerable to: PYSEC-2018-12 / GHSA-xp26-p53h-6h2p","Warn: Project is vulnerable to: PYSEC-2020-176 / GHSA-3pqx-4fqf-j49f","Warn: Project is vulnerable to: PYSEC-2020-96 / GHSA-6757-jp84-gxfx","Warn: Project is vulnerable to: PYSEC-2021-142 / GHSA-8q59-q68h-6hv4","Warn: Project is vulnerable to: GHSA-9hjg-9r4m-mvj7","Warn: Project is vulnerable to: GHSA-9wx4-h78v-vm56","Warn: Project is vulnerable to: PYSEC-2023-74 / GHSA-j8r2-6x86-q33q","Warn: Project is vulnerable to: PYSEC-2019-124 / GHSA-38fc-9xqv-7f7q","Warn: Project is vulnerable to: PYSEC-2019-123 / GHSA-887w-45rq-vxgf","Warn: Project is vulnerable to: GHSA-2m57-hf25-phgg","Warn: Project is vulnerable to: PYSEC-2023-87 / GHSA-rrm6-wvj7-cwh2"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-17T19:22:59.181Z","repository_id":8848929,"created_at":"2025-08-17T19:22:59.181Z","updated_at":"2025-08-17T19:22:59.181Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28503595,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-17T06:57:29.758Z","status":"ssl_error","status_checked_at":"2026-01-17T06:56:03.931Z","response_time":85,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","benchmarks","competitions","machine-learning","science"],"created_at":"2026-01-17T07:21:21.443Z","updated_at":"2026-01-17T07:21:21.614Z","avatar_url":"https://github.com/codalab.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"![CodaLab logo](codalab/apps/web/static/img/codalab-logo-fullcolor-positive.png) [![Circle CI](https://circleci.com/gh/codalab/codalab-competitions.svg?style=shield)](https://circleci.com/gh/codalab/codalab-competitions)\n[![codecov](https://codecov.io/gh/codalab/codalab-competitions/branch/develop/graph/badge.svg)](https://codecov.io/gh/codalab/codalab-competitions)\n\n\n\n## What is CodaLab?\n\nCodaLab is an open-source web-based platform that enables researchers, developers, and data scientists to collaborate, with the goal of advancing research fields where machine learning and advanced computation is used.  CodaLab helps to solve many common problems in the arena of data-oriented research through its online community where people can share worksheets and participate in competitions.\n\nTo see Codalab Competition's in action, visit [codalab.lisn.fr](https://codalab.lisn.fr/).\n\n_[Codabench](https://github.com/codalab/codabench), the next-gen of CodaLab Competitions, is out. [Try it out](https://www.codabench.org/)!_\n\n## Documentation\n\n- [CodaLab Wiki](https://github.com/codalab/codalab/wiki)\n\n## Community\n\nThe CodaLab community forum is hosted on Google Groups.\n- [CodaLab Competitions Google Groups Forum](https://groups.google.com/forum/#!forum/codalab-competitions)\n\n\n## Quick installation (for Linux!)\n\n_To participate in competitions, or even organize your own competition, **you don't need to install anything**, you just need to sign in an instance of the platform (e.g. [this one](https://codalab.lisn.fr/)). \nIf you wish to configure your own instance of CodaLab competitions, here are the instructions:_\n\nInstall docker and add your user to the docker group, if you haven't already\n\n```\n$ wget -qO- https://get.docker.com/ | sh\n$ sudo usermod -aG docker $USER\n```\n\nClone this repo and get the default environment setup\n```\n$ git clone https://github.com/codalab/codalab-competitions\n$ cd codalab-competitions\n$ cp .env_sample .env\n$ pip install docker-compose\n$ docker-compose up -d\n```\n\nNow you should be able to access http://localhost/\n\n**More details on how to configure your own instance:**\n- [Configure Codalab from scratch](https://github.com/codalab/codalab-competitions/wiki/Setup-Local-Competitions#user-content-get-the-source-code)\n- [Set up data storage](https://github.com/codalab/codalab-competitions/wiki/Storage)\n\n\n## License\n\nCopyright (c) 2013-2015, The Outercurve Foundation.\nCopyright (c) 2016-2021, Université Paris-Saclay.\nThis software is released under the Apache License 2.0 (the \"License\"); you may not use the software except in compliance with the License.\n\nThe text of the Apache License 2.0 can be found online at:\nhttp://www.opensource.org/licenses/apache2.0.php\n\n## Cite CodaLab Competitions in your research\n\n```\n@article{codalab_competitions_JMLR,\n  author  = {Adrien Pavao and Isabelle Guyon and Anne-Catherine Letournel and Dinh-Tuan Tran and Xavier Baro and Hugo Jair Escalante and Sergio Escalera and Tyler Thomas and Zhen Xu},\n  title   = {CodaLab Competitions: An Open Source Platform to Organize Scientific Challenges},\n  journal = {Journal of Machine Learning Research},\n  year    = {2023},\n  volume  = {24},\n  number  = {198},\n  pages   = {1--6},\n  url     = {http://jmlr.org/papers/v24/21-1436.html}\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodalab%2Fcodalab-competitions","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodalab%2Fcodalab-competitions","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodalab%2Fcodalab-competitions/lists"}