{"id":13572083,"url":"https://github.com/embeddings-benchmark/mteb","last_synced_at":"2026-04-19T01:05:20.366Z","repository":{"id":40779389,"uuid":"478037973","full_name":"embeddings-benchmark/mteb","owner":"embeddings-benchmark","description":"MTEB: Massive Text Embedding Benchmark","archived":false,"fork":false,"pushed_at":"2026-04-02T16:21:34.000Z","size":54233,"stargazers_count":3195,"open_issues_count":285,"forks_count":585,"subscribers_count":17,"default_branch":"main","last_synced_at":"2026-04-03T04:21:51.690Z","etag":null,"topics":["benchmark","bitext-mining","clustering","information-retrieval","low-resource-nlp","mteb","multilingual-nlp","multimodal","neural-search","reranking","retrieval","sbert","semantic-search","sentence-transformers","sts","text-classification","text-embedding"],"latest_commit_sha":null,"homepage":"https://embeddings-benchmark.github.io/mteb/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/embeddings-benchmark.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"docs/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"citation.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2022-04-05T08:25:47.000Z","updated_at":"2026-04-03T03:26:42.000Z","dependencies_parsed_at":"2023-02-02T20:31:48.884Z","dependency_job_id":"c9146f40-8284-47f0-a187-4c2a438c4d03","html_url":"https://github.com/embeddings-benchmark/mteb","commit_stats":{"total_commits":443,"total_committers":28,"mean_commits":"15.821428571428571","dds":0.6094808126410836,"last_synced_commit":"d292d937ceedb5d137537b2c25a0f135d1bb91b9"},"previous_names":[],"tags_count":724,"template":false,"template_full_name":null,"purl":"pkg:github/embeddings-benchmark/mteb","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/embeddings-benchmark%2Fmteb","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/embeddings-benchmark%2Fmteb/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/embeddings-benchmark%2Fmteb/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/embeddings-benchmark%2Fmteb/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/embeddings-benchmark","download_url":"https://codeload.github.com/embeddings-benchmark/mteb/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/embeddings-benchmark%2Fmteb/sbom","scorecard":{"id":374691,"data":{"date":"2025-08-11","repo":{"name":"github.com/embeddings-benchmark/mteb","commit":"177997f0144690eac0c082e5f973cfc89cdaa331"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":5.2,"checks":[{"name":"Maintained","score":10,"reason":"30 commit(s) and 10 issue activity found in the last 90 days -- score normalized to 10","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Code-Review","score":6,"reason":"Found 20/30 approved changesets -- score normalized to 6","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/dataset_loading.yml:1","Warn: no topLevel permission defined: .github/workflows/docs.yml:1","Warn: no topLevel permission defined: .github/workflows/leaderboard_build.yml:1","Warn: no topLevel permission defined: .github/workflows/leaderboard_refresh.yaml:1","Warn: no topLevel permission defined: .github/workflows/lint.yml:1","Warn: no topLevel permission defined: .github/workflows/model_loading.yml:1","Warn: no topLevel permission defined: .github/workflows/release.yml:1","Warn: no topLevel permission defined: .github/workflows/test.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: Apache License 2.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/dataset_loading.yml:13: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/dataset_loading.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/dataset_loading.yml:16: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/dataset_loading.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/docs.yml:15: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/docs.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/docs.yml:17: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/docs.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/docs.yml:34: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/docs.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/docs.yml:38: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/docs.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/leaderboard_build.yml:15: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/leaderboard_build.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/leaderboard_build.yml:18: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/leaderboard_build.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/lint.yml:14: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/lint.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/lint.yml:16: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/lint.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/model_loading.yml:14: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/model_loading.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/model_loading.yml:17: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/model_loading.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:27: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/release.yml/main?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/release.yml:34: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/release.yml/main?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/release.yml:40: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/release.yml/main?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/release.yml:47: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/test.yml:25: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/test.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/test.yml:29: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/test.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/test.yml:35: update your workflow using https://app.stepsecurity.io/secureworkflow/embeddings-benchmark/mteb/test.yml/main?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/leaderboard_build.yml:25","Info:   0 out of  16 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   3 third-party GitHubAction dependencies pinned","Info:   0 out of   1 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Signed-Releases","score":0,"reason":"Project has not signed or included provenance with any releases.","details":["Warn: release artifact 1.38.39 not signed: https://api.github.com/repos/embeddings-benchmark/mteb/releases/237114657","Warn: release artifact 1.38.38 not signed: https://api.github.com/repos/embeddings-benchmark/mteb/releases/235129364","Warn: release artifact 1.38.37 not signed: https://api.github.com/repos/embeddings-benchmark/mteb/releases/233884665","Warn: release artifact 1.38.36 not signed: https://api.github.com/repos/embeddings-benchmark/mteb/releases/233766215","Warn: release artifact 1.38.35 not signed: https://api.github.com/repos/embeddings-benchmark/mteb/releases/232968915","Warn: release artifact 1.38.39 does not have provenance: https://api.github.com/repos/embeddings-benchmark/mteb/releases/237114657","Warn: release artifact 1.38.38 does not have provenance: https://api.github.com/repos/embeddings-benchmark/mteb/releases/235129364","Warn: release artifact 1.38.37 does not have provenance: https://api.github.com/repos/embeddings-benchmark/mteb/releases/233884665","Warn: release artifact 1.38.36 does not have provenance: https://api.github.com/repos/embeddings-benchmark/mteb/releases/233766215","Warn: release artifact 1.38.35 does not have provenance: https://api.github.com/repos/embeddings-benchmark/mteb/releases/232968915"],"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Packaging","score":10,"reason":"packaging workflow detected","details":["Info: Project packages its releases by way of GitHub Actions.: .github/workflows/release.yml:19"],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 21 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-18T13:58:10.082Z","repository_id":40779389,"created_at":"2025-08-18T13:58:10.082Z","updated_at":"2025-08-18T13:58:10.082Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31448216,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-05T15:22:31.103Z","status":"ssl_error","status_checked_at":"2026-04-05T15:22:00.205Z","response_time":75,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["benchmark","bitext-mining","clustering","information-retrieval","low-resource-nlp","mteb","multilingual-nlp","multimodal","neural-search","reranking","retrieval","sbert","semantic-search","sentence-transformers","sts","text-classification","text-embedding"],"created_at":"2024-08-01T14:01:12.806Z","updated_at":"2026-04-05T20:01:55.820Z","avatar_url":"https://github.com/embeddings-benchmark.png","language":"Python","funding_links":[],"categories":["Python","Evaluation and Monitoring","Vector Database Engines","文本匹配 文本检索 文本相似度","RAG (Retrieval Augmented Generation）","Benchmarks \u0026 Datasets","Tools \u0026 Evaluation","Tools","Language Models for NLP","5. Retrieval-Augmented Generation (RAG) \u0026 Knowledge"],"sub_categories":["其他_文本生成、文本对话","Embedding","Domain-Specific Benchmarks","Benchmarking \u0026 Comparison","RAG and Retrieval","Evaluation and Benchmarks"],"readme":"\u003ch1 align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/embeddings-benchmark/mteb/blob/main/docs/images/logos/mteb_logo/dots-icon.png?raw=true\" alt=\"MTEB\" width=\"28\" style=\"vertical-align: middle; margin-right: 10px;\"/\u003e MTEB\n\u003c/h1\u003e\n\n\u003ch3 align=\"center\" style=\"border-bottom: none;\"\u003eMultimodal toolbox for evaluating embeddings and retrieval systems\u003c/h3\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://github.com/embeddings-benchmark/mteb/releases\"\u003e\n        \u003cimg alt=\"GitHub release\" src=\"https://img.shields.io/github/release/embeddings-benchmark/mteb.svg\"\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://github.com/embeddings-benchmark/mteb/blob/master/LICENSE\"\u003e\n        \u003cimg alt=\"License\" src=\"https://img.shields.io/github/license/embeddings-benchmark/mteb.svg?color=green\"\u003e\n    \u003c/a\u003e\n    \u003ca href=\"https://pepy.tech/project/mteb\"\u003e\n        \u003cimg alt=\"Downloads\" src=\"https://static.pepy.tech/personalized-badge/mteb?period=total\u0026units=international_system\u0026left_color=grey\u0026right_color=orange\u0026left_text=Downloads\"\u003e\n    \u003c/a\u003e\n\u003c/p\u003e\n\n\u003ch4 align=\"center\"\u003e\n    \u003cp\u003e\n        \u003ca href=\"https://embeddings-benchmark.github.io/mteb/installation/\"\u003eInstallation\u003c/a\u003e |\n        \u003ca href=\"https://embeddings-benchmark.github.io/mteb/\"\u003eUsage\u003c/a\u003e |\n        \u003ca href=\"https://huggingface.co/spaces/mteb/leaderboard\"\u003eLeaderboard\u003c/a\u003e |\n        \u003ca href=\"https://embeddings-benchmark.github.io/mteb/\"\u003eDocumentation\u003c/a\u003e |\n        \u003ca href=\"#citing\"\u003eCiting\u003c/a\u003e\n    \u003c/p\u003e\n\u003c/h4\u003e\n\n\n\u003ch3 align=\"center\"\u003e\n    \u003ca href=\"https://huggingface.co/spaces/mteb/leaderboard\"\u003e\u003cimg style=\"float: middle; padding: 10px 10px 10px 10px;\" width=\"60\" height=\"55\" src=\"https://github.com/embeddings-benchmark/mteb/blob/main/docs/images/logos/hf_logo.png?raw=true\" /\u003e\u003c/a\u003e\n\u003c/h3\u003e\n\n\n## Installation\n\nYou can install mteb simply using pip or uv. For more on installation please see the [documentation](https://embeddings-benchmark.github.io/mteb/installation/).\n\n```bash\npip install mteb\n```\n\nFor faster installation, you can also use [uv](https://docs.astral.sh/uv/):\n```bash\nuv add mteb\n```\n\n\n## Example Usage\n\nBelow we present a simple use-case example. For more information, see the [documentation](https://embeddings-benchmark.github.io/mteb/).\n\n```python\nimport mteb\nfrom sentence_transformers import SentenceTransformer\n\n# Select model\nmodel_name = \"sentence-transformers/all-MiniLM-L6-v2\"\nmodel = mteb.get_model(model_name) # if the model is not implemented in MTEB it will be eq. to SentenceTransformer(model_name)\n\n# Select tasks\ntasks = mteb.get_tasks(tasks=[\"Banking77Classification.v2\"])\n\n# evaluate\nresults = mteb.evaluate(model, tasks=tasks)\n```\n\nYou can also run it using the CLI:\n\n```bash\nmteb run \\\n    -m sentence-transformers/all-MiniLM-L6-v2 \\\n    -t \"Banking77Classification.v2\" \\\n    --output-folder results\n```\n\nFor more on how to use the CLI check out the [related documentation](https://embeddings-benchmark.github.io/mteb/get_started/usage/cli/).\n\n## Overview\n\n| Overview                       |                                                                                      |\n|--------------------------------|--------------------------------------------------------------------------------------|\n| 📈 [Leaderboard]               | The interactive leaderboard of the benchmark                                         |\n| **Get Started**.               |                                                                                      |\n| 🏃 [Get Started]               | Overview of how to use mteb                                                          |\n| 🤖 [Defining Models]           | How to use existing model and define custom ones                                     |\n| 📋 [Selecting tasks]           | How to select tasks, benchmarks, splits etc.                                         |\n| 🏭 [Running Evaluation]        | How to run the evaluations, including cache management, speeding up evaluations etc. |\n| 📊 [Loading Results]           | How to load and work with existing model results                                     |\n| **Overview**.                  |                                                                                      |\n| 📋 [Tasks]                     | Overview of available tasks                                                          |\n| 📐 [Benchmarks]                | Overview of available benchmarks                                                     |\n| 🤖 [Models]                    | Overview of available Models                                                         |\n| **Contributing**               |                                                                                      |\n| 🤖 [Adding a model]            | How to submit a model to MTEB and to the leaderboard                                 |\n| 👩‍💻 [Adding a dataset]          | How to add a new task/dataset to MTEB                                                |\n| 👩‍💻 [Adding a benchmark]        | How to add a new benchmark to MTEB and to the leaderboard                            |\n| 🤝 [Contributing]              | How to contribute to MTEB and set it up for development                              |\n\n[Get Started]: https://embeddings-benchmark.github.io/mteb/\n[Defining Models]: https://embeddings-benchmark.github.io/mteb/get_started/usage/defining_the_model/\n[Selecting tasks]: https://embeddings-benchmark.github.io/mteb/get_started/usage/selecting_tasks/\n[Running Evaluation]: https://embeddings-benchmark.github.io/mteb/get_started/usage/running_the_evaluation/\n[Loading Results]: https://embeddings-benchmark.github.io/mteb/get_started/usage/loading_results/\n[Tasks]: https://embeddings-benchmark.github.io/mteb/overview/available_tasks/retrieval/\n[Benchmarks]: https://embeddings-benchmark.github.io/mteb/overview/available_benchmarks/\n[Models]: https://embeddings-benchmark.github.io/mteb/overview/available_models/text/\n[Contributing]: https://embeddings-benchmark.github.io/mteb/CONTRIBUTING/\n[Adding a model]: https://embeddings-benchmark.github.io/mteb/contributing/adding_a_model/\n[Adding a dataset]: https://embeddings-benchmark.github.io/mteb/contributing/adding_a_dataset/\n[Adding a benchmark]: https://embeddings-benchmark.github.io/mteb/contributing/adding_a_benchmark/\n[Leaderboard]: https://huggingface.co/spaces/mteb/leaderboard\n\n## Citing\n\nMTEB was introduced in \"[MTEB: Massive Text Embedding Benchmark](https://arxiv.org/abs/2210.07316)\", and heavily expanded in \"[MMTEB: Massive Multilingual Text Embedding Benchmark](https://arxiv.org/abs/2502.13595)\". When using `mteb`, we recommend that you cite both articles.\n\n\u003cdetails\u003e\n  \u003csummary\u003e Bibtex Citation (click to unfold) \u003c/summary\u003e\n\n\n```bibtex\n@article{muennighoff2022mteb,\n  author = {Muennighoff, Niklas and Tazi, Nouamane and Magne, Loïc and Reimers, Nils},\n  title = {MTEB: Massive Text Embedding Benchmark},\n  publisher = {arXiv},\n  journal={arXiv preprint arXiv:2210.07316},\n  year = {2022},\n  url = {https://arxiv.org/abs/2210.07316},\n  doi = {10.48550/ARXIV.2210.07316},\n}\n\n@article{enevoldsen2025mmtebmassivemultilingualtext,\n  title={MMTEB: Massive Multilingual Text Embedding Benchmark},\n  author={Kenneth Enevoldsen and Isaac Chung and Imene Kerboua and Márton Kardos and Ashwin Mathur and David Stap and Jay Gala and Wissam Siblini and Dominik Krzemiński and Genta Indra Winata and Saba Sturua and Saiteja Utpala and Mathieu Ciancone and Marion Schaeffer and Gabriel Sequeira and Diganta Misra and Shreeya Dhakal and Jonathan Rystrøm and Roman Solomatin and Ömer Çağatan and Akash Kundu and Martin Bernstorff and Shitao Xiao and Akshita Sukhlecha and Bhavish Pahwa and Rafał Poświata and Kranthi Kiran GV and Shawon Ashraf and Daniel Auras and Björn Plüster and Jan Philipp Harries and Loïc Magne and Isabelle Mohr and Mariya Hendriksen and Dawei Zhu and Hippolyte Gisserot-Boukhlef and Tom Aarsen and Jan Kostkan and Konrad Wojtasik and Taemin Lee and Marek Šuppa and Crystina Zhang and Roberta Rocca and Mohammed Hamdy and Andrianos Michail and John Yang and Manuel Faysse and Aleksei Vatolin and Nandan Thakur and Manan Dey and Dipam Vasani and Pranjal Chitale and Simone Tedeschi and Nguyen Tai and Artem Snegirev and Michael Günther and Mengzhou Xia and Weijia Shi and Xing Han Lù and Jordan Clive and Gayatri Krishnakumar and Anna Maksimova and Silvan Wehrli and Maria Tikhonova and Henil Panchal and Aleksandr Abramov and Malte Ostendorff and Zheng Liu and Simon Clematide and Lester James Miranda and Alena Fenogenova and Guangyu Song and Ruqiya Bin Safi and Wen-Ding Li and Alessia Borghini and Federico Cassano and Hongjin Su and Jimmy Lin and Howard Yen and Lasse Hansen and Sara Hooker and Chenghao Xiao and Vaibhav Adlakha and Orion Weller and Siva Reddy and Niklas Muennighoff},\n  publisher = {arXiv},\n  journal={arXiv preprint arXiv:2502.13595},\n  year={2025},\n  url={https://arxiv.org/abs/2502.13595},\n  doi = {10.48550/arXiv.2502.13595},\n}\n```\n\u003c/details\u003e\n\n\nIf you use any of the specific benchmarks, we also recommend that you cite the authors of both the benchmark and its tasks:\n\n```py\nbenchmark = mteb.get_benchmark(\"MTEB(eng, v2)\")\nbenchmark.citation # get citation for a specific benchmark\n\n# you can also create a table of the task for the appendix using:\nbenchmark.tasks.to_latex()\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fembeddings-benchmark%2Fmteb","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fembeddings-benchmark%2Fmteb","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fembeddings-benchmark%2Fmteb/lists"}