{"id":20321307,"url":"https://github.com/traceloop/hub","last_synced_at":"2026-02-08T14:11:25.601Z","repository":{"id":262837145,"uuid":"877931866","full_name":"traceloop/hub","owner":"traceloop","description":"High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included","archived":false,"fork":false,"pushed_at":"2026-01-11T13:19:04.000Z","size":749,"stargazers_count":150,"open_issues_count":8,"forks_count":28,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-01-11T16:46:03.927Z","etag":null,"topics":["artificial-intelligence","datascience","generative-ai","llm","llmops","ml","model-monitoring","observability","open-source","opentelemetry","rust"],"latest_commit_sha":null,"homepage":"https://www.traceloop.com/docs/hub","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/traceloop.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-10-24T13:43:43.000Z","updated_at":"2026-01-10T23:31:21.000Z","dependencies_parsed_at":"2024-12-01T10:34:58.098Z","dependency_job_id":"1fe8327c-1fdf-418b-8c91-3bfcd377d4be","html_url":"https://github.com/traceloop/hub","commit_stats":null,"previous_names":["traceloop/hub"],"tags_count":40,"template":false,"template_full_name":null,"purl":"pkg:github/traceloop/hub","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/traceloop%2Fhub","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/traceloop%2Fhub/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/traceloop%2Fhub/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/traceloop%2Fhub/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/traceloop","download_url":"https://codeload.github.com/traceloop/hub/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/traceloop%2Fhub/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28478391,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-16T06:30:42.265Z","status":"ssl_error","status_checked_at":"2026-01-16T06:30:16.248Z","response_time":107,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","datascience","generative-ai","llm","llmops","ml","model-monitoring","observability","open-source","opentelemetry","rust"],"created_at":"2024-11-14T19:13:11.675Z","updated_at":"2026-01-16T11:56:21.426Z","avatar_url":"https://github.com/traceloop.png","language":"Rust","readme":"\u003cp align=\"center\"\u003e\n\u003ca href=\"https://www.traceloop.com/docs/hub#gh-light-mode-only\"\u003e\n\u003cimg width=\"300\" src=\"https://raw.githubusercontent.com/traceloop/hub/main/img/logo-light.png\"\u003e\n\u003c/a\u003e\n\u003ca href=\"https://www.traceloop.com/docs/hub#gh-dark-mode-only\"\u003e\n\u003cimg width=\"300\" src=\"https://raw.githubusercontent.com/traceloop/hub/main/img/logo-dark.png\"\u003e\n\u003c/a\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  \u003cp align=\"center\"\u003eOpen-source, high-performance LLM gateway written in Rust. Connect to any LLM provider with a single API. Observability Included.\u003c/p\u003e\n\u003c/p\u003e\n\u003ch4 align=\"center\"\u003e\n    \u003ca href=\"https://traceloop.com/docs/hub/getting-started\"\u003e\u003cstrong\u003eGet started »\u003c/strong\u003e\u003c/a\u003e\n    \u003cbr /\u003e\n    \u003cbr /\u003e\n  \u003ca href=\"https://traceloop.com/slack\"\u003eSlack\u003c/a\u003e |\n  \u003ca href=\"https://traceloop.com/docs/hub\"\u003eDocs\u003c/a\u003e\n\u003c/h4\u003e\n\n\u003ch4 align=\"center\"\u003e\n  \u003ca href=\"https://github.com/traceloop/hub/releases\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/release/traceloop/hub\"\u003e\n  \u003c/a\u003e\n   \u003ca href=\"https://github.com/traceloop/hub/blob/main/LICENSE\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/license-Apache 2.0-blue.svg\" alt=\"Traceloop Hub is released under the Apache-2.0 License\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/traceloop/hub/actions/workflows/ci.yml\"\u003e\n  \u003cimg src=\"https://github.com/traceloop/hub/actions/workflows/ci.yml/badge.svg\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/traceloop/hub/issues\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/commit-activity/m/traceloop/hub\" alt=\"git commit activity\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://www.ycombinator.com/companies/traceloop\"\u003e\u003cimg src=\"https://img.shields.io/website?color=%23f26522\u0026down_message=Y%20Combinator\u0026label=Backed\u0026logo=ycombinator\u0026style=flat-square\u0026up_message=Y%20Combinator\u0026url=https%3A%2F%2Fwww.ycombinator.com\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/traceloop/hub/blob/main/CONTRIBUTING.md\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/PRs-Welcome-brightgreen\" alt=\"PRs welcome!\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://traceloop.com/slack\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/chat-on%20Slack-blueviolet\" alt=\"Slack community channel\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://twitter.com/traceloopdev\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/follow-%40traceloopdev-1DA1F2?logo=twitter\u0026style=social\" alt=\"Traceloop Twitter\" /\u003e\n  \u003c/a\u003e\n\u003c/h4\u003e\n\nHub is a next generation smart proxy for LLM applications. It centralizes control and tracing of all LLM calls and traces.\nIt's built in Rust so it's fast and efficient. It's completely open-source and free to use.\n\nBuilt and maintained by Traceloop under the Apache 2.0 license.\n\n## 🚀 Getting Started\n\nMake sure to copy a `config.yaml` file from `config-example.yaml` and set the correct values, following the [configuration](https://www.traceloop.com/docs/hub/configuration) instructions.\n\nYou can then run the hub using the docker image:\n\n```\ndocker run --rm -p 3000:3000 -v $(pwd)/config.yaml:/etc/hub/config.yaml:ro -e CONFIG_FILE_PATH='/etc/hub/config.yaml'  -t traceloop/hub\n```\n\nYou can also run it locally. Make sure you have `rust` v1.82 and above installed and then run:\n\n```\ncargo run\n```\n\nConnect to the hub by using the OpenAI SDK on any language, and setting the base URL to:\n\n```\nhttp://localhost:3000/api/v1\n```\n\nFor example, in Python:\n\n```\nclient = OpenAI(\n    base_url=\"http://localhost:3000/api/v1\",\n    api_key=os.getenv(\"OPENAI_API_KEY\"),\n    # default_headers={\"x-traceloop-pipeline\": \"azure-only\"},\n)\ncompletion = client.chat.completions.create(\n    model=\"claude-3-5-sonnet-20241022\",\n    messages=[{\"role\": \"user\", \"content\": \"Tell me a joke about opentelemetry\"}],\n    max_tokens=1000,\n)\n```\n\n## 🌱 Contributing\n\nWhether big or small, we love contributions ❤️ Check out our guide to see how to [get started](https://traceloop.com/docs/hub/contributing/overview).\n\nNot sure where to get started? You can:\n\n- [Book a free pairing session with one of our teammates](mailto:nir@traceloop.com?subject=Pairing%20session\u0026body=I'd%20like%20to%20do%20a%20pairing%20session!)!\n- Join our \u003ca href=\"https://traceloop.com/slack\"\u003eSlack\u003c/a\u003e, and ask us any questions there.\n\n## 💚 Community \u0026 Support\n\n- [Slack](https://traceloop.com/slack) (For live discussion with the community and the Traceloop team)\n- [GitHub Discussions](https://github.com/traceloop/hub/discussions) (For help with building and deeper conversations about features)\n- [GitHub Issues](https://github.com/traceloop/hub/issues) (For any bugs and errors you encounter using OpenLLMetry)\n- [Twitter](https://twitter.com/traceloopdev) (Get news fast)\n","funding_links":[],"categories":["Rust"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftraceloop%2Fhub","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftraceloop%2Fhub","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftraceloop%2Fhub/lists"}