{"id":21743322,"url":"https://github.com/latitude-dev/latitude-llm","last_synced_at":"2026-04-20T17:05:57.706Z","repository":{"id":246536107,"uuid":"821360765","full_name":"latitude-dev/latitude-llm","owner":"latitude-dev","description":"Latitude is the open-source agent engineering platform","archived":false,"fork":false,"pushed_at":"2026-04-07T08:15:41.000Z","size":95957,"stargazers_count":3946,"open_issues_count":143,"forks_count":311,"subscribers_count":12,"default_branch":"main","last_synced_at":"2026-04-07T08:28:27.112Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://latitude.so","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"lgpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/latitude-dev.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":"AGENTS.md","dco":null,"cla":null}},"created_at":"2024-06-28T11:16:02.000Z","updated_at":"2026-04-07T02:49:56.000Z","dependencies_parsed_at":"2024-07-26T14:17:06.100Z","dependency_job_id":"1d477ce8-860c-418b-a0ec-793773552bf6","html_url":"https://github.com/latitude-dev/latitude-llm","commit_stats":null,"previous_names":["latitude-dev/latitude-llm"],"tags_count":41,"template":false,"template_full_name":null,"purl":"pkg:github/latitude-dev/latitude-llm","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/latitude-dev%2Flatitude-llm","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/latitude-dev%2Flatitude-llm/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/latitude-dev%2Flatitude-llm/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/latitude-dev%2Flatitude-llm/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/latitude-dev","download_url":"https://codeload.github.com/latitude-dev/latitude-llm/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/latitude-dev%2Flatitude-llm/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31515153,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-07T03:10:19.677Z","status":"ssl_error","status_checked_at":"2026-04-07T03:10:13.982Z","response_time":105,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-26T07:04:43.005Z","updated_at":"2026-04-07T14:03:19.828Z","avatar_url":"https://github.com/latitude-dev.png","language":"TypeScript","funding_links":[],"categories":["LLMOps","LLM and Agent Observability","Evaluation and Monitoring","Building","\u003ca id=\"tools\"\u003e\u003c/a\u003e🛠️ Tools","TypeScript","8. MLOps / LLMOps \u0026 Production","Supporting Infrastructure","Runtime","Catalog","Testing and Evaluation","Monitoring \u0026 Observability","*Ops for AI","Prompt Engineering"],"sub_categories":["LLM Observability \u0026 Tracing","Prompt Engineering","Bleeding Edge ⚗️","Prompt Management","Observation","Observability \u0026 Reliability Operations","LLMOps"],"readme":"\u003ch1 align=\"center\" style=\"border: none; margin-bottom: 8px;\"\u003e\n  Open-Source AI Engineering Platform\n\u003c/h1\u003e\n\n\u003cp align=\"center\"\u003e\n  Observability and evaluations first, then an eval-driven reliability loop to continuously improve prompts.\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://docs.latitude.so\" rel=\"dofollow\"\u003eDocs\u003c/a\u003e\u0026nbsp;\u0026nbsp;·\u0026nbsp;\u0026nbsp;\n  \u003ca href=\"https://join.slack.com/t/trylatitude/shared_invite/zt-35wu2h9es-N419qlptPMhyOeIpj3vjzw\"\u003eSlack\u003c/a\u003e\u0026nbsp;\u0026nbsp;·\u0026nbsp;\u0026nbsp;\n  \u003ca href=\"https://x.com/trylatitude\"\u003eX\u003c/a\u003e\n\u003c/p\u003e\n\n\u003e [!WARNING]\n\u003e You are viewing the **Latitude v2 Alpha** branch (`main`). This branch is in **active development** and is **not ready for production use**. APIs, features, and data formats may change without notice.\n\u003e\n\u003e For production use, please use the stable release on the [`latitude-v1`](https://github.com/latitude-dev/latitude-llm/tree/latitude-v1) branch.\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"docs/assets/readme/gif_ui.gif?raw=true\" alt=\"Latitude demo — observability, evals, and prompt management\" width=\"800\"/\u003e\n\u003c/p\u003e\n\n## 🌈 Why Latitude?\n\nLatitude is an open-source platform for building and operating LLM features in production.\n\nMost teams adopt Latitude in stages: start by instrumenting your existing LLM calls to get observability and evaluation coverage, then move into a reliability loop that turns production failures into repeatable fixes.\n\n**Start with observability + evaluations:**\n\n- **Observability** → capture prompts, inputs/outputs, tool calls, and latency/token usage/cost from real traffic\n- **Prompt playground** → reproduce runs, iterate with real inputs, version changes, and publish to the AI Gateway\n- **Datasets** → curate real examples for batch testing and regression suites\n- **Evaluations** → built-in evals, LLM-as-judge, and human-in-the-loop scoring\n- **Experiments** → compare models/providers and prompt versions with measurable results\n\n**Grow into the reliability loop:**\n\n- **Annotations** → turn human judgment into a signal you can track and optimize\n- **Issue discovery** → cluster failures into recurring issues and failure modes\n- **Automatic evals** → convert issues into continuous tests that guard releases\n- **Prompt optimizer (GEPA)** → search prompt variations against your eval suite and reduce recurring failures\n\nLatitude Telemetry works with most model providers and frameworks out of the box, and can be extended for custom integrations. See the [full integration list](https://docs.latitude.so/guides/getting-started/quick-start-dev) (including OTLP ingest).\n\n## 📚 Table Of Contents\n\n- [Getting Started](https://docs.latitude.so/guides/getting-started/introduction)\n- [Evaluations](https://docs.latitude.so/guides/evaluations/overview)\n- [Datasets \u0026 Testing](https://docs.latitude.so/guides/datasets/overview)\n- [Prompt Manager](https://docs.latitude.so/guides/prompt-manager/overview)\n- [Custom AI Agents](https://docs.latitude.so/guides/prompt-manager/agents)\n- [Integrations \u0026 Deployment](https://docs.latitude.so/guides/integration/publishing-deployment)\n- [Self-Hosting](https://docs.latitude.so/guides/self-hosted/production-setup)\n- [Advanced: PromptL](https://docs.latitude.so/promptl/getting-started/introduction)\n- [Contributing](#-contributing)\n- [License](#-license)\n\n## ⚡ Quick start\n\nLatitude is available as a managed cloud product or as a self-hosted deployment:\n\n1. **Latitude Cloud**: fully managed.\n2. **Latitude Self-Hosted**: run the open-source distribution on your own infrastructure.\n\nChoose the option that best fits your needs and follow the corresponding instructions below.\n\n### Latitude Cloud\n\nTo get started with Latitude, follow these steps:\n\n1. **Sign up** → Create an account at [latitude.so](https://latitude.so) and create a project.\n2. **Instrument** → Add the telemetry SDK (recommended) or export OTLP traces to compatible backend.\n3. **Evaluate** → Create datasets and evals to measure quality and catch regressions.\n4. **Manage + ship** → Version prompts/agents, publish changes, and deploy via the gateway.\n5. **Optimize** → Use eval-driven optimization to reduce recurring failures.\n\nFor more details on each step, see our [documentation](https://docs.latitude.so) or join the [community](https://join.slack.com/t/trylatitude/shared_invite/zt-35wu2h9es-N419qlptPMhyOeIpj3vjzw).\n\n### Latitude Self-Hosted\n\nFollow the instructions in the [self-hosted guide](https://docs.latitude.so/guides/self-hosted/production-setup) to get started with Latitude Self-Hosted.\n\nAfter setting up Latitude Self-Hosted, you can follow the same steps as in the Latitude Cloud guide to create, test, evaluate, and deploy your prompts.\n\n## 👥 Community\n\nThe Latitude community is on\n[Slack](https://join.slack.com/t/trylatitude/shared_invite/zt-3cl2m3xph-k5DBp3sJOtt_u6u3vxzZ0g), where you can ask questions, share feedback, and show what you're building.\n\n## 🤝 Contributing\n\nContributions are welcome. For an overview of the repo and its architecture, see\n[the contributor guide](https://docs.latitude.so/guides/contribution/contributors).\n\nIf you want to help, join the [Slack community](https://join.slack.com/t/trylatitude/shared_invite/zt-35wu2h9es-N419qlptPMhyOeIpj3vjzw), open an\n[issue](https://github.com/latitude-dev/latitude-llm/issues/new), or submit a pull request.\n\n## 📄 License\n\nLatitude is licensed under the [LGPL-3.0](LICENSE).\n\nAlternatively, we offer a more permissive commercial license for those who need it. Please contact us at [licensing@latitude.so](mailto:licensing@latitude.so) for more information.\n\n## 🔗 Links\n\n- [Home page](https://latitude.so?utm_campaign=github-readme)\n- [Documentation](https://docs.latitude.so/)\n- [Slack community](https://join.slack.com/t/trylatitude/shared_invite/zt-35wu2h9es-N419qlptPMhyOeIpj3vjzw)\n- [X / Twitter](https://x.com/trylatitude)\n\nMade with love by the Latitude Team\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flatitude-dev%2Flatitude-llm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flatitude-dev%2Flatitude-llm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flatitude-dev%2Flatitude-llm/lists"}