{"id":13572111,"url":"https://github.com/ajndkr/lanarky","last_synced_at":"2025-05-15T07:03:22.704Z","repository":{"id":153993639,"uuid":"624724781","full_name":"ajndkr/lanarky","owner":"ajndkr","description":"The web framework for building LLM microservices","archived":false,"fork":false,"pushed_at":"2024-07-06T06:21:57.000Z","size":24003,"stargazers_count":990,"open_issues_count":9,"forks_count":77,"subscribers_count":15,"default_branch":"main","last_synced_at":"2025-05-11T22:45:47.837Z","etag":null,"topics":["fastapi","llmops","microservices","python3","web"],"latest_commit_sha":null,"homepage":"https://lanarky.ajndkr.com/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ajndkr.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-04-07T05:36:32.000Z","updated_at":"2025-04-22T11:58:20.000Z","dependencies_parsed_at":"2023-09-22T20:37:05.583Z","dependency_job_id":"dcd68c97-6e91-49e2-91b9-fc450305a9be","html_url":"https://github.com/ajndkr/lanarky","commit_stats":{"total_commits":172,"total_committers":13,"mean_commits":13.23076923076923,"dds":"0.16279069767441856","last_synced_commit":"43375b45f4e17cc0bd75752f2ef6b45829864cee"},"previous_names":["ajndkr/fastapi-async-langchain"],"tags_count":52,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ajndkr%2Flanarky","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ajndkr%2Flanarky/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ajndkr%2Flanarky/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ajndkr%2Flanarky/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ajndkr","download_url":"https://codeload.github.com/ajndkr/lanarky/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254291961,"owners_count":22046424,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fastapi","llmops","microservices","python3","web"],"created_at":"2024-08-01T14:01:13.700Z","updated_at":"2025-05-15T07:03:22.663Z","avatar_url":"https://github.com/ajndkr.png","language":"Python","funding_links":[],"categories":["Python","Frameworks/Servers for Serving","A01_文本生成_文本对话","Tools","Serving","工具"],"sub_categories":["大语言对话模型及数据","Services","Frameworks/Servers for Serving","服务"],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003cimg src=\"https://raw.githubusercontent.com/ajndkr/lanarky/main/assets/logo-light-mode.png#gh-light-mode-only\" alt=\"lanarky-logo-light-mode\" width=\"500\"\u003e\n\u003cimg src=\"https://raw.githubusercontent.com/ajndkr/lanarky/main/assets/logo-dark-mode.png#gh-dark-mode-only\" alt=\"lanarky-logo-dark-mode\" width=\"500\"\u003e\n\n\u003ch4\u003eThe web framework for building LLM microservices.\u003c/h4\u003e\n\n[![Stars](https://img.shields.io/github/stars/ajndkr/lanarky)](https://github.com/ajndkr/lanarky/stargazers)\n[![License](https://img.shields.io/badge/License-MIT-yellow.svg)](https://github.com/ajndkr/lanarky/blob/main/LICENSE)\n[![Twitter](https://img.shields.io/twitter/follow/LanarkyAPI?style=social)](https://twitter.com/intent/follow?screen_name=LanarkyAPI)\n\n[![Python](https://img.shields.io/pypi/pyversions/lanarky.svg)](https://pypi.org/project/lanarky/)\n[![Coverage](https://coveralls.io/repos/github/ajndkr/lanarky/badge.svg?branch=main)](https://coveralls.io/github/ajndkr/lanarky?branch=main)\n[![Version](https://badge.fury.io/py/lanarky.svg)](https://pypi.org/project/lanarky/)\n[![Stats](https://img.shields.io/pypi/dm/lanarky.svg)](https://pypistats.org/packages/lanarky)\n\n\u003c/div\u003e\n\n\u003e ⚠️ **Disclaimer**: This project is now in maintenance mode. I won't be adding new features or actively maintaining the project as I have moved on to other projects and priorities. While I will address critical bugs and security issues as needed, active development has ceased from my end. I do encourage the community to continue to contribute to the project if they find it useful. Thank you for using lanarky!\n\nLanarky is a **python (3.9+)** web framework for developers who want to build microservices using LLMs.\nHere are some of its key features:\n\n- **LLM-first**: Unlike other web frameworks, lanarky is built specifically for LLM developers.\n  It's unopinionated in terms of how you build your microservices and guarantees zero vendor lock-in\n  with any LLM tooling frameworks or cloud providers\n- **Fast \u0026 Modern**: Built on top of FastAPI, lanarky offers all the FastAPI features you know and love.\n  If you are new to FastAPI, visit [fastapi.tiangolo.com](https://fastapi.tiangolo.com) to learn more\n- **Streaming**: Streaming is essential for many real-time LLM applications, like chatbots. Lanarky has\n  got you covered with built-in streaming support over **HTTP** and **WebSockets**.\n- **Open-source**: Lanarky is open-source and free to use. Forever.\n\nTo learn more about lanarky and get started, you can find the full documentation on [lanarky.ajndkr.com](https://lanarky.ajndkr.com)\n\n## Installation\n\nThe library is available on PyPI and can be installed via `pip`:\n\n```bash\npip install lanarky\n```\n\n## Getting Started\n\nLanarky provides a powerful abstraction layer to allow developers to build\nsimple LLM microservices in just a few lines of code.\n\nHere's an example to build a simple microservice that uses OpenAI's `ChatCompletion` service:\n\n```python\nfrom lanarky import Lanarky\nfrom lanarky.adapters.openai.resources import ChatCompletionResource\nfrom lanarky.adapters.openai.routing import OpenAIAPIRouter\n\napp = Lanarky()\nrouter = OpenAIAPIRouter()\n\n\n@router.post(\"/chat\")\ndef chat(stream: bool = True) -\u003e ChatCompletionResource:\n    system = \"You are a sassy assistant\"\n    return ChatCompletionResource(stream=stream, system=system)\n\n\napp.include_router(router)\n```\n\nVisit [Getting Started](https://lanarky.ajndkr.com/getting-started) for the full tutorial on building\nand testing your first LLM microservice with Lanarky.\n\n## Contributing\n\n[![Code check](https://github.com/ajndkr/lanarky/actions/workflows/code-check.yaml/badge.svg)](https://github.com/ajndkr/lanarky/actions/workflows/code-check.yaml)\n[![Publish](https://github.com/ajndkr/lanarky/actions/workflows/publish.yaml/badge.svg)](https://github.com/ajndkr/lanarky/actions/workflows/publish.yaml)\n\nContributions are more than welcome! If you have an idea for a new feature or want to help improve lanarky,\nplease create an issue or submit a pull request on [GitHub](https://github.com/ajndkr/lanarky).\n\nSee [CONTRIBUTING.md](https://github.com/ajndkr/lanarky/blob/main/CONTRIBUTING.md) for more information.\n\nSee [Lanarky Roadmap](https://github.com/users/ajndkr/projects/6) for the list of new features and future milestones.\n\n## License\n\nThe library is released under the [MIT License](https://github.com/ajndkr/lanarky/blob/main/LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fajndkr%2Flanarky","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fajndkr%2Flanarky","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fajndkr%2Flanarky/lists"}