{"id":28291942,"url":"https://github.com/kuloud/lite-llm","last_synced_at":"2025-09-13T08:37:09.273Z","repository":{"id":289452678,"uuid":"971296987","full_name":"kuloud/lite-llm","owner":"kuloud","description":null,"archived":false,"fork":false,"pushed_at":"2025-04-24T10:10:11.000Z","size":17,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-22T04:12:21.604Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://lite-llm.vercel.app","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kuloud.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-04-23T10:00:02.000Z","updated_at":"2025-04-24T10:10:15.000Z","dependencies_parsed_at":"2025-04-23T11:25:41.591Z","dependency_job_id":"6067758f-1f71-4c62-a016-0676f5320a8d","html_url":"https://github.com/kuloud/lite-llm","commit_stats":null,"previous_names":["kuloud/lite-llm"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/kuloud/lite-llm","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kuloud%2Flite-llm","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kuloud%2Flite-llm/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kuloud%2Flite-llm/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kuloud%2Flite-llm/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kuloud","download_url":"https://codeload.github.com/kuloud/lite-llm/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kuloud%2Flite-llm/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":274939761,"owners_count":25377876,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-13T02:00:10.085Z","response_time":70,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-22T04:12:20.645Z","updated_at":"2025-09-13T08:37:09.264Z","avatar_url":"https://github.com/kuloud.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# FastAPI Service\n\nThis project is a FastAPI application designed to provide an lightweight LLM service.\n\n\n## Project Structure\n\n```\nlite-llm\n├── api\n│   ├── index.py         # Contains serverless functions for Vercel\n├── app\n│   ├── main.py          # Entry point of the FastAPI application\n│   ├── routers          # Contains route definitions\n│   ├── models           # Contains data models\n│   ├── services         # Contains business logic\n│   └── utils            # Contains utility functions\n├── requirements.txt     # Lists project dependencies\n└── README.md            # Project documentation\n```\n\n## Setup Instructions\n\n1. Clone the repository:\n   ```bash\n   git clone git@github.com:kuloud/lite-llm.git\n   cd lite-llm\n   ```\n1. Create a virtual environment:\n   ```bash\n   python3.12 -m venv venv\n   ```\n\n1. Activate the virtual environment:\n   - On Windows:\n     ```\n     venv\\Scripts\\activate\n     ```\n   - On macOS/Linux:\n     ```bash\n     source venv/bin/activate\n     ```\n\n1. Install the required dependencies:\n   ```\n   pip install -r requirements.txt\n   ```\n\n## Usage\n\nTo run the FastAPI application, use the following command:\n\n```\nuvicorn app.main:app --reload\n```\n\n## API Documentation\nYou can access the interactive API documentation provided by FastAPI at the following URLs:\n\nSwagger UI: https://lite-llm.vercel.app/docs\nReDoc: https://lite-llm.vercel.app/redoc\n\n## Deployment on Vercel\n\nThis project is deployed on Vercel and uses the Python runtime with Serverless Functions. The FastAPI app is accessible at:\n\n**Base URL**: `https://lite-llm.vercel.app`\n\n### Example Endpoints\n\n- **Chat with GitHub Models**: `/api/models/chat`\n  - **Method**: POST\n  - **Request Body**:\n    ```json\n    {\n      \"messages\": [\n        {\n          \"role\": \"system\",\n          \"content\": \"You are a helpful assistant.\"\n        },\n        {\n          \"role\": \"user\",\n          \"content\": \"What is the capital of France?\"\n        }\n      ]\n    }\n    ```\n  - **Response**:\n    ```json\n    {\n      \"response\": \"The capital of France is Paris.\"\n    }\n    ```\n\n## WebSocket Endpoints\n\n### `/ws`\nThis WebSocket endpoint is used to interact with GitHub models.\n\n#### Connection\nTo establish a WebSocket connection, use the following URL:\n```plaintext\nws://your - server - address/ws/github - model\n\n## Contributing\n\nContributions are welcome! Please open an issue or submit a pull request for any improvements or features.\n\n## License\n\nThis project is licensed under the MIT License.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkuloud%2Flite-llm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkuloud%2Flite-llm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkuloud%2Flite-llm/lists"}