{"id":15880910,"url":"https://github.com/rjmacarthy/llamallamallama","last_synced_at":"2026-04-13T17:31:38.374Z","repository":{"id":177334185,"uuid":"619283734","full_name":"rjmacarthy/llamallamallama","owner":"rjmacarthy","description":"Llamallamallama is a chat solution that allows users to chat with \"Llama\" fine tuned with LoRa on the \"Alpaca\" dataset.","archived":false,"fork":false,"pushed_at":"2023-04-06T07:32:58.000Z","size":546,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-09-03T22:41:11.765Z","etag":null,"topics":["ai","alpaca","artificial-intelligence","chatbot","chatgpt","huggingface-transformers","llama","machine-learning","nlp","python","sveltekit","typescript"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rjmacarthy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-26T19:41:35.000Z","updated_at":"2024-04-15T21:19:38.000Z","dependencies_parsed_at":null,"dependency_job_id":"e253ba26-46fa-4b3a-935b-4758e1d33aa7","html_url":"https://github.com/rjmacarthy/llamallamallama","commit_stats":null,"previous_names":["rjmacarthy/llamallamallama"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/rjmacarthy/llamallamallama","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rjmacarthy%2Fllamallamallama","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rjmacarthy%2Fllamallamallama/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rjmacarthy%2Fllamallamallama/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rjmacarthy%2Fllamallamallama/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rjmacarthy","download_url":"https://codeload.github.com/rjmacarthy/llamallamallama/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rjmacarthy%2Fllamallamallama/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31762480,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-13T15:25:13.801Z","status":"ssl_error","status_checked_at":"2026-04-13T15:25:09.162Z","response_time":93,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","alpaca","artificial-intelligence","chatbot","chatgpt","huggingface-transformers","llama","machine-learning","nlp","python","sveltekit","typescript"],"created_at":"2024-10-06T03:22:47.887Z","updated_at":"2026-04-13T17:31:38.356Z","avatar_url":"https://github.com/rjmacarthy.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# llamallamallama\n\nllamallamallama is a chat solution that allows users to chat with \"Llama\" fine tuned with LoRa on the \"Alpaca\" dataset. The solution uses SvelteKit to stream responses from a Python API to the browser.\n\nThe AI model was trained on the alpaca dataset [Alpaca Dataset](https://github.com/tatsu-lab/stanford_alpaca).\n\nThe model streaming logic was inspired by [Alpaca-LoRA-Serve](https://github.com/deep-diver/Alpaca-LoRA-Serve).\n\nThe project uses sqllite to store chat history.\n\n![llamallamallama](./website/assets/llamallamallama.gif)\n\n## Installation\n\nCopy `backend/config.example.yml` to `config.yml` and edit for personal settings.\n\n### Backend\n\nTo install the backend dependencies, run the following command:\n\n`pip install -r requirements.txt` inside the backend directory.\n\nYou will need to add your models inside the `backend/models` folder if using locally to match `config.yml` or use Hugging Face.\n\n```\n.\n├── llama-7b\n└── llama-7b-ft\n```\n\nThe fine tuned folder should have the `adapter_model.bin` and `adapter_config.json` files.\n\n### Setup script\n\nRun `./scripts/setup.sh` to copy the configuration file and install the front-end.\n\n### Frontend\n\nTo install the frontend dependencies, run the following command:\n`npm install`\n\n### Docker\n\n```\ndocker compose up -d\n```\n\n## Usage\n\n### Backend\n\nTo start the backend, run the following command:\n\n`uvicorn main:app --reload`\n\nThis will start the backend server and make it available at http://localhost:8000.\n\n### Frontend\n\nTo start the frontend in development.mode, run the following command:\n\n`npm run dev`\n\nThis will start the frontend server and make it available at http://localhost:5173. You can then open this URL in a web browser to access the chat interface.\n\n## Contributing\n\nWe welcome contributions to the llamallamallama project!\n\n## License\n\nllamallamallama is licensed under the MIT. See the [LICENSE](LICENSE) file for details.\n\n## Credits\n\nllamallamallama was created by rjmacarthy with help from other repositories.\n\nI will update this soon with all the credits.\n\n\n## Todo\n\n- Get model and weights from huggingface\n- Docker\n- Setup scripts\n- Better UI\n- Chat context\n- Refactor\n- Add tests\n- Maintenance\n\n- Better configuration options\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frjmacarthy%2Fllamallamallama","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frjmacarthy%2Fllamallamallama","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frjmacarthy%2Fllamallamallama/lists"}