{"id":15653164,"url":"https://github.com/sollimann/chatty-llama","last_synced_at":"2025-04-30T21:26:31.321Z","repository":{"id":193234622,"uuid":"683122490","full_name":"Sollimann/chatty-llama","owner":"Sollimann","description":"A fullstack Rust + React chat app using open-source Llama language models","archived":false,"fork":false,"pushed_at":"2023-09-08T12:55:07.000Z","size":612,"stargazers_count":32,"open_issues_count":0,"forks_count":5,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-25T01:54:54.629Z","etag":null,"topics":["artificial-intelligence","chatbot","fullstack","llama2","llm","meta","react","rust"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Sollimann.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-08-25T16:48:50.000Z","updated_at":"2024-12-07T15:50:29.000Z","dependencies_parsed_at":"2024-08-11T01:45:54.092Z","dependency_job_id":null,"html_url":"https://github.com/Sollimann/chatty-llama","commit_stats":{"total_commits":28,"total_committers":2,"mean_commits":14.0,"dds":0.5,"last_synced_commit":"7982a64a389753dd94914eb57717356ee53e9a5b"},"previous_names":["sollimann/chatty-llama"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sollimann%2Fchatty-llama","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sollimann%2Fchatty-llama/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sollimann%2Fchatty-llama/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sollimann%2Fchatty-llama/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Sollimann","download_url":"https://codeload.github.com/Sollimann/chatty-llama/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251784447,"owners_count":21643291,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","chatbot","fullstack","llama2","llm","meta","react","rust"],"created_at":"2024-10-03T12:44:51.739Z","updated_at":"2025-04-30T21:26:31.301Z","avatar_url":"https://github.com/Sollimann.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\" style=\"font-family:Papyrus; font-size:4em;\"\u003e Chatty Llama \u003c/h1\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/Sollimann/chatty-llama/blob/main/docs/images/chatty-llama.jpg\" width=\"350\" \"\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003cem\u003eA fullstack chat app utilizing Llama LLMs\u003c/em\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://rust-lang.github.io/rfcs/2495-min-rust-version.html\"\u003e\u003cimg src=\"https://img.shields.io/badge/rustc-1.60+-blue.svg\" alt=\"minimum rustc 1.60\"\u003e\u003c/a\u003e\n    \u003ca href=\"https://GitHub.com/Sollimann/chatty-llama/graphs/commit-activity\"\u003e\u003cimg src=\"https://img.shields.io/badge/Maintained%3F-yes-green.svg\" alt=\"Maintenance\"\u003e\u003c/a\u003e\n    \u003ca href=\"https://GitHub.com/Sollimann/chatty-llama/pulls\"\u003e\u003cimg src=\"https://img.shields.io/github/issues-pr/Sollimann/chatty-llama.svg\" alt=\"GitHub pull-requests\"\u003e\u003c/a\u003e\n    \u003ca href=\"https://GitHub.com/Sollimann/chatty-llama/pulls\"\u003e\u003cimg src=\"https://img.shields.io/github/issues-pr-closed/Sollimann/chatty-llama.svg\" alt=\"GitHub pull-requests closed\"\u003e\u003c/a\u003e\n    \u003cimg src=\"https://views.whatilearened.today/views/github/Sollimann/chatty-llama.svg\" alt=\"ViewCount\"\u003e\n    \u003ca href=\"https://opensource.org/licenses/MIT\"\u003e\u003cimg src=\"https://img.shields.io/badge/License-MIT-yellow.svg\" alt=\"License: MIT\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n## How to run\n\n#### 1. Install huggingface-cli\n\n```sh\n$ make install-huggingface-cli\n```\n\n#### 2. Export huggingface token\n\nCreate a huggingface token: https://huggingface.co/settings/tokens\n\n, then set the token as env variable on your machine:\n\n```sh\n$ export HF_TOKEN=\u003cyour-token-here\u003e\n```\n\n#### 3. Download the [Llama-2-7B-Chat-GGML](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML) model\n\n```sh\n$ make download-model\n```\n\n#### 4. Run the chat app\n\n```sh\n$ make chatty-llama\n```\n\n**PS!** If you're having issues connecting to the `backend`, try running `make chatty-llama-host` instead.\n\nIn your browser, open http://localhost:80\n\n**Enjoy!**\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://github.com/Sollimann/chatty-llama/blob/main/docs/images/chat.png\" width=\"550\" \"\u003e\n\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsollimann%2Fchatty-llama","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsollimann%2Fchatty-llama","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsollimann%2Fchatty-llama/lists"}