{"id":20716684,"url":"https://github.com/kingabzpro/using-llama3-locally","last_synced_at":"2025-04-23T13:29:22.358Z","repository":{"id":239940189,"uuid":"800817076","full_name":"kingabzpro/using-llama3-locally","owner":"kingabzpro","description":"Running llama3 using Ollama-Python, Curl, LangChain, Chroma, and User interface.","archived":false,"fork":false,"pushed_at":"2024-05-15T14:10:06.000Z","size":427,"stargazers_count":51,"open_issues_count":0,"forks_count":6,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-23T13:29:06.593Z","etag":null,"topics":["embeddings","langchain","llama3","llms","ollama"],"latest_commit_sha":null,"homepage":"https://www.datacamp.com/tutorial/run-llama-3-locally","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kingabzpro.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-15T03:55:40.000Z","updated_at":"2025-04-17T06:41:23.000Z","dependencies_parsed_at":"2024-05-16T03:02:23.498Z","dependency_job_id":"2fd7332e-9033-4cf1-a9e8-67cb590507df","html_url":"https://github.com/kingabzpro/using-llama3-locally","commit_stats":null,"previous_names":["kingabzpro/using-llama3-locally"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kingabzpro%2Fusing-llama3-locally","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kingabzpro%2Fusing-llama3-locally/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kingabzpro%2Fusing-llama3-locally/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kingabzpro%2Fusing-llama3-locally/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kingabzpro","download_url":"https://codeload.github.com/kingabzpro/using-llama3-locally/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250439869,"owners_count":21430911,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["embeddings","langchain","llama3","llms","ollama"],"created_at":"2024-11-17T03:06:32.176Z","updated_at":"2025-04-23T13:29:22.315Z","avatar_url":"https://github.com/kingabzpro.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Using Llama-3 Locally\nIn this tutorial, we will learn how to use Llama-3 locally.\n - Using Llama 3 With Ollama\n - Accessing the Ollama API using CURL\n - Accessing the Ollama API using Python Package\n - Integrating the Llama 3 in VSCode\n - Developing the AI Application Locally using Langchain, Ollama, Chroma, and Langchain Hub.\n\n## Getting started\n\nInstall Ollama:\n```bash\ncurl -fsSL https://ollama.com/install.sh | sh\n```\nDownloading Llama3 and using it:\n```bash\nollama run llama3\n```\n\nServing the Llama3 locally:\n```bash\nollama serve\n```\n\nInstalling the required Python packages:\n```bash\npip install -r requirements.txt\n```\n\n## Running the Llama3 locally\n\nUsing CURL:\n```bash\nbash curl_ollama.sh\n```\n\nUsing Python package:\n```bash\npython python_api_ollama.py\n```\nUsing Async and Stream:\n```bash\npython async_stream_ollama.py\n```\n\n## Integrating Llama3 in VSCode\n\nRead the tutorial\n\n## Developing the AI Application Locally\n\nRun the following `langchain_ollama.ipynb` for building the vector store and testing the code.\n\nThen, run:\n```bash\npython AI_app.py\n```\nOutput:\n```bash\nQuestion: Who is Ali?\n\nAnswer: Based on the provided context, Ali is a character in the story whose life and tragic death are being pieced together through flashbacks and conversations with those who knew him.\n\nQuestion:\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkingabzpro%2Fusing-llama3-locally","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkingabzpro%2Fusing-llama3-locally","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkingabzpro%2Fusing-llama3-locally/lists"}