{"id":15664811,"url":"https://github.com/anakin87/llama2-haystack","last_synced_at":"2025-08-20T01:03:51.838Z","repository":{"id":182437104,"uuid":"668494467","full_name":"anakin87/llama2-haystack","owner":"anakin87","description":"Using Llama2 with Haystack, the NLP/LLM framework.","archived":false,"fork":false,"pushed_at":"2023-07-21T07:08:36.000Z","size":462,"stargazers_count":16,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-07-04T20:53:00.066Z","etag":null,"topics":["haystack","large-language-models","llama","llm","nlp"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/anakin87.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-07-20T00:30:40.000Z","updated_at":"2024-09-01T08:01:51.000Z","dependencies_parsed_at":"2024-09-04T09:40:22.726Z","dependency_job_id":null,"html_url":"https://github.com/anakin87/llama2-haystack","commit_stats":{"total_commits":6,"total_committers":2,"mean_commits":3.0,"dds":"0.16666666666666663","last_synced_commit":"09c22c06a15e40dcaa021a284fdd4be72a4ff297"},"previous_names":["anakin87/llama2-haystack"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/anakin87/llama2-haystack","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anakin87%2Fllama2-haystack","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anakin87%2Fllama2-haystack/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anakin87%2Fllama2-haystack/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anakin87%2Fllama2-haystack/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/anakin87","download_url":"https://codeload.github.com/anakin87/llama2-haystack/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anakin87%2Fllama2-haystack/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264502647,"owners_count":23618663,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["haystack","large-language-models","llama","llm","nlp"],"created_at":"2024-10-03T13:44:13.445Z","updated_at":"2025-08-20T01:03:51.701Z","avatar_url":"https://github.com/anakin87.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# llama2-haystack\n**(Experimental) Using Llama2 with Haystack**\n\nThe [notebook](llama2-haystack.ipynb) contains my hacky experiments in which I try to load and use [Llama2](https://ai.meta.com/llama/) with [Haystack](https://github.com/deepset-ai/haystack), the NLP/LLM framework.\n\n*It's nothing official or well refined, but perhaps it may be useful to other people experimenting.*\n\n![llama2-haystack](./assets/logo.png)\n\n## Notebook summary\n1) Installed Transformers from the main branch (and other libraries) 📚\n2) Loaded Llama-2-13b-chat-hf on Colab using 4-bit quantizazion, thanks to the great material shared by Younes Belkada 🙌\n3) Disabled Tensor Parallelism, which caused some issues 🛠️\n4) Installed a minimal version of Haystack\n5) Found a hacky way to load the model in Haystack's PromptNode\n6) Had a llama-zing chat session, from 🎧🎶 David Guetta to Don Matteo ⛪📿 (an Italian TV series)!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanakin87%2Fllama2-haystack","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fanakin87%2Fllama2-haystack","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanakin87%2Fllama2-haystack/lists"}