{"id":42301879,"url":"https://github.com/smellslikeml/dolla_llama","last_synced_at":"2026-01-27T10:37:37.381Z","repository":{"id":203409855,"uuid":"709387525","full_name":"smellslikeml/dolla_llama","owner":"smellslikeml","description":"Never forget the resource that helps to close that sales call! Power a real-time speech-to-text agent with retrieval augmented generation based on webscraped customer use-cases.","archived":false,"fork":false,"pushed_at":"2024-01-23T06:17:31.000Z","size":979,"stargazers_count":13,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-01-12T18:57:45.205Z","etag":null,"topics":["agent","copilot","llama","llms","rag","stt"],"latest_commit_sha":null,"homepage":"https://twitter.com/smellslikeml/status/1699471420076745104","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/smellslikeml.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2023-10-24T16:02:22.000Z","updated_at":"2025-09-18T05:55:20.000Z","dependencies_parsed_at":null,"dependency_job_id":"f5f959f2-e19c-4c4d-bf68-bc76beef0470","html_url":"https://github.com/smellslikeml/dolla_llama","commit_stats":null,"previous_names":["smellslikeml/dolla_llama"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/smellslikeml/dolla_llama","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smellslikeml%2Fdolla_llama","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smellslikeml%2Fdolla_llama/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smellslikeml%2Fdolla_llama/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smellslikeml%2Fdolla_llama/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/smellslikeml","download_url":"https://codeload.github.com/smellslikeml/dolla_llama/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/smellslikeml%2Fdolla_llama/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28422401,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T13:30:50.153Z","status":"ssl_error","status_checked_at":"2026-01-14T13:29:08.907Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agent","copilot","llama","llms","rag","stt"],"created_at":"2026-01-27T10:37:36.643Z","updated_at":"2026-01-27T10:37:37.376Z","avatar_url":"https://github.com/smellslikeml.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Dolla Llama: Real-Time Co-Pilot for Closing the Deal\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"assets/dolla_llama.png\" alt=\"Dolla Llama\" style=\"width:30%;height:30%\"\u003e\n\u003c/p\u003e\n\nImplements speech-to-text (STT) and retrieval-augmented generation (RAG) to assist live sales calls. \n\n## 🌟 Features:\n- STT with Whisper.cpp and llama.cpp for your LLM\n- Custom embeddings for your text corpus using SentenceTransformers\n- Indexing documents + embeddings with ElasticSearch\n\n## Table of Contents\n1. [Getting Started](#getting-started)\n2. [Creating Custom Embeddings](#creating-custom-embeddings)\n3. [Indexing with ElasticSearch](#indexing-with-elasticsearch)\n4. [Interface with Gradio](#interface-with-gradio)\n5. [Next Steps](#next-steps)\n\n## Getting Started\nThis demo assumes you have:\n\n- [docker](https://docs.docker.com/engine/install/) and [docker-compose](https://docs.docker.com/compose/install/) installed\n- Familiarity with [RAG](https://stackoverflow.blog/2023/10/18/retrieval-augmented-generation-keeping-llms-relevant-and-current/) and its applications\n\n### Setup\nMake sure to convert your Llama model to `gguf` format with [llama.cpp](https://github.com/ggerganov/llama.cpp) for serving using their instructions.\nThen save the model in a local directory named `models/` \n\n\nLaunch with:\n```\ndocker-compose up\n```\n\nAnd navigate to `http://localhost:8090` \n\n## Creating Custom Embeddings\n\nBy fine-tuning with SentenceTransformers, we can generate text embeddings locally for matching with documents in our Elasticsearch index.\n\nThe [scraper/main.py](scraper/main.py) script scrapes a list of sites to index. You can update the links in `scraper/config.json` \n\n## Indexing with ElasticSearch\n\nUsing Elasticsearch, we can index and tag documents for filtering and customization of the relevance scoring.\n\nThe [scraper/main.py](scarper/main.py) script also handles this after scraping. \n\n## Interface with Gradio\n\nWith Gradio, you press a button to begin and read suggestions in the chatbox.\n\nThe [app/app.py](app/app.py) contains the logic to run whisper for speech-to-text, run queries on the elasticsearch index, and launch the front-end. \n\n## Next Steps\n\n* Fine-tune an LLM for your usecase\n* Add additional indices for query/retrieval\n* Try a container orchestrator like k8s for robust distributed deployments\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsmellslikeml%2Fdolla_llama","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsmellslikeml%2Fdolla_llama","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsmellslikeml%2Fdolla_llama/lists"}