{"id":14964796,"url":"https://github.com/fuzzy-search/realtime-bakllava","last_synced_at":"2025-04-06T02:08:41.729Z","repository":{"id":205511523,"uuid":"714401340","full_name":"Fuzzy-Search/realtime-bakllava","owner":"Fuzzy-Search","description":"llama.cpp with BakLLaVA model describes what does it see","archived":false,"fork":false,"pushed_at":"2023-11-08T08:17:35.000Z","size":2977,"stargazers_count":380,"open_issues_count":4,"forks_count":45,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-10-30T00:52:22.265Z","etag":null,"topics":["bakllavva","cpp","demo-application","inference","llama","llamacpp","llm"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Fuzzy-Search.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-11-04T19:49:00.000Z","updated_at":"2024-10-27T19:49:17.000Z","dependencies_parsed_at":null,"dependency_job_id":"795504f1-9d93-45a6-a7df-381f29c03777","html_url":"https://github.com/Fuzzy-Search/realtime-bakllava","commit_stats":{"total_commits":14,"total_committers":3,"mean_commits":4.666666666666667,"dds":0.5,"last_synced_commit":"aee23f3406b32d8bb69fcadc6754ee45c2ca0979"},"previous_names":["fuzzy-search/realtime-bakllava-1-llama.app","fuzzy-search/realtime-bakllava"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Fuzzy-Search%2Frealtime-bakllava","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Fuzzy-Search%2Frealtime-bakllava/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Fuzzy-Search%2Frealtime-bakllava/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Fuzzy-Search%2Frealtime-bakllava/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Fuzzy-Search","download_url":"https://codeload.github.com/Fuzzy-Search/realtime-bakllava/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247423514,"owners_count":20936626,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bakllavva","cpp","demo-application","inference","llama","llamacpp","llm"],"created_at":"2024-09-24T13:33:47.685Z","updated_at":"2025-04-06T02:08:41.714Z","avatar_url":"https://github.com/Fuzzy-Search.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🍰 Bakllava Llama C++ Tutorial 🦙\n\nWelcome to the delicious world of Bakllava Llama with C++! Follow these steps to get your code running and indulge in AI sweetness! 😋\n\n🚨 Properly tested only with Apple silicon chip\n\n[youtube installation guide](https://youtu.be/UyRFbGK9QmI)\n\nsimilar relevant project: [Be My Eyes\" web app](https://github.com/lxe/llavavision#getting-started)\n\n\u003ca href=\"https://twitter.com/Karmedge\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/Twitter-%40karmedge-00000\"\u003e\u003c/a\u003e\n\n\u003ca href=\"https://www.linkedin.com/in/karmedge\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/LinkedIn-karmedge-informational\"\u003e\u003c/a\u003e\n\n## 🚀 Step 1: Install Llama C++\n\nFirst things first, let's get the Llama C++ installed.\n\n🔗 Clone the repository from GitHub:\n```jsx\ngit clone https://github.com/ggerganov/llama.cpp\ncd llama.cpp\n```\n### On Linux \u0026 macOS:\n🛠 Build with make:\n```\nmake\n```\n🏗 Or, if you prefer cmake:\n```\ncmake --build . --config Release\n```\n\n## 📦 Step 2: Download the Model!\n1. 📥 Download from Hugging Face - [mys/ggml_bakllava-1](https://huggingface.co/mys/ggml_bakllava-1/tree/main) this 2 files:\n* 🌟 ggml-model-q4_k.gguf (or any other quantized model) - only one is required!\n* 🧊 mmproj-model-f16.gguf\n\n2. ✂️ Copy the paths of those 2 files.\n3. 🏃‍♂️ Run this in the llama.cpp repository (replace YOUR_PATH with the paths to the files you downloaded):\n\n    #### macOS\n    ```\n    ./server -m YOUR_PATH/ggml-model-q4_k.gguf --mmproj YOUR_PATH/mmproj-model-f16.gguf -ngl 1\n    ```\n    #### Windows\n    ```\n    server.exe -m REPLACE_WITH_YOUR_PATH\\ggml-model-q4_k.gguf --mmproj REPLACE_WITH_YOUR_PATH\\mmproj-model-f16.gguf -ngl 1\n\n    ```\n4. 🎉 The llama server is now up and running!\n    \n    ⚠️ NOTE: Keep the server running in the background.\n5. 📹 Let's run the script to use the webcam or send it a single picture!\n\n## 🏃‍♀️ Step 3: Running the Demo\nOpen a new terminal window and clone the demo app:\n```\ngit clone https://github.com/Fuzzy-Search/realtime-bakllava.git\ncd realtime-bakllava\n```\n### 🛠 (Optional) Create a new Python virtual environment and activate it\n```\npython3 -m venv bakllava-venv\nsource bakllava-venv/bin/activate\npip3 install -r requirements.txt\n```\n### 🎥 Webcam Script\nTo start streaming from your webcam:\n\n! if you have problem with FFMPEG lib, download the source code and in file src/video_stream.py modify second line of code\n\n```\npython3 src/video_stream.py\n```\n\n### 🖼 Simple Picture Drop\n![Export-1699182386675](https://github.com/Fuzzy-Search/realtime-bakllava/assets/40468118/cc2384d9-1e16-4e94-a02c-47bd703d8ed7)\n\n```\npip install -r picture_requirements.txt\npython src/picture_drop.py --path src/sample_pic.png\n```\n\n\n## 📝 Enjoy your adventure with Llama C++! 🚀🦙\n\n## Star History\n\n[![Star History Chart](https://api.star-history.com/svg?repos=Fuzzy-Search/realtime-bakllava\u0026type=Date)](https://star-history.com/#Fuzzy-Search/realtime-bakllava\u0026Date)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffuzzy-search%2Frealtime-bakllava","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffuzzy-search%2Frealtime-bakllava","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffuzzy-search%2Frealtime-bakllava/lists"}