{"id":16387095,"url":"https://github.com/rudolfolah/metatron","last_synced_at":"2025-08-28T09:08:23.715Z","repository":{"id":181738756,"uuid":"660190305","full_name":"rudolfolah/metatron","owner":"rudolfolah","description":"Metatron is a project that brings together whisper.cpp, llama.cpp, and piper into a deployable stack with an awesome Node.js API wrapper for each of them.","archived":false,"fork":false,"pushed_at":"2024-12-26T22:36:55.000Z","size":35,"stargazers_count":7,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-30T18:01:57.720Z","etag":null,"topics":["dockerized","llama-cpp","llamacpp","piper","whisper-cpp","whispercpp"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rudolfolah.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-06-29T12:53:20.000Z","updated_at":"2024-12-26T22:36:59.000Z","dependencies_parsed_at":"2025-04-30T18:01:56.194Z","dependency_job_id":"8a19f64f-625f-4565-ac44-982eb4f81007","html_url":"https://github.com/rudolfolah/metatron","commit_stats":null,"previous_names":["rudolfolah/metatron"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/rudolfolah/metatron","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rudolfolah%2Fmetatron","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rudolfolah%2Fmetatron/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rudolfolah%2Fmetatron/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rudolfolah%2Fmetatron/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rudolfolah","download_url":"https://codeload.github.com/rudolfolah/metatron/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rudolfolah%2Fmetatron/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":272475088,"owners_count":24940683,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-28T02:00:10.768Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dockerized","llama-cpp","llamacpp","piper","whisper-cpp","whispercpp"],"created_at":"2024-10-11T04:24:53.807Z","updated_at":"2025-08-28T09:08:23.488Z","avatar_url":"https://github.com/rudolfolah.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# metatron\n\nMetatron is a project that brings together `whisper.cpp`, `llama.cpp`, and `piper` into a deployable stack with an awesome Node.js API wrapper for each of them.\n\nWhy? So you can deploy and scale out each part in your own network, and use the API to interact with them:\n* Send audio through the whisper API for a transcription\n* Send a prompt through llama API for a response\n* Send a response through piper API for text-to-speech audio\n\n## Usage\n\n```shell\n# Builds the images from local Dockerfiles\n./localdev_build.sh\n# Starts the Docker Compose project with a screen session to the web server and background workers\n./localdev_start.sh\n```\n\n```shell\ngit submodule update --init --recursive\ncd piper \u0026\u0026 docker buildx build --target build -t piper:latest .\n\n# for local development\ndocker build --target localdev -t metatron-api:localdev -f ./Dockerfile-api .\ndocker build --target localdev -t metatron-piper:localdev -f ./Dockerfile-piper .\ndocker build --target localdev -t metatron-llama:localdev -f ./Dockerfile-llama .\ndocker build --target localdev -t metatron-whisper:localdev -f ./Dockerfile-whisper .\ndocker compose up\n\n# for production\ndocker build -t metatron-api:latest -f ./Dockerfile-api .\ndocker build -t metatron-piper:latest -f ./Dockerfile-piper .\ndocker build -t metatron-llama:latest -f ./Dockerfile-llama .\ndocker build -t metatron-whisper:latest -f ./Dockerfile-whisper .\n```\n\nDebugging:\n\n```shell\ndocker build -t metatron --no-cache .\n```\n\n## Architecture\n\n```mermaid\ngraph TD\n    A[API] \u003c--\u003e K[Kafka]\n    S[Storage] --\u003e A\n    K \u003c--\u003e W_piper[piper\u003cbr\u003eworker]\n    K \u003c--\u003e W_whisper[whisper.cpp\u003cbr\u003eworker]\n    K \u003c--\u003e W_llama[llama.cpp\u003cbr\u003eworker]\n    Web[web app] --http--\u003e A\n    Web \u003c--web socket--\u003e A\n    K --\u003e Z[Zookeeper]\n    W_piper --\u003e S\n    W_whisper --\u003e S\n```\n\n### Data Flow\n\n1. API generates a UUID for the request:\n   * callback topic is `metatron-response-${UUID}`\n   * API subscribes to the callback topic:\n     * when a message is received, it is sent to the client via web socket\n     * when a message is received, it is deleted from the topic\n       * the transcription will be displayed in the web app\n       * the prompt and response will be displayed in the web app\n       * the synthesized audio will be played in the web app\n2. API sends message to `transcribe` topic with:\n   * UUID\n   * audio file id\n   * callback topic\n3. Whisper worker consumes message from `transcribe` topic\n4. Whisper worker sends message to callback topic with:\n   * UUID\n   * transcription data\n5. API sends message to `prompt` topic with:\n   * UUID\n   * prompt data\n   * callback topic\n6. Llama worker consumes message from `prompt` topic\n7. Llama worker sends message to callback topic with:\n   * UUID\n   * response data\n8. API sends message to `synthesize` topic with:\n   * UUID\n   * response data\n   * callback topic\n9. Piper worker consumes message from `synthesize` topic\n10. Piper worker uploads audio to storage\n11. Piper worker sends message to callback topic with:\n    * UUID\n    * audio file id\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frudolfolah%2Fmetatron","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frudolfolah%2Fmetatron","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frudolfolah%2Fmetatron/lists"}