{"id":18497814,"url":"https://github.com/containers/ai-lab-recipes","last_synced_at":"2025-05-16T10:06:31.649Z","repository":{"id":208278607,"uuid":"721232494","full_name":"containers/ai-lab-recipes","owner":"containers","description":"Examples for building and running LLM services and applications locally with Podman","archived":false,"fork":false,"pushed_at":"2025-05-12T04:54:23.000Z","size":6962,"stargazers_count":153,"open_issues_count":65,"forks_count":131,"subscribers_count":8,"default_branch":"main","last_synced_at":"2025-05-12T05:33:43.926Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/containers.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-11-20T16:17:46.000Z","updated_at":"2025-05-12T04:54:26.000Z","dependencies_parsed_at":"2023-11-26T19:25:06.636Z","dependency_job_id":"1a73a1f8-7c22-40d1-9c6c-da9c69200f7d","html_url":"https://github.com/containers/ai-lab-recipes","commit_stats":{"total_commits":816,"total_committers":61,"mean_commits":13.37704918032787,"dds":0.8455882352941176,"last_synced_commit":"7a7edc7c4979091fd24e3d23e6f8a2a7de6066f9"},"previous_names":["michaelclifford/locallm"],"tags_count":11,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/containers%2Fai-lab-recipes","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/containers%2Fai-lab-recipes/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/containers%2Fai-lab-recipes/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/containers%2Fai-lab-recipes/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/containers","download_url":"https://codeload.github.com/containers/ai-lab-recipes/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254509475,"owners_count":22082891,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T13:35:59.914Z","updated_at":"2025-05-16T10:06:31.625Z","avatar_url":"https://github.com/containers.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AI Lab Recipes\n\n![](/assets/ai_lab_recipes_logo.png) \n\nThis repo contains recipes for building and running containerized AI and LLM\nApplications with Podman.\n\nThese containerized AI recipes can be used to help developers quickly prototype\nnew AI and LLM based applications locally, without the need for relying on any other\nexternally hosted services. Since they are already containerized, it also helps\ndevelopers move quickly from prototype to production.\n\n## Model servers\n\n#### What's a model server?\n\nA model server is a program that serves machine-learning models, such as LLMs, and\nmakes their functions available via an API. This makes it easy for developers to \nincorporate AI into their applications. This repository provides descriptions and \ncode for building several of these model servers.\n\nMany of the sample applications rely on the `llamacpp_python` model server by\ndefault. This server can be used for various generative AI applications with various models.\nHowever, each sample application can be paired with a variety of model servers.\n\nLearn how to build and run the llamacpp_python model server by following the\n[llamacpp_python model server README](/model_servers/llamacpp_python/README.md).\n\n## Current Recipes \n\nRecipes consist of at least two components: A model server and an AI application.\nThe model server manages the model, and the AI application provides the specific \nlogic needed to perform some specific task such as chat, summarization, object \ndetection, etc. \n\nThere are several sample applications in this repository that can be found in the\n[recipes](./recipes) directory.\n\nThey fall under the categories:\n\n* [audio](./recipes/audio)\n* [computer-vision](./recipes/computer_vision)\n* [multimodal](./recipes/multimodal)\n* [natural language processing](./recipes/natural_language_processing)\n\n\nLearn how to build and run each application by visiting their README's. \nFor example, learn how to run the [chatbot recipe here](./recipes/natural_language_processing/chatbot).\n\n## Current AI Lab Recipe images built from this repository\n\nImages for many sample applications and models are available in `quay.io`. All\ncurrently built images are  tracked in\n[ailab-images.md](./ailab-images.md)\n\n## [Training](./training/README.md)\n\nLinux Operating System Bootable containers enabled for AI Training\n\n## Setting Up Git Hooks\n\nTo install our standard git hooks, run the following command:\n\n```sh\n./install-hooks.sh\n```\n\n### pre-commit hook\n\nEnsures that `training/ilab-wrapper/ilab` is duplicated into `training/nvidia-bootc/duplicated/ilab-wrapper/ilab`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcontainers%2Fai-lab-recipes","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcontainers%2Fai-lab-recipes","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcontainers%2Fai-lab-recipes/lists"}