{"id":15840228,"url":"https://github.com/ivangabriele/docker-functionary","last_synced_at":"2025-10-11T17:38:13.676Z","repository":{"id":200135161,"uuid":"704892386","full_name":"ivangabriele/docker-functionary","owner":"ivangabriele","description":"Ready-to-deploy Docker image for Functionary LLM served as an OpenAI-Compatible API.","archived":false,"fork":false,"pushed_at":"2025-10-01T19:31:01.000Z","size":27,"stargazers_count":5,"open_issues_count":2,"forks_count":1,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-10-07T10:37:37.248Z","etag":null,"topics":["ai","docker","docker-hub","docker-image","functionary","functions","large-language-models","llama2","llm","openai","openai-api","server","vllm"],"latest_commit_sha":null,"homepage":"","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ivangabriele.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.md","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-10-14T12:24:59.000Z","updated_at":"2024-05-09T17:50:45.000Z","dependencies_parsed_at":"2024-03-01T16:31:17.316Z","dependency_job_id":"d7ba0cdf-ba7c-4dec-ad9f-c47c4af14d97","html_url":"https://github.com/ivangabriele/docker-functionary","commit_stats":{"total_commits":7,"total_committers":2,"mean_commits":3.5,"dds":0.1428571428571429,"last_synced_commit":"27283dea4ebf60f0ed1e1fdb294836880a8d869f"},"previous_names":["ivangabriele/docker-functionary"],"tags_count":0,"template":false,"template_full_name":"ivangabriele/template-base","purl":"pkg:github/ivangabriele/docker-functionary","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ivangabriele%2Fdocker-functionary","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ivangabriele%2Fdocker-functionary/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ivangabriele%2Fdocker-functionary/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ivangabriele%2Fdocker-functionary/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ivangabriele","download_url":"https://codeload.github.com/ivangabriele/docker-functionary/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ivangabriele%2Fdocker-functionary/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279002539,"owners_count":26083399,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-10T02:00:06.843Z","response_time":62,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","docker","docker-hub","docker-image","functionary","functions","large-language-models","llama2","llm","openai","openai-api","server","vllm"],"created_at":"2024-10-05T16:42:13.692Z","updated_at":"2025-10-11T17:38:13.660Z","avatar_url":"https://github.com/ivangabriele.png","language":"Dockerfile","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Functionary Docker Image\n\n[![img-github]][link-github]\n[![img-docker]][link-docker]\n[![img-runpod]][link-runpod]\n\nReady-to-deploy Docker image including the [Functionary LLM][link-functionary] served via an OpenAI-Compatible API.\n\n\u003e [!WARNING]   \n\u003e This LLM model supports Function Calling. **However** It needs some hacking on the client-side\n\u003e because Functionary vLLm script doesn't respect Open-AI API Function Calling format.  \n\u003e I will provide an example project on how to achieve that in the coming days.\n\n\u003e [!IMPORTANT] \n\u003e There is no possibility to set an API Key at the moment.\n\u003e But I will work on adding that option as an environment variable.  \n\u003e In the meantime, don't share your endpoint with anybody.\n\n## Specifications\n\n### API\n\n- Default Port: `8000`\n- Path: `/v1`\n\nExample config for your OpenAI-compatible client (here using a RunPod endpoint):\n\n```json\n{\n  \"model\": \"musabgultekin/functionary-7b-v1\",\n  \"api_base\": \"https://[YOUR_CONTAINER_ID]-8000.proxy.runpod.net/v1\",\n  \"api_key\": \"functionary\", // Dummy API Key since it can't be `null`\n  \"api_type\": \"open_ai\"\n}\n```\n\n### Docker Image\n\n#### Base\n\n- [nvidia/pytorch](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch)\n\n#### Content\n\n- Python 3.9\n- [Functionary LLM](https://github.com/MeetKai/functionary)\n- [vLLM Server](https://github.com/vllm-project/vllm)\n\n## Deployment\n\n### RunPod\n\n[![img-runpod]][link-runpod]\n\n---\n\n[img-docker]: https://img.shields.io/docker/pulls/ivangabriele/functionary?style=for-the-badge\n[img-runpod]: https://img.shields.io/badge/RunPod-Deploy-673ab7?style=for-the-badge\n[img-github]: https://img.shields.io/badge/Github-Repo-black?logo=github\u0026style=for-the-badge\n[img-github-actions]: https://img.shields.io/github/actions/workflow/status/ivangabriele/docker-functionary/main.yml?branch=main\u0026style=for-the-badge\n\n[link-docker]: https://hub.docker.com/r/ivangabriele/functionary\n[link-functionary]: https://github.com/MeetKai/functionary\n[link-github]: https://github.com/ivangabriele/docker-functionary\n[link-github-actions]: https://github.com/ivangabriele/docker-functionary/actions/workflows/main.yml\n[link-runpod]: https://runpod.io/gsc?template=sihvefhjru\u0026ref=s0k66ov1\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fivangabriele%2Fdocker-functionary","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fivangabriele%2Fdocker-functionary","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fivangabriele%2Fdocker-functionary/lists"}