{"id":27775247,"url":"https://github.com/modular/modular","last_synced_at":"2025-12-11T22:10:43.624Z","repository":{"id":160541189,"uuid":"634043200","full_name":"modular/modular","owner":"modular","description":"The Modular Platform (includes MAX \u0026 Mojo)","archived":false,"fork":false,"pushed_at":"2025-05-11T07:37:01.000Z","size":59920,"stargazers_count":24019,"open_issues_count":814,"forks_count":2610,"subscribers_count":249,"default_branch":"main","last_synced_at":"2025-05-12T04:13:59.503Z","etag":null,"topics":["ai","language","machine-learning","max","modular","mojo","programming-language"],"latest_commit_sha":null,"homepage":"https://docs.modular.com/","language":"Mojo","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/modular.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-04-28T22:17:24.000Z","updated_at":"2025-05-12T03:21:34.000Z","dependencies_parsed_at":"2023-09-22T00:21:58.906Z","dependency_job_id":"66f5b372-0eb8-47b1-84e8-ba1fb5f48a74","html_url":"https://github.com/modular/modular","commit_stats":null,"previous_names":["modular/mojo","modular/max","modularml/mojo","modular/modular"],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/modular%2Fmodular","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/modular%2Fmodular/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/modular%2Fmodular/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/modular%2Fmodular/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/modular","download_url":"https://codeload.github.com/modular/modular/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253678865,"owners_count":21946315,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","language","machine-learning","max","modular","mojo","programming-language"],"created_at":"2025-04-30T03:01:59.303Z","updated_at":"2025-12-11T22:10:43.574Z","avatar_url":"https://github.com/modular.png","language":"Mojo","readme":"\u003cdiv align=\"center\"\u003e\n    \u003cimg src=\"https://modular-assets.s3.amazonaws.com/images/modular_github_logo_bg.png\"\u003e\n\n  [About Modular] | [Get started] | [API docs] | [Contributing] | [Changelog]\n\u003c/div\u003e\n\n[About Modular]: https://www.modular.com/\n[Get started]: https://docs.modular.com/max/get-started\n[API docs]: https://docs.modular.com/max/api\n[Contributing]: ./CONTRIBUTING.md\n[Changelog]: https://docs.modular.com/max/changelog\n\n# Modular Platform\n\n\u003e A unified platform for AI development and deployment, including **MAX**🧑‍🚀 and\n**Mojo**🔥.\n\nThe Modular Platform is an open and fully-integrated suite of AI libraries\nand tools that accelerates model serving and scales GenAI deployments. It\nabstracts away hardware complexity so you can run the most popular open\nmodels with industry-leading GPU and CPU performance without any code changes.\n\n![](https://docs.modular.com/images/modular-container-stack.png?20250513)\n\n## Get started\n\nYou don't need to clone this repo.\n\nYou can install Modular as a `pip` or `conda` package and then start an\nOpenAI-compatible endpoint with a model of your choice.\n\nIf we trim the ceremonial steps, you can start a local LLM endpoint with just\ntwo commands:\n\n```sh\npip install modular\n```\n\n```sh\nmax serve --model-path=modularai/Llama-3.1-8B-Instruct-GGUF\n```\n\nThen start sending the Llama 3 model inference requests using [our\nOpenAI-compatible REST API](https://docs.modular.com/max/api/serve).\n\nOr try running hundreds of other models from [our model\nrepository](https://builds.modular.com/?category=models).\n\nFor a complete walkthrough, see [the quickstart\nguide](https://docs.modular.com/max/get-started).\n\n## Deploy our container\n\nThe MAX container is our Kubernetes-compatible Docker container for convenient\ndeployment, using the same inference server you get from the `max serve`\ncommand shown above. We have separate containers for NVIDIA and AMD GPU\nenvironments, and a unified container that works with both.\n\nFor example, you can start a container for an NVIDIA GPU with this command:\n\n```sh\ndocker run --gpus=1 \\\n    -v ~/.cache/huggingface:/root/.cache/huggingface \\\n    -p 8000:8000 \\\n    docker.modular.com/modular/max-nvidia-full:latest \\\n    --model-path modularai/Llama-3.1-8B-Instruct-GGUF\n```\n\nFor more information, see our [MAX container\ndocs](https://docs.modular.com/max/container) or the [Modular Docker Hub\nrepository](https://hub.docker.com/u/modular).\n\n## About the repo\n\nWe're constantly open-sourcing more of the Modular Platform and you can find\nall of it in here. As of May, 2025, this repo includes over 450,000 lines of\ncode from over 6000 contributors, providing developers with production-grade\nreference implementations and tools to extend the Modular Platform with new\nalgorithms, operations, and hardware targets. It is quite likely **the world's\nlargest repository of open source CPU and GPU kernels**!\n\nHighlights include:\n\n- Mojo standard library: [/mojo/stdlib](mojo/stdlib)\n- MAX GPU and CPU kernels: [/max/kernels](max/kernels) (Mojo kernels)\n- MAX inference server: [/max/serve](max/serve) (OpenAI-compatible endpoint)\n- MAX model pipelines: [/max/pipelines](max/pipelines) (Python-based graphs)\n- Code example: [/examples](examples)\n\nThis repo has two major branches:\n\n- The [`main`](https://github.com/modular/modular/tree/main) branch, which is\nin sync with the nightly build and subject to new bugs. Use this branch for\n[contributions](./CONTRIBUTING.md), or if you [installed the nightly\nbuild](https://docs.modular.com/max/packages).\n\n- The [`stable`](https://github.com/modular/modular/tree/stable) branch, which\nis in sync with the last stable released version of Mojo. Use the examples in\nhere if you [installed the stable\nbuild](https://docs.modular.com/max/packages).\n\n## Contribute\n\nThanks for your interest in contributing to this repository!\n\nWe accept contributions to the [Mojo standard library](./mojo), [MAX AI\nkernels](./max/kernels), code examples, and Mojo docs, but currently not to any\nother parts of the repository.\n\nPlease see the [Contribution Guide](./CONTRIBUTING.md) for instructions.\n\nWe also welcome your bug reports.  If you have a bug, please [file an issue\nhere](https://github.com/modular/modular/issues/new/choose).\n\n## Contact us\n\nIf you'd like to chat with the team and other community members, please send a\nmessage to our [Discord channel](https://discord.gg/modular) and [our\nforum board](https://forum.modular.com/).\n\n## License\n\nThis repository and its contributions are licensed under the Apache License\nv2.0 with LLVM Exceptions (see the LLVM [License](https://llvm.org/LICENSE.txt)).\nModular, MAX and Mojo usage and distribution are licensed under the\n[Modular Community License](https://www.modular.com/legal/community).\n\n### Third party licenses\n\nYou are entirely responsible for checking and validating the licenses of\nthird parties (i.e. Huggingface) for related software and libraries that are downloaded.\n\n## Thanks to our contributors\n\n\u003ca href=\"https://github.com/modular/modular/graphs/contributors\"\u003e\n  \u003cimg src=\"https://contrib.rocks/image?repo=modular/modular\" /\u003e\n\u003c/a\u003e\n","funding_links":[],"categories":["Mojo","🔓 Open Source Inference Engines","Inference"],"sub_categories":["Inference Platform"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmodular%2Fmodular","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmodular%2Fmodular","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmodular%2Fmodular/lists"}