{"id":19156566,"url":"https://github.com/kyegomez/awesome-robotic-foundation-models","last_synced_at":"2026-06-16T01:30:17.066Z","repository":{"id":228415182,"uuid":"773934219","full_name":"kyegomez/awesome-robotic-foundation-models","owner":"kyegomez","description":"A vast array of Multi-Modal Embodied Robotic Foundation Models!","archived":false,"fork":false,"pushed_at":"2024-03-18T17:04:25.000Z","size":23,"stargazers_count":25,"open_issues_count":0,"forks_count":1,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-02-08T23:01:33.079Z","etag":null,"topics":["ai","artificial-intelligence","artificial-neural-networks","functions","machine-learning","ml","multi-modal","robotics"],"latest_commit_sha":null,"homepage":"https://discord.gg/7VckQVxvKk","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kyegomez.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-18T16:48:35.000Z","updated_at":"2024-12-10T02:35:41.000Z","dependencies_parsed_at":null,"dependency_job_id":"cfae76ab-bfff-4fed-844d-71015a544560","html_url":"https://github.com/kyegomez/awesome-robotic-foundation-models","commit_stats":null,"previous_names":["kyegomez/awesome-robotic-foundation-models"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2Fawesome-robotic-foundation-models","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2Fawesome-robotic-foundation-models/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2Fawesome-robotic-foundation-models/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2Fawesome-robotic-foundation-models/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kyegomez","download_url":"https://codeload.github.com/kyegomez/awesome-robotic-foundation-models/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239970675,"owners_count":19727013,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","artificial-intelligence","artificial-neural-networks","functions","machine-learning","ml","multi-modal","robotics"],"created_at":"2024-11-09T08:35:02.321Z","updated_at":"2026-06-16T01:30:17.033Z","avatar_url":"https://github.com/kyegomez.png","language":null,"funding_links":["https://polar.sh/kyegomez"],"categories":[],"sub_categories":[],"readme":"# awesome-robotic-foundation-models 🤖 🤖 🤖 \nA vast array of Multi-Modal Embodied Robotic Foundation Models we've worked on At Swarms! Join our team and let's democratize SOTA foundation models for robotics.\n\n# Models\n\n| Model Name              | Capabilities                                                                                                    | Industrial Use Cases                                                                              | List of Industries                                  | Production Metadata          | Link                                               |\n|-------------------------|-----------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------|-----------------------------------------------------|-----------------------------|----------------------------------------------------|\n| RT-X                    | CV, AI, Vision, Attention Model, Multimodal, Vision Transformer                                                 | Autonomous Vehicles, Surveillance, Robotics, Human-Machine Interaction                            | Automotive, Security, Robotics, Consumer Electronics | High performance, scalable   | [RT-X](https://github.com/kyegomez/RT-X)            |\n| VIMA                    | General Robot Manipulation with Multimodal Prompts                                                              | Manufacturing, Logistics, Automated Assembly                                                      | Manufacturing, Logistics                            | Modular, adaptable           | [VIMA](https://github.com/kyegomez/VIMA)           |\n| SayCan                  | Grounding Language in Robotic Affordances                                                                       | Service Robots, Assistive Technology                                                              | Healthcare, Hospitality                             | Easy integration             | [SayCan](https://github.com/kyegomez/SayCan)       |\n| AutoRT                  | Large Scale Orchestration of Robotic Agents                                                                     | Fleet Management, Automation in Large Scale Industries                                            | Logistics, Industrial Automation                    | Scalable, robust             | [AutoRT](https://github.com/kyegomez/AutoRT)       |\n| Awesome-LLM-Robotics    | Comprehensive list for Robotics/RL using LLM/multi-modal models                                                 | Research and Development, Educational                                                             | Academia, R\u0026D                                       | Research-oriented            | [Awesome-LLM-Robotics](https://github.com/kyegomez/Awesome-LLM-Robotics) |\n| RoboCAT                 | Self-Improving Foundation Agent for Robotic Manipulation                                                        | Advanced Manufacturing, Precision Engineering                                                     | Manufacturing, Engineering                          | Self-learning capabilities   | [RoboCAT](https://github.com/kyegomez/RoboCAT)     |\n| NeoCortex               | Foundation Model for Humanoid robots                                                                            | Healthcare, Elderly Care, Companion Robots                                                        | Healthcare, Consumer Products                       | High adaptability            | [NeoCortex](https://github.com/kyegomez/NeoCortex) |\n| CyberTron               | Suite of embodied multi-modal robotic transformers                                                              | Robotics Simulation, Training, and Development                                                    | Education, R\u0026D, Robotics Training                   | Plug and play, extensible    | [CyberTron](https://github.com/kyegomez/CyberTron) |\n| PALM-E                  | Embodied Multimodal Language Model, Diverse Joint Training across Language, Vision, Visual-Language Domains    | Education, Multimodal Interaction, Content Creation                                                | Education, Media, Entertainment                     | Internet-scale training data | [PALM-E](https://github.com/kyegomez/PALM-E)       |\n| HRTX                    | Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2                                                     | Swarm Robotics, Collaborative Tasks in Unstructured Environments                                   | Defense, Disaster Response                          | Distributed processing       | [HRTX](https://github.com/kyegomez/HRTX)           |\n| RT1                     | Part of RT-X, Embodied Robotic Learning Datasets and Models                                                     | Robotics Learning, Simulation-Based Training                                                      | Education, Robotics, Simulation                      | Customizable, data-driven    | [RT1](https://github.com/kyegomez/RT1)             |\n| RT2                     | Translates vision and language into action                                                                      | Human-Robot Interaction, Natural Language Processing in Robotics                                   | Consumer Electronics, Robotics                       | Intuitive interface          | [RT2](https://github.com/kyegomez/RT2)             |\n\n\n## 🫶 Contributions:\n\nThe easiest way to contribute is to pick any issue with the `good first issue` tag 💪. Read the Contributing guidelines [here](/CONTRIBUTING.md). Bug Report? [File here](https://github.com/swarms/gateway/issues) | Feature Request? [File here](https://github.com/swarms/gateway/issues)\n\nSwarms is an open-source project, and contributions are VERY welcome. If you want to contribute, you can create new features, fix bugs, or improve the infrastructure. Please refer to the [CONTRIBUTING.md](https://github.com/kyegomez/swarms/blob/master/CONTRIBUTING.md) and our [contributing board](https://github.com/users/kyegomez/projects/1) to participate in Roadmap discussions!\n\n\u003ca href=\"https://github.com/kyegomez/swarms/graphs/contributors\"\u003e\n  \u003cimg src=\"https://contrib.rocks/image?repo=kyegomez/swarms\" /\u003e\n\u003c/a\u003e\n\n----\n\n## Community\n\nJoin our growing community around the world, for real-time support, ideas, and discussions on Swarms 😊 \n\n- View our official [Blog](https://swarms.apac.ai)\n- Chat live with us on [Discord](https://discord.gg/kS3rwKs3ZC)\n- Follow us on [Twitter](https://twitter.com/kyegomez)\n- Connect with us on [LinkedIn](https://www.linkedin.com/company/the-swarm-corporation)\n- Visit us on [YouTube](https://www.youtube.com/channel/UC9yXyitkbU_WSy7bd_41SqQ)\n- [Join the Swarms community on Discord!](https://discord.gg/AJazBmhKnr)\n- Join our Swarms Community Gathering every Thursday at 1pm NYC Time to unlock the potential of autonomous agents in automating your daily tasks [Sign up here](https://lu.ma/5p2jnc2v)\n\n---\n\n## Discovery Call\nBook a discovery call to learn how Swarms can lower your operating costs by 40% with swarms of autonomous agents in lightspeed. [Click here to book a time that works for you!](https://calendly.com/swarm-corp)\n\n\n## Accelerate Backlog\nHelp us accelerate our backlog by supporting us financially! Note, we're an open source corporation and so all the revenue we generate is through donations at the moment ;)\n\n\u003ca href=\"https://polar.sh/kyegomez\"\u003e\u003cimg src=\"https://polar.sh/embed/fund-our-backlog.svg?org=kyegomez\" /\u003e\u003c/a\u003e\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkyegomez%2Fawesome-robotic-foundation-models","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkyegomez%2Fawesome-robotic-foundation-models","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkyegomez%2Fawesome-robotic-foundation-models/lists"}