Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kyegomez/awesome-robotic-foundation-models
A vast array of Multi-Modal Embodied Robotic Foundation Models!
https://github.com/kyegomez/awesome-robotic-foundation-models
List: awesome-robotic-foundation-models
ai artificial-intelligence artificial-neural-networks functions machine-learning ml multi-modal robotics
Last synced: 17 days ago
JSON representation
A vast array of Multi-Modal Embodied Robotic Foundation Models!
- Host: GitHub
- URL: https://github.com/kyegomez/awesome-robotic-foundation-models
- Owner: kyegomez
- License: apache-2.0
- Created: 2024-03-18T16:48:35.000Z (10 months ago)
- Default Branch: main
- Last Pushed: 2024-03-18T17:04:25.000Z (10 months ago)
- Last Synced: 2024-12-27T17:01:53.357Z (24 days ago)
- Topics: ai, artificial-intelligence, artificial-neural-networks, functions, machine-learning, ml, multi-modal, robotics
- Homepage: https://discord.gg/7VckQVxvKk
- Size: 22.5 KB
- Stars: 25
- Watchers: 5
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# awesome-robotic-foundation-models 🤖 🤖 🤖
A vast array of Multi-Modal Embodied Robotic Foundation Models we've worked on At Swarms! Join our team and let's democratize SOTA foundation models for robotics.
# Models
| Model Name | Capabilities | Industrial Use Cases | List of Industries | Production Metadata | Link |
|-------------------------|-----------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------|-----------------------------------------------------|-----------------------------|----------------------------------------------------|
| RT-X | CV, AI, Vision, Attention Model, Multimodal, Vision Transformer | Autonomous Vehicles, Surveillance, Robotics, Human-Machine Interaction | Automotive, Security, Robotics, Consumer Electronics | High performance, scalable | [RT-X](https://github.com/kyegomez/RT-X) |
| VIMA | General Robot Manipulation with Multimodal Prompts | Manufacturing, Logistics, Automated Assembly | Manufacturing, Logistics | Modular, adaptable | [VIMA](https://github.com/kyegomez/VIMA) |
| SayCan | Grounding Language in Robotic Affordances | Service Robots, Assistive Technology | Healthcare, Hospitality | Easy integration | [SayCan](https://github.com/kyegomez/SayCan) |
| AutoRT | Large Scale Orchestration of Robotic Agents | Fleet Management, Automation in Large Scale Industries | Logistics, Industrial Automation | Scalable, robust | [AutoRT](https://github.com/kyegomez/AutoRT) |
| Awesome-LLM-Robotics | Comprehensive list for Robotics/RL using LLM/multi-modal models | Research and Development, Educational | Academia, R&D | Research-oriented | [Awesome-LLM-Robotics](https://github.com/kyegomez/Awesome-LLM-Robotics) |
| RoboCAT | Self-Improving Foundation Agent for Robotic Manipulation | Advanced Manufacturing, Precision Engineering | Manufacturing, Engineering | Self-learning capabilities | [RoboCAT](https://github.com/kyegomez/RoboCAT) |
| NeoCortex | Foundation Model for Humanoid robots | Healthcare, Elderly Care, Companion Robots | Healthcare, Consumer Products | High adaptability | [NeoCortex](https://github.com/kyegomez/NeoCortex) |
| CyberTron | Suite of embodied multi-modal robotic transformers | Robotics Simulation, Training, and Development | Education, R&D, Robotics Training | Plug and play, extensible | [CyberTron](https://github.com/kyegomez/CyberTron) |
| PALM-E | Embodied Multimodal Language Model, Diverse Joint Training across Language, Vision, Visual-Language Domains | Education, Multimodal Interaction, Content Creation | Education, Media, Entertainment | Internet-scale training data | [PALM-E](https://github.com/kyegomez/PALM-E) |
| HRTX | Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2 | Swarm Robotics, Collaborative Tasks in Unstructured Environments | Defense, Disaster Response | Distributed processing | [HRTX](https://github.com/kyegomez/HRTX) |
| RT1 | Part of RT-X, Embodied Robotic Learning Datasets and Models | Robotics Learning, Simulation-Based Training | Education, Robotics, Simulation | Customizable, data-driven | [RT1](https://github.com/kyegomez/RT1) |
| RT2 | Translates vision and language into action | Human-Robot Interaction, Natural Language Processing in Robotics | Consumer Electronics, Robotics | Intuitive interface | [RT2](https://github.com/kyegomez/RT2) |
## 🫶 Contributions:
The easiest way to contribute is to pick any issue with the `good first issue` tag 💪. Read the Contributing guidelines [here](/CONTRIBUTING.md). Bug Report? [File here](https://github.com/swarms/gateway/issues) | Feature Request? [File here](https://github.com/swarms/gateway/issues)
Swarms is an open-source project, and contributions are VERY welcome. If you want to contribute, you can create new features, fix bugs, or improve the infrastructure. Please refer to the [CONTRIBUTING.md](https://github.com/kyegomez/swarms/blob/master/CONTRIBUTING.md) and our [contributing board](https://github.com/users/kyegomez/projects/1) to participate in Roadmap discussions!
----
## Community
Join our growing community around the world, for real-time support, ideas, and discussions on Swarms 😊
- View our official [Blog](https://swarms.apac.ai)
- Chat live with us on [Discord](https://discord.gg/kS3rwKs3ZC)
- Follow us on [Twitter](https://twitter.com/kyegomez)
- Connect with us on [LinkedIn](https://www.linkedin.com/company/the-swarm-corporation)
- Visit us on [YouTube](https://www.youtube.com/channel/UC9yXyitkbU_WSy7bd_41SqQ)
- [Join the Swarms community on Discord!](https://discord.gg/AJazBmhKnr)
- Join our Swarms Community Gathering every Thursday at 1pm NYC Time to unlock the potential of autonomous agents in automating your daily tasks [Sign up here](https://lu.ma/5p2jnc2v)
---
## Discovery Call
Book a discovery call to learn how Swarms can lower your operating costs by 40% with swarms of autonomous agents in lightspeed. [Click here to book a time that works for you!](https://calendly.com/swarm-corp)
## Accelerate Backlog
Help us accelerate our backlog by supporting us financially! Note, we're an open source corporation and so all the revenue we generate is through donations at the moment ;)
