awesome-foundation-model-ros
A collection ROS projects utilizing foundation models.
https://github.com/ycheng517/awesome-foundation-model-ros
Last synced: 4 days ago
JSON representation
-
Research-Grade Frameworks
- ros2_nanollm - ROS 2 wrapper for streaming VLMs with quantization.
- ROS2-NanoOWL - ROS 2 wrapper for OWL-ViT open vocabulary detection with TensorRT.
- visualnav-transformer-ros2 - ROS 2 port of [visualnav-transformer](https://github.com/robodhruv/visualnav-transformer) stack (GNM, ViNT and NoMaD)
- remembr - Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robots
- Yell At Your Robot - Improving On-the-Fly from Language Corrections
- Physical Intelligence π0 - A Vision-Language-Action Flow Model for General Robot Control
- pi-zero-pytorch - pytorch)
- `@dusty-nv` - zero-pytorch/issues/2`](https://github.com/lucidrains/pi-zero-pytorch/issues/2)])
- OpenNav: Efficient Open Vocabulary 3D Object Detection for Smart Wheelchair Navigation
- Awesome Foundation and Multimodal Models - Curated list of top foundation and multimodal models
- LeRobot
- Jetson AI Lab
- ROSA - Interact with ROS1- and ROS2-based robotics systems using natural language queries.
- ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning
- grounding_sam_ros - ROS 1 wrapper for Grounded Segment Anything.
- isaac_ros_segment_anything - ROS 2 wrapper for Segment Anything.
- isaac_ros_foundationpose - ROS 2 wrapper for FoundationPose.
- isaac_ros_dnn_stereo_depth - ROS 2 wrapper for Efficient Semi-Supervised stereo disparity (ESS).
- ros2ai - Use ROS 2 CLI through natural language.
- ROScribe - Create ROS packages using LLMs.
- explainable_ROS - Generate explanations for the actions performed by an autonomous robot.
- Tabletop Handybot - Use foundation models to perform basic tabletop tasks with a robotic arm.
- Utilizing LLMs as a Task Planning Agent for Robotics - Use LLMs for task planning for in-home item retrieval by a mobile robot.
- ROS-LLM (Auromix)
- ROSGPT: Next-Generation Human-Robot Interaction with ChatGPT and ROS
- ROSGPT_Vision: Commanding Robots Using Only Language Models' Prompts
- The Conversation is the Command: Interacting with Real-World Autonomous Robots through Natural Language (TCC-IRoNL)
- llama_ros - ROS 2 wrapper for llama.cpp.
- whisper_ros - ROS 2 wrapper for whisper.cpp. Also provides Voice Activity Detection.
- ros2_whisper - ROS 2 wrapper for whisper.cpp.
- ros2_sam
- ros_sam - ROS 2 wrapper for Segment Anything.
- grounding_sam_ros - ROS 1 wrapper for Grounded Segment Anything.
- isaac_ros_segment_anything - ROS 2 wrapper for Segment Anything.
- isaac_ros_foundationpose - ROS 2 wrapper for FoundationPose.
- isaac_ros_dnn_stereo_depth - ROS 2 wrapper for Efficient Semi-Supervised stereo disparity (ESS).
- ros2ai - Use ROS 2 CLI through natural language.
- ROSGPT_Vision: Commanding Robots Using Only Language Models' Prompts
- The Conversation is the Command: Interacting with Real-World Autonomous Robots through Natural Language (TCC-IRoNL)
- llama_ros - ROS 2 wrapper for llama.cpp.
- whisper_ros - ROS 2 wrapper for whisper.cpp. Also provides Voice Activity Detection.
- ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning
- ROS-LLM (Auromix)
- ROSGPT: Next-Generation Human-Robot Interaction with ChatGPT and ROS
- ros2_whisper - ROS 2 wrapper for whisper.cpp.
- ros2_sam
- ros_sam - ROS 2 wrapper for Segment Anything.
- ROScribe - Create ROS packages using LLMs.
- explainable_ROS - Generate explanations for the actions performed by an autonomous robot.
- Tabletop Handybot - Use foundation models to perform basic tabletop tasks with a robotic arm.
- Utilizing LLMs as a Task Planning Agent for Robotics - Use LLMs for task planning for in-home item retrieval by a mobile robot.
- rai-rosbot-xl-demo - Use the RAI framework to control a ROSbot XL mobile robot.
- rai-agriculture-demo - Use the RAI framework to supervise autonomous tractors.
- Awesome-LLM - A curated list of Large Language Models.
- Awesome VLM Architectures - A curated list of famous vision language models and their architectures.
- rai-rosbot-xl-demo - Use the RAI framework to control a ROSbot XL mobile robot.
- rai-agriculture-demo - Use the RAI framework to supervise autonomous tractors.
- Awesome-LLM - A curated list of Large Language Models.
- Awesome VLM Architectures - A curated list of famous vision language models and their architectures.
- Awesome Robotics Foundation Models - A survey of foundation models in robotics.
- Awesome Robotics Foundation Models - A survey of foundation models in robotics.
-
Community-Ready Frameworks
Programming Languages
Sub Categories
Keywords
ros2
15
llm
11
robotics
10
gpt
6
ros
6
vlm
5
llava
5
ai
5
langchain
4
multimodal
4
ggml
4
chatgpt
4
generative-ai
3
computer-vision
3
clip
3
blip
3
deep-learning
3
robotic-arm
2
embodied-intelligence
2
robot-assistant
2
language-models
2
robot-software
2
robot-framework
2
python
2
language-models-are-next
2
openai
2
gpt4
2
gpt35turbo
2
code-generation
2
stereo-camera
2
ros2-humble
2
nvidia
2
jetson
2
gpu
2
nasa
2
jpl
2
developer-tools
2
image-encoder
2
cogvlm
2
internlm
2
kosmos
2
awesome-list
2
awesome
2
qwen-vl
2
text-encoder
2
vision-language-model
2
whisper-cpp
2
voice-activity-detection
2
vad
2
speech-to-text
2