Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/nasa-jpl/rosa
ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.
https://github.com/nasa-jpl/rosa
agents ai developer-tools jpl llm nasa robotics ros ros2
Last synced: 6 days ago
JSON representation
ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.
- Host: GitHub
- URL: https://github.com/nasa-jpl/rosa
- Owner: nasa-jpl
- License: apache-2.0
- Created: 2024-08-05T20:35:20.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2024-11-14T03:37:07.000Z (about 1 month ago)
- Last Synced: 2024-12-08T16:00:18.726Z (13 days ago)
- Topics: agents, ai, developer-tools, jpl, llm, nasa, robotics, ros, ros2
- Language: Python
- Homepage: https://github.com/nasa-jpl/rosa/wiki
- Size: 159 KB
- Stars: 685
- Watchers: 15
- Forks: 55
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Governance: GOVERNANCE.md
Awesome Lists containing this project
- awesome-foundation-model-ros - ROSA - Interact with ROS1- and ROS2-based robotics systems using natural language queries. (Research-Grade Frameworks)
- awesome-foundation-model-ros - ROSA - AI Agent that can interact with ROS1- and ROS2-based robotics systems using natural language queries. (Community-Ready Frameworks)
- awesome-ai-robotics - **rosa** - ROSA is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots. (ROS2 / ROS2 Packages)
- awesome-ai-robotics - **rosa** - ROSA is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots. (ROS2 / ROS2 Packages)
README
The ROS Agent (ROSA) is designed to interact with ROS-based
robotics systems using natural language queries. 🗣️🤖
[](https://arxiv.org/abs/2410.06472v1)
[](https://nasa-ammos.github.io/slim/)
> [!IMPORTANT]
> 📚 **New to ROSA?** Check out our [Wiki](https://github.com/nasa-jpl/rosa/wiki) for documentation, guides and FAQs!
ROSA is your AI-powered assistant for ROS1 and ROS2 systems. Built on the [Langchain](https://python.langchain.com/v0.2/docs/introduction/) framework, ROSA helps you interact with robots using natural language, making robotics development more accessible and efficient.
#### ROSA Demo: NeBula-Spot in JPL's Mars Yard (click for YouTube)
[](https://www.youtube.com/watch?v=mZTrSg7tEsA)
## 🚀 Quick Start
### Requirements
- Python 3.9+
- ROS Noetic or higher
### Installation
```bash
pip3 install jpl-rosa
```
### Usage Examples
```python
from rosa import ROSA
llm = get_your_llm_here()
agent = ROSA(ros_version=1, llm=llm)
agent.invoke("Show me a list of topics that have publishers but no subscribers")
```
For detailed information on configuring the LLM, please refer to our [Model Configuration Wiki page](https://github.com/nasa-jpl/rosa/wiki/Model-Configuration).
## Adapting ROSA for Your Robot 🔧
ROSA is designed to be easily adaptable to different robots and environments. You can create custom agents by either inheriting from the `ROSA` class or creating a new instance with custom parameters.
For detailed information on creating custom agents, adding tools, and customizing prompts, please refer to our [Custom Agents Wiki page](https://github.com/nasa-jpl/rosa/wiki/Custom-Agents).
## TurtleSim Demo 🐢
We have included a demo that uses ROSA to control the TurtleSim robot in simulation. To run the demo, you will need to have Docker installed on your machine. 🐳
The following video shows ROSA reasoning about how to draw a 5-point star, then
executing the necessary commands to do so.
https://github.com/user-attachments/assets/77b97014-6d2e-4123-8d0b-ea0916d93a4e
For detailed instructions on setting up and running the TurtleSim demo, please refer to our [TurtleSim Demo Guide](https://github.com/nasa-jpl/rosa/wiki/Guide:-TurtleSim-Demo) in the Wiki.
## IsaacSim Extension (Coming Soon)
ROSA is coming to Nvidia IsaacSim! While you can already use ROSA with robots running in IsaacSim (using the ROS/ROS2 bridge), we are adding direct integration
in the form of an IsaacSim extension. This will allow you not only to control your robots in IsaacSim, but control IsaacSim itself. Check out the video below to learn mroe.
#### ROSA Demo: Nvidia IsaacSim Extension (click for YouTube)
[](https://www.youtube.com/watch?v=mm5525G_EfQ)
## 📘 Learn More
- [📕 Read the paper](https://arxiv.org/abs/2410.06472v1)
- [🗺️ Roadmap](https://github.com/nasa-jpl/rosa/wiki/Feature-Roadmap)
- [🏷️ Releases](https://github.com/nasa-jpl/rosa/releases)
- [❓ FAQ](https://github.com/nasa-jpl/rosa/wiki/FAQ)
## Changelog
See our [CHANGELOG.md](CHANGELOG.md) for a history of our changes.
## Contributing
Interested in contributing to our project? Please see our: [CONTRIBUTING.md](CONTRIBUTING.md)
For guidance on how to interact with our team, please see our code of conduct located
at: [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md)
For guidance on our governance approach, including decision-making process and our various roles, please see our
governance model at: [GOVERNANCE.md](GOVERNANCE.md)
## License
See our: [LICENSE](LICENSE)
## Support
Key points of contact are:
- [@RobRoyce](https://github.com/RobRoyce) ([email](mailto:[email protected]))
---
ROSA: Robot Operating System Agent 🤖
Copyright (c) 2024. Jet Propulsion Laboratory. All rights reserved.