Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/khaledsharif/omniverse-gym

Examples of how to use NVIDIA Omniverse Isaac Sim to solve Reinforcement Learning Games (rl-games)
https://github.com/khaledsharif/omniverse-gym

reinforcement-learning robotics simulation

Last synced: 30 days ago
JSON representation

Examples of how to use NVIDIA Omniverse Isaac Sim to solve Reinforcement Learning Games (rl-games)

Awesome Lists containing this project

README

        

# omniverse-gym
Examples of how to use NVIDIA Omniverse Isaac Sim for to solve Reinforcement Learning Games (RL-Games)

## Installation

Follow the Isaac Sim [documentation](https://docs.omniverse.nvidia.com/isaacsim/latest/installation/install_workstation.html) to install the latest Isaac Sim release (2023.1.1)

To install `omniisaacgymenvs`, first clone this repository:

```bash
git clone https://github.com/KhaledSharif/omniverse-gym.git
```

Once cloned, locate the [python executable in Isaac Sim](https://docs.omniverse.nvidia.com/isaacsim/latest/installation/install_python.html). By default, this should be `python.sh`. We will refer to this path as `PYTHON_PATH`.

To set a `PYTHON_PATH` variable in the terminal that links to the python executable, we can run a command that resembles the following. Make sure to update the paths to your local path. For Linux:

```bash
alias PYTHON_PATH=~/.local/share/ov/pkg/isaac_sim-2023.1.1/python.sh
```

Install the repository and its dependencies:

```bash
PYTHON_PATH -m pip install -e .
```

To run a simple form of PPO from `rl_games`, use the single-threaded training script:

```bash
PYTHON_PATH run.py task=Cartpole
```

The result is saved to the current working directory in a new directory called `runs`.

You can now evaluate your model by running the same environment in test (inference) mode using the saved model checkpoint.

```bash
PYTHON_PATH run.py task=Cartpole test=True checkpoint=runs/Cartpole/nn/Cartpole.pth
```