https://github.com/prokil/aact-teleop

Teleoperating Robots with AR and AAct
https://github.com/prokil/aact-teleop

augmented-reality quest robotics teleoperation

Last synced: about 1 year ago
JSON representation

Teleoperating Robots with AR and AAct

• Host: GitHub
• URL: https://github.com/prokil/aact-teleop
• Owner: ProKil
• Created: 2024-06-03T01:11:47.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2025-01-23T19:44:07.000Z (over 1 year ago)
• Last Synced: 2025-04-06T21:17:42.751Z (about 1 year ago)
• Topics: augmented-reality, quest, robotics, teleoperation
• Language: Python
• Homepage: https://aact.dev/latest/applications/robot-teleoperation/
• Size: 4.02 MB
• Stars: 4
• Watchers: 4
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# SIAT: Stretch Control with Immersive AR Teleoperation (CoRL 2024 Demo)

![Figure](figure/figure.png)

## Overview

SIAT (Stretch control with Immersive AR Teleoperation) is a novel system that enables intuitive control of the Stretch robot with Quest. Building on top of [AAct](https://aact.dev), it is easily extensible to integrate multiple sensors, control interfaces, and robotics models.

## Demo Team

Hao Zhu, Vidhi Jain, Su Li, Yonatan Bisk

### Contributors

Jensen (Yi-Che) Huang, Sophia Huang

## Features

* Intuitive AR interface for robot control

* Full body control with intuitive human movements

## System Requirements

### Hardware

* Hello Robot Stretch 3

* Oculus Quest 3 / Pro

### Software

Python 3.10 or later

# Usage

Please checkout the [documentation on aact.dev](https://aact.dev/latest/applications/robot-teleoperation/).

# Citations

If you use this work, please cite our paper:

```bibtex

@misc{zhu2024siat,

  title={SIAT: Stretch control with Immersive AR Teleoperation},

  author={Zhu, Hao and Jain, Vidhi and Li, Su and Bisk, Yonatan},

  howpublished={Demo presented at the Conference on Robot Learning (CoRL)},

  year={2024},

  note={Munich, Germany}

}

```

# Contact

For questions and support, please contact:

Hao Zhu (prokilchu@gmail.com)