Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://stanfordvl.github.io/ntp/
Neural Task Programming
https://stanfordvl.github.io/ntp/
Last synced: about 2 months ago
JSON representation
Neural Task Programming
- Host: GitHub
- URL: https://stanfordvl.github.io/ntp/
- Owner: StanfordVL
- License: mit
- Created: 2017-09-14T06:21:16.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2018-05-21T08:13:29.000Z (over 6 years ago)
- Last Synced: 2024-07-16T15:39:56.560Z (2 months ago)
- Size: 90.8 KB
- Stars: 81
- Watchers: 20
- Forks: 16
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
**[new]** We released our simulation framework [here](https://github.com/StanfordVL/NTP-vat-release).
## Neural Task Programming:
Learning to Generalize Across Hierarchical TasksDanfei Xu\*, Suraj Nair\*, Yuke Zhu, Julian Gao, Animesh Garg, Li Fei-Fei, Silvio Savarese
ICRA 2018
Abstract: In this work, we propose a novel robot learning framework called Neural Task Programming (NTP), which bridges the idea of few-shot learning from demonstration and neural program induction. NTP takes as input a task specification (e.g., video demonstration of a task) and recursively decomposes it into finer sub-task specifications. These specifications are fed to a hierarchical neural program, where bottom-level programs are callable subroutines that interact with the environment. We validate our method in three robot manipulation tasks. NTP achieves strong generalization across sequential tasks that exhibit hierarchal and compositional structures. The experimental results show that NTP learns to generalize well towards unseen tasks with increasing lengths, variable topologies, and changing objectives.
[**Arxiv 1710.01813**](https://arxiv.org/abs/1710.01813)
[**Network implementation details**](implementation.pdf)
[**Simulation environment**](https://github.com/StanfordVL/NTP-vat-release)
Click here for video:
[![Alt text](https://img.youtube.com/vi/THq7I7C5rkk/0.jpg)](https://www.youtube.com/watch?v=THq7I7C5rkk&feature=youtu.be)---
### Support or Contact
[Danfei Xu](http://cs.stanford.edu/~danfei/), [Yuke Zhu](https://web.stanford.edu/~yukez/), [Animesh Garg](http://animesh.garg.tech)
* These authors contributed equally to the paper