https://github.com/instance01/brtdp-ds-mpi
BRTDP implemented including DS-MPI for upper bound
https://github.com/instance01/brtdp-ds-mpi
bounded-realtime-dp brtdp ds-mpi markov-decision-process mdp paper-implementations rtdp
Last synced: 3 months ago
JSON representation
BRTDP implemented including DS-MPI for upper bound
- Host: GitHub
- URL: https://github.com/instance01/brtdp-ds-mpi
- Owner: instance01
- License: mit
- Created: 2019-08-20T07:24:55.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2020-03-04T04:48:15.000Z (about 6 years ago)
- Last Synced: 2025-01-20T00:35:52.025Z (about 1 year ago)
- Topics: bounded-realtime-dp, brtdp, ds-mpi, markov-decision-process, mdp, paper-implementations, rtdp
- Language: Python
- Homepage:
- Size: 4.1 MB
- Stars: 0
- Watchers: 2
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# BRTDP-DS-MPI
DS-MPI is also called Dijkstra Sweep for Monotone Pessimistic Initialization [1].
It is used for finding an efficient upper bound initialization for BRTDP.
This repo includes an implementation of BRTDP and DS-MPI.
For all my homies out there struggling to implement DS-MPI.
Watch it visit only a small part of the whole state space!
[1] McMahan, H. Brendan, Maxim Likhachev, and Geoffrey J. Gordon. "Bounded real-time dynamic programming: RTDP with monotone upper bounds and performance guarantees." Proceedings of the 22nd international conference on Machine learning. ACM, 2005.
## osmnx\_mdp
This is basically a stripped down version of [osmnx\_mdp](https://github.com/instance01/osmnx-mdp), which solves routing with uncertainty using Markov decision processes.
I decided to keep everything intact so it is clear how BRTDP is used. In this case, a single simulation of an agent trying to get from A to B on the Munich map using BRTDP.
Basically, `BRTDP_DS_MPI/algorithm/cpp_brtdp.cpp` has the main implementation and `BRTDP_DS_MPI/simulation.pyx` applies BRTDP.
Running/Development:
```
sudo docker build -t brtdp-ds-mpi -f Dockerfile .
sudo docker run -v $(pwd):/app -it brtdp-ds-mpi bash
```
To run the current simulation:
```
cd BRTDP_DS_MPI
setup
run
```