https://github.com/praveen-palanisamy/macad-agents

Agents code for Multi-Agent Connected Autonomous Driving (MACAD) described in the paper presented in the Machine Learning for Autonomous Driving Workshop at NeurIPS 2019:
https://github.com/praveen-palanisamy/macad-agents

autonomous-agents autonomous-driving connected-vehicle deep-reinforcement-learning multi-agent multi-agent-reinforcement-learning

Last synced: about 5 hours ago
JSON representation

Agents code for Multi-Agent Connected Autonomous Driving (MACAD) described in the paper presented in the Machine Learning for Autonomous Driving Workshop at NeurIPS 2019:

• Host: GitHub
• URL: https://github.com/praveen-palanisamy/macad-agents
• Owner: praveen-palanisamy
• Created: 2019-05-14T20:04:36.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2021-03-06T04:50:42.000Z (over 3 years ago)
• Last Synced: 2023-08-01T21:49:35.312Z (over 1 year ago)
• Topics: autonomous-agents, autonomous-driving, connected-vehicle, deep-reinforcement-learning, multi-agent, multi-agent-reinforcement-learning
• Language: Python
• Homepage: https://arxiv.org/abs/1911.04175
• Size: 50.8 KB
• Stars: 19
• Watchers: 3
• Forks: 8
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
### MACAD-Agents

[![](https://praveenp.com/projects/MACAD-Gym/HomoNcomIndePOIntrxMASS3CTWN3-v0-trained-policy.gif)](https://github.com/praveen-palanisamy/macad-gym)

Multi-Agent algorithms for Multi-Agent Connected Autonomous Driving using [MACAD-Gym](https://github.com/praveen-palanisamy/macad-gym)

#### How to train/test MACAD-Agents?

0. `git clone https://github.com/praveen-palanisamy/macad-agents`

> If you want to avoid building and running the Docker container, you can follow the instructions in the[Running MACAD-Agents witout Docker](https://github.com/praveen-palanisamy/macad-agents#running-macad-agents-without-docker) section instead and skip the next 2 steps.

1. Build the MACAD-Agents Docker container: `docker build --rm -f macad-agents/Dockerfile -t macad-agents:latest .` 

2. Run the MACAD-Agents training container:

`bash run.sh`

    You can pick from one of the available multi-agent training options:

    - To train multiple agents using PPO where the agents communicate/share learned weights, modify the last line in `run.sh` to look like this:

      `macad-agents:latest python -m macad_agents.rllib.ppo_multiagent_shared_weights.py`

    - To train multiple agents using IMPALA where the agents communicate/share learned weights, modify the last line in `run.sh` to look like this:

    

      `macad-agents:latest python -m macad_agents.rllib.impala_multiagent_shared_weights.py`

##### Running MACAD-Agents without Docker

 If you have all the necessary dependencies installed an configured on your host machine, you can run the agent script like shown below:

`cd macad-agents/src && python -m macad_agents.rllib.ppo_multiagent_shared_weights`

A brief gist of what you need to setup on your host machine is listed below:

https://github.com/praveen-palanisamy/macad-agents/blob/35c06f58b4eb9fa6c390bb5ad87d73c4f6c5d058/run.sh#L8-L12

Where `-e` is equivalent to `export` using the `bash` terminal.

#### Citing

If you find this work or [MACAD-Gym](https://github.com/praveen-palanisamy/macad-gym) useful in your research, please cite:

```bibtex

@misc{palanisamy2019multiagent,

    title={Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning},

    author={Praveen Palanisamy},

    year={2019},

    eprint={1911.04175},

    archivePrefix={arXiv},

    primaryClass={cs.LG}

}

```

Citation in other Formats: (Click to View)



MLA
Palanisamy, Praveen. "Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning." arXiv preprint arXiv:1911.04175 (2019).
APA
Palanisamy, P. (2019). Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning. arXiv preprint arXiv:1911.04175.
Chicago
Palanisamy, Praveen. "Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning." arXiv preprint arXiv:1911.04175 (2019).
Harvard
Palanisamy, P., 2019. Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning. arXiv preprint arXiv:1911.04175.
Vancouver
Palanisamy P. Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning. arXiv preprint arXiv:1911.04175. 2019 Nov 11.



BibTeX EndNote RefMan RefWorks