https://github.com/star2dust/parl-notes
A tutorial to learn RL from examples. This is my notes from a course of Baidu PaddlePaddle. (世界冠军带你从零实践强化学习)
https://github.com/star2dust/parl-notes
cartpole mountaincar parl q-learning-vs-sarsa reinforcement-learning
Last synced: 6 months ago
JSON representation
A tutorial to learn RL from examples. This is my notes from a course of Baidu PaddlePaddle. (世界冠军带你从零实践强化学习)
- Host: GitHub
- URL: https://github.com/star2dust/parl-notes
- Owner: star2dust
- License: mit
- Created: 2020-06-24T14:07:29.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2023-07-26T22:30:50.000Z (about 2 years ago)
- Last Synced: 2025-04-17T10:27:34.277Z (6 months ago)
- Topics: cartpole, mountaincar, parl, q-learning-vs-sarsa, reinforcement-learning
- Language: Python
- Homepage: https://star2dust.github.io/parl-notes/
- Size: 30.4 MB
- Stars: 12
- Watchers: 2
- Forks: 5
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# A Tutorial to Learn RL from Examples
## Install Requirements
```shell
# or try: pip install -r requirements.txt
pip install paddlepaddle==1.6.3
pip install parl==1.3.1
pip install gym
pip install atari-py
pip install rlschool==0.3.1
```
## PARL Basics
[PARL](https://github.com/PaddlePaddle/PARL) is a flexible and high-efficient reinforcement learning framework. PARL aims to build an agent for training algorithms to perform complex tasks. The main abstractions introduced by PARL that are used to build an agent recursively are the following:
- **Model** is abstracted to construct the forward network which defines a policy network or critic network given state as input.
- **Algorithm** describes the mechanism to update parameters in Model and often contains at least one model.
- **Agent**, a data bridge between the environment and the algorithm, is responsible for data I/O with the outside environment and describes data preprocessing before feeding data into the training process.
## Sarsa and Q-learning
To demonstrate Sarsa and Q-learning in CliffWalking environment.
```python
# sarsa
cd .\tutorials\lesson2\sarsa
python .\train.py
# qlearing
cd .\tutorials\lesson2\q_learning
python .\train.py
```
Results are put here. The first one is Sarsa, the other one is Q-learning.
## DQN
To demonstrate DQN in CartPole and MountainCar environment.
```python
# dqn
cd .\tutorials\lesson3\dqn
python .\train.py
cd .\tutorials\homework\lesson3\dqn_mountaincar
python .\train.py
```
Results are put here. The first one is CartPole , the other one is MountainCar .
