https://github.com/auralius/sutton-mountain-car

Sutton's Mountain Car Problem with Value Iteration
https://github.com/auralius/sutton-mountain-car

dynamic-programming mountain-car optimization reinforcement-learning sutton value-iteration

Last synced: about 2 months ago
JSON representation

Sutton's Mountain Car Problem with Value Iteration

• Host: GitHub
• URL: https://github.com/auralius/sutton-mountain-car
• Owner: auralius
• Created: 2021-08-14T22:42:05.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2021-11-18T14:36:37.000Z (over 3 years ago)
• Last Synced: 2025-02-01T10:27:14.425Z (4 months ago)
• Topics: dynamic-programming, mountain-car, optimization, reinforcement-learning, sutton, value-iteration
• Language: MATLAB
• Homepage:
• Size: 797 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

README

        
[![View Sutton's Mountain Car Problem with Value Iteration on File Exchange](https://www.mathworks.com/matlabcentral/images/matlab-file-exchange.svg)](https://www.mathworks.com/matlabcentral/fileexchange/39290-sutton-s-mountain-car-problem-with-value-iteration)

# Sutton Mountain Car Problem with Value Iteration

Please chek [this pdf](https://github.com/auralius/sutton-mountain-car/blob/main/Mountain%20Car%20Task.pdf) file for the details on the problem.

Please also check [this submission](https://www.mathworks.com/matlabcentral/fileexchange/100149-yadpf-yet-another-dynamic-programming-function), where a more general dynamic programming algorithm is used to sove this problem. You can also find a general implementation of value iteration implemented there.

This is an example for a 400 x 400 grids:

The car is replaced with Universitas Pertamina's logo ;-)

![](https://github.com/auralius/sutton-mountain-car/blob/main/animation.gif)

![](https://github.com/auralius/sutton-mountain-car/blob/main/policy_matrix.png)

![](https://github.com/auralius/sutton-mountain-car/blob/main/results.png)

![](https://github.com/auralius/sutton-mountain-car/blob/main/convergence.png)