https://github.com/rnuv/ai-car

A Self Driving Car, written in the Unity game engine, that uses deep reinforcement learning, ray casting and imitation learning to drive around a track on its own.
https://github.com/rnuv/ai-car

csharp mlagents unity-game-engine

Last synced: 21 days ago
JSON representation

A Self Driving Car, written in the Unity game engine, that uses deep reinforcement learning, ray casting and imitation learning to drive around a track on its own.

• Host: GitHub
• URL: https://github.com/rnuv/ai-car
• Owner: rNuv
• Created: 2021-03-13T18:12:03.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2023-06-15T05:11:16.000Z (over 1 year ago)
• Last Synced: 2024-11-10T16:16:21.612Z (2 months ago)
• Topics: csharp, mlagents, unity-game-engine
• Language: C#
• Homepage:
• Size: 30 MB
• Stars: 3
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# AI Car

## Description 

For my Independent Study - AI Class, I used Unity's MLAgents toolkit to train a car to drive around a track on its own. Each track has a checkpoint system in which an event is invoked after a car travels through a checkpoint. Each checkpoint event triggers a positive reward to the car agent. Each track also has walls that negatively reward the agent if it collides with them. As for the agent's observations, most of them come from the ray casts of the car (the red lines coming out of the car). To train faster, I also trained the agent with imitation learning, where I had a pre recorded demonstration of the car going aroupd the track multiple times and let the training algorithm use that demo as a reference. I found that imitation learning made the training process faster, but also made the agent learn the mistakes of the demo as well. 

## Pictures



    





  The initial left and right turn tracks used to train the agent.





    





  The agent (car) is controlling itself and has learned to stay on track.



## Technologies 

- ![Unity](https://img.shields.io/badge/unity-%23000000.svg?style=for-the-badge&logo=unity&logoColor=white)

- ![C#](https://img.shields.io/badge/c%23-%23239120.svg?style=for-the-badge&logo=c-sharp&logoColor=white)

---

*Made with <3 by Arnav, circa 2020*