Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/afondiel/self-driving-cars-perception-and-deep-learning-free-course-freecodecamp

Notes and key takeaways of the Self-Driving Cars Perception applied Deep Learning Free Course from freeCodeCamp.org
https://github.com/afondiel/self-driving-cars-perception-and-deep-learning-free-course-freecodecamp

2d-object-detection 3d-data-visualization 3d-object-detection bird-eye-view camera camera-calibration compter-vision data-visualization freecodecamp kitti-dataset lidar object-tracking perception robotics self-driving-car-engineer self-driving-cars vision-transformer vit yolo

Last synced: 1 day ago
JSON representation

Notes and key takeaways of the Self-Driving Cars Perception applied Deep Learning Free Course from freeCodeCamp.org

Awesome Lists containing this project

README 

        
# Self-Driving Cars Perception and Deep Learning - Free Course from freeCodeCamp.org



![](./docs/https___img.youtube.com_vi_cPOtULagNnI_hqdefault.avif)



## Overview



Notes and key takeaways of the Self-Driving Cars Perception and Deep Learning Free Course from [freeCodeCamp.org](freeCodeCamp.org).



Learn some computer vision core tasks for self-driving cars perception stack using deep learning, including road segmentation, object detection and tracking, and 3D data visualization.



**Prerequisites**



- ~2 hours

- Free course (No certificate awarded) 

- Intermediate level: Python and deep learning (required)



**Instructor**



- Sakshay Mahna from [(Robotics with Sakshay)](https://www.youtube.com/channel/UC57lEMTXZzXYu_y0FKdW6xA)

  

**Course Objectives**



- Gain a comprehensive understanding of the key computer vision tasks involved in self-driving car perception

- Deepen knowledge of deep learning techniques, particularly Convolutional Neural Networks (CNNs), for addressing these tasks

- Learn how to implement and evaluate deep learning models for road segmentation, object detection, tracking, and camera to bird's eye view (BEV) mapping

- Acquire hands-on experience with real-world data and popular deep learning libraries



## Course Contents



- [00 - Introduction](./00-introduction.md)

- [01 - Road Segmentation | Fully Convolutional Network (FCN)](./01-Road-Segmentation-FCN.md)

- [02 - 2D Object Detection | YOLO](./02-2D-Object-Detection-YOLO.md)

- [03 - Object Tracking | Deep SORT](./03-Object-Tracking-Deep-SORT.md)

- [04 - 3D Data Visualization | Homogenous Transformations | KITTI](./04-3D-Data-Visualization-Homogenous-Transformations-KITTI.md)

- [05 - Multi Task Learning | Multi Task Attention Network (MTAN)](./05-Multi-Task-Learning-MTAN.md)

- [06 - 3D Object Detection | SFA 3D](./06-3D-Object-Detection-SFA-3D.md)

- [07 - Camera to Bird's Eye View | UNetXST](./07-Camera-to-Birds-Eye-View-UNetXST.md )



## Read the Courses Online



Read the courses Online, you can visit [Perception for Self-Driving Cars Applied Deep Learning](#).



## Lab - Notebooks



|Chapter|Exercises|

|--|--|

|[1. Road Segmentation - Fully Convolutional Network (FCN)](./lab/notebooks/01-Road-Seg/road-segmentation-fcn-tf.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/01-Road-Seg/road-segmentation-fcn-tf.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/road-segmentation-fcn-tf/edit)|

|[2. 2D Object Detection - YOLO](./lab/notebooks/02-2d-object-det/2d-object-detection-yolov3-keras.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/02-2d-object-det/2d-object-detection-yolov3-keras.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/2d-object-detection-yolov3-keras/edit)|

|[3. Object Tracking - Deep SORT](./lab/notebooks/03-object-tracking/03-object-tracking-deep-sort.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/03-object-tracking/object-tracking-deep-sort.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/object-tracking-deep-sort/edit)|

|[4. 3D Data Visualization - Homogenous Transformations - KITTI](./lab/notebooks/04-3d-data-viz/3d-data-visualization-kitti-lidar.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/04-3d-data-viz/3d-data-visualization-kitti-lidar.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/3d-data-visualization-kitti-lidar/edit)|

|[5. Multi Task Learning - Multi Task Attention Network (MTAN)](./lab/notebooks/05-MTAN/mtan-multi-task-attention-network.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/05-MTAN/mtan-multi-task-attention-network.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/mtan-multi-task-attention-network/edit)|

|[6. 3D Object Detection - SFA 3D](./lab/notebooks/06-3d-obj-det/3d-object-detection-sfa3d.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/06-3d-obj-det/3d-object-detection-sfa3d.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/3d-object-detection-sfa3d/edit)|

|[7. Camera to Bird's Eye View - UNetXST](./lab/notebooks/07-UNetXST/unetxst-camera-to-bird-s-eye-view.ipynb)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Self-Driving-Cars-Perception-and-Deep-Learning-Free-Course-freeCodeCamp/blob/main/lab/notebooks/07-UNetXST/unetxst-camera-to-bird-s-eye-view.ipynb) [![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://www.kaggle.com/code/thepostitguy/unetxst-camera-to-bird-s-eye-view/edit)|



Happy Learning!



## Contributing



- Feel free to open a PR or an issue if you encounter some problem running the projects.



Here's how you can contribute:



- Fork this repository and clone it to your local machine.

- Create a new branch with a descriptive name for your contribution.

- Add your code and files to the branch and commit your changes.

- Push your branch to your forked repository and create a pull request to the main repository.

- Wait for your pull request to be reviewed and merged.



## References



Full course link: 

- [freeCodeCamp - Computer Vision and Perception for Self-Driving Cars (Deep Learning Course)](https://www.youtube.com/watch?v=cPOtULagNnI&t=0s)

- [Class central - (great to follow with split section)](https://www.classcentral.com/classroom/freecodecamp-computer-vision-and-perception-for-self-driving-cars-deep-learning-course-104874)



Other related courses:



Zero (Beginner):



- [Introduction to Computer Vision - Udacity (Beginner)](https://www.udacity.com/course/computer-vision-basics--ud810)

- [Introduction to Computer Vision for Self-Driving Cars - thinkautonomous](https://www.thinkautonomous.ai/blog/computer-vision-self-driving-cars-introduction/)

- [Computer Vision Kaggle Free Course](https://github.com/afondiel/Computer-Vision-Kaggle-Free-Course)



Apprentice (Intermediate):



- [The Complete Self-Driving Cars course applied Deep Learning - Udemy](https://github.com/afondiel/The-Complete-Self-Driving-Car-Course-Udemy)

- [Deep Learning for Autonomous Vehicles - Perception - NVIDIA](https://courses.nvidia.com/courses/course-v1:DLI+C-AV-01+V3/)



Hero (Advanced):



- [Advanced Computer Vision with TensorFlow - DeepLearningAI & Class Central](https://www.classcentral.com/course/advanced-computer-vision-with-tensorflow-22551)

- [Visual Perception - Self-Driving Specialization - University of Toronto](https://github.com/afondiel/Self-Driving-Cars-Specialization/tree/main/Course3-Visual-Perception-for-Self-Driving-Cars)

- [Introduction to Computer Vision (Advanced)](https://www.udacity.com/course/introduction-to-computer-vision--cd0360)

- [Udacity Computer Vision Nano Degree Program](https://www.udacity.com/course/computer-vision-nanodegree--nd891)

  - [Udacity Enterprise Syllabus Computer Vision nd891](https://business.udacity.com/rs/138-FQP-587/images/Udacity%20Enterprise%20Syllabus%20Computer%20Vision%20nd891.pdf)

  - Blog Review: https://www.mltut.com/udacity-computer-vision-nanodegree-review/

- [Advanced Computer Vision and Deep Learning - Udacity](https://www.udacity.com/course/advanced-computer-vision-and-deep-learning--cd0361)



> ### "Vision is a picture of the future that produces passion." ~ Bill Hybels