https://github.com/junzis/course-regression
Notebooks for CS4305TU Regression Lectures
https://github.com/junzis/course-regression
Last synced: 3 months ago
JSON representation
Notebooks for CS4305TU Regression Lectures
- Host: GitHub
- URL: https://github.com/junzis/course-regression
- Owner: junzis
- Created: 2020-09-02T21:39:33.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2022-10-14T21:36:47.000Z (over 2 years ago)
- Last Synced: 2025-01-22T01:45:02.600Z (5 months ago)
- Language: HTML
- Size: 5.48 MB
- Stars: 9
- Watchers: 3
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Regression for data science
This is a mini-course on regression, originally designed as part of the AI education program for TU Delft. I made it open for everyone who are insterested in learning *regression* in machine learning.
Clone the repository using `git`, or download it by click `Code -> Download Zip` at the top of this repository page.
---
## Overview
Generally, We use regression to study relationships among dependent and independent variables presented in the data. When these regression models are used for predicting unseen input, the approach is categorized as supervised machine learning.
In this mini-course, you will learn the following topics:
- **Simple linear regression** (single input, single output, linear relationship, deterministic)
- **Multiple linear regression** (multiple inputs, single output, linear relationship, deterministic)
- **Polynomial linear regression** (multiple inputs, single output, non-linear relationship, deterministic)
- **Logistic regression** (continuous input(s), binary output, deterministic)
- **Bayesian regression** (regression using stochastic process)
In between these specific regression topics, there are a few regression-related topics:
- **Regression metrics** (how to evaluate your regression model?)
- **Gradient descent algorithm** (how to perform optimization numerically?)
- **Bias variance trade-off** (why you model under-fits or over-fits?)
- **Regularization** (how to mitigate the over-fitting problem?)
## Materials for the lecture
The lectures are split into 11 short videos (edited to approximately 10 minutes on average). Feel free to use 1.25x or 1.5x speed to watch.
Most topics are taught with the same dataset (about airplanes) that I have created for this lecture.
Each course video is accompanied by a Python Jupyter notebook in this repository.
### List of videos
0. [Introduction](https://youtu.be/aNGv0LWsrLE)
0. [Data](https://youtu.be/3m1XgcNwprg)
0. [Simple linear regression](https://youtu.be/45mCqvpLNRc)
0. [Regression metrics](https://youtu.be/cwH_wjIKC98)
0. [Multiple regression](https://youtu.be/xNVGEKmbJDw)
0. [Gradient descent](https://youtu.be/7lnpBcggBrQ)
0. [Polynomial linear regression](https://youtu.be/Xh2p_iKjJrg)
0. [Bias variance tradeoff](https://youtu.be/UyhYAnN_Ljs)
0. [Regularization](https://youtu.be/gaG7ECUB6Sw)
0. [Logistic regression](https://youtu.be/kWH4qtBQjfo)
0. [Bayesian regression](https://youtu.be/_uwkQTIN9no)