https://github.com/adrhill/julia-ml-course
Julia Programming for Machine Learning course at TU Berlin
https://github.com/adrhill/julia-ml-course
course deep-learning julia machine-learning tutorial
Last synced: 19 days ago
JSON representation
Julia Programming for Machine Learning course at TU Berlin
- Host: GitHub
- URL: https://github.com/adrhill/julia-ml-course
- Owner: adrhill
- License: mit
- Created: 2023-04-24T15:17:08.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-29T14:52:04.000Z (6 months ago)
- Last Synced: 2024-10-29T17:32:05.481Z (6 months ago)
- Topics: course, deep-learning, julia, machine-learning, tutorial
- Language: Julia
- Homepage:
- Size: 12.3 MB
- Stars: 235
- Watchers: 10
- Forks: 28
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Julia for Machine Learning
[![Go to course website][goto-badge]][site-url]
[![TU Berlin ISIS page][isis-badge]][isis-url]
Course material and website for the [Julia for Machine Learning][site-url] course (JuML) at the [TU Berlin Machine Learning group][ml-group-url].
## Installation
Follow the [installation instructions](https://adrhill.github.io/julia-ml-course/E1_Installation/)
on the course website.
## Contents
### Lectures
The **first half of the course** is taught in five weekly sessions of three hours.
In each session, two lectures are taught:
| Week | Lecture | Content |
|:----:|:-------:|:--------------------------------------------------|
| 1 | 0 | General Information, Installation & Getting Help |
| | 1 | Basics 1: Types, Control-flow & Multiple Dispatch |
| 2 | 2 | Basics 2: Arrays, Linear Algebra |
| | 3 | Plotting & DataFrames |
| 3 | 4 | Basics 3: Data structures and custom types |
| | 5 | Classical Machine Learning |
| 4 | 6 | Automatic Differentiation |
| | 7 | Deep Learning |
| 5+ | Project | Workflows: Scripts, Experiments & Packages |
| | Project | Profiling & Debugging |
The first three weeks focus on teaching the fundamentals of the Julia programming language.
These weeks consist of longer lectures, followed up by shorter, "guided tours" of the Julia ecosystem,
including plotting, data-frames and classical machine learning algorithms.
Week four is all about Deep Learning:
A comprehensive lecture on automatic differentiation (AD)
sheds light on differences between Julia's various AD packages,
before giving a brief overview of Flux's Deep Learning ecosystem.
Finally, week five is all about starting your own Julia project,
taking a look at the structure of Julia packages and different workflows
for reproducible machine learning research.
This is followed up by a demonstration of Julia's debugging and profiling utilities.
The lectures and the homework cover the following packages:
| Package | Lecture | Description |
|:----------------- |:-------:|:-------------------------------------------------------|
| LinearAlgebra.jl | 2 | Linear algebra (standard library) |
| Plots.jl | 3 | Plotting & visualizations |
| DataFrames.jl | 3 | Working with and processing tabular data |
| MLJ.jl | 5 | Classical Machine Learning methods |
| ChainRules.jl | 6 | Forward- & reverse-rules for automatic differentiation |
| Zygote.jl | 6 | Reverse-mode automatic differentiation |
| Enzyme.jl | 6 | Forward- & reverse-mode automatic differentiation |
| ForwardDiff.jl | 6 | Forward-mode automatic differentiation |
| FiniteDiff.jl | 6 | Finite differences |
| FiniteDifferences.jl | 6 | Finite differences |
| Flux.jl | 7 | Deep Learning abstractions |
| MLDatasets.jl | 7 | Dataset loader |
| PkgTemplates.jl | Project | Package template |
| DrWatson.jl | Project | Workflow for scientific projects |
| Debugger.jl | Project | Debugger |
| Infiltrator.jl | Project | Debugger |
| ProfileView.jl | Project | Profiler |
| Cthulhu.jl | Project | Type inference debugger |
### Project
In the **second half of the course**, after passing the homework,
students work in groups on a small programming project of their choice,
learning best practices for package development in Julia, such as:
* how to structure and develop a package
* how to write package tests
* how to write and host package documentation
During code review sessions, students give each other feedback on their projects
before presenting their work in end-of-semester presentations.
[site-url]: https://adrhill.github.io/julia-ml-course/
[ml-group-url]: https://web.ml.tu-berlin.de
[isis-url]: https://isis.tu-berlin.de/course/view.php?id=43325
[goto-badge]: https://img.shields.io/badge/-Go%20to%20course%20website-informational
[isis-badge]: https://img.shields.io/badge/TU%20Berlin-ISIS%20page-red