{"id":13472191,"url":"https://github.com/dair-ai/Mathematics-for-ML","last_synced_at":"2025-03-26T15:31:31.230Z","repository":{"id":37543132,"uuid":"494763031","full_name":"dair-ai/Mathematics-for-ML","owner":"dair-ai","description":"🧮  A collection of resources to learn mathematics for machine learning","archived":false,"fork":false,"pushed_at":"2023-01-24T22:38:34.000Z","size":42,"stargazers_count":4481,"open_issues_count":10,"forks_count":418,"subscribers_count":74,"default_branch":"main","last_synced_at":"2024-10-30T04:13:19.241Z","etag":null,"topics":["ai","deep-learning","machine-learning","mathematics","ml"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dair-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-05-21T11:24:15.000Z","updated_at":"2024-10-29T17:31:05.000Z","dependencies_parsed_at":"2023-02-14T02:15:47.586Z","dependency_job_id":null,"html_url":"https://github.com/dair-ai/Mathematics-for-ML","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dair-ai%2FMathematics-for-ML","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dair-ai%2FMathematics-for-ML/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dair-ai%2FMathematics-for-ML/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dair-ai%2FMathematics-for-ML/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dair-ai","download_url":"https://codeload.github.com/dair-ai/Mathematics-for-ML/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245224613,"owners_count":20580372,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","deep-learning","machine-learning","mathematics","ml"],"created_at":"2024-07-31T16:00:52.779Z","updated_at":"2025-03-26T15:31:31.177Z","avatar_url":"https://github.com/dair-ai.png","language":null,"funding_links":[],"categories":["Others","🎓 Courses \u0026 Learning Paths","A01_机器学习教程","Uncategorized","📚 Project Purpose"],"sub_categories":["AI Engineer Specialization (Free Learning Hubs)","Uncategorized","Machine Learning (Entry-Level)"],"readme":"# Mathematics for Machine Learning\n\nA collection of resources to learn and review mathematics for machine learning.\n\n# :book: Books\n\n### Algebra, Topology, Differential Calculus, and Optimization Theory For Computer Science and Machine Learning\n*by Jean Gallier and Jocelyn Quaintance*\n\nIncludes mathematical concepts for machine learning and computer science. \n\nBook: https://www.cis.upenn.edu/~jean/math-deep.pdf\n\n### Applied Math and Machine Learning Basics\n*by Ian Goodfellow and Yoshua Bengio and Aaron Courville*\n\nThis includes the math basics for deep learning from the [Deep Learning](https://www.deeplearningbook.org/) book. \n\nChapter: https://www.deeplearningbook.org/contents/part_basics.html\n\n### Mathematics for Machine Learning\n*by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong*\n\nThis is probably the place you want to start. Start slowly and work on some examples. Pay close attention to the notation and get comfortable with it.\n\nBook: https://mml-book.github.io\n\n### Probabilistic Machine Learning: An Introduction\n*by Kevin Patrick Murphy*\n\nThis book contains a comprehensive overview of classical machine learning methods and the principles explaining them. \n\nBook: https://probml.github.io/pml-book/book1.html\n\n### Mathematics for Deep Learning\n*by Brent Werness, Rachel Hu et al.*\n\nThis reference contains some mathematical concepts to help build a better understanding of deep learning.\n\nChapter: https://d2l.ai/chapter_appendix-mathematics-for-deep-learning/index.html \n\n### The Mathematical Engineering of Deep Learning\n*by Benoit Liquet, Sarat Moka and Yoni Nazarathy*\n\nThis book provides a complete and concise overview of the mathematical engineering of deep learning. In addition to overviewing deep learning foundations, the treatment includes convolutional neural networks, recurrent neural networks, transformers, generative adversarial networks, reinforcement learning, and multiple tricks of the trade. The focus is on the basic mathematical description of deep learning models, algorithms and methods.\n\nBook: https://deeplearningmath.org\n\n### Bayes Rules! An Introduction to Applied Bayesian Modeling\n*by Alicia A. Johnson, Miles Q. Ott, Mine Dogucu*\n\nGreat online book covering Bayesian approaches. \n\nBook: https://www.bayesrulesbook.com/index.html\n\n# 📄 Papers\n\n### The Matrix Calculus You Need For Deep Learning\n*by Terence Parr \u0026 Jeremy Howard*\n\nIn deep learning, you need to understand a bunch of fundamental matrix operations. If you want to dive deep into the math of matrix calculus this is your guide.\n\nPaper: https://arxiv.org/abs/1802.01528\n\n### The Mathematics of AI\n*by Gitta Kutyniok*\n\nAn article summarising the importance of mathematics in deep learning research and how it’s helping to advance the field.\n\nPaper: https://arxiv.org/pdf/2203.08890.pdf\n\n# 🎥 Video Lectures\n\n### Multivariate Calculus by Imperial College London\n*by Dr. Sam Cooper \u0026 Dr. David Dye*\n\nBackpropagation is a key algorithm for training deep neural nets that rely on Calculus. Get familiar with concepts like chain rule, Jacobian, gradient descent.\n\nVideo Playlist: https://www.youtube.com/playlist?list=PLiiljHvN6z193BBzS0Ln8NnqQmzimTW23\n\n### Mathematics for Machine Learning - Linear Algebra\n*by Dr. Sam Cooper \u0026 Dr. David Dye*\n\nA great companion to the previous video lectures. Neural networks perform transformations on data and you need linear algebra to get better intuitions of how that is done.\n\nVideo Playlist: https://www.youtube.com/playlist?list=PLiiljHvN6z1_o1ztXTKWPrShrMrBLo5P3\n\n### CS229: Machine Learning\n*by Anand Avati*\n\nLectures containing mathematical explanations to many concepts in machine learning. \n\nCourse: https://www.youtube.com/playlist?list=PLoROMvodv4rNH7qL6-efu_q2_bPuy0adh\n\n# 🧮 Math Basics\n\n### The Elements of Statistical Learning\n*by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie*\n\nMachine learning deals with data and in turn uncertainty which is what statistics aims to teach. Get comfortable with topics like estimators, statistical significance, etc.\n\nBook: https://hastie.su.domains/ElemStatLearn/\n\nIf you are interested in an introduction to statistical learning, then you might want to check out [\"An Introduction to Statistical Learning\"](https://www.statlearning.com/).\n\n\n### Probability Theory: The Logic of Science\n*by E. T. Jaynes*\n\nIn machine learning, we are interested in building probabilistic models and thus you will come across concepts from probability theory like conditional probability and different probability distributions.\n\nSource: https://bayes.wustl.edu/etj/prob/book.pdf\n\n### Information Theory, Inference and Learning Algorithms\n*by David J. C. MacKay*\n\nWhen you are applying machine learning you are dealing with information processing which in essence relies on ideas from information theory such as entropy and KL Divergence,...\n\nBook: https://www.inference.org.uk/itprnn/book.html\n\n### Statistics and probability\n*by Khan Academy*\n\nA complete overview of statistics and probability required for machine learning.\n\nCourse: https://www.khanacademy.org/math/statistics-probability\n\n### Linear Algebra Done Right\n*by Sheldon Axler*\n\nSlides and video lectures on the popular linear algebra book Linear Algebra Done Right. \n\nLecture and Slides: https://linear.axler.net/LADRvideos.html\n\n### Linear Algebra\n*by Khan Academy*\n\nVectors, matrices, operations on them, dot \u0026 cross product, matrix multiplication etc. is essential for the most basic understanding of ML maths.\n\nCourse: https://www.khanacademy.org/math/linear-algebra\n\n## Calculus\n*by Khan Academy*\n\nPrecalculus, Differential Calculus, Integral Calculus, Multivariate Calculus\n\nCourse: https://www.khanacademy.org/math/calculus-home\n\n---\nThis collection is far from exhaustive but it should provide a good foundation to start learning some of the mathematical concepts used in machine learning. Reach out on [Twitter](https://twitter.com/omarsar0) if you have any questions.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdair-ai%2FMathematics-for-ML","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdair-ai%2FMathematics-for-ML","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdair-ai%2FMathematics-for-ML/lists"}