{"id":13665656,"url":"https://github.com/bradleyboehmke/data-science-learning-resources","last_synced_at":"2025-04-07T15:05:30.161Z","repository":{"id":55123731,"uuid":"159514539","full_name":"bradleyboehmke/data-science-learning-resources","owner":"bradleyboehmke","description":"A collection of data science and machine learning resources that I've found helpful (I only post what I've read!)","archived":false,"fork":false,"pushed_at":"2024-07-08T19:54:13.000Z","size":27788,"stargazers_count":534,"open_issues_count":3,"forks_count":121,"subscribers_count":30,"default_branch":"master","last_synced_at":"2025-03-24T13:21:19.469Z","etag":null,"topics":["data-science","machine-learning"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bradleyboehmke.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-11-28T14:27:51.000Z","updated_at":"2025-03-23T06:06:48.000Z","dependencies_parsed_at":"2024-07-09T00:25:08.551Z","dependency_job_id":null,"html_url":"https://github.com/bradleyboehmke/data-science-learning-resources","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bradleyboehmke%2Fdata-science-learning-resources","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bradleyboehmke%2Fdata-science-learning-resources/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bradleyboehmke%2Fdata-science-learning-resources/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bradleyboehmke%2Fdata-science-learning-resources/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bradleyboehmke","download_url":"https://codeload.github.com/bradleyboehmke/data-science-learning-resources/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247675597,"owners_count":20977376,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-science","machine-learning"],"created_at":"2024-08-02T06:00:46.065Z","updated_at":"2025-04-07T15:05:30.136Z","avatar_url":"https://github.com/bradleyboehmke.png","language":null,"funding_links":[],"categories":["Others"],"sub_categories":[],"readme":"# Data Science Learning Resources\n\n- [Programming](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/README.md#programming)\n- [Machine Learning](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/README.md#machine-learning)\n- [Leadership \u0026 Strategy](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/README.md#leadership--strategy)\n\n\u003cbr\u003e\n\n## Programming\n\n### General\n\n- [The Pragmatic Programmer](https://www.amazon.com/Pragmatic-Programmer-Journeyman-Master/dp/020161622X/ref=sr_1_1?ie=UTF8\u0026qid=1544653964\u0026sr=8-1\u0026keywords=the+pragmatic+programmer) (Book)\n- [Clean Code](https://www.amazon.com/Clean-Code-Handbook-Software-Craftsmanship/dp/0132350882) (Book)\n- [Architecture Playbook](https://nocomplexity.com/documents/arplaybook/index.html) (Online guide)\n\n### Python\n\n- [A Whirlwind Tour of Python](https://jakevdp.github.io/WhirlwindTourOfPython/index.html) (Book)\n- [Python Data Science Handbook](https://jakevdp.github.io/PythonDataScienceHandbook/)\n- [Python Tricks](https://www.amazon.com/Python-Tricks-Buffet-Awesome-Features/dp/1775093301) (Book)\n- [Learning Python](https://www.amazon.com/Learning-Python-5th-Mark-Lutz/dp/1449355730) (Book)\n- [Effective Python](https://effectivepython.com/) (Book)\n\n### R\n\n- [R for Data Science](https://r4ds.had.co.nz/) (Book)\n- [Advanced R](https://adv-r.hadley.nz/) (Book)\n- [R Markdown: The Definitive Guide](https://bookdown.org/yihui/rmarkdown/) (Book)\n- [bookdown: Authoring Books and Technical Documents with R Markdown](https://bookdown.org/yihui/bookdown/) (Book)\n- [Data Science in R: A Case Studies Approach to Computational Reasoning and Problem Solving](https://www.amazon.com/Data-Science-Approach-Computational-Reasoning/dp/1482234815/ref=sr_1_4?keywords=data+science+in+r\u0026qid=1578174035\u0026s=books\u0026sr=1-4) (Book)\n- [Automated Data Collection with R](https://www.amazon.com/Automated-Data-Collection-Practical-Scraping-ebook/dp/B014T25K5O/ref=sr_1_2?keywords=Automated+Data+Collection+with+R\u0026qid=1578174122\u0026s=books\u0026sr=1-2) (Book)\n- [Introduction to Data Science](https://rafalab.github.io/dsbook/) (Book)\n\n### Spark\n\n- [Spark: The Definitive Guide: Big Data Processing Made Simple](https://www.amazon.com/Spark-Definitive-Guide-Processing-Simple/dp/1491912219/ref=sr_1_1?keywords=spark+oreilly\u0026qid=1578175560\u0026s=books\u0026sr=1-1) (Book)\n- [Learning Spark: Lightning-Fast Big Data Analysis](https://www.amazon.com/Learning-Spark-Lightning-Fast-Data-Analysis/dp/1449358624/ref=sr_1_2?keywords=spark+oreilly\u0026qid=1578175595\u0026s=books\u0026sr=1-2) (Book)\n- [Mastering Spark with R: The Complete Guide to Large-Scale Analysis and Modeling](https://www.amazon.com/Mastering-Spark-Complete-Large-Scale-Analysis/dp/149204637X/ref=sr_1_1?crid=3TYKU59XRH5HV\u0026keywords=mastering+spark+with+r\u0026qid=1578175640\u0026s=books\u0026sprefix=mastering+spark+%2Cstripbooks%2C152\u0026sr=1-1) (Book)\n\n### Command Line\n\n- [The Missing Semester of Your CS Education](https://missing.csail.mit.edu/) (Online course)\n- [Learning the bash Shell](https://www.amazon.com/Learning-bash-Shell-Programming-Nutshell/dp/0596009658/ref=sr_1_1?crid=3F1N8U9IGYOWA\u0026keywords=learning+the+bash+shell%2C+3rd+edition\u0026qid=1581944136\u0026sprefix=learning+the+basdh%2Caps%2C345\u0026sr=8-1) (Book)\n- [The Art of the Command Line](https://github.com/jlevy/the-art-of-command-line) (GitHub resources)\n- [explainshell.com](https://explainshell.com/) (Online help)\n\n### Containers\n\n- [Docker tips \u0026 tricks or just useful commands](https://medium.com/@clasikas/docker-tips-tricks-or-just-useful-commands-6e1fd8220450) (Online article)\n- [Rocker: R configurations for Docker](https://github.com/rocker-org/rocker) (GitHub resources)\n- [Docker and Python: making them play nicely and securely for Data Science and ML](https://us.pycon.org/2020/schedule/presentation/175/) (PyCon Talk)\n\n### Functional Programming\n\n- [An Introduction to the Basic Principles of Functional Programming](https://medium.freecodecamp.org/an-introduction-to-the-basic-principles-of-functional-programming-a2c2a15c84) (Online article)\n- [R for Data Science, Ch. 21](https://r4ds.had.co.nz/iteration.html) (Book)\n- [Advanced R, Ch. 9](https://adv-r.hadley.nz/functionals.html) (Book)\n- [Jenny Bryan's purrr tutorials](https://jennybc.github.io/purrr-tutorial/) (Online tutorial)\n- [Foundations of Functional Programming with purrr](https://www.datacamp.com/courses/foundations-of-functional-programming-with-purrr) (DataCamp)\n- [Intermediate Functional Programming with purrr](https://www.datacamp.com/courses/intermediate-functional-programming-with-purrr) (DataCamp)\n\n### Version Control\n\n- [Excuse me, do you have a moment to talk about version control?](https://peerj.com/preprints/3159/) (Paper)\n- [Happy Git and GitHub for the useR](http://happygitwithr.com/) (Book)\n- [Learn Git](https://www.atlassian.com/git/tutorials/learn-git-with-bitbucket-cloud) (Online tutorial)\n- [Introduction to Git In 16 Minutes](https://vickyikechukwu.hashnode.dev/introduction-to-git-in-16-minutes) (Online tutorial)\n- [Git Commit Message Style Guide](http://udacity.github.io/git-styleguide/) (Online guide)\n\n### Code Packaging\n\n- [Python Packaging Authority](https://www.pypa.io/en/latest/)\n- [Python Packaging User Guide](https://packaging.python.org/)\n- [R Packages](https://r-pkgs.org/)\n\n### Style Guide, Readability, Best Practices\n\n- [The Art of Readable Code](https://www.amazon.com/Art-Readable-Code-Practical-Techniques-ebook/dp/B0064CZ1XE) (Book)\n- [The Tidyverse Style Guide](https://style.tidyverse.org/) (Online book)\n- [PEP 8 -- Style Guide for Python Code](https://www.python.org/dev/peps/pep-0008/) (Online guide)\n- [Guidelines for code reviews](https://github.com/lyst/MakingLyst/tree/master/code-reviews) (README)\n- [Code Review Best Practices](https://www.kevinlondon.com/2015/05/05/code-review-best-practices.html) (Blog post)\n\n### Testing\n\n- [Testing R Code](https://www.amazon.com/Testing-Code-Chapman-Hall-CRC/dp/1498763650) (Book)\n- [Python Testing with pytest](https://www.amazon.com/Python-Testing-pytest-Effective-Scalable/dp/1680502409/ref=sr_1_3?keywords=Python+Testing+with+pytest\u0026qid=1578174634\u0026s=books\u0026sr=1-3) (Book)\n- [Multiply your Testing Effectiveness with Parameterized Testing](https://us.pycon.org/2020/schedule/presentation/172/) (PyCon Talk)\n- [Test-Driven Development](https://www.amazon.com/Test-Driven-Development-Kent-Beck/dp/0321146530) (Book)\n\n## Machine Learning\n\n### General \n\n- [Introduction to Statistical Learning](https://www-bcf.usc.edu/~gareth/ISL/) (Book)\n- [Applied Predictive Modeling](http://appliedpredictivemodeling.com/) (Book)\n- [Elements of Statistical Learning](https://web.stanford.edu/~hastie/ElemStatLearn/) (Book)\n- [Computer Age of Statistical Inference](https://www.amazon.com/Computer-Age-Statistical-Inference-Mathematical/dp/1107149894) (Book)\n- [Statistical Modeling: The Two Cultures](http://www2.math.uu.se/~thulin/mm/breiman.pdf) (Paper)\n- [Deep Learning](https://www.amazon.com/slp/deep-learning/qh2mz33y5875zb7) (Book)\n- Hands-On Machine Learning with Scikit-Learn \u0026 TensorFlow ([Book](https://www.amazon.com/Hands-Machine-Learning-Scikit-Learn-TensorFlow/dp/1491962291/ref=sr_1_3?crid=R2UBOSHHEJPM\u0026keywords=hands+on+machine+learning+with+scikit+learn+and+tensorflow\u0026qid=1558957194\u0026s=books\u0026sprefix=hands+on+machine%2Cstripbooks%2C135\u0026sr=1-3) | [GitHub](https://github.com/ageron/handson-ml))\n- [Hands-On Machine Learning with R](https://bradleyboehmke.github.io/HOML/) (Book)\n- [Google's Machine Learning Crash Course](https://developers.google.com/machine-learning/crash-course) (MOOC)\n- [Rules of Machine Learning: Best Practices for ML Engineering](http://bit.ly/313AP5H ) (Article)\n- [How to Write Design Docs for Machine Learning Systems](https://eugeneyan.com/writing/ml-design-docs/?utm_source=convertkit\u0026utm_medium=email\u0026utm_campaign=Writing+Design+Docs+for+Machine+Learning+Systems%20-%205455802) (Article)\n\n### Unsupervised Modeling\n\n- [ISLR: Ch. 10.3 Clustering Methods](http://www-bcf.usc.edu/~gareth/ISL/) (Book chapter)\n- [A K-Means Clustering Algorithm](https://www.jstor.org/stable/pdf/2346830.pdf?casa_token=DyTW0ZLNC4gAAAAA:VNX2TGwDfcs5foMa96ZxnOM2mjaQU1WuCOLL8qF6iDBWp6ClU8-i2-OSXKbtO1uHm6_1oda_2egpvgYCvaix8UxUqUryqZj-Pw3G4m771Ev5-4kL46Y) (Paper)\n- [Generalized Low Rank Models](https://stanford.edu/~boyd/papers/pdf/glrm.pdf) (Paper)\n- [Deep Learning Ch. 15 Autoencoders](https://www.amazon.com/slp/deep-learning/qh2mz33y5875zb7) (Book chapter)\n- Hands-On Mach. Learning with Scikit-Learn Ch. 15 Autoencoders ([Book chapter](https://www.amazon.com/Hands-Machine-Learning-Scikit-Learn-TensorFlow/dp/1491962291/ref=sr_1_3?crid=R2UBOSHHEJPM\u0026keywords=hands+on+machine+learning+with+scikit+learn+and+tensorflow\u0026qid=1558957194\u0026s=books\u0026sprefix=hands+on+machine%2Cstripbooks%2C135\u0026sr=1-3) | [GitHub resource](https://github.com/ageron/handson-ml/blob/master/15_autoencoders.ipynb))\n- [Sparse autoencoder](https://web.stanford.edu/class/cs294a/sparseAutoencoder.pdf) (Andrew Ng CS294A lecture notes)\n\n### A/B Testing\n\n- [Lessons from Running Thoursands of A/B Tests](https://exp-platform.com/Documents/2014-10-11MITCodeKohaviExP.pdf) (Online presentation with many references)\n- [Online Controlled Experiments at Large Scale](http://www.academia.edu/download/40088649/Online_Controlled_Experiments_at_Large_S20151116-5472-1cpgarq.pdf) (Paper)\n- [Peaking at A/B Tests](http://library.usc.edu.ph/ACM/KKD%202017/pdfs/p1517.pdf) (Paper)\n- [Multi-armed Bandit](https://support.google.com/analytics/answer/2844870?hl=en\u0026ref_topic=1745207) (Online tutorial)\n- [A Modern Bayesian Look at the Multi-armed Bandit](https://pdfs.semanticscholar.org/0323/0c3c83dbb013c3e610702c6f650307f0ce5c.pdf) (Paper behind above online tutorial)\n- [Predicting Search Satisfaction Metrics with Interleaved Comparisons](https://www.microsoft.com/en-us/research/publication/predicting-search-satisfaction-metrics-with-interleaved-comparisons/) (Paper)\n- [Evaluating Retrieval Performance using Clickthrough Data](https://www.cs.cornell.edu/people/tj/publications/joachims_02b.pdf) (Paper)\n\n### Multivariate Adaptive Regression Splines\n- [Multivariate Adaptive Regression Splines](https://projecteuclid.org/download/pdf_1/euclid.aos/1176347963) (Friedman's original paper)\n- [APM: Ch. 7.2 Multivariate Adaptive Regression Splines](http://appliedpredictivemodeling.com/) (Book chapter)\n- [ESL: Ch. 9.4 Multivariate Adaptive Regression Splines](https://web.stanford.edu/~hastie/ElemStatLearn/) (Book chapter)\n- [Notes on the __earth__ package](http://www.milbo.org/doc/earth-notes.pdf) (Paper)\n\n### K-Nearest Neighbor\n- [k-Nearest neighbour classifiers](https://www.researchgate.net/profile/Sarah_Delany/publication/228686398_k-Nearest_neighbour_classifiers/links/0fcfd50d0c1d1f41ad000000/k-Nearest-neighbour-classifiers.pdf) (Paper)\n- [APM: Ch. 7.4 \u0026 13.5 K-Nearest Neighbors](http://appliedpredictivemodeling.com/) (Book chapter)\n- [ESL: Ch. 13.3 k-Nearest-Neighbor Classifiers](https://web.stanford.edu/~hastie/ElemStatLearn/) (Book chapter)\n\n### Random Forests\n\n- [An Introduction to Recursive Partitioning Using the RPART Routines](https://cran.r-project.org/web/packages/rpart/vignettes/longintro.pdf) (Paper)\n- [Random Forests - Leo Breiman's original research paper](https://link.springer.com/content/pdf/10.1023/A:1010933404324.pdf) (Paper)\n\n### Gradient Boosting Machines\n- [How to explain gradient boosting](https://explained.ai/gradient-boosting/) (Online tutorial)\n- [Trevor Hastie - Gradient Boosting \u0026 Random Forests at H2O World 2014](https://koalaverse.github.io/machine-learning-in-R/%20//www.youtube.com/watch?v=wPqtzj5VZus\u0026index=16\u0026list=PLNtMya54qvOFQhSZ4IKKXRbMkyL%20Mn0caa) (YouTube)\n- [Trevor Hastie - Data Science of GBM (2013)](http://www.slideshare.net/0xdata/gbm-27891077) (slides)\n- [Mark Landry - Gradient Boosting Method and Random Forest at H2O World 2015](https://www.youtube.com/watch?v=9wn1f-30_ZY) (YouTube)\n- [Peter Prettenhofer - Gradient Boosted Regression Trees in scikit-learn at PyData London 2014](https://www.youtube.com/watch?v=IXZKgIsZRm0) (YouTube)\n- [Alexey Natekin1 and Alois Knoll - Gradient boosting machines, a tutorial](http://journal.frontiersin.org/article/10.3389/fnbot.2013.00021/full) (Paper)\n- [How to Train XGBoost With Spark](https://databricks.com/blog/2020/11/16/how-to-train-xgboost-with-spark.html) (Blog)\n- [Training XGBoost4J-Spark with PySpark](https://databricks.com/notebooks/xgboost/xgboost4j-spark-example.html) (Tutorial notebook)\n- [Use XGBoost on Databricks](https://docs.databricks.com/applications/machine-learning/train-model/xgboost.html) (Tutorial notebooks)\n\n### Deep Learning\n- [Deep Learning with R](https://www.amazon.com/Deep-Learning-R-Francois-Chollet/dp/161729554X/ref=sr_1_3?keywords=deep+learning+with+r\u0026qid=1573422070\u0026sr=8-3) (Book)\n- [Deep Learning with Python](https://www.amazon.com/Deep-Learning-Python-Francois-Chollet/dp/1617294438/ref=sr_1_3?crid=1C568FMWA1B0C\u0026keywords=deep+learning+with+python\u0026qid=1573422053\u0026sprefix=deep+learning+with+%2Caps%2C154\u0026sr=8-3) (Book)\n- [Deep Learning Specialization](https://www.coursera.org/specializations/deep-learning) (MOOC)\n- [keras.rstudio.com](https://keras.rstudio.com/) (Online articles \u0026 tutorials)\n- [blogs.rstudio.com/tensorflow](https://blogs.rstudio.com/tensorflow/) (Online articles \u0026 tutorials)\n- [Illustrated Guide to Recurrent Neural Networks](http://www.kurious.pub/blog/Illustrated-Guide-to-Recurrent-Neural-Networks-4) (Blog)\n- [Illustrated Guide on Vanishing Gradients](http://www.kurious.pub/blog/Illustrated-Guide-on-Vanishing-Gradients-5) (Blog)\n- [Illustrated Guide to LSTMs and GRUs](http://www.kurious.pub/blog/Illustrated-Guide-to-LSTMs-and-GRUs-A-step-by-step-explanation-6) (Blog)\n- [Understanding LSTMs](https://colah.github.io/posts/2015-08-Understanding-LSTMs/) (Blog)\n- [Rohan \u0026 Lenny: Recurrent Neural Networks \u0026 LSTMs](https://ayearofai.com/rohan-lenny-3-recurrent-neural-networks-10300100899b) (Blog)\n- [The Unreasonable Effectiveness of Recurrent Neural Networks](http://karpathy.github.io/2015/05/21/rnn-effectiveness/) (Blog)\n- [Revisiting Small Batch Training for Deep Neural Networks](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/Revisiting%20Small%20Batch%20Training%20for%20Deep%20Neural%20Networks.pdf) (Paper)\n- [On Loss Functions for Deep Neural Networks in Classification](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/On%20Loss%20Functions%20for%20Deep%20Neural%20Networks%20in%20Classification.pdf) (Paper)\n- [Practical Recommendations for Gradient-Based Training of Deep Architectures](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/Practical-Recommendations-for-Gradient-Based-Training-of-Deep-Architectures.pdf) (Paper)\n- [Efficient BackProp](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/efficient-backprop-lecun.pdf) (Paper)\n- [Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/delving-deep-into-rectifiers-he-2015.pdf) (Paper)\n- [Cyclical Learning Rates for Training Neural Networks](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/Cyclical-Learning-Rates-for-Training-Neural-Networks.pdf) (Paper)\n- [A Disciplined Approach to Neural Network Hyperparameters: Part 1 – Learning Rate, Batch Size, Momentum, and Weight Decay](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/nn-hyperparameter-tuning.pdf) (Paper)\n- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://arxiv.org/pdf/1506.01497.pdf) (Paper)\n\n### Ensembles / Model Stacking / Super Learners\n- [Ensemble Methods in Machine Learning](http://web.engr.oregonstate.edu/~tgd/publications/mcs-ensembles.pdf) (Paper)\n- [Stacked Regressions](http://statistics.berkeley.edu/sites/default/files/tech-reports/367.pdf) (Paper)\n- [Super Learner](https://www.degruyter.com/view/j/sagmb.2007.6.issue-1/sagmb.2007.6.1.1309/sagmb.2007.6.1.1309.xml) (Paper)\n\n### Natural Language Processing / Text Mining\n\n- [Text Mining with R](https://www.tidytextmining.com/) (Book)\n- [Probabilistic Topic Models](http://www.cs.columbia.edu/~blei/papers/Blei2012.pdf) (Paper)\n- [The Illustrated Word2vec](http://jalammar.github.io/illustrated-word2vec/) (Online tutorial)\n- [Sebastian Ruder's series on Word Embeddings](https://ruder.io/word-embeddings-1/index.html) (Online articles \u0026 tutorials)\n- [Neural Models for Information Retrieval](https://arxiv.org/pdf/1705.01509.pdf) (Paper)\n- [Why do we use word embeddings in NLP?](https://towardsdatascience.com/why-do-we-use-embeddings-in-nlp-2f20e1b632d2) (Blog)\n\n### Recommendation Systems\n\n- [Collaborative Filters for Recommendation Systems](https://course.fast.ai/videos/?lesson=6) (Fast.ai Deep Learning Lesson, starts at 1:25:00)\n- [How to Measure and Mitigate Position Bias](https://eugeneyan.com/writing/position-bias/) (Blog)\n- [Counterfactual Evaluation for Recommendation Systems](https://eugeneyan.com/writing/counterfactual-evaluation/) (Blog)\n\n### Tuning\n\n- [Deep Learning Tuning Playbook](https://github.com/google-research/tuning_playbook) (Github repo README)\n- [Hyperparameters and Tuning Strategies for Random Forest](https://arxiv.org/pdf/1804.03515.pdf) (Paper)\n- [Tunability: Importance of Hyperparameters of Machine Learning Algorithms](https://arxiv.org/pdf/1802.09596.pdf) (Paper)\n- [Machine Learning Benchmarks and Random Forest Regression](https://cloudfront.escholarship.org/dist/prd/content/qt35x3v9t4/qt35x3v9t4.pdf) (Paper)\n- [Random Search for Hyperparameter Optimization](http://jmlr.csail.mit.edu/papers/volume13/bergstra12a/bergstra12a.pdf) (Paper)\n- [Algorithms for Hyper-Parameter Optimization](https://papers.nips.cc/paper/2011/hash/86e8f7ab32cfd12577bc2619bc635690-Abstract.html) (Paper)\n- [Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures](https://proceedings.mlr.press/v28/bergstra13.html) (Paper)\n\n### Feature Engineering\n\n- [Feature Engineering for Machine Learning](http://shop.oreilly.com/product/0636920049081.do) (Book)\n- [Feature Engineering and Selection: A Practical Approach for Predictive Models](http://www.feat.engineering/) (Book)\n- [Feature Stores - A Hierarchy of Needs](https://eugeneyan.com/writing/feature-stores/?utm_source=convertkit\u0026utm_medium=email\u0026utm_campaign=What+You+Need+to+Know+About+the+Feature+Store+Hierarchy+of+Needs%20-%205369173) (Article)\n\n### Feature Selection\n\n- [Feature Selection with the Boruta Package](https://www.jstatsoft.org/article/view/v036i11/v36i11.pdf) (Paper)\n- [APM: Ch. 19 An Introduction to Feature Selection](http://appliedpredictivemodeling.com/) (Book chapter)\n\n### Machine Learning Interpretability\n\n- [Scott Lundberg's presentation on SHAP](https://youtu.be/B-c8tIgchu0)\n- [H2O.ai Machine Learning Interpretability Resources](https://github.com/h2oai/mli-resources) (GitHub resources)\n- [Patrick Hall's Awesome Machine Learning Interpretability Resources](https://github.com/jphall663/awesome-machine-learning-interpretability) (GitHub resources)\n- [Interpretable Machine Learning](https://christophm.github.io/interpretable-ml-book/) (Book)\n- [Visualizing the Feature Importance for Black Box Models](https://arxiv.org/abs/1804.06620) (Paper)\n- [A Simple and Effective Model-Based Variable Importance Measure](https://arxiv.org/abs/1805.04755) (Paper)\n- [Peeking Inside the Black Box: Visualizing Statistical Learning with Plots of Individual Conditional Expectation](https://arxiv.org/abs/1309.6392) (Paper)\n- [pdp: An R Package for Constructing Partial Dependence Plots](https://journal.r-project.org/archive/2017/RJ-2017-016/RJ-2017-016.pdf) (Paper)\n- [\"Why Should I Trust You?\": Explaining the Predictions of Any Classifier](https://arxiv.org/abs/1602.04938) (Paper)\n- [A Unified Approach to Interpreting Model Predictions](https://arxiv.org/abs/1705.07874) (Paper)\n- [Consistent Individualized Feature Attribution for Tree Ensembles](https://arxiv.org/abs/1802.03888) (Paper)\n- [On the Art and Science of Machine Learning Explanations](https://arxiv.org/pdf/1810.02909) (Paper)\n- [Explanation in artificial intelligence: Insights from the social sciences](https://arxiv.org/pdf/1706.07269) (Paper)\n- [Please Stop Permuting Features: An Explanation and Alternatives](https://arxiv.org/abs/1905.03151) (Paper)\n- [A Stratification Approach to Partial Dependence for Codependent Variables](https://arxiv.org/abs/1907.06698) (Paper)\n- [Explaining Machine Learning Classifiers through Diverse Counterfactual Examples](https://www.microsoft.com/en-us/research/publication/explaining-machine-learning-classifiers-through-diverse-counterfactual-examples/) (Paper)\n\n### Auto ML\n\n- [A Review of Automatic Selection Methods for Machine Learning Algorithms and Hyperparameter Values](http://pages.cs.wisc.edu/~gangluo/automatic_selection_review.pdf) (Paper)\n- [Learning Multiple Defaults for Machine Learning Algorithms](https://arxiv.org/abs/1811.09409) (Paper)\n\n### Benchmarking\n\n- [The Design and Analysis of Benchmark Experiments](https://www.jstor.org/stable/pdf/27594139.pdf) (Paper)\n- [Szilard Pafka's ML Benchmarking Research](https://github.com/szilard/benchm-ml) (GitHub resources)\n- [Data-driven advice for applying machine learning to bioinformatics problems](https://arxiv.org/pdf/1708.05070.pdf) (Paper)\n\n### Resampling Procedures\n\n- [Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning](https://arxiv.org/abs/1811.12808) (Paper)\n- [Futility Analysis in the Cross-Validation of Machine Learning Models](https://arxiv.org/pdf/1405.6974.pdf) (Paper)\n- [Estimating Classification Error Rate: Repeated Cross-validation, Repeated Hold-out, and Bootstrap](https://github.com/bradleyboehmke/data-science-learning-resources/blob/master/resources/resampling-comparison.pdf) (Paper)\n\n### Productionalization\n\n- [150 Successful Machine Learning Models: 6 Lessons Learned at Booking.com](https://dl.acm.org/doi/10.1145/3292500.3330744) (Paper)\n- [Hidden Technical Debt in Machine Learning Systems](https://papers.nips.cc/paper/5656-hidden-technical-debt-in-machine-learning-systems.pdf) (Paper)\n- [Deep Learning in Production](https://github.com/ahkarami/Deep-Learning-in-Production) (Github resources)\n- [Building Riviera: A Declarative Real-Time Feature Engineering Framework](https://doordash.engineering/2021/03/04/building-a-declarative-real-time-feature-engineering-framework/?utm_source=convertkit\u0026utm_medium=email\u0026utm_campaign=Writing+Design+Docs+for+Machine+Learning+Systems%20-%205455802) (Blog - DoorDash) \n- [Software Engineering for Machine Learning: A Case Study](https://www.microsoft.com/en-us/research/uploads/prod/2019/03/amershi-icse-2019_Software_Engineering_for_Machine_Learning.pdf) (Paper - Microsoft)\n- [The ML Test Score: A Rubric for ML Production Readiness and Technical Debt Reduction](https://research.google/pubs/pub46555/) (Paper - Google)\n- [Designing Machine Learning Systems](https://a.co/d/fcDGU9O) (Book)\n- [Machine Learning Operations (MLOps): Overview, Definition, and Architecture](https://arxiv.org/abs/2205.02302) (Paper)\n\n### Model Monitoring\n\n- [Data Management for ML-based Analytics and Beyond](https://ddkang.github.io/papers/2023/jds.pdf) (Paper) \n\n## Leadership \u0026 Strategy\n\n### Management \u0026 Leadership\n\n- [Beware the Data Science Pin Factory: The Power of the Full-Stack Data Science Generalist](https://multithreaded.stitchfix.com/blog/2019/03/11/FullStackDS-Generalists/) (Blog - Stitch Fix)\n- [Engineers Shouldn’t Write ETL: A Guide to Building a High Functioning Data Science Department](https://multithreaded.stitchfix.com/blog/2016/03/16/engineers-shouldnt-write-etl/) (Blog - Stitch Fix)\n- [The Engineering/Manager Pendulum](https://charity.wtf/2017/05/11/the-engineer-manager-pendulum/) (Blog)\n- [Lessons learned managing the GitLab Data team](https://about.gitlab.com/blog/2020/02/10/lessons-learned-as-data-team-manager/) (Blog - GitLab)\n- [The Manager's Path: A Guide for Tech Leaders Navigating Growth and Change](https://www.amazon.com/Managers-Path-Leaders-Navigating-Growth/dp/1491973897/ref=sr_1_1?crid=1SPIBADHM1RXO\u0026dchild=1\u0026keywords=The+Manager%27s+Path%3A+A+Guide+for+Tech+Leaders+Navigating+Growth+and+Change\u0026qid=1609688389\u0026sprefix=recessed+lighting+ang%2Caps%2C185\u0026sr=8-1) (Book)\n- [Who is fit to lead data science?](https://www.kdnuggets.com/2021/02/fit-lead-data-science.html) (Blog - KDnuggets)\n- [Platform Revolution](https://www.amazon.com/Platform-Revolution-Networked-Markets-Transforming/dp/0393354350/ref=asc_df_0393354350/?tag=hyprod-20\u0026linkCode=df0\u0026hvadid=312175933381\u0026hvpos=\u0026hvnetw=g\u0026hvrand=1035572653413444981\u0026hvpone=\u0026hvptwo=\u0026hvqmt=\u0026hvdev=c\u0026hvdvcmdl=\u0026hvlocint=\u0026hvlocphy=9015829\u0026hvtargid=pla-303822642427\u0026psc=1\u0026tag=\u0026ref=\u0026adgrpid=60258871817\u0026hvpone=\u0026hvptwo=\u0026hvadid=312175933381\u0026hvpos=\u0026hvnetw=g\u0026hvrand=1035572653413444981\u0026hvqmt=\u0026hvdev=c\u0026hvdvcmdl=\u0026hvlocint=\u0026hvlocphy=9015829\u0026hvtargid=pla-303822642427) (Book)\n- [No Rules Rules: Netflix and the Culture of Reinvention](https://www.amazon.com/No-Rules-Netflix-Culture-Reinvention/dp/1984877860/ref=sr_1_2?dchild=1\u0026keywords=no+rules+rules\u0026qid=1603384965\u0026s=books\u0026sr=1-2) (Book)\n- [Living by the Code](https://www.amazon.com/Living-Code-First-Developers-Innovators/dp/1942878826/ref=sr_1_1?dchild=1\u0026keywords=living+by+the+code\u0026qid=1614096281\u0026sr=8-1) (Book)\n- [The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers](https://www.microsoft.com/en-us/research/publication/the-best-of-both-worlds-unlocking-the-potential-of-hybrid-work-for-software-engineers/) (Paper)\n\n### Cloud Strategy\n\n- [The Cost of Cloud, a Trillion Dollar Paradox](https://a16z.com/2021/05/27/cost-of-cloud-paradox-market-cap-cloud-lifecycle-scale-growth-repatriation-optimization/) (Blog - Andreessen Horowitz)\n- [From Cloud Computing to Sky Computing](https://sigops.org/s/conferences/hotos/2021/papers/hotos21-s02-stoica.pdf) (Paper)\n\n### Product\n\n- [The Influential Product Manager: How to Lead and Launch Successful Technology Products](https://www.amazon.com/Influential-Product-Manager-Successful-Technology-ebook/dp/B07Y3ZG5NV/ref=sr_1_1_sspa?crid=2GQMTCRZIC8KP\u0026dchild=1\u0026keywords=the+influential+product+manager\u0026qid=1603384998\u0026sprefix=The+influential+product%2Cstripbooks%2C180\u0026sr=8-1-spons\u0026psc=1\u0026spLa=ZW5jcnlwdGVkUXVhbGlmaWVyPUEyQVUxOVQ5RjRQRENVJmVuY3J5cHRlZElkPUEwMzIzNDAzQjlCOEdFWjZaVjA3JmVuY3J5cHRlZEFkSWQ9QTA4NTU1NzhYQzhWWUhaSUE1NFMmd2lkZ2V0TmFtZT1zcF9hdGYmYWN0aW9uPWNsaWNrUmVkaXJlY3QmZG9Ob3RMb2dDbGljaz10cnVl) (Book)\n- [Mastering Product Management: A Step-by-Step Guide](https://www.amazon.com/Mastering-Product-Management-Step-Step/dp/1733839003/ref=sr_1_3?crid=PYM2K7DWJSNC\u0026dchild=1\u0026keywords=mastering+product+management+a+step-by-step+guide\u0026qid=1607368736\u0026sprefix=Mastering+Product%2Caps%2C202\u0026sr=8-3) (Book)\n\n### Performance Reviews\n\n- [Preparing for performance reviews ahead of time](https://newsletter.pragmaticengineer.com/p/preparing-for-performance-reviews) (Blog)\n- [Get your work recognized: write a brag document](https://jvns.ca/blog/brag-documents/) (Blog + template)\n- [Don't do invisible work](https://www.youtube.com/watch?v=HiF83i1OLOM\u0026list=PLYXaKIsOZBsu3h2SSKEovRn7rGy7wkUAV\u0026index=30) (Presentation)\n- [Work log template for Software Engineers](https://docs.google.com/document/d/10szdym6SXJ_3GH6-nefOOfzEX1lYlpSu74MAFbpX2t0/edit) (Template)\n- [Sending weekly 5-15 updates](https://lethain.com/weekly-updates/) (Blog)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbradleyboehmke%2Fdata-science-learning-resources","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbradleyboehmke%2Fdata-science-learning-resources","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbradleyboehmke%2Fdata-science-learning-resources/lists"}