{"id":38944151,"url":"https://github.com/talperetz/awesome-gradient-boosting","last_synced_at":"2026-01-17T16:00:10.448Z","repository":{"id":72231555,"uuid":"166406109","full_name":"talperetz/awesome-gradient-boosting","owner":"talperetz","description":"A curated list of Gradient Boosting resources for Data Scientists","archived":false,"fork":false,"pushed_at":"2019-01-18T13:10:09.000Z","size":3,"stargazers_count":16,"open_issues_count":0,"forks_count":4,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-11-03T21:04:05.515Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/talperetz.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2019-01-18T13:04:38.000Z","updated_at":"2023-03-11T12:29:05.000Z","dependencies_parsed_at":"2023-02-23T08:15:15.453Z","dependency_job_id":null,"html_url":"https://github.com/talperetz/awesome-gradient-boosting","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/talperetz/awesome-gradient-boosting","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/talperetz%2Fawesome-gradient-boosting","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/talperetz%2Fawesome-gradient-boosting/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/talperetz%2Fawesome-gradient-boosting/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/talperetz%2Fawesome-gradient-boosting/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/talperetz","download_url":"https://codeload.github.com/talperetz/awesome-gradient-boosting/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/talperetz%2Fawesome-gradient-boosting/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28511852,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-17T13:38:16.342Z","status":"ssl_error","status_checked_at":"2026-01-17T13:37:44.060Z","response_time":85,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-01-17T16:00:08.391Z","updated_at":"2026-01-17T16:00:10.232Z","avatar_url":"https://github.com/talperetz.png","language":null,"funding_links":[],"categories":["Related Awesome Lists"],"sub_categories":["Comparison Studies"],"readme":"Awesome Gradient Boosting\n==========================\n\nA curated list of Gradient Boosting resources for Data Scientists [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome)\n\nList of content\n\n1. [Intro](#intro)\n2. [Implementations](#implementations)\n3. [Parameter Tuning](#parameter-tuning)\n4. [Posts](#posts)\n5. [Talks](#talks)\n6. [Notebooks](#notebooks)\n7. [Datasets](#datasets)\n\n\n# Intro\n- [Wikipedia](https://en.wikipedia.org/wiki/Gradient_boosting) - Gradient Boosting\n- [XGBoost](https://xgboost.readthedocs.io/en/latest/tutorials/model.html) - Introduction to Boosted Trees\n- [Kaggle](http://blog.kaggle.com/2017/01/23/a-kaggle-master-explains-gradient-boosting/) - a kaggle master explains gradient boosting\n\n# Implementations\n- XGBoost\n\t* [XGBoost Github](https://github.com/dmlc/xgboost) \n\t* [XGBoost Documentation](https://xgboost.readthedocs.io/en/latest/)\n\t* [XGBoost Paper](https://arxiv.org/abs/1603.02754) - XGBoost: A Scalable Tree Boosting System  \t\n- LightGBM\n\t* [LightGBM Github](https://github.com/Microsoft/LightGBM) \n\t* [LightGBM Documentation](https://lightgbm.readthedocs.io/en/latest/)\n\t* [LightGBM Paper](https://papers.nips.cc/paper/6907-lightgbm-a-highly-efficient-gradient-boosting-decision-tree.pdf) - LightGBM: A Highly Efficient Gradient Boosting\nDecision Tree\n- Catboost\n\t* [Catboost Github](https://github.com/catboost/catboost) \n\t* [Catboost Documentation](https://tech.yandex.com/catboost/doc/dg/concepts/about-docpage/)\n\t* [Catboost Paper](https://arxiv.org/pdf/1706.09516.pdf) - CatBoost: unbiased boosting with categorical features\n- Other\n\t* [sklearn](https://scikit-learn.org/stable/modules/ensemble.html#gradient-boosting) - Gradient Boosting Guide \n\t* [H20](http://docs.h2o.ai/h2o/latest-stable/h2o-docs/data-science/gbm.html) - GBM\n\t\n# Parameter Tuning\n- [Hyperspace](https://github.com/talperetz/hyperspace/tree/master/GBDTs) - Hyperparameters Spaces for Optimization\n- [XGBoost](https://www.analyticsvidhya.com/blog/2016/03/complete-guide-parameter-tuning-xgboost-with-codes-python/) - Complete Guide to Parameter Tuning in XGBoost (with codes in Python)\n- [LightGBM](https://lightgbm.readthedocs.io/en/latest/Parameters-Tuning.html) - parameters tuning guides for different scenarios\n- [Catboost](https://tech.yandex.com/catboost/doc/dg/concepts/parameter-tuning-docpage/) - some tips on the possible parameter settings\n\n# Posts\n* [Gradient Boosting Explained](http://arogozhnikov.github.io/2016/06/24/gradient_boosting_explained.html) - by Brilliantly wrong thoughts on science and programming\n* [Gradient Boosting From Scratch](https://medium.com/mlreview/gradient-boosting-from-scratch-1e317ae4587d) - by ML Review\n* [CatBoost vs. Light GBM vs. XGBoost](https://towardsdatascience.com/catboost-vs-light-gbm-vs-xgboost-5f93620723db) - by Alvira Swalin on Towards Data Science\n* [Mastering The New Generation of Gradient Boosting](https://towardsdatascience.com/https-medium-com-talperetz24-mastering-the-new-generation-of-gradient-boosting-db04062a7ea2) - by Tal Peretz on Towards Data Science\n\n# Talks\n* [Catboost](https://www.youtube.com/watch?v=8o0e-r0B5xQ) - Anna Veronika Dorogush on pydata\n* [Can one do better than XGBoost?](https://www.youtube.com/watch?v=5CWwwtEM2TA) - Mateusz Susik on pydata\n\n\n# Notebooks\n* [Kaggle XGBoost](https://www.kaggle.com/dansbecker/xgboost)\n* [Catboost + LightGBM + XGBoost](https://gist.github.com/talperetz/6030f4e9997c249b09409dcf00e78f91) - comparison of the 3 implementations on categorical dataset.\n\n# Datasets\n* [Catboost Datasets](https://tech.yandex.com/catboost/doc/dg/concepts/python-reference_datasets-docpage/)\n\n\n## License\n\n[![CC0](http://i.creativecommons.org/p/zero/1.0/88x31.png)](http://creativecommons.org/publicdomain/zero/1.0/)\n\nTo the extent possible under law, [Tal Peretz](https://github.com/igorbarinov/) has waived all copyright and related or neighboring rights to this work.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftalperetz%2Fawesome-gradient-boosting","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftalperetz%2Fawesome-gradient-boosting","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftalperetz%2Fawesome-gradient-boosting/lists"}