https://github.com/josedv82/nba_schedule_xgboost_classifier
Predicting NBA game outcomes using schedule related information. This is an example of supervised learning where a xgboost model was trained with 20 seasons worth of NBA games and uses SHAP values for model explainability.
https://github.com/josedv82/nba_schedule_xgboost_classifier
h2o h2oai nba-analytics nba-stats shap shapley-additive-explanations shapley-value supervised-learning xgboost xgboost-algorithm
Last synced: 9 months ago
JSON representation
Predicting NBA game outcomes using schedule related information. This is an example of supervised learning where a xgboost model was trained with 20 seasons worth of NBA games and uses SHAP values for model explainability.
- Host: GitHub
- URL: https://github.com/josedv82/nba_schedule_xgboost_classifier
- Owner: josedv82
- License: mit
- Created: 2021-04-15T18:16:08.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-11-15T12:46:35.000Z (about 4 years ago)
- Last Synced: 2025-02-03T14:47:43.482Z (10 months ago)
- Topics: h2o, h2oai, nba-analytics, nba-stats, shap, shapley-additive-explanations, shapley-value, supervised-learning, xgboost, xgboost-algorithm
- Language: Jupyter Notebook
- Homepage:
- Size: 12.9 MB
- Stars: 3
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Influence of schedule & travel metrics on game outcomes in the NBA.
Predicting NBA game outcomes and extracting win probabilities for each game based on schedule, travel and game density metrics.
#### Goal:
The model outcomes game predictions (along with the probability associated to winning and losing). However, my main goal was to understand how different games may be affected by schedule related metrics such as mileage, rest, density, time zone shifts, etc. This information could potentially be used by teams to optimize travel plans and manage different schedule indicators during the season.
#### Data Source:
* I built an R package ([{airball}](https://github.com/josedv82/airball)) to [scrape the data](https://github.com/josedv82/NBA_Predictive_Model/blob/main/Airball_Download.Rmd). {airball} provides various functions to extract schedule related metrics from public box score information.
* Data preparation. My code to clean the data and prepare it for modeling is available [here.](https://github.com/josedv82/NBA_Schedule_Classifier/blob/main/Airball_Download.Rmd)
Once the data is ready:
* To train the model I used 20 seasons of NBA data (2000-19).
* I also ran the model on 2021 season data to check its performance given some of the differences in schedule related to COVID.
#### Metrics:
* ```Game Outcome``` (model target)
* ```Distance Travelled``` Distance travelled over "X" time windows for both teams in a game.
* ```Time Zone Shifts``` Number of time zone shifs over "X" time windows for both teams in a game.
* ```Games Played``` Games played over "X" time windows for both teams.
* ```Rest Days``` Number of rest days prior to a game for both teams.
* ```Location``` Home or Away.
* ```Streak``` Consecutive Ws or Ls for both teams.
* ```Win %``` Winning % for each team.
#### XGBoost model:
* This is an example of supervised learning where a [XGBoost](https://www.kaggle.com/prashant111/xgboost-k-fold-cv-feature-importance) classifier was implemented. I used the [{h2o}](https://www.h2o.ai/products/h2o/) package in R to build, train and evaluate the model.
* Current model performance:
```
MSE: 0.1803835
RMSE: 0.4247158
LogLoss: 0.5333432
Mean Per-Class Error: 0.2758835
AUC: 0.8041708
AUCPR: 0.8072966
Gini: 0.6083416
R^2: 0.2784605
Confusion Matrix (vertical: actual; across: predicted) for F1-optimal threshold:
0 1 Error Rate
0 2495 1335 0.348564 =1335/3830
1 774 3035 0.203203 =774/3809
Totals 3269 4370 0.276083 =2109/7639
```
#### Model Explainability:
* I used [SHAP](https://www.kaggle.com/dansbecker/shap-values) values to identify feature importance, as well as to explain how different features contribute to model predictions and outcome probabilities for each observation.
* Below is an example image of how the model makes a decision for one game:
For more info on the science behind SHAP values visit this [video.](https://www.youtube.com/watch?v=-taOhqkiuIo)
#### Check Out the Code:
* A static copy of the notebook is available [here](https://github.com/josedv82/NBA_Predictive_Model/blob/main/NBA_Schedule_xgboost.ipynb)
* For access to the interactive notebook visit [this link](https://github.com/josedv82/NBA_Predictive_Model/blob/main/NBA_Schedule_xgboost.ipynb) to open google colab.
#### Future Work:
* Continue improving model performance.
* Identify other potential relevant features.
* Deploy model into shiny app to provide user friendly access to predictions.
#### Other NBA schedule related work
* [NBA Game Density APP](https://josedv.shinyapps.io/NBASchedule/)
* [airball R package](https://github.com/josedv82/airball)