https://github.com/iglee/explainaboard-experiments
for keeping track of experiments done with ExplainaBoard
https://github.com/iglee/explainaboard-experiments
Last synced: about 1 year ago
JSON representation
for keeping track of experiments done with ExplainaBoard
- Host: GitHub
- URL: https://github.com/iglee/explainaboard-experiments
- Owner: iglee
- Created: 2022-04-05T01:56:13.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2022-06-03T13:06:18.000Z (about 4 years ago)
- Last Synced: 2025-06-03T03:07:36.094Z (about 1 year ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 3.85 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ExplainaBoard-experiments
for keeping track of experiments done with ExplanaBoard
## Summary of scripts
- `src/process_wmt21reports.py`: organize the json reports from explainaboard into data points with metrics, also calculated URIEL distances
- `src/process_wmt21train.py`: organize the training data from WMT21 into data points with data size, type token ratio, ttr distance, and subword tokenization (subword not implemented yet).
- `src/linear_regression.py`: helper functions for linear regression.
- builds regression pipelines from polynomial or simple regression, (basis expansion can be added too, but not added yet.)
- trains pipelines using bootstrapping,
- get feature importances
- prints results (MSE and R2).
- `src/generate_reports.sh` : generates reports from explainaboard from a given input directory
- `sample_data`: for now, I have a `pkl` of a data frame to be used for regression related models.
- `notebooks/linear-regression-analysis.ipynb`: notebook containing results/plots/analysis so far, related to regression models. mostly linear regression was explored, but I tried out SVM and GPR as non-linear examples.