https://github.com/myurasov/kaggle-birdclef-2021
https://github.com/myurasov/kaggle-birdclef-2021
Last synced: 24 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/myurasov/kaggle-birdclef-2021
- Owner: myurasov
- Created: 2021-04-26T12:09:17.000Z (about 4 years ago)
- Default Branch: master
- Last Pushed: 2021-08-03T00:43:35.000Z (over 3 years ago)
- Last Synced: 2025-04-06T16:45:34.967Z (27 days ago)
- Language: Jupyter Notebook
- Size: 42.7 MB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Code for BirdCLEF 2021 Kaggle Competition
## Running
### Starting Jupyter Lab and TensorBoard
`$ docker/docker-forever.sh [--gpus='device=###|all'] [--jupyter_port=####|8888] [--tensorboard_port=####|6006]`
### Shell
`$ docker/docker.sh [--gpus='device=###|all'] bash`
## Workflow
### Create geofilter
```sh
cli/get_flybies.run.py --dataset dataset-all-m1.pickle --miles 500 --time_tolerance_months 1 --only_months 1 --last_n_years 5 > docs/flybies-all-500mi-last_5y-1mo_tolerance.txt
```
### Prepare data
```sh
cli/prepare_short.run.py --min_rating 3 --max_from_clip 10 --no_rating_value 3 --rectify_class_balance 0 --sample_with_stride 5 --out_csv short-C.csv && \
cli/prepare_long.run.py --split_multilabel 1 --out_csv long-C.csv && \
cli/create_dataset.run.py --in_csvs short-X.csv long-X.csv --out dataset-X.pickle --secondary_label_p 0.33 --rectify_class_balance 1 --geofilter all-500mi-last_5y-1mo_tolerance --folds 7 && \
cli/cache_waves.py --dataset dataset-X.pickle
```
### Train
```
cli/train_fe.run.py --run X --dataset dataset-X.pickle --lr 0.001 --lr_patience 5 --samples_per_epoch 128000 --model msg_enb4_imagenet_noxdense --amp 1 --val_fold 0.15 --batch 64 --preload_val_data 1 --multiprocessing 4x4 --epochs 500 --weight_by_rareness 0 --monitor_metric val_f1_score
```
### Upload code to Kaggle
Configure credentials in the `kaggle.json` polaced in the root of the project.
```sh
cli/kaggle_upload_repo.sh
```