Main Technologies

• Hydra - a framework for elegantly configuring complex applications. The key feature is the ability to dynamically create a hierarchical configuration by composition and override it through config files and the command line.
• PyTorch Lightning - a lightweight PyTorch wrapper for high-performance AI research. Think of it as a framework for organizing your PyTorch code.

Resources

• lucmos/nn-template
• jxpress/lightning-hydra-template-vertex-ai - lightning-hydra-template integration with Vertex AI hyperparameter tuning and custom training job
• drivendata/cookiecutter-data-science

📌  Introduction

• this page

⚡  Your Superpowers

• here
• many more
• 40+ useful trainer flags
• the right lightning trainer flags
• docs
• Optuna Sweeper
• this issue
• Ray AWS launcher for Hydra
• here

❤️  Contributions

• Contributors

Experiment Tracking

• docs

Hyperparameter Search

• Optuna, Ax or Nevergrad

Best Practices

• documentation
• here

Distributed Training

• docs

🚀  Quickstart