Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/packquickly/schedule_free_optx

Schedule free optimiser implemented in JAX using Optimistix
https://github.com/packquickly/schedule_free_optx

Last synced: 16 days ago
JSON representation

Schedule free optimiser implemented in JAX using Optimistix

Awesome Lists containing this project

README

        

# Schedule-free optimisers in JAX using Optimistix

An implementation of the new [schedule-free SGD and AdamW](https://arxiv.org/abs/2405.15682) optimisers in JAX using [Optimistix](https://github.com/patrick-kidger/optimistix).

Screenshot 2024-05-29 at 10 24 28 PM

# Installation

To install, simply download this repo and run

```pip install -e .```

in your Python environment. Then use `from schedule_free_optx import ScheduleFreeSGD, ScheduleFreeAdamW` and use them as any other Optimistix optimiser!