Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/neptune-ai/neptune-sacred

Sacred-compatible UI for experiment tracking. 📊 Log and visualize machine learning model metrics, hyperparameters, code, dataset versions, and more.
https://github.com/neptune-ai/neptune-sacred

compare dashboard filter frontend management metadata mlops observer sacred sacredboard

Last synced: 10 days ago
JSON representation

Sacred-compatible UI for experiment tracking. 📊 Log and visualize machine learning model metrics, hyperparameters, code, dataset versions, and more.

Awesome Lists containing this project

README

        

# Neptune + Sacred Integration

Neptune is a lightweight experiment tracker that offers a single place to track, compare, store, and collaborate on experiments and models.

This integration lets you use Neptune as a UI for the experiments you track in Sacred.

## What will you get with this integration?

* Log, organize, visualize, and compare ML experiments in a single place
* Monitor model training live
* Version and query production-ready models and associated metadata (e.g., datasets)
* Collaborate with the team and across the organization

## What will be logged to Neptune?

* Hyperparameters
* Losses and metrics
* Training code (Python scripts or Jupyter notebooks) and Git information
* Dataset version
* Model configuration
* [Other metadata](https://docs.neptune.ai/logging/what_you_can_log)

![image](https://docs.neptune.ai/img/app/integrations/sacred.png)

## Resources

* [Documentation](https://docs.neptune.ai/integrations/sacred)
* [Code example on GitHub](https://github.com/neptune-ai/examples/tree/main/integrations-and-supported-tools/sacred/scripts)
* [Example dashboard in the Neptune app](https://app.neptune.ai/o/common/org/sacred-integration/e/SAC-1341/dashboard/Sacred-Dashboard-6741ab33-825c-4b25-8ebb-bb95c11ca3f4)
* [Run example in Google Colab](https://colab.research.google.com/github/neptune-ai/examples/blob/main/integrations-and-supported-tools/sacred/notebooks/Neptune_Sacred.ipynb)

## Example

On the command line:

```
pip install neptune-sacred
```

In Python:

```python
import neptune

# Start a run
run = neptune.init_run(
project = "common/sacred-integration",
api_token = neptune.ANONYMOUS_API_TOKEN,
)

# Create a Sacred experiment
experiment = Experiment("image_classification", interactive=True)

# Add NeptuneObserver and run the experiment
experiment.observers.append(NeptuneObserver(run=run))
experiment.run()
```

## Support

If you got stuck or simply want to talk to us, here are your options:

* Check our [FAQ page](https://docs.neptune.ai/getting_help)
* You can submit bug reports, feature requests, or contributions directly to the repository.
* Chat! When in the Neptune application click on the blue message icon in the bottom-right corner and send a message. A real person will talk to you ASAP (typically very ASAP),
* You can just shoot us an email at [email protected]