Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/delta-rs/nebula
A Package Manager for Machine Learning Datasets and Models.
https://github.com/delta-rs/nebula
dataset datasets machine-learning ml package-manager rust
Last synced: about 1 month ago
JSON representation
A Package Manager for Machine Learning Datasets and Models.
- Host: GitHub
- URL: https://github.com/delta-rs/nebula
- Owner: delta-rs
- License: bsd-3-clause
- Created: 2024-12-16T11:09:06.000Z (about 2 months ago)
- Default Branch: master
- Last Pushed: 2024-12-18T16:28:35.000Z (about 2 months ago)
- Last Synced: 2024-12-18T17:28:04.010Z (about 2 months ago)
- Topics: dataset, datasets, machine-learning, ml, package-manager, rust
- Language: Rust
- Homepage: https://deltaml.org
- Size: 14.6 KB
- Stars: 2
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
# Nebula
A package manager for machine learning datasets and models.
## Nebula CLI
### Commands
The Nebula CLI provides a set of commands to interact with the Nebula package manager. The following commands will be implemented:
```shell
nebula init # Initializes the local Nebula environment
nebula install [--version ] # Downloads and installs a dataset or model
nebula search # Searches for datasets or models in the Nebula repository
nebula list # Lists all installed packages
nebula update [--all | ] # Updates datasets and models to the latest version
nebula remove # Removes a specified dataset or model
nebula info # Displays detailed dataset or model information
nebula explore [--filter ] # Interactively explores package data
nebula config --set # Sets a configuration option
nebula config --get # Retrieves a configuration value
nebula sync # Synchronizes local datasets and models with the remote repository
nebula cache clean [--force] # Clears the local dataset and models cache
nebula cache list # Lists cached datasets and models
nebula registry set # Sets the target registry URL
nebula --help # Shows help for a specific command
```
Examples:
```shell
nebula search climate_data # Search for packages related to climate data
nebula install neural_net_model_v2 --version 1.0.1 # Install a specific version of a model
nebula install climate_dataset_2023 # Install the latest version of a dataset
nebula explore climate_data_2023 --filter .temperature # Explore specific data within a dataset
nebula update --all # Update all installed datasets and models
nebula remove outdated_model # Remove an outdated model
nebula info new_dataset # Get detailed info about a new dataset
nebula registry set https://myregistry.example.com # Set the target registry URL
```
## Nebula Registry
The Nebula CLI communicates with the registry via gRPC using Tonic. The registry can be self-hosted if desired and using the CLI we can configure the registry URL.
## Nebula Registry Web
In the far away future we might implement a web interface for the Nebula registry.
## Contributors
The following contributors have either helped to start this project, have contributed
code, are actively maintaining it (including documentation), or in other ways
being awesome contributors to this project. **We'd like to take a moment to recognize them.**
[
](https://github.com/mjovanc)
## License
The BSD 3-Clause License.