https://github.com/allenai/prior
🐍 A Python Package for Seamless Data Distribution in AI Workflows
https://github.com/allenai/prior
ai2thor artificial-intelligence datasets deep-learning
Last synced: 9 months ago
JSON representation
🐍 A Python Package for Seamless Data Distribution in AI Workflows
- Host: GitHub
- URL: https://github.com/allenai/prior
- Owner: allenai
- License: apache-2.0
- Created: 2022-05-29T22:47:16.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2023-11-30T18:14:41.000Z (over 2 years ago)
- Last Synced: 2025-09-23T11:27:17.563Z (10 months ago)
- Topics: ai2thor, artificial-intelligence, datasets, deep-learning
- Language: Python
- Homepage:
- Size: 55.9 MB
- Stars: 26
- Watchers: 5
- Forks: 3
- Open Issues: 14
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Citation: CITATION.cff
Awesome Lists containing this project
README
🐍 PRIOR
A Python Package for Seamless Data Distribution in AI Workflows
## Installation
Install the `prior` package with pip:
```bash
pip install prior
```
## Datasets
- ProcTHOR-10k [[GitHub]](https://github.com/allenai/procthor-10k)
```python
import prior
prior.load_dataset("procthor-10k")
```
- Object Nav Evaluation [[GitHub]](https://github.com/allenai/object-nav-eval)
```python
import prior
prior.load_dataset("object-nav-eval")
```
## Models
- ProcTHOR Models [[GitHub]](https://github.com/allenai/procthor-models)
```python
import prior
prior.load_model(project="procthor-models", model="object-nav-pretraining")
```
## Example Usage
To use a public Python dataset, simply run:
```python
import prior
dataset = prior.load_dataset("test-dataset", entity="mattdeitke", revision="main")
```
Here, `revision` can be either a tag, branch, or commit hash.
## Private Datasets
If you want to use a private dataset, make sure you're either:
1. Already logged into GitHub from the command line, and able to pull a private repo.
2. Set the GITHUB_TOKEN environment variable to a GitHub authentication token with read access to private repositories (e.g., `export GITHUB_TOKEN=`). You can generate a GitHub authentication token [here](https://github.com/settings/tokens).
3. Set the `gh_auth_token` global variable in the `prior` package with:
```python
import prior
prior.gh_auth_token = ""
```
## Citation
To cite the PRIOR package, please use:
```bibtex
@software{prior,
author={Matt Deitke and Aniruddha Kembhavi and Luca Weihs},
doi={10.5281/zenodo.7072830},
title={{PRIOR: A Python Package for Seamless Data Distribution in AI Workflows}},
url={https://github.com/allenai/prior},
year={2022}
}
```