An open API service indexing awesome lists of open source software.

https://github.com/laion-ai/gif

General / Global Inference Framework
https://github.com/laion-ai/gif

Last synced: 4 months ago
JSON representation

General / Global Inference Framework

Awesome Lists containing this project

README

          

# GIF
General / Global Inference Framework

## Outline

- 1. Define models you want to use including preprocessors
- 2. Select input format (e.g., webdataest)
- 3. Run distributed inference (including multinode / sbatch support)
- 4. Save to parquets / upload to S3

## Quickguide

Currently, only WebDataset format as input is supported.

- 1. git clone this repository
- 2. set your configuration in config.py
- 3. python3 main.py