https://github.com/apsdehal/flava-tutorials
Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
https://github.com/apsdehal/flava-tutorials
Last synced: 8 months ago
JSON representation
Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
- Host: GitHub
- URL: https://github.com/apsdehal/flava-tutorials
- Owner: apsdehal
- Created: 2022-06-22T19:00:45.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2022-06-22T20:30:08.000Z (almost 4 years ago)
- Last Synced: 2025-01-31T16:51:29.639Z (over 1 year ago)
- Language: Jupyter Notebook
- Size: 2.5 MB
- Stars: 12
- Watchers: 3
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# FLAVA Tutorials
This repository contains tutorials for FLAVA model introduced [here](https://arxiv.org/abs/2112.04482). The model is available on Hugging Face hub at [https://huggingface.co/facebook/flava-full](https://huggingface.co/facebook/flava-full).
1. [Interact with FLAVA](./flava-interact.ipynb) 
1. [WinoGround FLAVA Example](./winoground-flava-example.ipynb)
1. [Zero-Shot on ImageNet](./imagenet-zeroshot.ipynb)
1. Zero-Shot on GLUE [to be added soon]
1. Linear Probe on Vision tasks [to be added soon]
1. Fine-tune on custom task [to be added soon]
Some of these notebooks are inspired from notebook introduced by CLIP.