https://github.com/autodistill/autodistill-blip
BLIP module for use with Autodistill.
https://github.com/autodistill/autodistill-blip
autodistill blip computer-vision
Last synced: 2 months ago
JSON representation
BLIP module for use with Autodistill.
- Host: GitHub
- URL: https://github.com/autodistill/autodistill-blip
- Owner: autodistill
- License: bsd-3-clause
- Created: 2023-06-12T10:32:23.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2023-12-06T10:43:15.000Z (over 1 year ago)
- Last Synced: 2025-04-14T12:13:16.618Z (2 months ago)
- Topics: autodistill, blip, computer-vision
- Language: Python
- Homepage: https://docs.autodistill.com
- Size: 14.6 KB
- Stars: 5
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Autodistill BLIP Module
This repository contains the code supporting the BLIP base model for use with [Autodistill](https://github.com/autodistill/autodistill).
[BLIP](https://github.com/salesforce/LAVIS), developed by Salesforce, is a computer vision model that supports visual question answering and zero-shot classification. Autodistill supports classifying images using BLIP.
Read the full [Autodistill documentation](https://autodistill.github.io/autodistill/).
Read the [BLIP Autodistill documentation](https://autodistill.github.io/autodistill/base_models/blip/).
## Installation
To use BLIP with autodistill, you need to install the following dependency:
```bash
pip3 install autodistill-blip
```
## Quickstart
```python
from autodistill_blip import BLIP
# define an ontology to map class names to our BLIP prompt
# the ontology dictionary has the format {caption: class}
# where caption is the prompt sent to the base model, and class is the label that will
# be saved for that caption in the generated annotations
# then, load the model
base_model = BLIP(
ontology=CaptionOntology(
{
"person": "person",
"a forklift": "forklift"
}
)
)
base_model.label("./context_images", extension=".jpeg")
```
## License
This project is licensed under a [3-Clause BSD license](LICENSE).
## 🏆 Contributing
We love your input! Please see the core Autodistill [contributing guide](https://github.com/autodistill/autodistill/blob/main/CONTRIBUTING.md) to get started. Thank you 🙏 to all our contributors!