Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/autodistill/autodistill-gcp-vision

Autodistill Google Cloud Vision module for use in training a custom, fine-tuned model.
https://github.com/autodistill/autodistill-gcp-vision

autodistill google-cloud model-distillation object-detection

Last synced: 3 days ago
JSON representation

Autodistill Google Cloud Vision module for use in training a custom, fine-tuned model.

Awesome Lists containing this project

README 

        


  


    

      

    

  





# Autodistill GCP Vision Module



This repository contains the code supporting the [Google Cloud Object Localization API](https://cloud.google.com/vision/docs/object-localizer#vision_localize_objects-python) base model for use with [Autodistill](https://github.com/autodistill/autodistill).



With this repository, you can label images using the Google Cloud Object Localization API and train a fine-tuned model using the generated labels.



This is ideal if you want to train a model that you own on a custom dataset.



You can then use your trained model on your computer using Autodistill, or at the edge or in the cloud by deploying with [Roboflow Inference](https://inference.roboflow.com).



See our Autodistill modules for [AWS Rekognition](https://github.com/autodistill/autodistill-rekognition) and [Azure Custom Vision](https://github.com/autodistill/autodistill-azure-vision) if you are interested in using those services instead.



Read the full [Autodistill documentation](https://autodistill.github.io/autodistill/).



Read the [GCP Vision Autodistill documentation](https://autodistill.github.io/autodistill/base_models/gcp_vision/).



## Installation



> [!NOTE]  

> Using this project will incur billing charges for API calls to the Google Cloud Object Localization API. Refer to the [Google Cloud Vision pricing](https://cloud.google.com/vision/pricing) for more information. This package makes one API call per image you want to label.



To use the Google Cloud Object Localization API with autodistill, you need to install the following dependency:



```bash

pip install autodistill-gcp-vision

```



You will then need to authenticate with the `gcloud` CLI.



Learn [how to install gcloud](https://cloud.google.com/sdk/docs/install).



Learn [how to set up and authenticate with gcloud](https://cloud.google.com/sdk/docs/initializing).



## Quickstart



```python

from autodistill_gcp_vision import GCPVision

from autodistill.detection import CaptionOntology

import supervision as sv

import cv2



# define an ontology to map class names to our Google Cloud Object Localization API prompt

# the ontology dictionary has the format {caption: class}

# where caption is the prompt sent to the base model, and class is the label that will

# be saved for that caption in the generated annotations

# then, load the model

base_model = GCPVision(

    ontology=CaptionOntology(

        {

            "Person": "Person",

            "a forklift": "forklift"

        }

    )

)



detections = base_model.predict("image.jpeg")

print(detections)



# annotate predictions on an image

classes = base_model.ontology.classes()



box_annotator = sv.BoxAnnotator()



labels = [

	f"{classes[class_id]} {confidence:0.2f}"

	for _, _, confidence, class_id, _

	in detections

]



image = cv2.imread("image.jpeg")



annotated_frame = box_annotator.annotate(

	scene=image.copy(),

	detections=detections,

	labels=labels

)



sv.plot_image(image=annotated_frame, size=(16, 16))

```



## License



This project is licensed under an [MIT license](LICENSE).



## 🏆 Contributing



We love your input! Please see the core Autodistill [contributing guide](https://github.com/autodistill/autodistill/blob/main/CONTRIBUTING.md) to get started. Thank you 🙏 to all our contributors!