https://github.com/kevinzakka/clip_playground

An ever-growing playground of notebooks showcasing CLIP's impressive zero-shot capabilities
https://github.com/kevinzakka/clip_playground

colab-notebook deep-learning openai vision-and-language

Last synced: about 2 months ago
JSON representation

An ever-growing playground of notebooks showcasing CLIP's impressive zero-shot capabilities

• Host: GitHub
• URL: https://github.com/kevinzakka/clip_playground
• Owner: kevinzakka
• License: mit
• Created: 2021-07-25T01:38:41.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2022-07-27T19:56:27.000Z (about 2 years ago)
• Last Synced: 2024-06-08T04:31:56.116Z (3 months ago)
• Topics: colab-notebook, deep-learning, openai, vision-and-language
• Language: Jupyter Notebook
• Homepage: https://blog.kzakka.com/posts/clip/
• Size: 11.3 MB
• Stars: 142
• Watchers: 4
• Forks: 12
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Citation: CITATION.cff

Awesome Lists containing this project

README

        
# Playground for CLIP-like models

| Demo  | Colab Link |

| ------------- | ------------- |

| GradCAM Visualization  |  [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kevinzakka/clip_playground/blob/main/CLIP_GradCAM_Visualization.ipynb)  |

| Naive Zero-shot Detection  | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kevinzakka/clip_playground/blob/main/CLIP_Patch_Detection.ipynb)  |

| Smarter Zero-shot Detection  | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kevinzakka/clip_playground/blob/main/CLIP_Zero_shot_Detector.ipynb)  |

| Captcha Solver  | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kevinzakka/clip_playground/blob/main/CLIP_reCAPTCHA.ipynb) |

If you find this playground useful, consider citing it:

```bibtex

@software{zakka2021clipplayground,

    author = {Zakka, Kevin},

    month = {7},

    title = {{A Playground for CLIP-like Models}},

    url = {https://github.com/kevinzakka/clip_playground},

    version = {0.0.1},

    year = {2021}

}

```

## Changelog

### 2021-07-28

* Better plotting for reCAPTCHA.

### 2021-07-27

* Allow multiple captions in detection query, colon separated.

* Allow the user to resize an image during selective search.

* Tuned the rejection parameters of selective search.

* Minor bugfix in naive patch detector.