Projects in Awesome Lists by zer0int
A curated list of projects in awesome lists by zer0int .
https://github.com/zer0int/clip-fine-tune
Fine-tuning code for CLIP models
clip comfyui fine-tune fine-tuning finetune openai sdxl textencoder
Last synced: 28 Apr 2025
https://github.com/zer0int/comfyui-hunyuanvideo-nyan
Text Encoders finally matter 🤖🎥 - scale CLIP & LLM influence! + a Nerdy Transformer Shuffle node
clip comfyui comfyui-nodes hunyuan hunyuan-video llm t2v text-encoder
Last synced: 15 Feb 2025
https://github.com/zer0int/clip-xai-gui
CLIP GUI - XAI app ~ explainable (and guessable) AI with ViT & ResNet models
attention attention-visualization clip game gradient-ascent gui image-to-text vision-transformer vit xai
Last synced: 28 Apr 2025
https://github.com/zer0int/comfyui-nuke-a-text-encoder
For SDXL, SD1.5, Flux. Nuke T5 and let CLIP guide Flux.1 on its own! Or let let random guide Flux.1! Or load a CLIP crazy opinion embedding about your image and let that guide the AI!
clip comfyui comfyui-nodes embeddings flux1 remove sdxl t5 text-encoder
Last synced: 30 Apr 2025
https://github.com/zer0int/clip-sae-finetune
Sparse Autoencoders (SAE) vs CLIP fine-tuning fun.
adversarial-attacks adversarial-learning clip fine-tune fine-tuning finetune sae sparse-autoencoder vision-transformer vit
Last synced: 30 Apr 2025
https://github.com/zer0int/clip-vit-visualization
What do CLIP Vision Transformers learn? Feature Visualization can show you!
activation clip feature neuron vision-transformer visualization vit xai
Last synced: 28 Apr 2025
https://github.com/zer0int/clip-text-image-interpretability
Get CLIP ViT text tokens about an image, visualize attention as a heatmap.
attention-visualization clip gradient-ascent heatmap image-to-text vit xai
Last synced: 02 Jan 2025
https://github.com/zer0int/clip-gradient-ascent-embeddings
Use CLIP to create matching texts + embeddings for given images; useful for XAI, adversarial training
adversarial-attacks adversarial-examples clip contrastive-language-image-pretraining embeddings gradient-ascent text-embeddings text-image typographic-attack
Last synced: 30 Apr 2025
https://github.com/zer0int/comfyui-llama3-layer-shuffle-prompting
Shuffle LLama-3.2 layers and have it prompt an image. Node works with any model - Flux, SD3, SDXL...
comfyu-nodes comfyui experimental flux instruct layer llama3 llama3-2 llm prompting research sd3 sdxl shuffle
Last synced: 19 Apr 2025
https://github.com/zer0int/clip-deepdream
Deep Dreaming with CLIP Vision Transformers
ai aiart clip deep deepdream deepdream-maker deepdreamgenerator dream explainable-ai vision-transformer vit xai
Last synced: 28 Apr 2025
https://github.com/zer0int/clip-layer-deck-shuffle
Experimental removal / shuffling of layers in CLIP ViT + Text Transformer
ai clip layer visiontransformer xai
Last synced: 02 Jan 2025
https://github.com/zer0int/comfyui-workflows
Workflows to implement fine-tuned CLIP Text Encoders with ComfyUI / SD, SDXL, SD3
Last synced: 22 Feb 2025
https://github.com/zer0int/clip-tokenizer
A simple CLIP tokenizer encode / decode script. For when you need to know CLIP's tokenization and / or token IDs for some reason.
Last synced: 02 Jan 2025
https://github.com/zer0int/clip-generative-adversarial
Projected Gradient Descent (PGD), inverted and amplified -> prompt & generate images with CLIP
adversarial adversarial-attacks adversarial-examples ai clip generative generative-ai pgd vision-transformer xai
Last synced: 22 Feb 2025
https://github.com/zer0int/clip-xai-game
Playing by AI's rules - Matching Pairs / Memory with CLIP Cosine Similarity!
clip cosine-similarity game gui matching-pairs memory python xai
Last synced: 22 Feb 2025
https://github.com/zer0int/bitsandbytes-windows
Windows bitsandbytes 0.44.1.dev0 for Python 3.10, CUDA 12.6
Last synced: 13 Mar 2025
https://github.com/zer0int/clip-attention-entropy
A small script for CLIP attn entropy plots
attention clip contrastive-learning entropy plot text-image transformer visualization vit
Last synced: 22 Feb 2025
https://github.com/zer0int/clip-ringelpiez
Plotting a CLIP vs. a CLIP in arbitrary ways.
Last synced: 22 Feb 2025
https://github.com/zer0int/golden-gate-clip
Like Golden Gate Claude, but with a CLIP Vision Transformer ~ feature activation manipulation fun!
activation clip explainable-ai goldengate gradient-ascent manipulation visiontransformer xai
Last synced: 22 Feb 2025
https://github.com/zer0int/gpt-4-tiktoken-tokens-etc
Extracted from OpenAI/tiktoken
Last synced: 22 Feb 2025
https://github.com/zer0int/llmorse
Talk Morse code to multimodal LLM using your voice. Beep-boop!
audio avm gpt4o hallucination morse morse-code morse-code-translator multimodal voice
Last synced: 14 Mar 2025
https://github.com/zer0int/auto-gpt-sd-vision-alpha
Too messy to bother with as-is, probably. Only works with v0.2.2 of Auto-GPT.
Last synced: 22 Feb 2025
https://github.com/zer0int/clip-text-to-image
CLIP guiding self towards an image, from text prompt
ascending-vit clip experimental gradient-ascent vit
Last synced: 22 Feb 2025
https://github.com/zer0int/clip-fine-tune-registers-gated
Vision Transformers Needs Registers. And Gated MLPs. And +20M params. Tiny modality gap ensues!
clip comfyui fine-tune finetune flux1 gated gelu register-tokens registers relu text-to-image transformers vision
Last synced: 11 Mar 2025
https://github.com/zer0int/clip-direct-ascent-synthesis
Like a CLIP + VQGAN. Except without a VQGAN.
Last synced: 02 Mar 2025
https://github.com/zer0int/clip-interrogator-longclip-hallucinwords
CLIP Interrogator, fully in HuggingFace Transformers 🤗, with LongCLIP & CLIP's own words and / or *your* own words!
blip blip2 captioning-images clip clip-interrogator gradient-ascent interrogator longclip
Last synced: 13 Mar 2025