{"id":27957627,"url":"https://github.com/laion-ai/laionide","last_synced_at":"2025-10-14T07:34:35.773Z","repository":{"id":47372407,"uuid":"494097839","full_name":"LAION-AI/laionide","owner":"LAION-AI","description":"This repository contains training code and checkpoitns for finetuning glide.","archived":false,"fork":false,"pushed_at":"2022-08-17T22:52:01.000Z","size":23891,"stargazers_count":11,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-05-07T18:13:52.405Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/LAION-AI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-05-19T14:06:19.000Z","updated_at":"2024-10-07T10:22:35.000Z","dependencies_parsed_at":"2022-08-23T11:11:02.629Z","dependency_job_id":null,"html_url":"https://github.com/LAION-AI/laionide","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/LAION-AI/laionide","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LAION-AI%2Flaionide","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LAION-AI%2Flaionide/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LAION-AI%2Flaionide/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LAION-AI%2Flaionide/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/LAION-AI","download_url":"https://codeload.github.com/LAION-AI/laionide/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LAION-AI%2Flaionide/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279018221,"owners_count":26086307,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-14T02:00:06.444Z","response_time":60,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-05-07T18:13:50.827Z","updated_at":"2025-10-14T07:34:35.758Z","avatar_url":"https://github.com/LAION-AI.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# laionide \n\nShout out to stability.ai for donating the compute to [laion](https://discord.gg/8pSACZJk) needed for this to be possible.\n\n## Laionide (v3)\n\nComparison:\n\nOpenAI `glide-base-filtered` (top) and `laionide-v3` (bottom).\n\n![](/compare.png)\n\n\u003e \"People are walking with umbrellas in the rain\" \n\nFiles:\n- [laionide-v3-base.pt](https://github.com/afiaka87/laionide/releases/download/Checkpoints/laionide-v3-base.pt)\n\nInference:\n- [replicate](https://replicate.com/laion-ai/laionide-v3)\n- [colab](https://gist.github.com/laion-ai/8655b15c94bf0e80f586ce54cfe39ab5#file-laionide-v3-ipynb)\n- [locally](https://github.com/laion-ai/pyglide)\n\nResults:\n- [comparison to openai W\u0026B report](https://wandb.ai/afiaka87/laionide-v3-glide/reports/Laionide-Version-3-Benchmark--VmlldzoxNjE0MTE3)\n\nNotes:\n- You can use `laionide-v2-sr.pt` to upscale the outputs from `laionide-v3-base.pt`.\n- There are watermarks in some outputs. You can try to prompt engineer this away, but it isn't always possible. `royalty free` seems to work well. \n\nTraining details:\n- finetuned `laionide-v2-base.pt` for 9 epochs on a subset of CC12M (~1.5 million pairs), COCO (~100K pairs), virtual genome (~100K pairs), and open images localized annotations (~800K pairs). \n- 20% of unconditional/empty token, per the paper.\n\n## Laionide (v2)\n\nFiles:\n- [laionide-v2-base.pt](https://github.com/afiaka87/laionide/releases/download/Checkpoints/laionide-v2-base.pt)\n- [laionide-v2-sr.pt](https://github.com/afiaka87/laionide/releases/download/Checkpoints/laionide-v2-sr.pt)\n\nInference:\n- [replicate](https://replicate.com/laion-ai/laionide-v2)\n\nTraining details:\n- Data was removed from training given any of the following:\n- Value of 'NSFW' or 'LIKELY' in the nsfw column from LAION's metadata (better than nothing)\n- Images which originally had an aspect ratio greater than 1.3 (or) less than 0.8\n- The original width or original height is less than 256 pixels.\n- Captions were checked against a list of slurs. If a slur is in the caption, it is removed. I won't be publishing the slurs.\n\n\n## Laionide (v1)\n\nFiles (Links currently broken)\n- https://www.dropbox.com/s/mchzd28p9ees0db/laionide-base.pt\n- https://www.dropbox.com/s/7cxn0gelotpocun/laionide-upsample.pt\n\nTraining details\n\n- GLIDE finetune on laion over both the base model \n- 1M captions seen for 2 epochs with 20% chance of unconditional token\n- Upsample model sees 200K samples.\n\nInference\n- [colab](https://gist.github.com/afiaka87/5f64e4de49b50554270a0a6ece243014#file-laionide-ipynb)\n- [replicate](https://replicate.com/laion-ai/laionide)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flaion-ai%2Flaionide","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flaion-ai%2Flaionide","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flaion-ai%2Flaionide/lists"}