{"id":13488688,"url":"https://soon-yau.github.io/visconet/","last_synced_at":"2025-03-28T01:37:18.992Z","repository":{"id":211629818,"uuid":"728714926","full_name":"soon-yau/visconet","owner":"soon-yau","description":"Official Repo of ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNet","archived":false,"fork":false,"pushed_at":"2024-10-17T23:07:55.000Z","size":170423,"stargazers_count":25,"open_issues_count":0,"forks_count":2,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-10-20T10:19:37.030Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://soon-yau.github.io/visconet/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/soon-yau.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2023-12-07T14:34:51.000Z","updated_at":"2024-10-07T15:18:18.000Z","dependencies_parsed_at":"2024-01-22T16:46:06.650Z","dependency_job_id":"133c811a-24d2-46fa-8091-104750ca512d","html_url":"https://github.com/soon-yau/visconet","commit_stats":null,"previous_names":["soon-yau/visconet"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soon-yau%2Fvisconet","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soon-yau%2Fvisconet/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soon-yau%2Fvisconet/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soon-yau%2Fvisconet/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/soon-yau","download_url":"https://codeload.github.com/soon-yau/visconet/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":222333976,"owners_count":16968058,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T18:01:20.116Z","updated_at":"2025-03-28T01:37:18.987Z","avatar_url":"https://github.com/soon-yau.png","language":"Jupyter Notebook","funding_links":[],"categories":["Additional conditions"],"sub_categories":[],"readme":"## *ViscoNet*: Bridging and Harmonizing Visual and Textual Conditioning for ControlNet\n[Soon Yau Cheong](https://scholar.google.com/citations?user=dRot7GUAAAAJ\u0026hl=en)\n[Armin Mustafa](https://scholar.google.com/citations?user=0xOHqkMAAAAJ\u0026hl=en)\n[Andrew Gilbert](https://scholar.google.com/citations?user=NNhnVwoAAAAJ\u0026hl=en)\n\n\n\u003ca href='https://soon-yau.github.io/visconet/'\u003e\u003cimg src='https://img.shields.io/badge/Project-Page-Green'\u003e\u003c/a\u003e \n\u003ca href='https://arxiv.org/abs/2312.03154'\u003e\u003cimg src='https://img.shields.io/badge/Paper-Arxiv-red'\u003e\u003c/a\u003e \n[![YouTube](https://badges.aleen42.com/src/youtube.svg)](https://youtu.be/3_6Zq3hk86Q)\n\nhttps://github.com/soon-yau/visconet/assets/19167278/ae58b7ab-fa76-4253-8a10-46656f234b20\n\n### Requirements\nA suitable [conda](https://conda.io/) environment named `control` can be created\nand activated with:\n```\nconda env create -f environment.yaml\nconda activate control\n```\n### Files\nAll model and data files are in [here](https://huggingface.co/soonyau/visconet/tree/main).\nIncluding eval.zip containing all images used in human evaluation.\n\n### Gradio App\n[![App](./assets/app.png)](https://youtu.be/3_6Zq3hk86Q)\nrun ```python gradio_visconet.py```\n\n### Citation\n```\n@inproceedings{visconet,\n        author    = {Cheong, Soon Yau and Mustafa, Armin and Gilbert, Andrew},\n        title     = {ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNet},\n        booktitle = {ECCV Workshop Proceedings}\n        month     = {September},\n        year      = {2024}}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/soon-yau.github.io%2Fvisconet%2F","html_url":"https://awesome.ecosyste.ms/projects/soon-yau.github.io%2Fvisconet%2F","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/soon-yau.github.io%2Fvisconet%2F/lists"}