{"id":17603111,"url":"https://github.com/yjg30737/pyqt-text-generation-inference-gui","last_synced_at":"2025-04-13T09:20:59.509Z","repository":{"id":191808836,"uuid":"685442903","full_name":"yjg30737/pyqt-text-generation-inference-gui","owner":"yjg30737","description":"GUI version of text-generation-inference","archived":false,"fork":false,"pushed_at":"2023-09-01T00:00:28.000Z","size":15,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-27T00:54:55.593Z","etag":null,"topics":["huggingface","pyqt","pyqt5","text-generation","text-generation-inference","text-generation-webui"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yjg30737.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-08-31T08:37:12.000Z","updated_at":"2023-09-01T20:07:50.000Z","dependencies_parsed_at":"2023-10-11T09:02:11.746Z","dependency_job_id":null,"html_url":"https://github.com/yjg30737/pyqt-text-generation-inference-gui","commit_stats":{"total_commits":6,"total_committers":1,"mean_commits":6.0,"dds":0.0,"last_synced_commit":"0a0bb2dfb79bd4b73fed6c6106fcf928e364776f"},"previous_names":["yjg30737/pyqt-text-generation-inference-gui"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yjg30737%2Fpyqt-text-generation-inference-gui","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yjg30737%2Fpyqt-text-generation-inference-gui/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yjg30737%2Fpyqt-text-generation-inference-gui/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yjg30737%2Fpyqt-text-generation-inference-gui/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yjg30737","download_url":"https://codeload.github.com/yjg30737/pyqt-text-generation-inference-gui/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248689272,"owners_count":21145902,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["huggingface","pyqt","pyqt5","text-generation","text-generation-inference","text-generation-webui"],"created_at":"2024-10-22T13:39:57.837Z","updated_at":"2025-04-13T09:20:59.481Z","avatar_url":"https://github.com/yjg30737.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# pyqt-text-generation-inference-gui\nGUI version of text-generation-inference\n\nMy computer is not good enough to test this out (because my good old pal OutOfMemoryError!), so how about you try this?\n\n## Requirements\n* PyQt5\u003e=5.14 (for GUI)\n* ansi2html (for showing colorful console)\n* text_generation (for using text-generation-inference)\n\n## How to Use\n\nBefore using this, you need to install Docker Desktop and run it. This will not work if you don't have it\n\n1. clone this!\n2. pip install -r requirements.txt\n3. cd src\n4. python main.py\n\nAdd any models that you want to use in main.py. It shows in \"Model\" combobox. You can see the combobox in \"Result\" section below.\n\n![image](https://github.com/yjg30737/pyqt-text-generation-inference-gui/assets/55078043/a6825e5f-0433-4053-a80b-214e05282f6a)\n\n#### You need Access Tokens if you want to test llama2, falcon, etc. \n\n## Result\n\n![image](https://github.com/yjg30737/pyqt-text-generation-inference-gui/assets/55078043/58bd221a-bd7b-4c09-b170-ac694538a776)\n\n![image](https://github.com/yjg30737/pyqt-text-generation-inference-gui/assets/55078043/cbd168bd-7e7b-446f-8e16-41530b3223c4)\n\nI'm using bigscience/bloom-560m in this example. \n\n## TroubleShooting\n### Server is not running?\n\nThis error indicates that 127.0.0.1:8080 is not running. Run the docker-desktop, \n\nsearch the port with\n\nnetstat -ano | findstr 8080 \n\nand remove any service \u0026 software which port 8080 is allocated.\n\n## Note\n\nThis project is not complete, but i probably rarely touch this one, so i need collaborator :)\n\nIf you want to collaborate feel free to join. I want to work with a team, please.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyjg30737%2Fpyqt-text-generation-inference-gui","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyjg30737%2Fpyqt-text-generation-inference-gui","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyjg30737%2Fpyqt-text-generation-inference-gui/lists"}