{"id":15158128,"url":"https://github.com/jamnicki/metin2_vision_bot","last_synced_at":"2025-04-02T07:31:23.398Z","repository":{"id":227159951,"uuid":"765800072","full_name":"jamnicki/metin2_vision_bot","owner":"jamnicki","description":"Automatic MMORPG Bot for Dungeons Massive Passing based on Windows API, YoloV8 object detection, statistical methods from OpenCV, Tesseract-OCR and spaCy virtualised on Hyper-V, Win11+CUDA","archived":false,"fork":false,"pushed_at":"2024-04-03T16:03:03.000Z","size":427883,"stargazers_count":6,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-16T15:53:56.813Z","etag":null,"topics":["computer-vision","object-detection","opencv","spacy","tesseract-ocr","torchvision","ultralytics","win32"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jamnicki.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-01T16:33:26.000Z","updated_at":"2025-03-02T08:19:24.000Z","dependencies_parsed_at":"2024-04-03T17:00:50.720Z","dependency_job_id":null,"html_url":"https://github.com/jamnicki/metin2_vision_bot","commit_stats":null,"previous_names":["jamnicki/metin2_vision_bot"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jamnicki%2Fmetin2_vision_bot","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jamnicki%2Fmetin2_vision_bot/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jamnicki%2Fmetin2_vision_bot/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jamnicki%2Fmetin2_vision_bot/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jamnicki","download_url":"https://codeload.github.com/jamnicki/metin2_vision_bot/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246774595,"owners_count":20831572,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","object-detection","opencv","spacy","tesseract-ocr","torchvision","ultralytics","win32"],"created_at":"2024-09-26T20:40:26.778Z","updated_at":"2025-04-02T07:31:18.385Z","avatar_url":"https://github.com/jamnicki.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Metin2 (MMORPG) Vision Bot\n\nAutomatic Bot for Massive Dungeons Passing based on Windows API, YoloV8 object detection, statistical methods from OpenCV, Tesseract-OCR and spaCy virtualised with Hyper-V (Win11+CUDA)\n\n## Demo\n\n\u003cdiv align=\"center\"\u003e\n    \u003cvideo src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/3a4a4a4a-a1ac-4911-8ce1-5cf917d08e7d\u003e\n\u003c/div\u003e\n\u003cdiv align=\"center\"\u003e\n    \u003cvideo src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/9984878b-9811-406f-bfc2-4f3c30795f69\u003e\n\u003c/div\u003e\n\u003cdiv align=\"center\"\u003e\n    \u003cvideo src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/62987cd4-6f0f-419f-b636-24daa029de3b\u003e\n\u003c/div\u003e\n\n\n## Key Packages\n- Keyboard and Mouse controll: `pynput`\n- Custom Data Annotation: `Roboflow`\n- Object detection: `ultralytics`, `OpenCV`\n- Messages handling: `Tesseract-OCR`, `spaCy`\n\n## Funcionalities\n- Autonomic Dungeon Passing\n- Autonomic Metin Stones Destroying among all of the channels\n- Idle Exp\n\n\u003e All of those modes can handle boundary situations such as game crash or logging out.\n\n## YoloV8\n\nModel prepared with Ultralytics YOLOv8.0.196 🚀 Python-3.10.12 torch-2.1.0+cu121 CUDA:0 (Tesla T4, 15102MiB)\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg width=80% src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/2316a2b4-4551-4572-8825-f70b270ffd51\u003e\n\u003c/div\u003e\n\n\u003cbr\u003e\n\n| Class | Images | Instances | Precision* | Recall* | mAP50* | mAP50-95* |\n|-|:-:|-:|-:|-:|-:|-:|\n| all | 31 | 36 | 0.993 | 0.939 | 0.974 | 0.828 |\n| boss_gnoll_cpt | 31 | 11 | 0.983 | 0.818 | 0.931 | 0.739 |\n| metin_polany | 31 | 12 | 0.996 | 1 | 0.995 | 0.867 |\n| npc_straznik | 31 | 13 | 0.999 | 1 | 0.995 | 0.877 |\n\n\u003e \\* - Box level\n\n\u003cbr\u003e\n\n\u003cdiv align=\"center\"\u003e\n    \u003cimg width=70% src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/36d47e7a-ce6a-40ab-a71c-dcb0216e4333\u003e\n\u003c!--     \u003cimg width=70% src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/34e5c6af-0377-40f9-b923-cab9951ffb1a\u003e --\u003e\n\u003c/div\u003e\n\n\n## Custom Dataset\n[Roboflow Dataset Overview](https://universe.roboflow.com/metin2visionbot/mt2-valium-polana) (316 images, 800x600)\n\n### Augmentation\n- Outputs per training example: 3\n- Flip: Horizontal\n- Blur: Up to 1px\n\n### Annotation Heatmap\n\n\u003cimg width=30% src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/9bdaacb1-6317-49c5-9017-83fe09758871\u003e\n\n## Direction Recognition\n\nGrayscale Threshold, Contours Recognition and not triangular shape filter\n\n\u003cimg width=60% src=https://github.com/jamnicki/metin2_vision_bot/assets/56606076/2b024e26-d2b6-4dfc-b757-8db8de789faf\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjamnicki%2Fmetin2_vision_bot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjamnicki%2Fmetin2_vision_bot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjamnicki%2Fmetin2_vision_bot/lists"}