{"id":19881029,"url":"https://github.com/gridaco/context","last_synced_at":"2025-06-28T17:08:10.953Z","repository":{"id":108795936,"uuid":"296843361","full_name":"gridaco/context","owner":"gridaco","description":"📖 UI/UX context detection engine","archived":false,"fork":false,"pushed_at":"2021-01-03T17:23:11.000Z","size":9,"stargazers_count":11,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-31T05:57:58.024Z","etag":null,"topics":["button-detection","context-detection","labelling","ml","nlp","tree-analysis","ui","ui-structure","ui-ux","ux"],"latest_commit_sha":null,"homepage":"https://bridged.xyz/engine","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gridaco.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2020-09-19T10:29:50.000Z","updated_at":"2024-01-19T16:26:08.000Z","dependencies_parsed_at":"2023-06-05T05:45:27.560Z","dependency_job_id":null,"html_url":"https://github.com/gridaco/context","commit_stats":{"total_commits":9,"total_committers":1,"mean_commits":9.0,"dds":0.0,"last_synced_commit":"3cf1bf477a16d7a4f8035047ccf10b8ceabb5e87"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gridaco%2Fcontext","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gridaco%2Fcontext/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gridaco%2Fcontext/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gridaco%2Fcontext/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gridaco","download_url":"https://codeload.github.com/gridaco/context/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gridaco%2Fcontext/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":258141706,"owners_count":22656412,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["button-detection","context-detection","labelling","ml","nlp","tree-analysis","ui","ui-structure","ui-ux","ux"],"created_at":"2024-11-12T17:13:02.730Z","updated_at":"2025-06-28T17:08:10.934Z","avatar_url":"https://github.com/gridaco.png","language":null,"readme":"# context\n\u003e A Neural-symbolic engine for understanding UI/UX context.\n\n\n## Detection \u0026 Labelling\n\n- JSON Tree analysis\n- Text context detection\n- Layout Group of interest clustering\n- Button detection\n- List detection\n- Layout detection\n- Graphic element detection\n\n\n## Button detection\n**Method - CV Template matching (text removal postprocessing)**\n\nafter removing the text, template matching could give us better accuracy.\n\n\n**Method - Tree Analysis (rule based)**\n\nWith givven ui json tree, we analyze the position, alignment, the content of the button label's text to check if it is in *Verb* form.\n\n\n**Reflect Button Manipulation (Reverse Enginerring / ML)**\n\nWith Reflect's Button system spec definition, we generate millions of possible button form, Train it, and use them for existing design's button detection.\n\n\n**Visibility Score (CV)**\n\nThe score of specific element, which looks like pressable. Color Visibility, EM level, and more.\n\n\n**Context Score (NLP)**\n\nSimple NLP and with ui text content classification, we can score the content is likey to be a button text.\n\n\n## Icons 2 vec (Icon classification)\nicon (vision based) classification and positioning on vector space indicating it's semantic space\n\n\n\n## Data set\n\n## Making your own dataset\n\nLabel your design with [Bridged's Labeller](https://github.com/bridgedxyz/ui-labeller)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgridaco%2Fcontext","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgridaco%2Fcontext","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgridaco%2Fcontext/lists"}