https://github.com/gridaco/context
📖 UI/UX context detection engine
https://github.com/gridaco/context
button-detection context-detection labelling ml nlp tree-analysis ui ui-structure ui-ux ux
Last synced: 2 months ago
JSON representation
📖 UI/UX context detection engine
- Host: GitHub
- URL: https://github.com/gridaco/context
- Owner: gridaco
- License: mit
- Created: 2020-09-19T10:29:50.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-01-03T17:23:11.000Z (over 4 years ago)
- Last Synced: 2024-04-14T05:14:34.830Z (about 1 year ago)
- Topics: button-detection, context-detection, labelling, ml, nlp, tree-analysis, ui, ui-structure, ui-ux, ux
- Homepage: https://bridged.xyz/engine
- Size: 8.79 KB
- Stars: 11
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# context
> A Neural-symbolic engine for understanding UI/UX context.
## Detection & Labelling
- JSON Tree analysis
- Text context detection
- Layout Group of interest clustering
- Button detection
- List detection
- Layout detection
- Graphic element detection
## Button detection
**Method - CV Template matching (text removal postprocessing)**
after removing the text, template matching could give us better accuracy.
**Method - Tree Analysis (rule based)**
With givven ui json tree, we analyze the position, alignment, the content of the button label's text to check if it is in *Verb* form.
**Reflect Button Manipulation (Reverse Enginerring / ML)**
With Reflect's Button system spec definition, we generate millions of possible button form, Train it, and use them for existing design's button detection.
**Visibility Score (CV)**
The score of specific element, which looks like pressable. Color Visibility, EM level, and more.
**Context Score (NLP)**
Simple NLP and with ui text content classification, we can score the content is likey to be a button text.
## Icons 2 vec (Icon classification)
icon (vision based) classification and positioning on vector space indicating it's semantic space
## Data set
## Making your own dataset
Label your design with [Bridged's Labeller](https://github.com/bridgedxyz/ui-labeller)