{"id":16683779,"url":"https://github.com/apollozhu/ar-lipstick","last_synced_at":"2025-09-11T09:35:48.072Z","repository":{"id":65940475,"uuid":"192637544","full_name":"ApolloZhu/AR-Lipstick","owner":"ApolloZhu","description":"ARKit/FirebaseMLVision based virtual lipstick. TRY IT:","archived":false,"fork":false,"pushed_at":"2021-09-28T07:26:40.000Z","size":3818,"stargazers_count":73,"open_issues_count":2,"forks_count":13,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-04-03T23:31:58.586Z","etag":null,"topics":["arkit","augmented-reality","face-detection","firebase","hacktoberfest","ios","lipstick","makeup","mlkit","swift","vision","youtube"],"latest_commit_sha":null,"homepage":"https://apollozhu.github.io/AR-Lipstick/beta","language":"Swift","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ApolloZhu.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-06-19T01:37:37.000Z","updated_at":"2025-02-24T09:02:55.000Z","dependencies_parsed_at":"2023-02-17T11:25:12.885Z","dependency_job_id":null,"html_url":"https://github.com/ApolloZhu/AR-Lipstick","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ApolloZhu/AR-Lipstick","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ApolloZhu%2FAR-Lipstick","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ApolloZhu%2FAR-Lipstick/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ApolloZhu%2FAR-Lipstick/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ApolloZhu%2FAR-Lipstick/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ApolloZhu","download_url":"https://codeload.github.com/ApolloZhu/AR-Lipstick/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ApolloZhu%2FAR-Lipstick/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":274609465,"owners_count":25316621,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-11T02:00:13.660Z","response_time":74,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["arkit","augmented-reality","face-detection","firebase","hacktoberfest","ios","lipstick","makeup","mlkit","swift","vision","youtube"],"created_at":"2024-10-12T14:26:06.688Z","updated_at":"2025-09-11T09:35:48.031Z","avatar_url":"https://github.com/ApolloZhu.png","language":"Swift","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AR Lipstick\n\n## [Download beta on TestFlight](https://testflight.apple.com/join/IL5MiSG6)\n\nARKit/MLKit Face Detection based virtual lipstick.\n\n## ARKit\n\nRequires iPhone X/XR/XS/XS Max, iPad Pro (11-inch), iPad Pro (12.9-inch, 3rd generation), or other iOS devices with front-facing TrueDepth camera running iOS 11.0 or later.\n\nMainly based on Apple’s sample code [Tracking and Visualizing Faces](https://developer.apple.com/documentation/arkit/tracking_and_visualizing_faces).\nSupport for multiple faces is not yet verified, but it should work (I hope).\n\nI modified the original wireframe to only mask where the lips are, but it’s not very precise.\nHere’s the **preview** of the [full size wireframe texture](assets/wireframeTexture.png) for you to make your own,\nprobably more precise mask:\n\n[![Face Wireframe](assets/wireframePreview.png)](assets/wireframeTexture.png)\n\n## MLKit Face Detection\n\nFor other devices not having ARKit face detector, we'll use MLKit to trace facial contours, like this:\n\n![FirebaseMLVision Face Contours](https://developers.google.com/ml-kit/vision/face-detection/images/face_contours.svg)\n\nI highly recommend checking out the [official documentation](https://developers.google.com/ml-kit/vision/face-detection) for more instructions.\n\n### Vision\n\nI tried the Apple provided Vision.framekwork, but it can only generate a ***LOW QUALITY*** outline for lips.\nIt's not suitable for the purpose of this app, but if you are interested in using it for some other features,\nsee [VNFaceLandmarks2D](https://developer.apple.com/documentation/vision/vnfacelandmarks2d) for details.\n\n## Acknowledgements\n\nList of lipstick colors (and their names/brands in Chinese) are from [Ovilia/lipstick](https://github.com/Ovilia/lipstick).\n\nI never figured out how and if [grizzly3ear/lipster-mobile](https://github.com/grizzly3ear/lipster-mobile) works,\nbut it does point me to Vision.framework and FirebaseMLVision (predecessor of MLKit Face Detection).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapollozhu%2Far-lipstick","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapollozhu%2Far-lipstick","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapollozhu%2Far-lipstick/lists"}