{"id":21580983,"url":"https://github.com/minhphan46/ar_object_detection","last_synced_at":"2025-07-04T18:10:58.039Z","repository":{"id":204004952,"uuid":"707562113","full_name":"minhphan46/ar_object_detection","owner":"minhphan46","description":"📱An React Native app powered by the Viro library that detects and displays images and objects in real-time, presenting lifelike 3D models through augmented reality (AR)🕶️","archived":false,"fork":false,"pushed_at":"2024-05-19T18:18:11.000Z","size":185946,"stargazers_count":14,"open_issues_count":1,"forks_count":5,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-11T18:15:54.093Z","etag":null,"topics":["android","ar","augmented-reality","image-detection","object-detection","react-native","typescript","viro","viro-react"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/minhphan46.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-10-20T07:10:32.000Z","updated_at":"2025-04-13T08:05:07.000Z","dependencies_parsed_at":"2024-05-19T18:50:12.630Z","dependency_job_id":null,"html_url":"https://github.com/minhphan46/ar_object_detection","commit_stats":null,"previous_names":["minhphan46/ar_object_detection"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/minhphan46/ar_object_detection","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhphan46%2Far_object_detection","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhphan46%2Far_object_detection/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhphan46%2Far_object_detection/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhphan46%2Far_object_detection/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/minhphan46","download_url":"https://codeload.github.com/minhphan46/ar_object_detection/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhphan46%2Far_object_detection/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263594623,"owners_count":23485877,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["android","ar","augmented-reality","image-detection","object-detection","react-native","typescript","viro","viro-react"],"created_at":"2024-11-24T14:10:34.865Z","updated_at":"2025-07-04T18:10:58.023Z","avatar_url":"https://github.com/minhphan46.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AR App with React Native 😎\n\nThis project is an AR (Augmented Reality) application developed using React Native, designed to integrate AR into navigation and product detection. The app provides an immersive experience by allowing users to detect products and navigate to them using both 2D maps and 3D AR visualizations.\n\nThis is a new [**React Native**](https://reactnative.dev) project, bootstrapped using [`@react-native-community/cli`](https://github.com/react-native-community/cli).\\\nWe use [**Viro library**](https://github.com/viromedia/viro) that detects and displays images and objects in real-time, presenting lifelike 3D models through augmented reality (AR)🕶️\n\n## Technologies\n\n- **React Native**\n- **Viro - AR**\n- **Mapbox**\n- **Redux Toolkit**\n- **Mobile Sensors**\n\n# Video Preview\n\n\u003cp align=\"center\"\u003e\n  \u003cimg width=\"200\" alt=\"detect object\" src=\"./assets/videos/detect_object.gif\"\u003e\n  \u003cimg width=\"200\" alt=\"direction\" src=\"./assets/videos/navigator.gif\"\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg width=\"200\" alt=\"detect object\" src=\"./assets/videos/router.jpg\"\u003e\n  \u003cimg width=\"250\" alt=\"card\" src=\"./assets/images/mocks/bohuc_card.jpg\"\u003e\n  \u003cimg width=\"400\" alt=\"direction\" src=\"./assets/videos/dich_truc.jpg\"\u003e\n\u003c/p\u003e\n\n# Getting Started\n\n\u003e **Note**: Make sure you have completed the [React Native - Environment Setup](https://reactnative.dev/docs/environment-setup) instructions till \"Creating a new application\" step, before proceeding.\n\n## Step 1: Install the dependencies\n\n```bash\n# using npm\nnpm install\n\n# OR using Yarn\nyarn install\n\n# if you can't install, try:\nnpm install --legacy-peer-deps\n```\n\n## Step 2: Start your Application\n\nYou need to use real device to test or run this app.\n\n```bash\n# using npm\nnpm start\n\n# OR using Yarn\nyarn start\n```\n\n## Step 3: Open the App on Your Device:\n\n- For iOS: Use Xcode to open the project and run on a simulator or device.\n- For Android: Use Android Studio or a connected device.\n\n## Main Features\n\n### Detect Products in AR\n\n- **Product Recognition and Information Display**: The app can scan and recognize products, displaying relevant information in AR.\n- **Navigation Using AR**: Users can navigate to the products using both 2D maps and AR 3D paths.\n\n## Detailed Functionality\n\n### Product Recognition and Information Display\n\n- **Product Image Recognition**: Utilizing Viro, the app recognizes product images.\n- **Image Dataset Creation**: A dataset of product images is created for recognition.\n- **AR Information Card Display**: Once a product is recognized, an information card about the product is displayed in AR.\n\n### Navigation Using AR\n\n- **3D Model Display**: AR models are displayed using Viro.\n- **Coordinate Transformation**: Real-world coordinates are converted into AR reference frames.\n- **Mapbox Integration in AR**: Mapbox is integrated to provide navigation routes within the AR environment.\n\n### Steps for Shortest Path Navigation to a Product\n\n1. **Data Initialization**: Collect product data and initialize it on Mapbox.\n2. **Shortest Path Calculation**: Use Dijkstra's algorithm to find the shortest path from the current location to the product.\n3. **Path Visualization**: Draw the navigation path in Viro.\n\n## Challenges\n\n- **Mobile Sensor Optimization**: The current mobile sensors are not fully optimized for AR navigation.\n- **Indoor Positioning**: Accurate indoor positioning remains a significant challenge.\n\n## Contributing\n\nContributions are welcome! Please fork the repository and submit a pull request for any enhancements or bug fixes.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fminhphan46%2Far_object_detection","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fminhphan46%2Far_object_detection","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fminhphan46%2Far_object_detection/lists"}