{"id":18233262,"url":"https://github.com/jjateen/ar-iot","last_synced_at":"2026-01-26T21:52:41.237Z","repository":{"id":261058069,"uuid":"874910025","full_name":"Jjateen/AR-IoT","owner":"Jjateen","description":" This repository showcases AR-IoT, a cutting-edge project that combines Augmented Reality (AR) and the Internet of Things (IoT) using Unity, Vuforia, and the ESP32. Experience real-time sensor control and data visualization through interactive virtual buttons and seamless cloud connectivity.","archived":false,"fork":false,"pushed_at":"2024-11-04T12:58:03.000Z","size":8958,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-25T01:51:09.094Z","etag":null,"topics":["augmented-reality","blynk","blynk-iot-platform","esp32","unity","unity3d","vuforia"],"latest_commit_sha":null,"homepage":"","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Jjateen.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-18T17:28:20.000Z","updated_at":"2024-11-04T12:58:06.000Z","dependencies_parsed_at":"2024-11-04T13:40:13.652Z","dependency_job_id":null,"html_url":"https://github.com/Jjateen/AR-IoT","commit_stats":null,"previous_names":["jjateen/ar-iot"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jjateen%2FAR-IoT","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jjateen%2FAR-IoT/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jjateen%2FAR-IoT/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jjateen%2FAR-IoT/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Jjateen","download_url":"https://codeload.github.com/Jjateen/AR-IoT/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248339262,"owners_count":21087214,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["augmented-reality","blynk","blynk-iot-platform","esp32","unity","unity3d","vuforia"],"created_at":"2024-11-04T15:03:31.685Z","updated_at":"2026-01-26T21:52:36.215Z","avatar_url":"https://github.com/Jjateen.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AR-IoT: Augmented Reality Meets the Internet of Things\n\nWelcome to **AR-IoT**, an innovative project that bridges the world of Augmented Reality (AR) and the Internet of Things (IoT) using **Unity**, **Vuforia**, and the **ESP32** microcontroller. This project aims to provide a seamless and interactive experience for controlling and visualizing sensor data in real-time, utilizing the power of virtual buttons and cloud-based connectivity.\n\n## Table of Contents\n- [Overview](#overview)\n- [Features](#features)\n- [Technology Stack](#technology-stack)\n- [Setup Instructions](#setup-instructions)\n- [Script Descriptions](#script-descriptions)\n- [Project Structure](#project-structure)\n- [Future Work](#future-work)\n- [Demo](#demo)\n\n## Overview\n**AR-IoT** demonstrates the integration of AR and IoT in a single cohesive system. With **Vuforia** and **Unity**, the project overlays virtual buttons onto a target plane, allowing users to interact with sensor data or control actuators visually. The **ESP32**, in conjunction with **Blynk 2.0**, provides a robust framework for real-time data acquisition and device control over the cloud.\n\n### How It Works\n- **Virtual Buttons**: Using Vuforia, the Unity-based AR app displays buttons that can toggle actuators or fetch sensor readings when pressed.\n- **Sensor Data**: The ESP32 board, programmed using Arduino, collects temperature and humidity data using a DHT11 sensor and updates these readings to the Blynk cloud.\n- **Cloud Connectivity**: The project leverages the Blynk 2.0 API for seamless communication between the AR app and the ESP32, making data visualization and control a breeze.\n\n## Features\n- **Interactive AR Interface**: Engage with virtual buttons mapped to physical actions or sensor data readings.\n- **Real-Time Data**: View up-to-date sensor readings in Unity using Blynk API integration.\n- **Seamless IoT Control**: Control actuators on the ESP32 from the AR app using cloud-based API requests.\n- **User-Friendly Design**: Simple and intuitive interface for non-technical users to interact with IoT devices.\n\n## Technology Stack\n- **Hardware**: ESP32, DHT11 sensor, Relay, AC Bulb\n- **Software**:\n  - **Unity**: For building the AR interface\n  - **Vuforia**: For target tracking and virtual button integration\n  - **Blynk 2.0**: For cloud connectivity and data management\n  - **Arduino**: For programming the ESP32\n  - **C#**: For scripting in Unity\n\n## Setup Instructions\n### Prerequisites\n- Install **Unity** with Vuforia support.\n- Install the **Arduino IDE** and set up your ESP32 board.\n- Create a Blynk account and set up a template for your ESP32 device.\n\n### Step 1: Arduino Sketch Setup\n1. Open the `blynk2_Esp32_test.ino` file in the Arduino IDE.\n2. Update the `BLYNK_TEMPLATE_ID`, `BLYNK_DEVICE_NAME`, and `BLYNK_AUTH_TOKEN` with your Blynk project details.\n3. Configure your WiFi credentials:\n   ```cpp\n   char ssid[] = \"your-SSID\";\n   char pass[] = \"your-PASSWORD\";\n   ```\n4. Upload the sketch to your ESP32.\n\n### Step 2: Unity and Vuforia Setup\n1. Open the **Sensor App** or **Virtual Buttons App** in Unity.\n2. Ensure Vuforia is set up with the appropriate license key and target database.\n3. Assign the `click.cs` or `First.cs` script to the relevant GameObjects.\n4. Modify the Blynk API URLs in the scripts as necessary to match your setup.\n\n### Step 3: Running the System\n- Launch the Unity app on your AR-capable device.\n- Point the device at the target plane to view and interact with virtual buttons.\n- Use the Blynk web dashboard or mobile app to monitor and control the ESP32.\n\n## Script Descriptions\n### Arduino Sketch\n- **blynk2_Esp32_test.ino**: This script runs on the ESP32 and connects it to a WiFi network and the Blynk cloud. It uses a DHT11 sensor to measure temperature and humidity, sends the readings to the Blynk app, and toggles an LED on and off using Blynk virtual pins.\n\n### Unity C# Scripts\n- **click.cs** (located in `Sensor App/Assets/`):\n  - Manages the behavior of virtual buttons in the Unity AR app.\n  - Uses Vuforia’s `VirtualButtonBehaviour` to trigger events when a virtual button is pressed.\n  - Retrieves temperature and humidity data from the Blynk cloud using Unity’s `UnityWebRequest`.\n  - Updates `InputField` UI components with the sensor data.\n\n- **First.cs** (located in `Virtual Buttons App/Assets/`):\n  - Handles the functionality of two virtual buttons in the Unity AR app.\n  - `Vb_on` turns an LED on, and `Vb_off` turns it off by sending HTTP GET requests to the Blynk cloud.\n  - Uses Vuforia’s `VirtualButtonBehaviour` to detect button presses and logs the status of the LED.\n\n## Project Structure\n```\nAR-IoT/\n│\n├── Arduino Sketch/\n│   ├── blynk2_Esp32_test.ino       # Main ESP32 code for Blynk integration\n│   ├── debug.cfg                   # Debug configuration\n│   ├── debug_custom.json           # Custom debug settings\n│   └── esp32.svd                   # ESP32 peripheral description\n│\n├── Sensor App/\n│   ├── Assets/                     # Unity assets for the sensor app\n│   ├── Packages/\n│   ├── ProjectSettings/\n│   └── QCAR/                       # Vuforia target assets\n│\n├── Virtual Buttons App/\n│   ├── Assets/                     # Unity assets for the virtual buttons app\n│   ├── Packages/\n│   ├── ProjectSettings/\n│   └── QCAR/                       # Vuforia target assets\n│\n├── .gitattributes                  # Git configuration\n├── demo_video.mp4                  # Demonstration video of the project\n└── .gitignore                      # Git ignore file\n```\n\n## Future Work\n- **Enhanced AR Visualizations**: Improve the user interface with more intuitive 3D models and animations.\n- **Additional Sensors**: Integrate more sensors to expand the IoT capabilities.\n- **Mobile App Integration**: Develop a companion app for more convenient control and monitoring.\n\n## Demo\nCheck out the project in action:\n\n[AR-IoT Demo Video](https://www.linkedin.com/posts/jjateen_augmentedreality-vuforia-unity-activity-7068212600731222017-pRAD?utm_source=share\u0026utm_medium=member_desktop)\n\n---\n\nFeel free to explore the project and be inspired by the way AR technology can transform IoT experiences!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjjateen%2Far-iot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjjateen%2Far-iot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjjateen%2Far-iot/lists"}