https://github.com/jjateen/ar-iot
This repository showcases AR-IoT, a cutting-edge project that combines Augmented Reality (AR) and the Internet of Things (IoT) using Unity, Vuforia, and the ESP32. Experience real-time sensor control and data visualization through interactive virtual buttons and seamless cloud connectivity.
https://github.com/jjateen/ar-iot
augmented-reality blynk blynk-iot-platform esp32 unity unity3d vuforia
Last synced: 5 months ago
JSON representation
This repository showcases AR-IoT, a cutting-edge project that combines Augmented Reality (AR) and the Internet of Things (IoT) using Unity, Vuforia, and the ESP32. Experience real-time sensor control and data visualization through interactive virtual buttons and seamless cloud connectivity.
- Host: GitHub
- URL: https://github.com/jjateen/ar-iot
- Owner: Jjateen
- Created: 2024-10-18T17:28:20.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-11-04T12:58:03.000Z (over 1 year ago)
- Last Synced: 2025-03-25T01:51:09.094Z (over 1 year ago)
- Topics: augmented-reality, blynk, blynk-iot-platform, esp32, unity, unity3d, vuforia
- Language: C#
- Homepage:
- Size: 8.54 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# AR-IoT: Augmented Reality Meets the Internet of Things
Welcome to **AR-IoT**, an innovative project that bridges the world of Augmented Reality (AR) and the Internet of Things (IoT) using **Unity**, **Vuforia**, and the **ESP32** microcontroller. This project aims to provide a seamless and interactive experience for controlling and visualizing sensor data in real-time, utilizing the power of virtual buttons and cloud-based connectivity.
## Table of Contents
- [Overview](#overview)
- [Features](#features)
- [Technology Stack](#technology-stack)
- [Setup Instructions](#setup-instructions)
- [Script Descriptions](#script-descriptions)
- [Project Structure](#project-structure)
- [Future Work](#future-work)
- [Demo](#demo)
## Overview
**AR-IoT** demonstrates the integration of AR and IoT in a single cohesive system. With **Vuforia** and **Unity**, the project overlays virtual buttons onto a target plane, allowing users to interact with sensor data or control actuators visually. The **ESP32**, in conjunction with **Blynk 2.0**, provides a robust framework for real-time data acquisition and device control over the cloud.
### How It Works
- **Virtual Buttons**: Using Vuforia, the Unity-based AR app displays buttons that can toggle actuators or fetch sensor readings when pressed.
- **Sensor Data**: The ESP32 board, programmed using Arduino, collects temperature and humidity data using a DHT11 sensor and updates these readings to the Blynk cloud.
- **Cloud Connectivity**: The project leverages the Blynk 2.0 API for seamless communication between the AR app and the ESP32, making data visualization and control a breeze.
## Features
- **Interactive AR Interface**: Engage with virtual buttons mapped to physical actions or sensor data readings.
- **Real-Time Data**: View up-to-date sensor readings in Unity using Blynk API integration.
- **Seamless IoT Control**: Control actuators on the ESP32 from the AR app using cloud-based API requests.
- **User-Friendly Design**: Simple and intuitive interface for non-technical users to interact with IoT devices.
## Technology Stack
- **Hardware**: ESP32, DHT11 sensor, Relay, AC Bulb
- **Software**:
- **Unity**: For building the AR interface
- **Vuforia**: For target tracking and virtual button integration
- **Blynk 2.0**: For cloud connectivity and data management
- **Arduino**: For programming the ESP32
- **C#**: For scripting in Unity
## Setup Instructions
### Prerequisites
- Install **Unity** with Vuforia support.
- Install the **Arduino IDE** and set up your ESP32 board.
- Create a Blynk account and set up a template for your ESP32 device.
### Step 1: Arduino Sketch Setup
1. Open the `blynk2_Esp32_test.ino` file in the Arduino IDE.
2. Update the `BLYNK_TEMPLATE_ID`, `BLYNK_DEVICE_NAME`, and `BLYNK_AUTH_TOKEN` with your Blynk project details.
3. Configure your WiFi credentials:
```cpp
char ssid[] = "your-SSID";
char pass[] = "your-PASSWORD";
```
4. Upload the sketch to your ESP32.
### Step 2: Unity and Vuforia Setup
1. Open the **Sensor App** or **Virtual Buttons App** in Unity.
2. Ensure Vuforia is set up with the appropriate license key and target database.
3. Assign the `click.cs` or `First.cs` script to the relevant GameObjects.
4. Modify the Blynk API URLs in the scripts as necessary to match your setup.
### Step 3: Running the System
- Launch the Unity app on your AR-capable device.
- Point the device at the target plane to view and interact with virtual buttons.
- Use the Blynk web dashboard or mobile app to monitor and control the ESP32.
## Script Descriptions
### Arduino Sketch
- **blynk2_Esp32_test.ino**: This script runs on the ESP32 and connects it to a WiFi network and the Blynk cloud. It uses a DHT11 sensor to measure temperature and humidity, sends the readings to the Blynk app, and toggles an LED on and off using Blynk virtual pins.
### Unity C# Scripts
- **click.cs** (located in `Sensor App/Assets/`):
- Manages the behavior of virtual buttons in the Unity AR app.
- Uses Vuforia’s `VirtualButtonBehaviour` to trigger events when a virtual button is pressed.
- Retrieves temperature and humidity data from the Blynk cloud using Unity’s `UnityWebRequest`.
- Updates `InputField` UI components with the sensor data.
- **First.cs** (located in `Virtual Buttons App/Assets/`):
- Handles the functionality of two virtual buttons in the Unity AR app.
- `Vb_on` turns an LED on, and `Vb_off` turns it off by sending HTTP GET requests to the Blynk cloud.
- Uses Vuforia’s `VirtualButtonBehaviour` to detect button presses and logs the status of the LED.
## Project Structure
```
AR-IoT/
│
├── Arduino Sketch/
│ ├── blynk2_Esp32_test.ino # Main ESP32 code for Blynk integration
│ ├── debug.cfg # Debug configuration
│ ├── debug_custom.json # Custom debug settings
│ └── esp32.svd # ESP32 peripheral description
│
├── Sensor App/
│ ├── Assets/ # Unity assets for the sensor app
│ ├── Packages/
│ ├── ProjectSettings/
│ └── QCAR/ # Vuforia target assets
│
├── Virtual Buttons App/
│ ├── Assets/ # Unity assets for the virtual buttons app
│ ├── Packages/
│ ├── ProjectSettings/
│ └── QCAR/ # Vuforia target assets
│
├── .gitattributes # Git configuration
├── demo_video.mp4 # Demonstration video of the project
└── .gitignore # Git ignore file
```
## Future Work
- **Enhanced AR Visualizations**: Improve the user interface with more intuitive 3D models and animations.
- **Additional Sensors**: Integrate more sensors to expand the IoT capabilities.
- **Mobile App Integration**: Develop a companion app for more convenient control and monitoring.
## Demo
Check out the project in action:
[AR-IoT Demo Video](https://www.linkedin.com/posts/jjateen_augmentedreality-vuforia-unity-activity-7068212600731222017-pRAD?utm_source=share&utm_medium=member_desktop)
---
Feel free to explore the project and be inspired by the way AR technology can transform IoT experiences!