https://github.com/ynagatomo/ARWallPicture

An minimal iOS app that displays images on the wall with AR.
https://github.com/ynagatomo/ARWallPicture

Last synced: 3 months ago
JSON representation

An minimal iOS app that displays images on the wall with AR.

• Host: GitHub
• URL: https://github.com/ynagatomo/ARWallPicture
• Owner: ynagatomo
• Created: 2022-12-17T01:42:39.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2023-02-12T04:44:06.000Z (over 1 year ago)
• Last Synced: 2024-06-12T09:40:45.236Z (5 months ago)
• Language: Swift
• Size: 4.96 MB
• Stars: 39
• Watchers: 3
• Forks: 5
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• fucking-open-source-ios-apps - AR Wall Picture

README

        
# iOS app - AR Wall Picture

An iOS app that displays images from your Photo Library on the wall in AR.

![AppIcon](assets/appIcon180.jpg)

- Target: iPhone / iOS 16.0+, iPad / iPadOS 16.0+

- Build: macOS 13.1+, Xcode 14.2+

An iOS app in a separate project repo allows you to generate images using Stable Diffusion

on your devices and save them to your Photo Library.

Let's appreciate them in AR with this iOS app.

- GitHub repo of the iOS app - AR Diffusion Museum: https://github.com/ynagatomo/ARDiffMuseum

From this project you can see:

- ARKit: plane detection and displaying the planes

- RealityKit: dynamic image-texture replacement and using a custom material (Metal Shader)

- PhotoKit: PhotoPicker (new in iOS 16)

## Change Log

none

## Features

1. selecting images from Photo Library

1. detecting virtual or horizontal planes in AR

1. displaying images in AR and automatic image switching based on viewing angle

1. showing visual effects on the images in AR

1. built-in sample images

![Image](assets/ss1_3000.jpg)

## UI

This project provides a minimal UI. Feel free to extend it as you like and create your own app.

![Image](assets/ss2_ui.jpg)

## Vertex Shader

This project contains a vertex shader to play waving geometry animation in AR.

It uses a custom material and geometry modifier of RealityKit 2.

- RealityKit: CustomMaterial https://developer.apple.com/documentation/realitykit/custommaterial

- RealityKit: GeometryModifier https://developer.apple.com/documentation/realitykit/custommaterial/geometrymodifier

Please create your shader and replace with it.

![Image](assets/shader1.png)

![Image](assets/shader2.png)

## Consideration

### Visual Effects

The app uses a simple Metal Shader to provide a visual effect.

Please modify it as you like.

### Creating a picture-frame

The app uses a simple picture frame.

As this project contains the Blender file of the picture frame,

you can modify it.

1. modify or create your picture frame with Blender

1. convert it to USDZ with Reality Converter

1. replace or add it to the Project

1. edit the `AppConstant.swift` to name it if needed

- Blender file: `assets/panel1_1.blend`

## Related apps

1. ImgGenSD2: https://github.com/ynagatomo/ImgGenSD2

1. AR Diffusion Museum: https://github.com/ynagatomo/ARDiffMuseum

![Image](assets/relatedapps.jpg)

## References

none

![MIT License](http://img.shields.io/badge/license-MIT-blue.svg?style=flat)