Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/tucan9389/depthprediction-coreml

The example of running Depth Prediction using Core ML
https://github.com/tucan9389/depthprediction-coreml

coreml depth-prediction fcrn-depthprediction swift

Last synced: 15 days ago
JSON representation

The example of running Depth Prediction using Core ML

Host: GitHub
URL: https://github.com/tucan9389/depthprediction-coreml
Owner: tucan9389
License: mit
Created: 2019-07-20T04:45:48.000Z (over 5 years ago)
Default Branch: master
Last Pushed: 2021-06-15T14:32:24.000Z (over 3 years ago)
Last Synced: 2024-10-23T05:34:50.383Z (24 days ago)
Topics: coreml, depth-prediction, fcrn-depthprediction, swift
Language: Swift
Homepage: https://github.com/motlabs/awesome-ml-demos-with-ios
Size: 53.2 MB
Stars: 136
Watchers: 4
Forks: 15
Open Issues: 1
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # DepthPrediction-CoreML

![platform-ios](https://img.shields.io/badge/platform-ios-lightgrey.svg)

![swift-version](https://img.shields.io/badge/swift-5.0-red.svg)

![lisence](https://img.shields.io/badge/license-MIT-black.svg)

This project is Depth Prediction on iOS with Core ML.
If you are interested in iOS + Machine Learning, visit [here](https://github.com/motlabs/iOS-Proejcts-with-ML-Models) you can see various DEMOs.


| GIF demo 1 | Screenshot 1 | Screenshot 2 | Screenshot 3 | Screenshot 4 |

| ------------ | ------------ | ------------ | ------------ | ------------ |

|  |  |  |  |  |

## How it works

> When use Metal

![image](https://user-images.githubusercontent.com/37643248/100520171-bdfeea00-31df-11eb-92f5-15e17fa10962.png)

## Requirements

- Xcode 10.2+

- iOS 11.0+

- Swift 5

## Model

### Download

Download model from [apple's model page](https://developer.apple.com/machine-learning/models/).

### Matadata

|            | input node    | output node    |   size   |

| :--------: | :-----------: | :------------: | :----: |

| FCRN     | `[1, 304, 228, 3]`
name: `image` | `[1, 128, 160]`
name: `depthmap` | 254.7 MB |

| FCRNFP16 | `[1, 304, 228, 3]`
name: `image` | `[1, 128, 160]`
name: `depthmap` | 127.3 MB |

### Inference Time

| Device        | Inference Time | Total Time(GPU) | Total Time(CPU) |

| ------------- | :-----: | :-----: | :-----------: |

| iPhone 12 Pro Max | ⏲ | ⏲ | ⏲ |

| iPhone 12 Pro | ⏲ | ⏲ | ⏲ |

| iPhone 12     | ⏲ | ⏲ | ⏲ |

| iPhone 12 Mini | ⏲ | ⏲ | ⏲ |

| iPhone 11 Pro Max | ⏲ | ⏲ | ⏲ |

| iPhone 11 Pro | **134 ms**  | **134 ms** | **149 ms** |

| iPhone 11     | ⏲ | ⏲ | ⏲ |

| iPhone SE(2nd) | ⏲ | ⏲ | ⏲ |

| iPhone XS Max | 146 ms | ⏲ | 155 ms |

| iPhone XS     | 146 ms | ⏲ | 151 ms |

| iPhone XR     | 148 ms  | ⏲ | 154 ms |

| iPhone X      | 624 ms  | ⏲ | 640 ms |

| iPhone 8+     | 621 ms  | ⏲ | 634 ms |

| iPhone 8      | 626 ms  | ⏲ | 639 ms |

| iPhone 7+     | 595 ms  | ⏲ | 609 ms |

| iPhone 7      | 612 ms  | ⏲ | 624 ms |

| iPhone 6S+    | 1038 ms | ⏲ | 1051 ms |

## See also

- [motlabs/iOS-Proejcts-with-ML-Models](https://github.com/motlabs/iOS-Proejcts-with-ML-Models)


  : The challenge using machine learning model created from tensorflow on iOS

- [iro-cp/FCRN-DepthPrediction](https://github.com/iro-cp/FCRN-DepthPrediction)


  : The repository prividing FCRN-DepthPrediction model