https://github.com/yas-sim/objectron-3d-object-detection-openvino
Sample implementation of 3D object detection with Intel OpenVINO
https://github.com/yas-sim/objectron-3d-object-detection-openvino
3d-object-detection deep-learning intel mediapipe object-detection objectron openvino python sample
Last synced: 8 months ago
JSON representation
Sample implementation of 3D object detection with Intel OpenVINO
- Host: GitHub
- URL: https://github.com/yas-sim/objectron-3d-object-detection-openvino
- Owner: yas-sim
- License: apache-2.0
- Created: 2020-06-28T12:11:18.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2020-06-29T23:25:31.000Z (almost 6 years ago)
- Last Synced: 2025-03-29T15:34:53.843Z (about 1 year ago)
- Topics: 3d-object-detection, deep-learning, intel, mediapipe, object-detection, objectron, openvino, python, sample
- Language: Python
- Homepage:
- Size: 128 KB
- Stars: 15
- Watchers: 2
- Forks: 5
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Overview
This is a sample implementaion of 3D object detection application using Intel(r) Distribution of OpenVINO(tm) Toolkit. The program uses `objectron` model from [Google *mediapipe* project](https://github.com/google/mediapipe) to detect the objects from the input images.
In this project, I took the `objectron` model in TF SavedModel format from [PINTO model zoo](https://github.com/PINTO0309/PINTO_model_zoo) in the GitHub.
これはIntel(r) Distribution of OpenVINO(tm) Toolkitを使用した3D物体検出アプリケーションの参考実装です。プログラムは[Google *mediapipe*プロジェクト](https://github.com/google/mediapipe)の`objectron`モデルを使用しています。
このプロジェクトではPINTOさんの[PINTO model zoo](https://github.com/PINTO0309/PINTO_model_zoo)からTF SavedModelフォーマットのモデルデータを使用させて頂いています。
**Example of Detection result**
## 1. Prerequisites
* [Intel Distribution of OpenVINO toolkit 2020.2 (or newer)](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html)
## 2. Download Objectron TensorFlow model from PINTO model zoo
*Linux compatible environment is required to run `download.sh` script to get the model*
### 2.1 Download the model download script
Download `download.sh` from [https://github.com/PINTO0309/PINTO_model_zoo/tree/master/36_Objectron/01_float32](https://github.com/PINTO0309/PINTO_model_zoo/tree/master/36_Objectron/01_float32)
### 2.2 Run `download.sh` to get `saved_model_object_detection_3d_chair/*`
```sh
./download.sh
```
You'll get following files (and the other model files too).
```sh
saved_model_object_detection_3d_chair/
+ variables/
| + variables.data-00000-of-00001
| + variables.index
+ saved_model.pb
```
## 3. Convert objectron TF model into OpenVINO IR model
Use `Model Optimizer (MO)` to convert the TF model into IR model.
Linux
```sh
python3 ${INTEL_OPENVINO_DIR}/deployment_tools/model_optimizer/mo.py \
--saved_model_dir saved_model_object_detection_3d_chair \
--scale 255 \
--output_dir objectron_chair \
--data_type FP16
```
Windows
```sh
python "%INTEL_OPENVINO_DIR%\deployment_tools\model_optimizer\mo.py" ^
--saved_model_dir saved_model_object_detection_3d_chair ^
--scale 255 ^
--output_dir objectron_chair ^
--data_type FP16
```
An IR model `./objectron_chair/saved_model.xml|.bin` will be generated.
## 4. Run sample program
```sh
(Linux) python3 objectron.py [-m model.xml] [-i input_image] [--heatmap]
(Win10) python objectron.py [-m model.xml] [-i input_image] [--heatmap]
```
*Options*
`-m`: IR model path (default: `./objectron_chair/saved_model.xml`)
`-i`: Input image path. A webCam will be used as the input when you specify `cam` (default: `chair.jpg`)
`--heatmap`: Display heatmap
**Command line example:**
```sh
$ python3 objectron.py -m ./objectron_chair/object_detection_3d_chair.xml -i cam --heatmap
```
## 5. Test Environment
- Ubuntu 18.04 / Windows 10 1909
- OpenVINO 2020.3 LTS
## See Also
* [Google AI Blog, Real-Time 3D Object Detection on Mobile Devices with MediaPipe](https://ai.googleblog.com/2020/03/real-time-3d-object-detection-on-mobile.html)
* [GitHub, Google *mediapipe* project](https://github.com/google/mediapipe)
* [GitHub, PINTO model zoo](https://github.com/PINTO0309)
* [Intel(r) Distribution of OpenVINO(tm) Toolkit](https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit.html)