Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/BMW-InnovationLab/BMW-IntelOpenVINO-Detection-Inference-API

This is a repository for a No-Code object detection inference API using the OpenVINO. It's supported on both Windows and Linux Operating systems.
https://github.com/BMW-InnovationLab/BMW-IntelOpenVINO-Detection-Inference-API

computer-vision cpu deeplearning detection-algorithm detection-api docker inference inference-engine neural-network nocode object-detection openvino openvino-model-zoo openvino-toolkit resnet rest-api

Last synced: about 1 month ago
JSON representation

This is a repository for a No-Code object detection inference API using the OpenVINO. It's supported on both Windows and Linux Operating systems.

Awesome Lists containing this project

README 

        
# OpenVINO Inference API 



This is a repository for an object detection inference API using the OpenVINO. It's supported on both Windows and Linux Operating systems.



Models in Intermediate Representation(IR) format, converted using [Intel® OpenVINO™ toolkit v2021.1](https://docs.openvino.ai/2021.1/index.html) or using [Intel® OpenVINO™ toolkit v2021.4](https://docs.openvino.ai/2021.4/index.html), can be deployed in this API. Currently, OpenVINO supports conversion for Models trained in several Machine Learning frameworks including Caffe, Tensorflow etc. Please refer to [the OpenVINO documentation](https://docs.openvinotoolkit.org/2021.1/openvino_docs_MO_DG_prepare_model_convert_model_Converting_Model.html) for further details on converting your Model.



**Note: To be able to use the sample inference model provided with this repository make sure to have **`git lfs`** installed and initialized then use** `git clone` **and avoid downloading the repository as ZIP because it will not download the acutual model stored on** `git lfs` **but just the pointer instead**



## Prerequisites



- OS:

  - Ubuntu 18.04

  - Windows 10 pro/enterprise

- Docker

- [git-lfs](https://git-lfs.github.com/)



### Check for prerequisites



To check if you have docker-ce installed:



```sh

docker --version

```



### Install prerequisites



#### Ubuntu



Use the following command to install docker on Ubuntu:



```sh

chmod +x install_prerequisites.sh && source install_prerequisites.sh

```



#### Windows 10



To [install Docker on Windows](https://docs.docker.com/docker-for-windows/install/), please follow the link.



**P.S: For Windows users, open the Docker Desktop menu by clicking the Docker Icon in the Notifications area. Select Settings, and then Advanced tab to adjust the resources available to Docker Engine.**



## Build The Docker Image



In order to build the project run the following command from the project's root directory:



```sh

sudo docker build -t openvino_inference_api .

```

### Behind a proxy



```sh

sudo docker build --build-arg http_proxy='' --build-arg https_proxy='' -t openvino_inference_api .

```



## Run The Docker Container



If you wish to deploy this API using **docker**, please issue the following run command.



To run the API, go the to the API's directory and run the following:



#### Using Linux based docker:



```sh

sudo docker run -itv $(pwd)/models:/models -v $(pwd)/models_hash:/models_hash -p :80 openvino_inference_api

```

#### Using Windows based docker:



```sh

docker run -itv ${PWD}\models:/models -v ${PWD}\models_hash:/models_hash -p :80 openvino_inference_api

```



The   can be any unique port of your choice.



The API file will be run automatically, and the service will listen to http requests on the chosen port.



## API Endpoints



To see all available endpoints, open your favorite browser and navigate to:



```

http://:/docs

```



### Endpoints summary



#### /load (GET)



Loads all available models and returns every model with it's hashed value. Loaded models are stored and aren't loaded again.



![load model](./files/load_models.gif)



#### /detect (POST)



Performs inference on an image using the specified model and returns the bounding-boxes of the objects in a JSON format.



![detect image](./files/detect_image.gif)



#### /models/{model_name}/predict_image (POST)



Performs inference on an image using the specified model, draws bounding boxes on the image, and returns the resulting image as response.



![predict image](./files/predict_image.gif)



#### /models/{model_name}/config (GET)



Returns the model's configuration



![config image](./files/config_image.gif)



#### /models (GET)



Lists all the available models



#### /models/{model_name}/labels (GET)



Returns all the object labels of the model as a list



#### /models/{model_name}/predict (POST)



Performs inference on a given image using the model and returns the bounding-boxes of the objects as JSON.



**P.S: If you are using custom endpoints like /detect, /predict_image, you should always use the /load endpoint first and then use /detect**



## Model structure



The folder "models" contains subfolders of all the models to be loaded.

Inside each subfolder there should be a:



- bin file (.bin): contains the model weights



- xml file (.xml): describes the network topology



- class file (classes.txt): contains the names of the object classes, which should be in the below format



  ```text

      class1

      class2

      ...

  ```

- config.json (This is a json file containing information about the model)



  ```json

    {

        "inference_engine_name": "openvino_detection",

        "confidence": 60,

        "predictions": 15,

        "number_of_classes": 2,

        "framework": "openvino",

        "type": "detection",

        "network": "fasterrcnn"

    }

  ```

  P.S:

  - You can change confidence and predictions values while running the API

  - The API will return bounding boxes with a confidence higher than the "confidence" value. A high "confidence" can show you only accurate predictions



The "models" folder structure should be similar to as shown below:



```shell

│──models

  │──model_1

  │  │──.bin

  │  │──.xml

  │  │──classes.txt

  │  │──config.json

  │

  │──model_2

  │  │──.bin

  │  │──.xml

  │  │──classes.txt

  │  │──config.json

```

## Using with Anonymization Api



In this section, docker-compose will build and run the OpenVINO Inference Api alongside the Anonymization Api.



To build and run both the APIs together, clone the Anonymization API repository to your machine. Replace the "/jsonFiles/url_configuration.json" with the file in the "/docker_anonymize" directory of this repo.



Two services are configured in the "docker-compose.yml" file in the "/docker_anonymize" directory: the OpenVINO Inference API and the Anonymization API. 



You can modify the build context to specify the base directory of anonymization api (ensure the correct path is also given for the mounted volumes).You can also modify the host ports you wish to use for the APIs.



Now, run the following command in the "/docker_anonymize" directory of this repo:



```sh

docker-compose up

```



In the terminal, you should now see all the APIs running together.



## Acknowledgements



[OpenVINO Toolkit](https://github.com/openvinotoolkit)



[intel.com](https://intel.com)



[robotron.de](https://www.robotron.de/)