https://github.com/shunk031/libtorch-gin-api-server

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)
https://github.com/shunk031/libtorch-gin-api-server

api-server cgo docker gin golang libtorch pytorch

Last synced: 2 months ago
JSON representation

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

• Host: GitHub
• URL: https://github.com/shunk031/libtorch-gin-api-server
• Owner: shunk031
• License: mit
• Created: 2019-06-07T11:21:39.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2019-06-08T05:43:30.000Z (over 5 years ago)
• Last Synced: 2024-06-20T13:30:37.815Z (7 months ago)
• Topics: api-server, cgo, docker, gin, golang, libtorch, pytorch
• Language: Go
• Homepage:
• Size: 340 KB
• Stars: 17
• Watchers: 2
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

[![GitHub license](https://img.shields.io/github/license/shunk031/libtorch-gin-api-server.svg)](https://github.com/shunk031/libtorch-gin-api-server/blob/master/LICENSE)

![Golang 1.9](https://img.shields.io/badge/golang-1.9%2B-blue.svg)

![Python 3.7](https://img.shields.io/badge/python-3.7%2B-brightgreen.svg)

## Convert your model to torch script

```shell

$ python convert_to_torch_script_via_tracing.py

# converted model is saved to assets/model.pt

```

## How to Run

```shell

$ docker-compose up api

```

## Credits

Parts of the implementation is borrowed from [rai-project/go-pytorch](https://github.com/rai-project/go-pytorch).