{"id":20153076,"url":"https://github.com/huawei-noah/bolt","last_synced_at":"2025-05-16T05:05:41.023Z","repository":{"id":37740267,"uuid":"225365905","full_name":"huawei-noah/bolt","owner":"huawei-noah","description":"Bolt is a deep learning library with high performance and heterogeneous flexibility.","archived":false,"fork":false,"pushed_at":"2024-07-30T21:02:29.000Z","size":118824,"stargazers_count":941,"open_issues_count":42,"forks_count":160,"subscribers_count":49,"default_branch":"master","last_synced_at":"2025-04-08T15:05:41.490Z","etag":null,"topics":["android","arm","bolt","caffe","cnn","cv","deep-learning","high-performance","huawei","inference","ios","mali","mobile","nlp","noah","onnx","rnn","tensorflow","x86"],"latest_commit_sha":null,"homepage":"https://huawei-noah.github.io/bolt/","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/huawei-noah.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-12-02T12:06:12.000Z","updated_at":"2025-04-04T04:13:37.000Z","dependencies_parsed_at":"2024-11-29T09:53:04.278Z","dependency_job_id":null,"html_url":"https://github.com/huawei-noah/bolt","commit_stats":null,"previous_names":[],"tags_count":10,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huawei-noah%2Fbolt","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huawei-noah%2Fbolt/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huawei-noah%2Fbolt/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huawei-noah%2Fbolt/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/huawei-noah","download_url":"https://codeload.github.com/huawei-noah/bolt/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254471061,"owners_count":22076585,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["android","arm","bolt","caffe","cnn","cv","deep-learning","high-performance","huawei","inference","ios","mali","mobile","nlp","noah","onnx","rnn","tensorflow","x86"],"created_at":"2024-11-13T23:16:58.582Z","updated_at":"2025-05-16T05:05:36.013Z","avatar_url":"https://github.com/huawei-noah.png","language":"C++","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Introduction\n---\n[![License: MIT](docs/images/license-mit.png)](https://opensource.org/licenses/MIT)\n\n[Bolt](https://huawei-noah.github.io/bolt/) is a light-weight library for deep learning.\nBolt, as a universal deployment tool for all kinds of neural networks, aims to automate the deployment pipeline and achieve extreme acceleration.\nBolt has been widely deployed and used in many departments of HUAWEI company, such as 2012 Laboratory, CBG and HUAWEI Product Lines.\nIf you have questions or suggestions, you can submit issue. **QQ群: 833345709**\n\n# Why Bolt is what you need?\n---\n- **High Performance:** **15%+** faster than existing open source acceleration libraries.\n- **Rich Model Conversion:** support Caffe, ONNX, TFLite, Tensorflow.\n- **Various Inference Precision:** support FP32, FP16, INT8, 1-BIT.\n- **Multiple platforms:** ARM CPU(v7, v8, v8.2+, v9), X86 CPU(AVX2, AVX512), GPU(Mali, Qualcomm, Intel, AMD)\n- **Bolt is the first to support NLP and also supports common CV applications.**\n- **Minimize ROM/RAM**\n- Rich Graph Optimization\n- Efficient Thread Affinity Setting\n- [Auto Algorithm Tuning](https://zhuanlan.zhihu.com/p/336218879)\n- [Time-Series Data Acceleration](docs/USER_HANDBOOK.md#time-series-data-acceleration)\n\n[See more excellent features and details here](https://zhuanlan.zhihu.com/p/317111024)\n\n# Building Status\n---\nThere are some common used platform for inference. More targets can be seen from [scripts/target.sh](scripts/target.sh). Please make a suitable choice depending on your environment. \nIf you want to build on-device training module, you can add **--train** option.\nIf you want to use multi-threads parallel, you can add **--openmp** option.\nIf you want to build for cortex-M or cortex-A7 with restricted ROM/RAM(Sensor, MCU), you can see [docs/LITE.md](docs/LITE.md).\n\n*Bolt defaultly link static library, This may cause some problem on some platforms. You can use --shared option to link shared library.*\n\n| target platform        | precision          | build command                                        | Linux | Windows | MacOS |\n| ---------------------- | ------------------ | ---------------------------------------------------- | ----- | ------- | ----- |\n| Android(armv7)         | fp32,int8          | ./install.sh --target=android-armv7                  | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-android-armv7) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-android-armv7) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-android-armv7) |\n| Android(armv8)         | fp32,int8          | ./install.sh --target=android-aarch64 --fp16=off     | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-android-armv8) |\n| Android(armv8.2+)      | fp32,fp16,int8,bnn | ./install.sh --target=android-aarch64                | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-android-armv8) |\n| Android(armv9)         | fp32,fp16,bf16,int8,bnn | ./install.sh --target=android-aarch64_v9        | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-android-armv8) |\n| Android(gpu)           | fp16               | ./install.sh --target=android-aarch64 --gpu          | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-android-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-android-armv8) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-android-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-android-armv8) |\n| Android(x86_64)        | fp32,int8          | ./install.sh --target=android-x86_64                 | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-android-x86_64.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-android-x86_64) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-android-x86_64.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-android-x86_64) | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-android-x86_64.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-android-x86_64) |\n| iOS(armv7)             | fp32,int8          | ./install.sh --target=ios-armv7                      | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-ios-armv7.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-ios-armv7) |\n| iOS(armv8)             | fp32,int8          | ./install.sh --target=ios-aarch64 --fp16=off         | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-ios-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-ios-armv8) |\n| iOS(armv8.2+)          | fp32,fp16,int8,bnn | ./install.sh --target=ios-aarch64                    | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-ios-armv8.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-ios-armv8) |\n| Linux(armv7)           | fp32,int8          | ./install.sh --target=linux-armv7_blank              | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-x86) | / | / |\n| Linux(armv8)           | fp32,int8          | ./install.sh --target=linux-aarch64_blank --fp16=off | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-x86) | / | / |\n| Linux(armv8.2+)        | fp32,fp16,int8,bnn | ./install.sh --target=linux-aarch64_blank            | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-x86) | / | / |\n| Linux(x86_64)          | fp32,int8          | ./install.sh --target=linux-x86_64                   | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-x86) | / | / |\n| Linux(x86_64_avx2)     | fp32               | ./install.sh --target=linux-x86_64_avx2              | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-x86-avx2) | / | / |\n| Linux(x86_64_avx512)   | fp32,int8          | ./install.sh --target=linux-x86_64_avx512            | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/linux-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Alinux-x86-avx2) | / | / |\n| Windows(x86_64)        | fp32,int8          | ./install.sh --target=windows-x86_64                 | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-x86) | / |\n| Windows(x86_64_avx2)   | fp32               | ./install.sh --target=windows-x86_64_avx2            | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-x86-avx2) | / |\n| Windows(gpu)           | fp16               | ./install.sh --target=windows-x86_64_avx2 --gpu --fp16=on | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-x86-avx2) | / |\n| Windows(x86_64_avx512) | fp32,int8          | ./install.sh --target=windows-x86_64_avx512          | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/windows-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Awindows-x86-avx2) | / |\n| Windows(armv8.2+)      | fp32,fp16,int8,bnn | ./install.sh --target=windows-aarch64                | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-x86) |\n| MacOS(x86_64)          | fp32,int8          | ./install.sh --target=macos-x86_64                   | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-x86) |\n| MacOS(x86_64_avx2)     | fp32               | ./install.sh --target=macos-x86_64_avx2              | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-x86-avx2) |\n| MacOS(x86_64_avx512)   | fp32,int8          | ./install.sh --target=macos-x86_64_avx512            | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-x86-avx2.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-x86-avx2) |\n| MacOS(armv8.2+)        | fp32,fp16,int8,bnn | ./install.sh --target=macos-aarch64                  | / | / | [![Build Status](https://img.shields.io/github/actions/workflow/status/huawei-noah/bolt/macos-x86.yml?branch=master)](https://github.com/huawei-noah/bolt/actions?query=workflow%3Amacos-x86) |\n\n# Quick Start\n---\n\u003cdiv align=center\u003e\u003cimg src=\"docs/images/QuickStart.jpg\" width = 100% height = 100%  style=\"border: 1px solid rgba(151,151,151,0.50)\" /\u003e\u003c/div\u003e\nTwo steps to get started with bolt.\n\n1. Conversion: use **[X2bolt](model_tools/tools/X2bolt/X2bolt.cpp)** to convert your model from caffe, onnx, tflite or tensorflow to .bolt file;\n\n2. Inference: run **[benchmark](inference/examples/benchmark/benchmark.cpp)** with .bolt and data to get the inference result.\n\n   For more details about the usage of [**X2bolt**](model_tools/tools/X2bolt/X2bolt.cpp) and [**benchmark**](inference/examples/benchmark/benchmark.cpp) tools,  see [docs/USER_HANDBOOK.md](docs/USER_HANDBOOK.md). \n\n# DL Applications in Bolt\n\n  Here we show some interesting and useful applications in bolt.\n\n| \u003ccenter\u003eImage Classification\u003c/br\u003e[android](kit/Android/SimpleImageClassification) [ios](kit/iOS/SimpleImageClassification)\u003c/center\u003e | \u003ccenter\u003eFace Detection\u003c/br\u003e[ios](kit/iOS/FaceDetection)  [exe](inference/examples/ultra_face)\u003c/center\u003e | \u003ccenter\u003ePose Detection\u003c/br\u003e[android](kit/Android/PoseDetect)\u003c/center\u003e |\n| :------: | :------: | :------: |\n| \u003cimg src=\"docs/images/ImageClassification.gif\" width = 50% height = 20% /\u003e       | \u003cimg src=\"docs/images/FaceDetection.gif\" width = 70% height = 30% /\u003e | \u003cimg src=\"docs/images/PoseDetect.gif\" width = 50% height = 22% /\u003e |\n\n| \u003ccenter\u003eSemantics Analysis\u003c/br\u003e[android](kit/Android/Semantics)\u003c/center\u003e | \u003ccenter\u003eReading Comprehension\u003c/br\u003e[android](kit/Android/ReadingComprehension)\u003c/center\u003e | \u003ccenter\u003eChinese Speech Recognition\u003c/br\u003e[android](kit/Android/ChineseSpeechRecognition)    [ios](kit/iOS/ChineseSpeechRecognition)\u003c/center\u003e |\n| :------: | :------: | :------: |\n| \u003cimg src=\"docs/images/SemanticsAnalysis.gif\" width = 45% height = 20% /\u003e | \u003cimg src=\"docs/images/ReadingComprehension.gif\" width = 45% height = 20% /\u003e | \u003cimg src=\"docs/images/ChineseSpeechRecognition.gif\" width = 50% height = 20% /\u003e |\n\n# Verified Networks\n---\n  Bolt has shown its high performance in the inference of common CV, NLP and Recommendation neural networks. Some of the representative networks that we have verified are listed below. You can find detailed benchmark information in [docs/BENCHMARK.md](docs/BENCHMARK.md).\n\n  \u003ctable border=\"1\"  bordercolor=\"#00CCCC\"  width=\"300\"\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\n        Application\n      \u003c/td\u003e\n      \u003ctd\u003e\n        Models\n      \u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\n        CV\n      \u003c/td\u003e\n      \u003ctd\u003e\n        Resnet50, Shufflenet, Squeezenet, Densenet, Efficientnet, Mobilenet_v1, Mobilenet_v2, Mobilenet_v3,\n        \u003ca href=\"https://github.com/liuzechun/Bi-Real-net\"\u003eBiRealNet\u003c/a\u003e,\n        \u003ca href=\"https://github.com/liuzechun/ReActNet\"\u003eReActNet\u003c/a\u003e,\n        \u003ca href=\"https://github.com/huawei-noah/ghostnet\"\u003eGhostnet\u003c/a\u003e,\n        \u003ca href=\"https://github.com/milesial/Pytorch-UNet\"\u003eunet\u003c/a\u003e,\n        LCNet, Pointnet,\n        \u003ca href=\"https://github.com/thangtran480/hair-segmentation\"\u003ehair-segmentation\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/duc\"\u003educ\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/fcn\"\u003efcn\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/retinanet\"\u003eretinanet\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/ssd\"\u003eSSD\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/faster-rcnn\"\u003eFaster-RCNN\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/faster-rcnn\"\u003eMask-RCNN\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/yolov2-coco\"\u003eYolov2\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/tiny-yolov3\"\u003eYolov3\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/vision/object_detection_segmentation/yolov4\"\u003eYolov4\u003c/a\u003e,\n        \u003ca href=\"https://github.com/ultralytics/yolov5\"\u003eYolov5\u003c/a\u003e,\n        ViT, TNT, RepVGG, VitAE, CMT, EfficientFormer ...\n      \u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\n        NLP\n      \u003c/td\u003e\n      \u003ctd\u003e Bert, Albert, Tinybert, Neural Machine Translation, Text To Speech(Tactron,Tactron2,FastSpeech+hifigan,melgan), Automatic Speech Recognition, DFSMN, Conformer,\n        \u003ca href=\"docs/USER_HANDBOOK.md#voice-wake-up\"\u003eTdnn\u003c/a\u003e,\n        \u003ca href=\"https://tfhub.dev/google/lite-model/nonsemantic-speech-benchmark/frill-nofrontend/1\"\u003eFRILL\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/text/machine_comprehension/t5\"\u003eT5\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/text/machine_comprehension/gpt-2\"\u003eGPT-2\u003c/a\u003e,\n        \u003ca href=\"https://github.com/onnx/models/tree/master/text/machine_comprehension/roberta\"\u003eRoberta\u003c/a\u003e, Wenet ...\n      \u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\n        Recommendation\n      \u003c/td\u003e\n      \u003ctd\u003e\n        NFM, AFM, ONN, wide\u0026deep, DeepFM, MMOE\n      \u003c/td\u003e\n    \u003c/tr\u003e\n    \u003ctr\u003e\n      \u003ctd\u003e\n        More DL Tasks\n      \u003c/td\u003e\n      \u003ctd\u003e\n        ...\n      \u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/table\u003e\n\n  More models than these mentioned above are supported, users are encouraged to further explore.\n\n# On-Device Training\n---\nOn-Device Training has come, it's a beta vesion which supports [Lenet](./training/demos/lenet_demo/), [Mobilenet_v1](./training/demos/mobilenet_v1_demo) and [Resnet18](./training/demos/resnet18_demo) for training on the embedded devices and servers. Want more details of on-device training in bolt? Get with the official training [tutorial](./training/TUTORIAL.md).\n\n# Documentations\n---\nEverything you want to know about bolt is recorded in the detailed documentations stored in [docs](docs).\n\n- [How to install bolt with different compilers?](docs/INSTALL.md).\n- [How to use bolt to inference your ML models?](docs/USER_HANDBOOK.md)\n\t- [How to deploy Pytorch model?](docs/DEPLOYMENT_GUIDE_PYTORCH_CN.md)\n\t- [How to deploy Tensorflow model?](docs/DEPLOYMENT_GUIDE_TENSORFLOW_CN.md)\n\t- [How to deploy Onnx model?](docs/DEPLOYMENT_GUIDE_ONNX_CN.md)\n\t- [How to deploy Tflite model?](docs/DEPLOYMENT_GUIDE_TFLITE_CN.md)\n\t- [How to deploy Caffe model?](docs/DEPLOYMENT_GUIDE_CAFFE_CN.md)\n- [How to develop bolt to customize more models?](docs/DEVELOPER.md)\n- [Operators documentation](docs/OPERATORS.md)\n- [Benchmark results on some universal models.](docs/BENCHMARK.md)\n- [How to visualise/protect bolt model?](docs/USER_HANDBOOK.md#model-visualization)\n- [How to build demo/example with kit?](docs/KIT.md)\n- [Frequently Asked Questions(FAQ)](docs/FAQ.md)\n\n# Articles\n---\n- [深度学习加速库Bolt领跑端侧AI](https://zhuanlan.zhihu.com/p/317111024)\n- [为什么 Bolt 这么快：矩阵向量乘的实现](https://zhuanlan.zhihu.com/p/97928435)\n- [深入硬件特性加速TinyBert，首次实现手机上Bert 6ms推理](https://zhuanlan.zhihu.com/p/158620259)\n- [Bolt GPU性能优化，让上帝帮忙掷骰子](https://zhuanlan.zhihu.com/p/336218879)\n- [Bolt助力HMS机器翻译，自然语言处理又下一城](https://zhuanlan.zhihu.com/p/337887620)\n- [ARM CPU 1-bit推理，走向极致的道路](https://zhuanlan.zhihu.com/p/158161592)\n- [基于深度学习加速库Bolt的声音克隆技术(Voice Cloning)](https://zhuanlan.zhihu.com/p/498919929)\n\n# 教程\n---\n- 图像分类: [Android Demo](https://zhuanlan.zhihu.com/p/359264809), [iOS Demo](https://zhuanlan.zhihu.com/p/359259766)\n- 图像增强: [Android Deme](./docs/DIT.md#camera-enlarge), [iOS Demo](./docs/DIT.md#camera-enlarge)\n- 情感分类: [Android Demo](https://zhuanlan.zhihu.com/p/414971037)\n- 中文语音识别: [Android Demo](https://zhuanlan.zhihu.com/p/414978782), [iOS Demo](https://zhuanlan.zhihu.com/p/414981121)\n- 人脸检测: [Android Demo](https://zhuanlan.zhihu.com/p/414975102), [iOS Demo](https://zhuanlan.zhihu.com/p/414971375)\n\n# Acknowledgement\n---\nBolt refers to the following projects: [caffe](https://github.com/BVLC/caffe), [onnx](https://github.com/onnx/onnx), [tensorflow](https://github.com/tensorflow/tensorflow), [ncnn](https://github.com/Tencent/ncnn), [mnn](https://github.com/alibaba/MNN), [dabnn](https://github.com/JDAI-CV/dabnn).\n\n# License\n---\nThe MIT License(MIT)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhuawei-noah%2Fbolt","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhuawei-noah%2Fbolt","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhuawei-noah%2Fbolt/lists"}