{"id":13438451,"url":"https://github.com/PaddlePaddle/Anakin","last_synced_at":"2025-03-20T06:30:26.047Z","repository":{"id":33004626,"uuid":"133907444","full_name":"PaddlePaddle/Anakin","owner":"PaddlePaddle","description":"High performance  Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.","archived":true,"fork":false,"pushed_at":"2022-09-23T22:22:29.000Z","size":25597,"stargazers_count":532,"open_issues_count":69,"forks_count":134,"subscribers_count":57,"default_branch":"master","last_synced_at":"2025-02-12T17:01:46.168Z","etag":null,"topics":["ai","amd","arm","bitmain","cambricon","cross-platform","high-performance","inference-engine","intel","nvidia"],"latest_commit_sha":null,"homepage":"https://anakin.baidu.com/","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/PaddlePaddle.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-05-18T05:32:25.000Z","updated_at":"2025-01-29T00:24:27.000Z","dependencies_parsed_at":"2023-01-14T23:15:25.582Z","dependency_job_id":null,"html_url":"https://github.com/PaddlePaddle/Anakin","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PaddlePaddle%2FAnakin","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PaddlePaddle%2FAnakin/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PaddlePaddle%2FAnakin/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PaddlePaddle%2FAnakin/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/PaddlePaddle","download_url":"https://codeload.github.com/PaddlePaddle/Anakin/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244564790,"owners_count":20473130,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","amd","arm","bitmain","cambricon","cross-platform","high-performance","inference-engine","intel","nvidia"],"created_at":"2024-07-31T03:01:05.635Z","updated_at":"2025-03-20T06:30:21.033Z","avatar_url":"https://github.com/PaddlePaddle.png","language":"C++","funding_links":[],"categories":["C++"],"sub_categories":[],"readme":"# Anakin2.0\n\n[![Build Status](https://travis-ci.org/PaddlePaddle/Anakin.svg?branch=developing)](https://travis-ci.org/PaddlePaddle/Anakin)\n[![License](https://img.shields.io/badge/license-Apache%202-blue.svg)](LICENSE)\n[![Coverage Status](https://coveralls.io/repos/github/xklnono/Anakin/badge.svg)](https://coveralls.io/github/xklnono/Anakin)\n\nWelcome to the Anakin GitHub.\n\nAnakin is a cross-platform, high-performance inference engine, which is originally\ndeveloped by Baidu engineers and is a large-scale application of industrial products.\n\nPlease refer to our [release announcement](https://github.com/PaddlePaddle/Anakin/releases) to track the latest feature of Anakin.\n\n## Features\n\n- **Flexibility**\n\n    Anakin is a cross-platform, high-performance inference engine, supports a wide range of neural network architectures and different hardware platforms. It is easy to run Anakin on GPU / x86 / ARM platform.\n\n    Anakin has integrated with NVIDIA TensorRT and open source this part of integrated API to provide services, developers can call the API directly or modify it as needed, which will be more flexible for development requirements.\n\n-  **High performance**\n\n    In order to give full play to the performance of hardware, we optimized the\n    forward prediction at different levels.\n      - Automatic graph fusion. The goal of all performance optimizations under a\n      given algorithm is to make the ALU as busy as possible. Operator fusion\n      can effectively reduce memory access and keep the ALU busy.\n\n      - Memory reuse. Forward prediction is a one-way calculation. We reuse\n      the memory between the input and output of different operators, thus\n      reducing the overall memory overhead.\n\n      - Assembly level optimization. Saber is a underlying DNN library for Anakin, which\n      is deeply optimized at assembly level.\n\n## NV GPU Benchmark\n### Machine And Enviornment\n\u003e  CPU: `Intel(R) Xeon(R) CPU 5117 @ 2.0GHz`  \n\u003e  GPU: `Tesla P4`  \n\u003e  cuda: `CUDA8`  \n\u003e  cuDNN: `v7`  \n\n* Time：warmup 10，running 1000 times to get average time\n* Latency (`ms`) and Memory(MB) of different batch\n\n\u003e The counterpart of **`Anakin`** is the acknowledged high performance inference engine **`NVIDIA TensorRT 5`** ,   The models which TensorRT 5 doesn't support we use the custom plugins  to support.\n\n### \u003cspan id = '1'\u003e VGG16 \u003c/span\u003e\n\n| Batch_Size | RT latency FP32(ms) | Anakin2 Latency FP32 (ms) |RT Memory (MB) | Anakin2 Memory (MB) |\n|------------|---------------------|---------------------------|---------------|---------------------|\n| 1          | 8.52532             | 8.2387                    |1090.89        | 702                 |\n| 2          | 14.1209             | 13.8772                   |1056.02        | 768.76              |\n| 4          | 24.4529             | 24.3391                   |1002.17        | 840.54              |\n| 8          | 46.7956             | 46.3309                   |1098.98        | 935.61              |\n\n\n### \u003cspan id = '2'\u003e Resnet50 \u003c/span\u003e\n\n| Batch_Size | RT latency FP32(ms) | Anakin2 Latency FP32 (ms) | RT Latency INT8 (ms) | Anakin2 Latency INT8 (ms) | RT Memory FP32(MB) | Anakin2 Memory FP32(MB) |\n|------------|---------------------|---------------------------|----------------------|---------------------------|--------------------|-------------------------|\n| 1          | 4.6447              | 3.0863                    | 1.78892              | 1.61537                   | 1134.88            | 311.25                  |\n| 2          | 6.69187             | 5.13995                   | 2.71136              | 2.70022                   | 1108.86            | 382                     |\n| 4          | 11.1943             | 9.20513                   | 4.16771              | 4.77145                   | 885.96             | 406.86                  |\n| 8          | 19.8769             | 17.1976                   | 6.2798               | 8.68197                   | 813.84             | 532.61                  |\n\n\n### \u003cspan id = '3'\u003e Resnet101 \u003c/span\u003e\n\n| Batch_Size | RT latency (ms) | Anakin2 Latency (ms) | RT Latency INT8 (ms) | Anakin2 Latency INT8 (ms) | RT Memory (MB) | Anakin2 Memory (MB) |\n|------------|-----------------|----------------------|----------------------|---------------------------|----------------|---------------------|\n| 1          | 9.98695         | 5.44947              | 2.81031              | 2.74399                   | 1159.16        | 500.5               |\n| 2          | 17.3489         | 8.85699              | 4.8641               | 4.69473                   | 1158.73        | 492                 |\n| 4          | 20.6198         | 16.8214              | 7.11608              | 8.45324                   | 1021.68        | 541.08              |\n| 8          | 31.9653         | 33.5015              | 11.2403              | 15.4336                   | 914.49         | 611.54              |\n\n\n## X86 CPU Benchmark\n### Machine And Enviornment\n\u003e  CPU: `Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz` with HT, for FP32 test  \n\u003e  CPU: `Intel(R) Xeon(R) Gold 6271 CPU @ 2.60GHz` with HT, for INT8 test  \n\u003e  System: `CentOS 6.3` with `GCC 4.8.2`, for benchmark between Anakin and Intel Caffe  \n\n* All test enable `8 thread parallel`\n* Time：warmup 10，running 200 times to get average time\n\n\u003e The counterpart of **`Anakin`** is **`Intel Cafe`(1.1.6)** with mklml.\n\n| Net_Name    | Batch_Size | Anakin2 Latency(2650v4) fp32 (ms) | caffe Latency(2650v4) fp32 (ms) | Anakin2 Latency int8(6271) (ms) |\n|-------------|----|-------------------------------------|-----------------------------------|---------------------------------|\n| resnet50    | 1  | 20.6201                             | 24.1369                           | 3.20866                         |\n| resnet50    | 2  | 39.2286                             | 43.1096                           | 5.44311                         |\n| resnet50    | 4  | 77.1392                             | 81.8814                           | 9.93424                         |\n| resnet50    | 8  | 152.941                             | 158.321                           | 19.5618                         |\n| vgg16       | 1  | 55.6132                             | 70.532                            | 15.3181                         |\n| vgg16       | 2  | 96.5034                             | 131.451                           | 22.5082                         |\n| vgg16       | 4  | 180.479                             | 247.926                           | 37.2974                         |\n| vgg16       | 8  | 346.619                             | 485.44                            | 67.6682                         |\n| mobilenetv1 | 1  | 3.98104                             | 5.42775                           | 0.926546                        |\n| mobilenetv1 | 2  | 7.27079                             | 9.16058                           | 1.35007                         |\n| mobilenetv1 | 4  | 14.4029                             | 16.2505                           | 2.37271                         |\n| mobilenetv1 | 8  | 29.1651                             | 29.8381                           | 3.75992                         |\n| vgg16_ssd   | 1  | 125.948                             | 143.412                           |                                 |\n| vgg16_ssd   | 2  | 247.242                             | 266.22                            |                                 |\n| vgg16_ssd   | 4  | 488.377                             | 510.978                           |                                 |\n| vgg16_ssd   | 8  | 972.762                             | 995.407                           |                                 |\n| mobilenetv2 | 1  | 3.78504                             | 23.0066                           |                                 |\n| mobilenetv2 | 2  | 7.24622                             | 65.9301                           |                                 |\n| mobilenetv2 | 4  | 13.7638                             | 85.3893                           |                                 |\n| mobilenetv2 | 8  | 28.4093                             | 131.669                           |\n\n\n## ARM CPU Benchmark\n### Machine And Enviornment\n\u003e  CPU: `Kirin 980`  \n\u003e  CPU: `Snapdragon 652`  \n\u003e  CPU: `Snapdragon 855`  \n\u003e  CPU: `RK3399`  \n\n* Compile circumstance: Android ndk cross compile，gcc 4.9，enable neon\n* Time：warmup 10，running 10 times to get average time\n* Note: 1、shufflenetv2 int8 model add swish operator\n\u003e The counterpart of **`Anakin`** is **`ncnn`(20190320)**. This benchmark we test ARMv7 ARMv8 splitly\n\n\n\n### ARMv8 TEST\n* ABI： arm64-v8a\n- Latency (`ms`) of `one batch`\n\n| Kirin 980       | Anakin fp32 |          |          | Anakin int8 |          |          | NCNN fp32 |          |          | NCNN int8 |          |          |\n|---------------|-------------|----------|----------|-------------|----------|----------|-----------|----------|----------|-----------|----------|----------|\n|               | 1 thread        | 2 thread     | 4 thread     | 1 thread        | 2 thread     | 4 thread     | 1 thread      | 2 thread     | 4 thread     | 1 thread      | 2 thread     | 4 thread     |\n| mobilenet_v1  | 34.172      | 19.369   | 12.723   | 37.588      | 20.692   | 13.280   | 45.420    | 24.220   | 16.730   | 50.560    | 27.820   | 20.010   |\n| mobilenet_v2  | 30.489      | 17.784   | 12.327   | 29.581      | 17.208   | 15.307   | 30.390    | 17.310   | 12.900   |           |          |          |\n| mobilenet_ssd | 71.609      | 37.477   | 28.952   |             |          |          | 88.220    | 70.070   | 66.430   | 103.700   | 85.160   | 85.320   |\n| resnet50      | 255.748     | 137.842  | 104.628  |             |          |          | 1299.480  | 695.830  | 498.010  | 243.360   | 131.100  | 89.800   |\n| shufflenetv1  | 11.544      | 8.931    | 7.027    |             |          |          | 12.810    | 9.390    | 8.030    |           |          |          |\n| shufflenetv2  | 11.687      | 7.899    | 5.321    | 20.402      | 11.529   | 9.061    |           |          |          |           |          |          |\n| squeezenet    | 28.580      | 16.638   | 14.435   |             |          |          |           |          |          |           |          |          |\n| googlenet     | 93.917      | 52.742   | 40.301   | 130.875     | 72.522   | 54.204   |\n\n---\n---\n\n| Snapdragon 855        | Anakin fp32 |          |         | Anakin int8 |          |          | NCNN fp32 |           |          | NCNN int8 |          |          |\n|---------------|-------------|----------|---------|-------------|----------|----------|-----------|-----------|----------|-----------|----------|----------|\n|               | 1 thread        | 2 thread     | 4 thread    | 1 thread        | 2 thread     | 4 thread     | 1 thread      | 2 thread      | 4 thread     | 1 thread      | 2 thread     | 4 thread     |\n| mobilenet_v1  | 32.019      | 19.024   | 10.491  | 34.363      | 20.292   | 10.382   | 37.110    | 22.310    | 13.520   | 47.430    | 28.350   | 15.830   |\n| mobilenet_v2  | 28.533      | 17.455   | 10.433  | 24.487      | 15.182   | 9.133    | 25.060    | 15.970    | 11.250   |           |          |          |\n| mobilenet_ssd | 66.454      | 41.397   | 23.639  |             |          |          | 101.560   | 69.380    | 43.930   | 136.420   | 91.010   | 47.490   |\n| resnet50      | 201.362     | 132.133  | 78.300  |             |          |          | 1141.290  | 724.090   | 385.990  | 229.020   | 138.450  | 82.060   |\n| shufflenetv1  | 10.153      | 7.101    | 5.327   |             |          |          | 11.610    | 8.020     | 5.870    |           |          |          |\n| shufflenetv2  | 10.868      | 6.713    | 4.526   | 17.306      | 10.987   | 6.788    |           |           |          |           |          |          |\n| squeezenet    | 25.880      | 16.134   | 9.697   |             |          |          |           |           |          |           |          |          |\n| googlenet     | 85.774      | 54.518   | 34.025  | 118.120     | 73.686   | 41.865   |\n\n---\n---\n\n| Snapdragon 652        | Anakin fp32 |          |          | Anakin int8 |          |          | NCNN fp32 |           |          | NCNN int8 |          |          |\n|---------------|-------------|----------|----------|-------------|----------|----------|-----------|-----------|----------|-----------|----------|----------|\n|               | 1 thread        | 2 thread     | 4 thread     | 1 thread        | 2 thread     | 4 thread     | 1 thread      | 2 thread      | 4 thread     | 1 thread      | 2 thread     | 4 thread     |\n| mobilenet_v1  | 109.994     | 54.937   | 33.174   | 83.887      | 43.639   | 24.665   | 123.320   | 122.670   | 65.100   | 128.800   | 154.370  | 125.570  |\n| mobilenet_v2  | 80.712      | 46.314   | 30.874   | 69.340      | 43.590   | 31.864   | 89.920    | 90.900    | 55.320   |           |          |          |\n| mobilenet_ssd | 246.459     | 121.684  | 134.019  |             |          |          | 248.190   | 138.170   | 142.350  | 247.020   | 145.080  | 211.000  |\n| resnet50      | 673.285     | 346.287  | 378.065  |             |          |          | 880.940   | 514.190   |          | 533.760   | 313.630  |          |\n| shufflenetv1  | 34.948      | 26.635   | 21.571   |             |          |          | 39.950    | 25.520    | 20.180   |           |          |          |\n| shufflenetv2  | 35.530      | 21.440   | 16.434   | 49.498      | 29.116   | 19.346   |           |           |          |           |          |          |\n| squeezenet    | 87.037      | 47.192   | 28.663   |             |          |          |           |           |          |           |          |          |\n| googlenet     | 268.023     | 148.533  | 95.624   | 236.492     | 131.510  | 81.561   |\n\n---\n---\n\n| RK3399        | Anakin fp32 |          |      | Anakin int8 |          |      | NCNN fp32 |          |      | NCNN int8 |          |      |\n|---------------|-------------|----------|------|-------------|----------|------|-----------|----------|------|-----------|----------|------|\n|               | 1 thread        | 2 thread     | 4 thread | 1 thread        | 2 thread     | 4 thread | 1 thread      | 2 thread     | 4 thread | 1 thread      | 2 thread     | 4 thread |\n| mobilenet_v1  | 111.317     | 60.008   |      | 87.201      | 45.693   |      | 149.270   | 91.200   |      | 142.790   | 86.140   |      |\n| mobilenet_v2  | 105.767     | 60.899   |      | 79.065      | 53.914   |      | 118.530   | 86.900   |      |           |          |      |\n| mobilenet_ssd | 232.923     | 128.337  |      |             |          |      | 268.900   | 157.860  |      | 256.560   | 149.730  |      |\n| resnet50      | 671.800     | 369.386  |      |             |          |      | 1029.300  | 571.230  |      | 569.250   | 344.830  |      |\n| shufflenetv1  | 38.761      | 25.971   |      |             |          |      |           |          |      |           |          |      |\n| shufflenetv2  | 36.220      | 22.095   |      | 51.879      | 30.351   |      |           |          |      |           |          |      |\n| squeezenet    | 98.489      | 54.863   |      |             |          |      |           |          |      |           |          |      |\n| googlenet     | 274.166     | 159.429  |      | 235.085     | 133.044  |\n\n\n\n### ARMv7 TEST\n* ABI： armveabi-v7a with neon\n- Latency (`ms`) of `one batch`\n\n| Kirin 980       | Anakin fp32 |          |          | Anakin int8 |          |          | NCNN fp32 |          |          | NCNN int8 |          |          |\n|---------------|-------------|----------|----------|-------------|----------|----------|-----------|----------|----------|-----------|----------|----------|\n|               | 1 thread        | 2 thread     | 4 thread     | 1 thread        | 2 thread     | 4 thread     | 1 thread      | 2 thread     | 4 thread     | 1 thread      | 2 thread     | 4 thread     |\n| mobilenet_v1  | 39.051      | 19.813   | 14.184   | 39.026      | 22.048   | 14.250   | 50.240    | 26.850   | 20.010   | 92.900    | 49.420   | 37.160   |\n| mobilenet_v2  | 36.052      | 19.550   | 14.507   | 32.656      | 19.641   | 15.735   | 35.890    | 20.730   | 18.550   |           |          |          |\n| mobilenet_ssd | 83.474      | 44.530   | 33.116   |             |          |          | 99.960    | 53.160   | 84.360   | 180.000   | 91.380   | 68.140   |\n| resnet50      | 291.478     | 158.954  | 129.484  |             |          |          | 1412.37   | 766.62   | 560.760  | 355.010   | 189.18   | 133.410  |\n| shufflenetv1  | 11.909      | 9.761    | 7.441    |             |          |          | 16.030    | 10.660   | 8.120    |           |          |          |\n| shufflenetv2  | 11.755      | 7.983    | 6.289    | 21.968      | 14.111   | 9.888    |           |          |          |           |          |          |\n| squeezenet    | 30.148      | 20.908   | 17.084   |             |          |          |           |          |          |           |          |          |\n| googlenet     | 108.210     | 65.798   | 58.630   | 140.886     | 79.910   | 60.693   |\n\n---\n---\n\n| Snapdragon 855        | Anakin fp32 |          |         | Anakin int8 |          |          | NCNN fp32 |           |          | NCNN int8 |          |          |\n|---------------|-------------|----------|---------|-------------|----------|----------|-----------|-----------|----------|-----------|----------|----------|\n|               | 1 thread        | 2 thread     | 4 thread    | 1 thread        | 2 thread     | 4 thread     | 1 thread      | 2 thread      | 4 thread     | 1 thread      | 2 thread     | 4 thread     |\n| mobilenet_v1  | 34.015      | 20.064   | 11.410  | 42.222      | 21.532   | 11.746   | 41.150    | 24.870    | 18.420   | 79.180    | 48.470   | 24.530   |\n| mobilenet_v2  | 30.742      | 18.507   | 11.354  | 24.628      | 15.133   | 9.079    | 30.060    | 19.220    | 15.520   |           |          |          |\n| mobilenet_ssd | 69.749      | 44.010   | 26.000  |             |          |          | 85.030    | 62.770    | 48.940   | 154.600   | 138.700  | 82.140   |\n| resnet50      | 218.581     | 146.509  | 92.899  |             |          |          | 1380.340  | 996.410   | 540.660  | 324.720   | 261.920  | 126.270  |\n| shufflenetv1  | 11.032      | 7.430    | 5.369   |             |          |          | 13.390    | 9.270     | 6.360    |           |          |          |\n| shufflenetv2  | 11.372      | 7.120    | 4.728   | 19.393      | 12.278   | 7.719    |           |           |          |           |          |          |\n| squeezenet    | 27.860      | 17.538   | 10.729  |             |          |          |           |           |          |           |          |          |\n| googlenet     | 100.719     | 69.509   | 49.021  | 127.982     | 83.369   | 50.275   |\n\n---\n---\n\n| Snapdragon 652        | Anakin fp32 |          |          | Anakin int8 |          |          | NCNN fp32 |           |           | NCNN int8 |          |          |\n|---------------|-------------|----------|----------|-------------|----------|----------|-----------|-----------|-----------|-----------|----------|----------|\n|               | 1 thread        | 2 thread     | 4 thread     | 1 thread        | 2 thread     | 4 thread     | 1 thread      | 2 thread      | 4 thread      | 1 thread      | 2 thread     | 4 thread     |\n| mobilenet_v1  | 121.982     | 63.004   | 37.325   | 86.672      | 45.728   | 26.354   | 130.740   | 140.850   | 81.810    | 184.630   | 192.730  | 144.740  |\n| mobilenet_v2  | 89.113      | 50.609   | 35.291   | 72.679      | 45.888   | 33.887   | 94.520    | 101.380   | 65.570    |           |          |          |\n| mobilenet_ssd | 236.466     | 132.293  | 86.335   |             |          |          | 270.630   | 295.520   | 174.280   | 350.640   | 286.420  | 243.850  |\n| resnet50      | 751.528     | 405.433  | 255.699  |             |          |          | 2762.890  | 1447.070  | 883.730   | 664.180   | 369.020  |          |\n| shufflenetv1  | 36.883      | 23.718   | 15.144   |             |          |          | 53.660    | 33.450    | 23.330    |           |          |          |\n| shufflenetv2  | 36.933      | 26.353   | 20.507   | 53.243      | 31.083   | 21.550   |           |           |           |           |          |          |\n| squeezenet    | 92.748      | 51.936   | 33.027   |             |          |          |           |           |           |           |          |          |\n| googlenet     | 296.092     | 179.542  | 125.509  | 242.505     | 140.083  | 89.646   |\n\n---\n---\n\n| RK3399        | Anakin fp32 |          | Anakin int8 |          | NCNN fp32 |           | NCNN int8 |          |\n|---------------|-------------|----------|-------------|----------|-----------|-----------|-----------|----------|\n|               | 1 thread        | 2 thread     | 1 thread        | 2 thread     | 1 thread      | 2 thread      | 1 thread      | 2 thread     |\n| mobilenet_v1  | 116.981     | 65.033   | 87.768      | 47.617   | 155.830   | 98.520    | 201.800   | 116.440  |\n| mobilenet_v2  | 118.229     | 70.567   | 83.790      | 55.413   | 126.530   | 90.930    |           |          |\n| mobilenet_ssd | 237.196     | 134.508  |             |          | 292.130   | 183.650   | 361.570   | 200.370  |\n| resnet50      | 725.582     | 413.995  |             |          | 2883.120  | 1632.800  | 702.660   | 404.970  |\n| shufflenetv1  | 41.094      | 27.353   |             |          |           |           |           |          |\n| shufflenetv2  | 37.660      | 23.489   | 53.558      | 32.122   |           |           |           |          |\n| squeezenet    | 104.519     | 59.402   |             |          |           |           |           |          |\n| googlenet     | 305.304     | 190.897  | 244.855     | 142.493  |\n\n## Documentation\n\n**All you need is in [Doc Index](docs/README.md)**\n\nWe also provide [English](docs/Manual/Tutorial_en.md) and [Chinese](docs/Manual/Tutorial_ch.md)  tutorial documentation.\n\n- User guide\n\n   You can get the working principle of the project, C++ interface description and code examples from [here](docs/Manual/Tutorial_ch.md). You can also learn about the model converter [here](docs/Manual/Converter_ch.md).\n\n- Developer guide\n\n  You might want to know more details of Anakin and make it better. Please refer to [how to add custom devices](docs/Manual/addCustomDevice.md) and [how to add custom device operators](docs/Manual/addCustomOp.md).\n\n- [How to Contribute](docs/Manual/Contribution_ch.md)\n\n   We appreciate your contributions!\n\n## Ask Questions\n\nYou are welcome to submit questions and bug reports as [Github Issues](https://github.com/PaddlePaddle/Anakin/issues).\n\n## Copyright and License\nAnakin is provided under the [Apache-2.0 license](LICENSE).\n\n## Acknowledgement\nAnakin refers to the following projects:\n- [Caffe](https://github.com/BVLC/caffe)\n- [ComputeLibrary](https://github.com/ARM-software/ComputeLibrary)\n- [gemmlowp](https://github.com/google/gemmlowp)\n- [ncnn](https://github.com/Tencent/ncnn)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FPaddlePaddle%2FAnakin","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FPaddlePaddle%2FAnakin","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FPaddlePaddle%2FAnakin/lists"}