https://github.com/modeltc/mqbench

Model Quantization Benchmark
https://github.com/modeltc/mqbench

Last synced: 9 months ago
JSON representation

Model Quantization Benchmark

• Host: GitHub
• URL: https://github.com/modeltc/mqbench
• Owner: ModelTC
• License: apache-2.0
• Created: 2021-08-19T13:32:15.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2025-04-12T09:39:41.000Z (10 months ago)
• Last Synced: 2025-04-12T10:31:49.614Z (10 months ago)
• Language: Python
• Size: 3.45 MB
• Stars: 798
• Watchers: 14
• Forks: 142
• Open Issues: 13
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          


    



------------

[![Documentation Status](https://readthedocs.org/projects/mqbench/badge/?version=latest)](https://mqbench.readthedocs.io/en/latest/?badge=latest)

[![Lint and test](https://github.com/ModelTC/MQBench/actions/workflows/lint-and-test.yml/badge.svg?branch=main)](https://github.com/ModelTC/MQBench/actions/workflows/lint-and-test.yml)

[![license](https://img.shields.io/github/license/ModelTC/MQBench)](https://github.com/ModelTC/MQBench/blob/main/LICENSE)

## Latest News

- **Jan 10, 2025:** 🚀 MQBench already supports torch2.5.1!!! The old version that supports torch1.10 is [here](https://github.com/ModelTC/MQBench/tree/mqb-torch1.10).

## Introduction

MQBench is an open-source model quantization toolkit based on PyTorch fx.

The envision of MQBench is to provide:

- **SOTA Algorithms**. With MQBench, the hardware vendors and researchers can benefit from the latest research progress in academic.

- **Powerful Toolkits**. With the toolkit, quantization node can be inserted to the original PyTorch module automatically with respect to the specific hardware. After training, the quantized model can be smoothly converted to the format that can inference on the real device.

## Installation

```shell

git clone git@github.com:ModelTC/MQBench.git

cd MQBench

pip install -v -e .

```

## Documentation

MQBench aims to support (1) various deployable quantization algorithms and (2) hardware backend libraries to facilitate the development of the community.

For the detailed information, please refer to [MQBench documentation](https://mqbench.readthedocs.io/en/latest/).

## Citation

If you use this toolkit or benchmark in your research, please cite this project.

```latex

@article{MQBench,

  title   = {MQBench: Towards Reproducible and Deployable Model Quantization Benchmark},

  author  = {Yuhang Li* and Mingzhu Shen* and Jian Ma* and Yan Ren* and Mingxin Zhao* and

             Qi Zhang* and Ruihao Gong* and Fengwei Yu and Junjie Yan},

  journal= {Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks},

  year={2021}

}

```

## License

This project is released under the [Apache 2.0 license](LICENSE).