https://github.com/Xilinx/finn

Dataflow compiler for QNN inference on FPGAs
https://github.com/Xilinx/finn

compiler dataflow fpga neural-network quantization

Last synced: 9 days ago
JSON representation

Dataflow compiler for QNN inference on FPGAs

• Host: GitHub
• URL: https://github.com/Xilinx/finn
• Owner: Xilinx
• License: bsd-3-clause
• Created: 2018-06-29T15:49:53.000Z (over 6 years ago)
• Default Branch: main
• Last Pushed: 2024-05-28T14:53:44.000Z (5 months ago)
• Last Synced: 2024-05-29T01:43:55.923Z (5 months ago)
• Topics: compiler, dataflow, fpga, neural-network, quantization
• Language: Python
• Homepage: https://xilinx.github.io/finn
• Size: 77.1 MB
• Stars: 674
• Watchers: 31
• Forks: 213
• Open Issues: 80
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE.txt
  • Authors: AUTHORS.rst

Awesome Lists containing this project

• awesome-approximate-dnn - FINN - framework for creating HW accelerator (HLS code) from BREVITAS quantized model, downto BNN, create PE architecture (Tools / FPGA based accelerator / HLS for CNNs)
• awesome-robotic-tooling - finn - Fast, Scalable Quantized Neural Network Inference on FPGAs. (Sensor Processing / Machine Learning)
• awesome-opensource-hardware - finn

README

        
##  Fast, Scalable Quantized Neural Network Inference on FPGAs



[![GitHub Discussions](https://img.shields.io/badge/discussions-join-green)](https://github.com/Xilinx/finn/discussions)

[![ReadTheDocs](https://readthedocs.org/projects/finn/badge/?version=latest&style=plastic)](http://finn.readthedocs.io/)

FINN is an experimental framework from Integrated Communications and AI Lab of AMD Research & Advanced Development to explore deep neural network inference on FPGAs.

It specifically targets quantized neural

networks, with emphasis on

generating dataflow-style architectures customized for each network.

The resulting FPGA accelerators are highly efficient and can yield high throughput and low latency.

The framework is fully open-source in order to give a higher degree of flexibility, and is intended to enable neural network research spanning several layers of the software/hardware abstraction stack.

We have a separate repository [finn-examples](https://github.com/Xilinx/finn-examples) that houses pre-built examples for several neural networks.

For more general information about FINN, please visit the [project page](https://xilinx.github.io/finn/) and check out the [publications](https://xilinx.github.io/finn/publications).

## Getting Started

Please see the [Getting Started](https://finn.readthedocs.io/en/latest/getting_started.html) page for more information on requirements, installation, and how to run FINN in different modes. Due to the complex nature of the dependencies of the project, **we only support Docker-based execution of the FINN compiler at this time**.

## What's New in FINN?

* Please find all news under [GitHub discussions Announcements](https://github.com/Xilinx/finn/discussions/categories/announcements).

## Documentation

You can view the documentation on [readthedocs](https://finn.readthedocs.io). Additionally, there is a series of [Jupyter notebook tutorials](https://github.com/Xilinx/finn/tree/main/notebooks), which we recommend running from inside Docker for a better experience.

## Community

We have [GitHub discussions](https://github.com/Xilinx/finn/discussions) where you can ask questions. You can use the GitHub issue tracker to report bugs, but please don't file issues to ask questions as this is better handled in GitHub discussions.

We also heartily welcome contributions to the project, please check out the [contribution guidelines](CONTRIBUTING.md) and the [list of open issues](https://github.com/Xilinx/finn/issues). Don't hesitate to get in touch over [GitHub discussions](https://github.com/Xilinx/finn/discussions) to discuss your ideas.

In the past, we also had a [Gitter channel](https://gitter.im/xilinx-finn/community). Please be aware that this is no longer maintained by us but can still be used to search for questions previous users had.

## Citation

The current implementation of the framework is based on the following publications. Please consider citing them if you find FINN useful.

    @article{blott2018finn,

      title={FINN-R: An end-to-end deep-learning framework for fast exploration of quantized neural networks},

      author={Blott, Michaela and Preu{\ss}er, Thomas B and Fraser, Nicholas J and Gambardella, Giulio and O’brien, Kenneth and Umuroglu, Yaman and Leeser, Miriam and Vissers, Kees},

      journal={ACM Transactions on Reconfigurable Technology and Systems (TRETS)},

      volume={11},

      number={3},

      pages={1--23},

      year={2018},

      publisher={ACM New York, NY, USA}

    }

    @inproceedings{finn,

    author = {Umuroglu, Yaman and Fraser, Nicholas J. and Gambardella, Giulio and Blott, Michaela and Leong, Philip and Jahre, Magnus and Vissers, Kees},

    title = {FINN: A Framework for Fast, Scalable Binarized Neural Network Inference},

    booktitle = {Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays},

    series = {FPGA '17},

    year = {2017},

    pages = {65--74},

    publisher = {ACM}

    }

## Old version

We previously released an early-stage prototype of a toolflow that took in Caffe-HWGQ binarized network descriptions and produced dataflow architectures. You can find it in the [v0.1](https://github.com/Xilinx/finn/tree/v0.1) branch in this repository.

Please be aware that this version is deprecated and unsupported, and the main branch does not share history with that branch so it should be treated as a separate repository for all purposes.