Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/iree-org/iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.
https://github.com/iree-org/iree

compiler cuda jax machine-learning mlir onnx pytorch runtime spirv tensorflow vulkan

Last synced: 3 days ago
JSON representation

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Host: GitHub
URL: https://github.com/iree-org/iree
Owner: iree-org
License: apache-2.0
Created: 2019-09-12T20:57:39.000Z (over 5 years ago)
Default Branch: main
Last Pushed: 2025-01-16T09:39:53.000Z (6 days ago)
Last Synced: 2025-01-16T10:55:20.558Z (6 days ago)
Topics: compiler, cuda, jax, machine-learning, mlir, onnx, pytorch, runtime, spirv, tensorflow, vulkan
Language: C++
Homepage: http://iree.dev/
Size: 188 MB
Stars: 2,933
Watchers: 92
Forks: 641
Open Issues: 1,236
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Citation: CITATION.cff
- Codeowners: .github/CODEOWNERS
- Authors: AUTHORS

Awesome Lists containing this project

AiTreasureBox - iree-org/iree - 01-19_2936_2](https://img.shields.io/github/stars/iree-org/iree.svg)|A retargetable MLIR-based machine learning compiler and runtime toolkit.| (Repos)
awesome-mojo-max-mlir - IREE - org/iree?style=social"/> : A retargetable MLIR-based machine learning compiler and runtime toolkit. [iree.dev/](http://iree.dev/) (Machine Learning)
awesome-mojo-max-mlir - IREE - org/iree?style=social"/> : A retargetable MLIR-based machine learning compiler and runtime toolkit. [iree.dev/](http://iree.dev/) (Machine Learning)
awesome-cuda-triton-hpc - IREE - org/iree?style=social"/> : IREE: Intermediate Representation Execution Environment. A retargetable MLIR-based machine learning compiler and runtime toolkit. [iree.dev/](http://iree.dev/) (Frameworks)

README

        # IREE: Intermediate Representation Execution Environment



IREE (**I**ntermediate **R**epresentation **E**xecution **E**nvironment,

pronounced as "eerie") is an [MLIR](https://mlir.llvm.org/)-based end-to-end

compiler and runtime that lowers Machine Learning (ML) models to a unified IR

that scales up to meet the needs of the datacenter and down to satisfy the

constraints and special considerations of mobile and edge deployments.

See [our website](https://iree.dev/) for project details, user

guides, and instructions on building from source.

[![IREE Discord Status](https://discordapp.com/api/guilds/689900678990135345/widget.png?style=shield)]([https://discord.gg/wEWh6Z9nMU](https://discord.gg/wEWh6Z9nMU))

[![pre-commit](https://img.shields.io/badge/pre--commit-enabled-brightgreen?logo=pre-commit)](https://github.com/pre-commit/pre-commit)

[![OpenSSF Best Practices](https://www.bestpractices.dev/projects/8738/badge)](https://www.bestpractices.dev/projects/8738)

## Project news

* 2024-05-23: [IREE joins the LF AI & Data Foundation as a sandbox-stage project](https://lfaidata.foundation/blog/2024/05/23/announcing-iree-a-new-initiative-for-machine-learning-deployment/)

## Project status

### Release status

Releases notes are

[published on GitHub releases](https://github.com/iree-org/iree/releases?q=prerelease%3Afalse).

| Package | Release status |

| -- | -- |

GitHub release (stable) | [![GitHub Release](https://img.shields.io/github/v/release/iree-org/iree)](https://github.com/iree-org/iree/releases/latest)

GitHub release (nightly) | [![GitHub Release](https://img.shields.io/github/v/release/iree-org/iree?include_prereleases)](https://github.com/iree-org/iree/releases)

Python iree-base-compiler | [![PyPI version](https://badge.fury.io/py/iree-base-compiler.svg)](https://badge.fury.io/py/iree-base-compiler)

Python iree-base-runtime | [![PyPI version](https://badge.fury.io/py/iree-base-runtime.svg)](https://badge.fury.io/py/iree-base-runtime)

### Build status

[![CI](https://github.com/iree-org/iree/actions/workflows/ci.yml/badge.svg?query=branch%3Amain+event%3Apush)](https://github.com/iree-org/iree/actions/workflows/ci.yml?query=branch%3Amain+event%3Apush)

[![PkgCI](https://github.com/iree-org/iree/actions/workflows/pkgci.yml/badge.svg?query=branch%3Amain+event%3Apush)](https://github.com/iree-org/iree/actions/workflows/pkgci.yml?query=branch%3Amain+event%3Apush)

#### Nightly build status

| Operating system | Build status |

| -- | --: |

Linux | [![CI - Linux arm64 clang](https://github.com/iree-org/iree/actions/workflows/ci_linux_arm64_clang.yml/badge.svg?query=branch%3Amain+event%3Aschedule)](https://github.com/iree-org/iree/actions/workflows/ci_linux_arm64_clang.yml?query=branch%3Amain+event%3Aschedule)

macOS | [![CI - macOS x64 clang](https://github.com/iree-org/iree/actions/workflows/ci_macos_x64_clang.yml/badge.svg?query=branch%3Amain+event%3Aschedule)](https://github.com/iree-org/iree/actions/workflows/ci_macos_x64_clang.yml?query=branch%3Amain+event%3Aschedule)

macOS | [![CI - macOS arm64 clang](https://github.com/iree-org/iree/actions/workflows/ci_macos_arm64_clang.yml/badge.svg?query=branch%3Amain+event%3Aschedule)](https://github.com/iree-org/iree/actions/workflows/ci_macos_arm64_clang.yml?query=branch%3Amain+event%3Aschedule)

Windows | [![CI - Windows x64 MSVC](https://github.com/iree-org/iree/actions/workflows/ci_windows_x64_msvc.yml/badge.svg?query=branch%3Amain+event%3Aschedule)](https://github.com/iree-org/iree/actions/workflows/ci_windows_x64_msvc.yml?query=branch%3Amain+event%3Aschedule)

For the full list of workflows see

https://iree.dev/developers/general/github-actions/.

## Communication channels

*   [GitHub issues](https://github.com/iree-org/iree/issues): Feature requests,

    bugs, and other work tracking

*   [IREE Discord server](https://discord.gg/wEWh6Z9nMU): Daily development

    discussions with the core team and collaborators

*   (New) [iree-announce email list](https://lists.lfaidata.foundation/g/iree-announce):

    Announcements

*   (New) [iree-technical-discussion email list](https://lists.lfaidata.foundation/g/iree-technical-discussion):

    General and low-priority discussion

*   (Legacy) [iree-discuss email list](https://groups.google.com/forum/#!forum/iree-discuss):

    Announcements, general and low-priority discussion

### Related project channels

*   [MLIR topic within LLVM Discourse](https://llvm.discourse.group/c/llvm-project/mlir/31):

    IREE is enabled by and heavily relies on [MLIR](https://mlir.llvm.org). IREE

    sometimes is referred to in certain MLIR discussions. Useful if you are also

    interested in MLIR evolution.

## Architecture overview

![IREE Architecture](docs/website/docs/assets/images/iree_architecture_dark.svg#gh-dark-mode-only)

![IREE Architecture](docs/website/docs/assets/images/iree_architecture.svg#gh-light-mode-only)

See [our website](https://iree.dev/) for more information.

## Presentations and talks

Community meeting recordings: [IREE YouTube channel](https://www.youtube.com/@iree4356)

Date | Title | Recording | Slides

---- | ----- | --------- | ------

2021-06-09 | IREE Runtime Design Tech Talk | [recording](https://drive.google.com/file/d/1p0DcysaIg8rC7ErKYEgutQkOJGPFCU3s/view) | [slides](https://drive.google.com/file/d/1ikgOdZxnMz1ExqwrAiuTY9exbe3yMWbB/view?usp=sharing)

2020-08-20 | IREE CodeGen (MLIR Open Design Meeting) | [recording](https://drive.google.com/file/d/1325zKXnNIXGw3cdWrDWJ1-bp952wvC6W/view?usp=sharing) | [slides](https://docs.google.com/presentation/d/1NetHjKAOYg49KixY5tELqFp6Zr2v8_ujGzWZ_3xvqC8/edit)

2020-03-18 | Interactive HAL IR Walkthrough | [recording](https://drive.google.com/file/d/1_sWDgAPDfrGQZdxAapSA90AD1jVfhp-f/view?usp=sharing) |

2020-01-31 | End-to-end MLIR Workflow in IREE (MLIR Open Design Meeting) | [recording](https://drive.google.com/open?id=1os9FaPodPI59uj7JJI3aXnTzkuttuVkR) | [slides](https://drive.google.com/open?id=1RCQ4ZPQFK9cVgu3IH1e5xbrBcqy7d_cEZ578j84OvYI)

## License

IREE is licensed under the terms of the Apache 2.0 License with LLVM Exceptions.

See [LICENSE](LICENSE) for more information.