https://github.com/eljandoubi/triton-flash-attn

https://github.com/eljandoubi/triton-flash-attn

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/eljandoubi/triton-flash-attn
• Owner: eljandoubi
• License: apache-2.0
• Created: 2025-01-02T13:39:13.000Z (4 months ago)
• Default Branch: master
• Last Pushed: 2025-03-08T04:12:42.000Z (2 months ago)
• Last Synced: 2025-03-08T04:27:48.754Z (2 months ago)
• Language: Makefile
• Size: 0 Bytes
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        


    

        

    





    

        

            Triton Flash Attention

        

    



![License](https://img.shields.io/github/license/eljandoubi/triton-flash-attn)

![Pylint](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Lint.yml/badge.svg)

| Python Version | Build Status |

|---------------|-------------|

| 3.8          | ![Python 3.8](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Build.yml/badge.svg?event=push&job=Build%20Python%203.8) |

| 3.9          | ![Python 3.9](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Build.yml/badge.svg?event=push&job=Build%20Python%203.9) |

| 3.10         | ![Python 3.10](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Build.yml/badge.svg?event=push&job=Build%20Python%203.10) |

| 3.11         | ![Python 3.11](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Build.yml/badge.svg?event=push&job=Build%20Python%203.11) |

| 3.12         | ![Python 3.12](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Build.yml/badge.svg?event=push&job=Build%20Python%203.12) |

| 3.13         | ![Python 3.13](https://github.com/eljandoubi/triton-flash-attn/actions/workflows/Build.yml/badge.svg?event=push&job=Build%20Python%203.13) |

Coding Flash Attention from scratch using triton and pytorch.

## Setup environment

* Clone the repository and Go to `triton-flash-attn` directory.

```bash

git clone https://github.com/eljandoubi/triton-flash-attn.git && cd triton-flash-attn

```

* Build environment.

```bash

make build

```

## Clean environment

```bash

make clean

```