https://github.com/viig99/viig99-streamlit-demos

Tool to help Visualize flex attention mod_maps.
https://github.com/viig99/viig99-streamlit-demos

bigbird demo flexattention pytorch streamlit

Last synced: about 1 month ago
JSON representation

Tool to help Visualize flex attention mod_maps.

• Host: GitHub
• URL: https://github.com/viig99/viig99-streamlit-demos
• Owner: viig99
• License: apache-2.0
• Created: 2024-08-23T00:30:05.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-08-28T16:30:11.000Z (3 months ago)
• Last Synced: 2024-09-27T20:03:52.226Z (about 2 months ago)
• Topics: bigbird, demo, flexattention, pytorch, streamlit
• Language: Python
• Homepage: https://viig99-app-demos-jz7hllm8n2ps6fkkwmotuj.streamlit.app/
• Size: 136 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

        
# Flex-Attention Mask Visualization

A Streamlit app to visualize the attention mask of the [Flex-Attention](https://pytorch.org/blog/flexattention/) model.

[![Open in Streamlit](https://static.streamlit.io/badges/streamlit_badge_black_white.svg)](https://viig99-app-demos-jz7hllm8n2ps6fkkwmotuj.streamlit.app/)

### How to run it on your own machine

1. Install the requirements

   ```

   $ pip install -r requirements.txt

   ```

2. Run the app

   ```

   $ streamlit run streamlit_app.py

   ```