Projects in Awesome Lists tagged with flash-attention-2
A curated list of projects in awesome lists tagged with flash-attention-2 .
https://github.com/arihanv/Shush
Shush is an app that deploys a WhisperV3 model with Flash Attention v2 on Modal and makes requests to it via a NextJS app
flash-attention-2 huggingface-transformers machine-learning modal shadcn-ui transcription whisper
Last synced: 30 Nov 2024
https://github.com/bbc-esq/whispers2t-transcriber
Uses the powerful WhisperS2T and Ctranslate2 libraries to batch transcribe multiple files
audio-recorder audio-recording audio-transcribing audio-transcription ctranslate2 flash-attention-2 transcr transcriber transcription whispers2t
Last synced: 01 May 2025
https://github.com/bruce-lee-ly/flash_attention_inference
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
cuda cutlass flash-attention flash-attention-2 gpu inference large-language-model llm mha multi-head-attention nvidia tensor-core
Last synced: 13 Apr 2025
https://github.com/erfanzar/jax-flash-attn2
A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/Pallas/JAX).
flash-attention flash-attention-2 jax pallas
Last synced: 12 Apr 2025
https://github.com/nptt9/illama
A fast, lightweight, parallel inference server for Llama LLMs.
exllama exllamav2 flash-attention-2 inference llama llama2 llama3 llm-inference paged-attention server
Last synced: 22 Mar 2025
https://github.com/nickpotafiy/illama
A fast, lightweight, parallel inference server for Llama LLMs.
exllama exllamav2 flash-attention-2 inference llama llama2 llama3 llm-inference paged-attention server
Last synced: 26 Mar 2025
https://github.com/lalitdotdev/transcribex
Transcribe audio in minutes with OpenAI's WhisperV3 and Flash Attention v2 + Transformers without relying on third-party providers and APIs. Host it yourself or try it out.
bun fastapi flash-attention-2 huggingface-transformers modal next14 nvidia-cuda nvidia-gpu python transcription transformers virtual-environment wavesurfer-js whisper- whisperv3
Last synced: 06 Mar 2025
