https://github.com/thu-ml/riflex

Official implementation for "RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers" (ICML 2025)

cogvideox diffusion diffusion-models diffusion-transformer dit extrapolation generative-model hunyuan-video long-video-generation position-embedding rope video-generation

Last synced: 01 Jul 2025

https://github.com/naver-ai/rope-vit

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

eccv2024 position-embedding rotary-position-embedding self-attention transformer vision-transformer

Last synced: 06 Apr 2026

https://github.com/erogol/blagpt

Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.

attention-mechanisms deep-learning diffusion-llm dllm gpt gpt-2 hymba large-language-models llm llm-training machine-learning position-embedding pytorch transformers

Last synced: 07 Jul 2025

https://github.com/lartpang/rotarypositionembedding

position-embedding rope

Last synced: 20 Apr 2026