Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists by lucidrains
A curated list of projects in awesome lists by lucidrains .
https://github.com/lucidrains/vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
artificial-intelligence attention-mechanism computer-vision image-classification transformers
Last synced: 30 Jul 2024
https://github.com/lucidrains/DALLE2-pytorch
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
artificial-intelligence deep-learning text-to-image
Last synced: 30 Jul 2024
https://github.com/lucidrains/imagen-pytorch
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
artificial-intelligence deep-learning imagination-machine text-to-image text-to-video
Last synced: 30 Jul 2024
https://github.com/lucidrains/PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers
Last synced: 31 Jul 2024
https://github.com/lucidrains/palm-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers
Last synced: 02 Aug 2024
https://github.com/lucidrains/denoising-diffusion-pytorch
Implementation of Denoising Diffusion Probabilistic Model in Pytorch
artificial-intelligence deep-learning generative-model score-matching
Last synced: 31 Jul 2024
https://github.com/lucidrains/DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
artificial-intelligence attention-mechanism deep-learning multi-modal text-to-image transformers
Last synced: 30 Jul 2024
https://github.com/lucidrains/deep-daze
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
artificial-intelligence deep-learning implicit-neural-representation multi-modality siren text-to-image transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
artificial-intelligence attention-mechanism deep-learning transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/stylegan2-pytorch
Simplest working implementation of Stylegan2, state of the art generative adversarial network, in Pytorch. Enabling everyone to experience disentanglement
artificial-intelligence generative-adversarial-network generative-model machine-learning pytorch
Last synced: 01 Aug 2024
https://github.com/lucidrains/musiclm-pytorch
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
artificial-intelligence attention-mechanisms deep-learning music-synthesis transformers
Last synced: 30 Jul 2024
https://github.com/lucidrains/big-sleep
A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
artificial-intelligence deep-learning generative-adversarial-networks multimodality text-to-image
Last synced: 30 Jul 2024
https://github.com/lucidrains/audiolm-pytorch
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
artificial-intelligence attention-mechanisms audio-synthesis deep-learning transformers
Last synced: 05 Aug 2024
https://github.com/lucidrains/reformer-pytorch
Reformer, the efficient Transformer, in Pytorch
artificial-intelligence attention-mechanism machine-learning pytorch transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/lion-pytorch
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
artificial-intelligence deep-learning evolutionary-search optimizers
Last synced: 31 Jul 2024
https://github.com/lucidrains/toolformer-pytorch
Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
api-calling artificial-intelligence attention-mechanisms deep-learning transformers
Last synced: 31 Jul 2024
https://github.com/lucidrains/make-a-video-pytorch
Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch
artificial-intelligence attention-mechanisms axial-convolutions deep-learning text-to-video
Last synced: 31 Jul 2024
https://github.com/lucidrains/byol-pytorch
Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
artificial-intelligence deep-learning self-supervised-learning
Last synced: 01 Aug 2024
https://github.com/lucidrains/lightweight-gan
Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two
artificial-intelligence deep-learning generative-adversarial-network
Last synced: 01 Aug 2024
https://github.com/lucidrains/alphafold2
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
artificial-intelligence attention-mechanism deep-learning protein-folding
Last synced: 01 Aug 2024
https://github.com/lucidrains/lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
artificial-intelligence attention attention-mechanism computer-vision deep-learning
Last synced: 01 Aug 2024
https://github.com/lucidrains/self-rewarding-lm-pytorch
Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
artificial-intelligence beyond-human-data deep-learning self-rewarding transformers
Last synced: 07 Aug 2024
https://github.com/lucidrains/naturalspeech2-pytorch
Implementation of Natural Speech 2, Zero-shot Speech and Singing Synthesizer, in Pytorch
artificial-intelligence deep-learning latent-diffusion residual-vector-quantization singing-synthesis speech-synthesis zero-shot
Last synced: 05 Aug 2024
https://github.com/lucidrains/video-diffusion-pytorch
Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch
artificial-intelligence ddpm deep-learning text-to-video video-generation
Last synced: 31 Jul 2024
https://github.com/lucidrains/flamingo-pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
artificial-intelligence attention-mechanism deep-learning transformers visual-question-answering
Last synced: 07 Aug 2024
https://github.com/lucidrains/soundstorm-pytorch
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
artificial-intelligence attention-mechanism audio-generation deep-learning non-autoregressive transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
artificial-intelligence attention attention-mechanism deep-learning transformers
Last synced: 03 Aug 2024
https://github.com/lucidrains/perceiver-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
artificial-intelligence attention-mechanism deep-learning
Last synced: 31 Jul 2024
https://github.com/lucidrains/RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
artificial-intelligence attention-mechanism deep-learning retrieval transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/PaLM-pytorch
Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
artificial-general-intelligence attention-mechanism deep-learning transformers
Last synced: 07 Aug 2024
https://github.com/lucidrains/phenaki-pytorch
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
artificial-intelligence attention-mechanisms deep-learning imagination-machine text-to-video transformers
Last synced: 09 Aug 2024
https://github.com/lucidrains/TimeSformer-pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
artificial-intelligence attention-mechanism deep-learning transformers video-classification
Last synced: 05 Aug 2024
https://github.com/lucidrains/bottleneck-transformer-pytorch
Implementation of Bottleneck Transformer in Pytorch
artificial-intelligence attention-mechanism deep-learning image-classification transformers vision
Last synced: 02 Aug 2024
https://github.com/lucidrains/x-clip
A concise but complete implementation of CLIP with various experimental improvements from recent papers
artificial-intelligence contrastive-learning deep-learning multi-modal-learning zero-shot-learning
Last synced: 01 Aug 2024
https://github.com/lucidrains/meshgpt-pytorch
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
artificial-intelligence attention-mechanisms deep-learning mesh-generation transformers
Last synced: 31 Jul 2024
https://github.com/lucidrains/linear-attention-transformer
Transformer based on a variant of attention that is linear complexity in respect to sequence length
artificial-intelligence attention-mechanism deep-learning pytorch transformer
Last synced: 01 Aug 2024
https://github.com/lucidrains/memorizing-transformers-pytorch
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
approximate-nearest-neighbors artificial-intelligence attention-mechanism deep-learning memory retrieval transformers
Last synced: 02 Aug 2024
https://github.com/lucidrains/MEGABYTE-pytorch
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
artificial-intelligence attention-mechanisms deep-learning learned-tokenization long-context transformers
Last synced: 03 Aug 2024
https://github.com/lucidrains/point-transformer-pytorch
Implementation of the Point Transformer layer, in Pytorch
artificial-intelligence attention-mechanism deep-learning point-cloud
Last synced: 31 Jul 2024
https://github.com/lucidrains/nuwa-pytorch
Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch
artificial-intelligence attention-mechanism deep-learning text-to-audio text-to-video transformers
Last synced: 08 Aug 2024
https://github.com/lucidrains/voicebox-pytorch
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch
artificial-intelligence deep-learning text-to-speech
Last synced: 31 Jul 2024
https://github.com/lucidrains/rotary-embedding-torch
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
artificial-intelligence deep-learning positional-encoding
Last synced: 31 Jul 2024
https://github.com/lucidrains/ring-attention-pytorch
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
attention-mechanism distributed-attention efficient-attention long-context
Last synced: 04 Aug 2024
https://github.com/lucidrains/enformer-pytorch
Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch
artificial-intelligence attention-mechanism deep-learning dna-sequences gene-expression genomics transformer
Last synced: 31 Jul 2024
https://github.com/lucidrains/egnn-pytorch
Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch
artificial-intelligence deep-learning equivariance graph-neural-network
Last synced: 05 Aug 2024
https://github.com/lucidrains/recurrent-memory-transformer-pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
artificial-intelligence attention-mechanisms deep-learning long-context memory recurrence transformers
Last synced: 03 Aug 2024
https://github.com/lucidrains/FLASH-pytorch
Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
artificial-intelligence attention-mechanism deep-learning efficient-transformers transformers
Last synced: 03 Aug 2024
https://github.com/lucidrains/BS-RoFormer
Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs
artificial-intelligence attention-mechanisms deep-learning music-source-separation transformers
Last synced: 05 Aug 2024
https://github.com/lucidrains/medical-chatgpt
Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis
artificial-intelligence attention-mechanisms deep-learning medicine transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/q-transformer
Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind
artificial-intelligence attention-mechanisms deep-learning offline-learning q-learning robotics transformers
Last synced: 02 Aug 2024
https://github.com/lucidrains/transformer-in-transformer
Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch
artificial-intelligence deep-learning image-classification transformers
Last synced: 07 Aug 2024
https://github.com/lucidrains/st-moe-pytorch
Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
artificial-intelligence conditional-computation deep-learning mixture-of-experts
Last synced: 09 Aug 2024
https://github.com/lucidrains/x-unet
Implementation of a U-net complete with efficient attention as well as the latest research findings
artificial-intelligence deep-learning image-generation segmentation u-net
Last synced: 01 Aug 2024
https://github.com/lucidrains/perfusion-pytorch
Implementation of Key-Locked Rank One Editing, from Nvidia AI
artificial-intelligence deep-learning memory-editing text-to-image
Last synced: 01 Aug 2024
https://github.com/lucidrains/jax2torch
Use Jax functions in Pytorch
deep-learning-framework jax torch
Last synced: 31 Jul 2024
https://github.com/lucidrains/halonet-pytorch
Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones
artificial-intelligence attention-mechanism deep-learning vision
Last synced: 03 Aug 2024
https://github.com/lucidrains/flash-cosine-sim-attention
Implementation of fused cosine similarity attention in the same style as Flash Attention
artificial-intelligence attention-mechanisms deep-learning
Last synced: 04 Aug 2024
https://github.com/lucidrains/PaLM-jax
Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
artificial-general-intelligence attention-mechanism deep-learning jax transformers
Last synced: 01 Aug 2024
https://github.com/lucidrains/contrastive-learner
A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network
artificial-intelligence contrastive-loss deep-learning self-supervised-learning
Last synced: 03 Aug 2024
https://github.com/lucidrains/hamburger-pytorch
Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
artificial-intelligence deep-learning matrix-decomposition
Last synced: 01 Aug 2024
https://github.com/lucidrains/lie-transformer-pytorch
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
artificial-intelligence attention-mechanism deep-learning equivariance se3 transformer
Last synced: 05 Aug 2024
https://github.com/lucidrains/geometric-vector-perceptron
Implementation of Geometric Vector Perceptron, a simple circuit for 3d rotation equivariance for learning over large biomolecules, in Pytorch. Idea proposed and accepted at ICLR 2021
artficial-intelligence biomolecule deep-learning equivariance protein-structure
Last synced: 05 Aug 2024
https://github.com/lucidrains/compositional-attention-pytorch
Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process with disentangled search and retrieval head aggregation, in Pytorch
artificial-intelligence attention-mechanism deep-learning
Last synced: 03 Aug 2024
https://github.com/lucidrains/logavgexp-torch
Implementation of LogAvgExp for Pytorch
Last synced: 03 Aug 2024