Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists by lucidrains

A curated list of projects in awesome lists by lucidrains .

https://github.com/lucidrains/vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

artificial-intelligence attention-mechanism computer-vision image-classification transformers

Last synced: 30 Jul 2024

https://github.com/lucidrains/DALLE2-pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

artificial-intelligence deep-learning text-to-image

Last synced: 30 Jul 2024

https://github.com/lucidrains/imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

artificial-intelligence deep-learning imagination-machine text-to-image text-to-video

Last synced: 30 Jul 2024

https://github.com/lucidrains/PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers

Last synced: 31 Jul 2024

https://github.com/lucidrains/palm-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

artificial-intelligence attention-mechanisms deep-learning human-feedback reinforcement-learning transformers

Last synced: 02 Aug 2024

https://github.com/lucidrains/denoising-diffusion-pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

artificial-intelligence deep-learning generative-model score-matching

Last synced: 31 Jul 2024

https://github.com/lucidrains/DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

artificial-intelligence attention-mechanism deep-learning multi-modal text-to-image transformers

Last synced: 30 Jul 2024

https://github.com/lucidrains/deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

artificial-intelligence deep-learning implicit-neural-representation multi-modality siren text-to-image transformers

Last synced: 01 Aug 2024

https://github.com/lucidrains/x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

artificial-intelligence attention-mechanism deep-learning transformers

Last synced: 01 Aug 2024

https://github.com/lucidrains/stylegan2-pytorch

Simplest working implementation of Stylegan2, state of the art generative adversarial network, in Pytorch. Enabling everyone to experience disentanglement

artificial-intelligence generative-adversarial-network generative-model machine-learning pytorch

Last synced: 01 Aug 2024

https://github.com/lucidrains/musiclm-pytorch

Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

artificial-intelligence attention-mechanisms deep-learning music-synthesis transformers

Last synced: 30 Jul 2024

https://github.com/lucidrains/big-sleep

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

artificial-intelligence deep-learning generative-adversarial-networks multimodality text-to-image

Last synced: 30 Jul 2024

https://github.com/lucidrains/audiolm-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

artificial-intelligence attention-mechanisms audio-synthesis deep-learning transformers

Last synced: 05 Aug 2024

https://github.com/lucidrains/lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

artificial-intelligence deep-learning evolutionary-search optimizers

Last synced: 31 Jul 2024

https://github.com/lucidrains/toolformer-pytorch

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

api-calling artificial-intelligence attention-mechanisms deep-learning transformers

Last synced: 31 Jul 2024

https://github.com/lucidrains/make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

artificial-intelligence attention-mechanisms axial-convolutions deep-learning text-to-video

Last synced: 31 Jul 2024

https://github.com/lucidrains/byol-pytorch

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

artificial-intelligence deep-learning self-supervised-learning

Last synced: 01 Aug 2024

https://github.com/lucidrains/lightweight-gan

Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two

artificial-intelligence deep-learning generative-adversarial-network

Last synced: 01 Aug 2024

https://github.com/lucidrains/alphafold2

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

artificial-intelligence attention-mechanism deep-learning protein-folding

Last synced: 01 Aug 2024

https://github.com/lucidrains/lambda-networks

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

artificial-intelligence attention attention-mechanism computer-vision deep-learning

Last synced: 01 Aug 2024

https://github.com/lucidrains/self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

artificial-intelligence beyond-human-data deep-learning self-rewarding transformers

Last synced: 07 Aug 2024

https://github.com/lucidrains/naturalspeech2-pytorch

Implementation of Natural Speech 2, Zero-shot Speech and Singing Synthesizer, in Pytorch

artificial-intelligence deep-learning latent-diffusion residual-vector-quantization singing-synthesis speech-synthesis zero-shot

Last synced: 05 Aug 2024

https://github.com/lucidrains/video-diffusion-pytorch

Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

artificial-intelligence ddpm deep-learning text-to-video video-generation

Last synced: 31 Jul 2024

https://github.com/lucidrains/flamingo-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

artificial-intelligence attention-mechanism deep-learning transformers visual-question-answering

Last synced: 07 Aug 2024

https://github.com/lucidrains/soundstorm-pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

artificial-intelligence attention-mechanism audio-generation deep-learning non-autoregressive transformers

Last synced: 01 Aug 2024

https://github.com/lucidrains/performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

artificial-intelligence attention attention-mechanism deep-learning transformers

Last synced: 03 Aug 2024

https://github.com/lucidrains/perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

artificial-intelligence attention-mechanism deep-learning

Last synced: 31 Jul 2024

https://github.com/lucidrains/RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

artificial-intelligence attention-mechanism deep-learning retrieval transformers

Last synced: 01 Aug 2024

https://github.com/lucidrains/PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

artificial-general-intelligence attention-mechanism deep-learning transformers

Last synced: 07 Aug 2024

https://github.com/lucidrains/phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

artificial-intelligence attention-mechanisms deep-learning imagination-machine text-to-video transformers

Last synced: 09 Aug 2024

https://github.com/lucidrains/TimeSformer-pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

artificial-intelligence attention-mechanism deep-learning transformers video-classification

Last synced: 05 Aug 2024

https://github.com/lucidrains/x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent papers

artificial-intelligence contrastive-learning deep-learning multi-modal-learning zero-shot-learning

Last synced: 01 Aug 2024

https://github.com/lucidrains/meshgpt-pytorch

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

artificial-intelligence attention-mechanisms deep-learning mesh-generation transformers

Last synced: 31 Jul 2024

https://github.com/lucidrains/linear-attention-transformer

Transformer based on a variant of attention that is linear complexity in respect to sequence length

artificial-intelligence attention-mechanism deep-learning pytorch transformer

Last synced: 01 Aug 2024

https://github.com/lucidrains/memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

approximate-nearest-neighbors artificial-intelligence attention-mechanism deep-learning memory retrieval transformers

Last synced: 02 Aug 2024

https://github.com/lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

artificial-intelligence attention-mechanisms deep-learning learned-tokenization long-context transformers

Last synced: 03 Aug 2024

https://github.com/lucidrains/point-transformer-pytorch

Implementation of the Point Transformer layer, in Pytorch

artificial-intelligence attention-mechanism deep-learning point-cloud

Last synced: 31 Jul 2024

https://github.com/lucidrains/nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

artificial-intelligence attention-mechanism deep-learning text-to-audio text-to-video transformers

Last synced: 08 Aug 2024

https://github.com/lucidrains/voicebox-pytorch

Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch

artificial-intelligence deep-learning text-to-speech

Last synced: 31 Jul 2024

https://github.com/lucidrains/rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

artificial-intelligence deep-learning positional-encoding

Last synced: 31 Jul 2024

https://github.com/lucidrains/ring-attention-pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

attention-mechanism distributed-attention efficient-attention long-context

Last synced: 04 Aug 2024

https://github.com/lucidrains/enformer-pytorch

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

artificial-intelligence attention-mechanism deep-learning dna-sequences gene-expression genomics transformer

Last synced: 31 Jul 2024

https://github.com/lucidrains/egnn-pytorch

Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch

artificial-intelligence deep-learning equivariance graph-neural-network

Last synced: 05 Aug 2024

https://github.com/lucidrains/recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

artificial-intelligence attention-mechanisms deep-learning long-context memory recurrence transformers

Last synced: 03 Aug 2024

https://github.com/lucidrains/FLASH-pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

artificial-intelligence attention-mechanism deep-learning efficient-transformers transformers

Last synced: 03 Aug 2024

https://github.com/lucidrains/BS-RoFormer

Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

artificial-intelligence attention-mechanisms deep-learning music-source-separation transformers

Last synced: 05 Aug 2024

https://github.com/lucidrains/medical-chatgpt

Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis

artificial-intelligence attention-mechanisms deep-learning medicine transformers

Last synced: 01 Aug 2024

https://github.com/lucidrains/q-transformer

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind

artificial-intelligence attention-mechanisms deep-learning offline-learning q-learning robotics transformers

Last synced: 02 Aug 2024

https://github.com/lucidrains/transformer-in-transformer

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

artificial-intelligence deep-learning image-classification transformers

Last synced: 07 Aug 2024

https://github.com/lucidrains/st-moe-pytorch

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

artificial-intelligence conditional-computation deep-learning mixture-of-experts

Last synced: 09 Aug 2024

https://github.com/lucidrains/x-unet

Implementation of a U-net complete with efficient attention as well as the latest research findings

artificial-intelligence deep-learning image-generation segmentation u-net

Last synced: 01 Aug 2024

https://github.com/lucidrains/perfusion-pytorch

Implementation of Key-Locked Rank One Editing, from Nvidia AI

artificial-intelligence deep-learning memory-editing text-to-image

Last synced: 01 Aug 2024

https://github.com/lucidrains/jax2torch

Use Jax functions in Pytorch

deep-learning-framework jax torch

Last synced: 31 Jul 2024

https://github.com/lucidrains/halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

artificial-intelligence attention-mechanism deep-learning vision

Last synced: 03 Aug 2024

https://github.com/lucidrains/flash-cosine-sim-attention

Implementation of fused cosine similarity attention in the same style as Flash Attention

artificial-intelligence attention-mechanisms deep-learning

Last synced: 04 Aug 2024

https://github.com/lucidrains/PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

artificial-general-intelligence attention-mechanism deep-learning jax transformers

Last synced: 01 Aug 2024

https://github.com/lucidrains/contrastive-learner

A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network

artificial-intelligence contrastive-loss deep-learning self-supervised-learning

Last synced: 03 Aug 2024

https://github.com/lucidrains/hamburger-pytorch

Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"

artificial-intelligence deep-learning matrix-decomposition

Last synced: 01 Aug 2024

https://github.com/lucidrains/lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

artificial-intelligence attention-mechanism deep-learning equivariance se3 transformer

Last synced: 05 Aug 2024

https://github.com/lucidrains/geometric-vector-perceptron

Implementation of Geometric Vector Perceptron, a simple circuit for 3d rotation equivariance for learning over large biomolecules, in Pytorch. Idea proposed and accepted at ICLR 2021

artficial-intelligence biomolecule deep-learning equivariance protein-structure

Last synced: 05 Aug 2024

https://github.com/lucidrains/compositional-attention-pytorch

Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process with disentangled search and retrieval head aggregation, in Pytorch

artificial-intelligence attention-mechanism deep-learning

Last synced: 03 Aug 2024

https://github.com/lucidrains/logavgexp-torch

Implementation of LogAvgExp for Pytorch

logsumexp pytorch

Last synced: 03 Aug 2024