Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with attention-model

A curated list of projects in awesome lists tagged with attention-model .

https://github.com/jiahuiyu/generative_inpainting

DeepFill v1/v2 with Contextual Attention and Gated Convolution, CVPR 2018, and ICCV 2019 Oral

attention-model deep-neural-networks deepfill generative-adversarial-network image-inpainting tensorflow

Last synced: 18 Dec 2024

https://github.com/JiahuiYu/generative_inpainting

DeepFill v1/v2 with Contextual Attention and Gated Convolution, CVPR 2018, and ICCV 2019 Oral

attention-model deep-neural-networks deepfill generative-adversarial-network image-inpainting tensorflow

Last synced: 26 Oct 2024

https://github.com/philipperemy/keras-attention

Keras Attention Layer (Luong and Bahdanau scores).

attention-mechanism attention-model deep-learning keras keras-neural-networks

Last synced: 20 Dec 2024

https://github.com/lorenmt/mtan

The implementation of "End-to-End Multi-Task Learning with Attention" [CVPR 2019].

attention-model multi-task-learning pytorch

Last synced: 15 Nov 2024

https://github.com/zhongkaifu/seq2seqsharp

Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

attention-model cuda deep-learning encoder-decoder gpu image lstm machine-translation neural-network seq2seq sequence-to-sequence tensor text transformer transformer-architecture transformer-encoder translation vision-transformer

Last synced: 21 Dec 2024

https://github.com/hkproj/transformer-from-scratch-notes

Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)

attention-is-all-you-need attention-model notes study-notes transformer transformer-architecture

Last synced: 17 Nov 2024

https://github.com/guillaume-chevalier/Linear-Attention-Recurrent-Neural-Network

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

attention-is-all-you-need attention-mechanism attention-model lstm pytorch recurrent-neural-networks rnn

Last synced: 05 Nov 2024

https://github.com/guillaume-chevalier/linear-attention-recurrent-neural-network

A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)

attention-is-all-you-need attention-mechanism attention-model lstm pytorch recurrent-neural-networks rnn

Last synced: 01 Nov 2024

https://github.com/kyegomez/rt-x

Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"

artificial-intelligence attention-is-all-you-need attention-model computer-vision gpt4 gpt4all multimodal vision vision-transformer

Last synced: 18 Dec 2024

https://github.com/monk1337/various-attention-mechanisms

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

attention attention-lstm attention-mechanism attention-mechanisms attention-model attention-network bahdanau-attention hierarchical-attention keras luong-attention multi-head-attention pytorch scaled-dot-product-attention self-attention sentence-attention

Last synced: 24 Nov 2024

https://github.com/RituYadav92/Radar-RGB-Attentive-Multimodal-Object-Detection

Object Detection on Radar sensor and RGB camera images. https://ieeexplore.ieee.org/document/9191046 Full Thesis : RADAR+RGB Fusion for Robust Object Detection in Autonomous Vehicles. Zenodo. https://doi.org/10.5281/zenodo.13738235

attention-model autonomous-vehicles multifusion-technique object-detection radar rgbd-image-processing sensor-fusion vision

Last synced: 28 Oct 2024

https://github.com/rituyadav92/radar-rgb-attentive-multimodal-object-detection

Object Detection on Radar sensor and RGB camera images. https://ieeexplore.ieee.org/document/9191046 Full Thesis : RADAR+RGB Fusion for Robust Object Detection in Autonomous Vehicles. Zenodo. https://doi.org/10.5281/zenodo.13738235

attention-model autonomous-vehicles multifusion-technique object-detection radar rgbd-image-processing sensor-fusion vision

Last synced: 30 Nov 2024

https://github.com/dbklim/Voice_ChatBot

Chatbot in russian with speech recognition using PocketSphinx and speech synthesis using RHVoice. The AttentionSeq2Seq model is used. Imlemented using Python3+TensorFlow+Keras.

attention-model bot chatbot flask gensim keras lstm natural-language-processing nlp pocketsphinx restful-api rhvoice russian seq2seq speech-recognition speech-synthesis tensorflow text-processing word2vec

Last synced: 27 Nov 2024

https://github.com/dbklim/voice_chatbot

Chatbot in russian with speech recognition using PocketSphinx and speech synthesis using RHVoice. The AttentionSeq2Seq model is used. Imlemented using Python3+TensorFlow+Keras.

attention-model bot chatbot flask gensim keras lstm natural-language-processing nlp pocketsphinx restful-api rhvoice russian seq2seq speech-recognition speech-synthesis tensorflow text-processing word2vec

Last synced: 11 Nov 2024

https://github.com/guokr/caver

Caver: a toolkit for multilabel text classification.

attention-model cnn deep-learning multi-label-classification nlp pytorch text-classification

Last synced: 22 Nov 2024

https://github.com/hiyouga/pban-pytorch

A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis, PyTorch implementation.

aspect-based-sentiment-analysis attention-model deep-learning natural-language-processing nlp pytorch sentiment-analysis

Last synced: 06 Dec 2024

https://github.com/ningshixian/Keras-Tutorial

Keras深度学习框架配置+Keras教程+Keras Trick

attention-model keras-implementations keras-tutorials

Last synced: 27 Nov 2024

https://github.com/Tsedao/MultiRM

[Nat. Commun.] Code for paper 'Attention-based multi-label neural networks for integrated prediction and interpretation of twelve widely occurring RNA modifications'

attention-model bioinformatics pytorch

Last synced: 28 Nov 2024

https://github.com/maestro-project/frame

FRAME: Fast Roofline Analytical Modeling and Estimation

accelerator attention-model cost-model dnn

Last synced: 17 Nov 2024

https://github.com/kyegomez/audioflamingo

Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities"

ai artificial-intelligence attention-is-all-you-need attention-mechanism attention-model audio audio-ai deeplearning llm machine-learning ml transformer

Last synced: 09 Nov 2024

https://github.com/fahdseddik/deeplearning.ai-natural-language-processing-specialization

This is all my notebooks, lab solutions, and assignments for the DeepLearning.AI Natural Language Processing Specialization on Coursera.

attention-model coursera coursera-specialization deeplearning-ai natural-language-processing nlp probabilistic-models sequence-models vector-space-models

Last synced: 07 Nov 2024

https://github.com/kyegomez/selfextend

Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta

ai artificial-intelligence attention-is-all-you-need attention-mechanism attention-model gpt4 machine-learning ml pytorch torch

Last synced: 09 Nov 2024

https://github.com/ivankuchin/pancreas_segmentation

Tensorflow implementation of a 3D-CNN U-net with Grid Attention and DSV for pancreas segmentation trained on CT-82.

3d-cnn 3d-convolutional-network 3d-convolutions ai attention-mechanism attention-model deep-supervision dsv ml pancreas pancreas-segmentation pancreatic-cancer u-net

Last synced: 14 Dec 2024

https://github.com/borgwardtlab/fisher_information_embedding

Official code for Fisher information embedding for node and graph learning (ICML 2023)

attention-model graph-kernels graph-learning graph-neural-networks icml-2023 information-geometry

Last synced: 21 Nov 2024

https://github.com/minar09/u-net-attention

U-Net + Attention, extending U-Net model for semantic segmentation. Implemented with TensorFlow.

attention attention-gate attention-model attention-to-scale encoder-decoder multi-scale semantic-segmentation tensorflow u-net

Last synced: 07 Nov 2024

https://github.com/firasl/inverse_attention

This repository provides the official implementation of 'Learning to ignore: rethinking attention in CNNs' accepted in BMVC 2021.

attention attention-is-all-you-need attention-model cbam computer-vision learning-by-ignoring tensorflow2

Last synced: 15 Nov 2024

https://github.com/rituyadav92/dausar_supervised_change_detection_floods_igarss2022

Supervised Change Detection for Floods. https://ieeexplore.ieee.org/document/9883132

attention-model change-detection sar siamese-network supervised-learning

Last synced: 30 Nov 2024

https://github.com/vibhujawa/vqa-2018

This repo implements attention networks for visual question answering

attention-model pytorch vqa-dataset

Last synced: 04 Dec 2024

https://github.com/nicolay-r/mlp-attention

Multilayer Perceptron Attention Layer implementation for Relation Extraction

attention-model relation-extraction

Last synced: 19 Dec 2024

https://github.com/praveena2j/rjcma

ABAW6 (CVPR-W) We achieved second place in the valence arousal challenge of ABAW6

affective-computing arousal-valence attention-model emotion emotion-recognition multimodal-learning

Last synced: 15 Nov 2024

https://github.com/mahdizynali/brats2020-tensorflow-brain-tumor-segmentation

implementation of Tensorflow Unet brain tumor segmentation and detection enhanced with attention model on nii datasets

attention-model brain detection machine-learning neural-network opencv segmentation tensorflow tensorflow2 tumor-detection tumor-segmentation unet unet-image-segmentation

Last synced: 10 Nov 2024

https://github.com/V-Sense/omniAttention

This is the GitHub page for the QoMEX 2018 paper: Visual Attention in Omnidirectional Video for Virtual Reality Applications

360-video attention attention-model saliency saliency-detection saliency-map virtual-reality

Last synced: 23 Oct 2024

https://github.com/kyegomez/open-namm

An open source implementation of the paper: "AN EVOLVED UNIVERSAL TRANSFORMER MEMORY"

agora agoralab ai arxviv attention attention-mechanism attention-model chatgpt deep-learning gpt ml open-implementation open-source papers transformers

Last synced: 10 Dec 2024

https://github.com/praveena2j/rjcaforspeakerverification

[FG 2024] "Audio-Visual Person Verification based on Recursive Fusion of Joint Cross-Attention"

attention attention-model audio-visual-learning multimodal-learning speaker-verification

Last synced: 15 Nov 2024

https://github.com/iamarunbrahma/language-translation-using-attention-models

In this project, we translated Italian sentence to English sentence using custom encoder-decoder models and attention mechanism.

attention-model encoder-decoder lstm machine-translation

Last synced: 07 Dec 2024