Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-huggingface

🤗 A list of wonderful open-source projects & applications integrated with Hugging Face libraries.
https://github.com/bobvanluijt/awesome-huggingface

Last synced: about 9 hours ago
JSON representation

  • 🧰 NLP Toolkits

    • Lightning Transformers - Transformers with PyTorch Lightning interface.
    • Adapter Transformers - Extension to the Transformers library, integrating adapters into state-of-the-art language models.
    • AllenNLP - An open-source NLP research library.
    • Graph4NLP - Enabling easy use of Graph Neural Networks for NLP.
    • Lightning Transformers - Transformers with PyTorch Lightning interface.
    • Adapter Transformers - Extension to the Transformers library, integrating adapters into state-of-the-art language models.
    • Obsei - A low-code AI workflow automation tool and performs various NLP tasks in the workflow pipeline.

  • đŸ—ē Translation

    • dl-translate - A deep learning-based translation library based on HF Transformers.
    • dl-translate - A deep learning-based translation library based on HF Transformers.
    • EasyNMT - Easy-to-use, state-of-the-art translation library and Docker images based on HF Transformers.

  • 🤗 Official Libraries

    • transformers - State-of-the-art natural language processing for Jax, PyTorch and TensorFlow.
    • datasets - The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools.
    • tokenizers - Fast state-of-the-Art tokenizers optimized for research and production.
    • knockknock - Get notified when your training ends with only two additional lines of code.
    • accelerate - A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision.
    • nn_pruning - Prune a model while finetuning or training.
    • huggingface_hub - Client library to download and publish models and other files on the huggingface.co hub.
    • autonlp - Train state-of-the-art natural language processing models and deploy them in a scalable environment automatically.

  • 📱 Hardware

    • Intel - Collaboration with Intel for configuration options.

  • 👩‍đŸĢ Tutorials

  • đŸĨĄ Text Representation

    • Sentence Transformers - Widely used encoders computing dense vector representations for sentences, paragraphs, and images.
    • WhiteningBERT - An easy unsupervised sentence embedding approach with whitening.
    • SimCSE - State-of-the-art sentence embedding with contrastive learning.
    • DensePhrases - Learning dense representations of phrases at scale.

  • ⚙ī¸ Inference Engines

    • TurboTransformers - An inference engine for transformers with fast C++ API.
    • FasterTransformer - A script and recipe to run the highly optimized transformer-based encoder and decoder component on NVIDIA GPUs.
    • lightseq - A high performance inference library for sequence processing and generation implemented in CUDA.
    • FastSeq - Efficient implementation of popular sequence models (e.g., Bart, ProphetNet) for text generation, summarization, translation tasks etc.

  • 🏎ī¸ Model Compression/Acceleration

    • TextBrewer - State-of-the-art distillation methods to compress language models.
    • BERT-of-Theseus - Compressing BERT by progressively replacing the components of the original BERT.
    • torchdistill - PyTorch-based modular, configuration-driven framework for knowledge distillation.

  • 🏹ī¸ Adversarial Attack

    • TextAttack - A Python framework for adversarial attacks, data augmentation, and model training in NLP.
    • TextFlint - A unified multilingual robustness evaluation toolkit for NLP.
    • OpenAttack - An open-source textual adversarial attack toolkit.

  • 🔁 Style Transfer

    • Styleformer - A neural language style transfer framework to transfer text smoothly between styles.
    • ConSERT - A contrastive framework for self-supervised sentence representation transfer.

  • đŸ’ĸ Sentiment Analysis

    • conv-emotion - Implementation of different architectures for emotion recognition in conversations.
    • Jina Integration - Jina integration of Hugging Face Accelerated API.
    • Weaviate Integration - Weaviate integration of Hugging Face Transformers.
    • ColBERT - A fast and accurate retrieval model, enabling scalable BERT-based search over large text collections in tens of milliseconds.

  • ❓ Question Answering

    • Haystack - End-to-end framework for developing and deploying question-answering systems in the wild.

  • 🙅 Grammatical Error Correction

    • Gramformer - A framework for detecting, highlighting and correcting grammatical errors on natural language text.

  • 📖 Knowledge and Entity

    • PURE - Entity and relation extraction from text.

  • 🎙 Speech

    • s3prl - A self-supervised speech pre-training and representation learning toolkit.
    • speechbrain - A PyTorch-based speech toolkit.

  • đŸ¤¯ Multi-modality

    • ViLT - A vision-and-language transformer Without convolution or region supervision.

  • 🤖 Reinforcement Learning

    • trl - Fine-tune transformers using Proximal Policy Optimization (PPO) to align with human preferences.
Programming Languages
Python 35 Jupyter Notebook 4 C++ 3 Rust 1
Categories
🤗 Official Libraries 8 🧰 NLP Toolkits 7 đŸĨĄ Text Representation 4 ⚙ī¸ Inference Engines 4 🔍 Neural Search 3 🏹ī¸ Adversarial Attack 3 đŸ—ē Translation 3 🏎ī¸ Model Compression/Acceleration 3 🔁 Style Transfer 2 🎙 Speech 2 đŸ¤¯ Multi-modality 1 đŸ’ĸ Sentiment Analysis 1 🙅 Grammatical Error Correction 1 📱 Hardware 1 ❓ Question Answering 1 👩‍đŸĢ Tutorials 1 📖 Knowledge and Entity 1 🤖 Reinforcement Learning 1
Sub Categories
Keywords
nlp 19 pytorch 16 natural-language-processing 15 bert 10 deep-learning 8 transformers 7 machine-learning 7 python 5 transformer 5 pretrained-models 3 natural-language-understanding 3 gpt 3 language-model 3 glue 2 speech-recognition 2 tensorflow 2 computer-vision 2 inference 2 huggingface 2 sentiment-analysis 2 adversarial-attacks 2 model-hub 2 data-augmentation 2 parameter-efficient-tuning 2 parameter-efficient-learning 2 lora 2 adapters 2 passage-retrieval 1 open-domain-qa 1 knowledge-base 1 information-retrieval 1 sentence-embeddings 1 workflow-automation 1 workflow 1 security 1 text-classification 1 text-analytics 1 text-analysis 1 social-network-analysis 1 social-listening 1 adversarial-samples 1 slot-filling 1 albert 1 decoder 1 gpt2 1 gpu 1 huggingface-transformers 1 machine-translation 1 roberta 1 distillation 1