Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with huggingface-transformers

A curated list of projects in awesome lists tagged with huggingface-transformers .

https://github.com/rn0x/transtexa

A versatile library for text translation using Hugging Face's Transformers

ai hugging huggingface-transformers library local nodejs transformers translation

Last synced: 31 Oct 2024

https://github.com/aniketdash7/text_summarization

Using huggingface transformers to build a pre-trained summarization pipeline.

huggingface huggingface-transformers python streamlit text-summarization

Last synced: 10 Oct 2024

https://github.com/winstxnhdw/ct2hf

A friendly CLI tool for converting and uploading transformers for CTranslate2.

ctranslate2 huggingface huggingface-transformers transformers

Last synced: 23 Oct 2024

https://github.com/2003harsh/blog-generation-using-llama2

The Blog Generation project uses advanced AI technologies like Llama 2, LangChain, and Hugging Face to create custom blog content. With Streamlit, users can input a topic, word count, and audience type to generate blogs quickly and efficiently. The project combines the power of LLms with a simple, interactive interface for easy content creation.

huggingface-transformers langchain llama2 llm nlp

Last synced: 03 Dec 2024

https://github.com/prashver/nlp-driven-video-summarizer-and-insight-tool

An NLP-powered tool for transcribing, summarizing, and indexing podcast content, with video-to-audio conversion and multilingual support.

flask-application huggingface-transformers keyword-extraction named-entity-recognition natural-language-processing ntlk spacy speech-to-text speech-translation text-summarization topic-modeling

Last synced: 18 Dec 2024

https://github.com/prateekrajsrivastav/question-answering-model

This project is an NLP-based Question-Answering System that leverages machine learning and natural language processing techniques to provide answers to user queries based on a given context or dataset. The system processes textual input, extracts meaningful insights, and returns relevant answers to the user's question.

huggingface-transformers matplotlib nltk numpy pandas seaborn spacy

Last synced: 20 Dec 2024

https://github.com/t-mohamed-shafeek/llm-for-language-translation

This repository contains a simple and beginner-level noteboook which employs the mBART LLM/model for the translation of English text into Indian Languages.

huggingface-transformers language-tra llm llm-inference mbart mbart50 nlp nmt

Last synced: 14 Dec 2024

https://github.com/cyse7125-su24-team10/pinecone-loader

Builds Docker Image for Loading Pinecone Database with Vectors from CVE data.

huggingface-transformers langchain llama3 pinecone

Last synced: 12 Oct 2024

https://github.com/kaifcoder/Stan

Develop and deploy a Large Language Model (LLM) based tool for generating human like responses to natural language inputs for network not connected over internet

chroma huggingface-transformers langchain-python llm python streamlit

Last synced: 06 Jan 2025

https://github.com/bilgenurbekar/turkishcyberbullying

Contains fine-tuned BERT models and results in the text classification category using Turkish social media data

bert-fine-tuning huggingface-transformers matplotlib numpy pandas python pytorch scikit-learn transformers

Last synced: 10 Oct 2024

https://github.com/luca683/telesummary

Telegram Bot that summarizes messages in a telegram group.

docker elasticsearch fluentd huggingface-transformers kafka kibana machine-learning spark telegram telegram-bot

Last synced: 11 Oct 2024

https://github.com/deepschneider/bert-examples

Fine Tuning BERT for Text Classification and Question Answering Using TensorFlow & PyTorch Frameworks

bert bert-fine-tuning bert-model bert-pytorch bert-squad data-science huggingface-transformers pytorch pytorch-tutorial tensorflow-tutorials tensorflow2

Last synced: 16 Nov 2024

https://github.com/hrolive/rapid-application-development-using-large-language-models

Strong understanding and practical knowledge of LLM application development by exploring the open-sourced ecosystem, including pretrained LLMs, that can help you get started quickly developing LLM-based applications.

chatbot huggingface huggingface-transformers langchain large-language-models llama-index llm multimodal nvidia python pytorch transformers

Last synced: 07 Dec 2024

https://github.com/0xzee/finetune_model_dataset

Fine-Tunning Model llama3.2 on local Dataset using LoRA, QLoRA and PEFT..

huggingface huggingface-transformers llama3-2 lora peft-fine-tuning-llm qlora

Last synced: 06 Dec 2024

https://github.com/0xzee/finetune_model_unsloth

⚙️ Fine-Tune 🦙 Llama 3.1, Phi-3.. Models on custom DataSet using 🕴️ unsloth & Saving to HuggingFace Hub

colab-notebook finetuned-model huggingface huggingface-models huggingface-transformers llama3-8b llama3-finetune training unsloth

Last synced: 06 Dec 2024

https://github.com/asawirshafiq/bert-tweet-classification

This project uses a fine-tuned BERT model for tweet classification, focusing on detecting bullying in tweets. The model leverages BERT's advanced language understanding to effectively identify and categorize harmful or abusive language.

bert-fine-tuning classification huggingface-transformers pytorch

Last synced: 21 Dec 2024

https://github.com/valentin-laurent/evalstudent

Exploratory notebooks and utils related to the "Feedback Prize - Evaluating Student Writing" Kaggle competition.

deep-learning huggingface-transformers kaggle longformer-models natural-language-processing tensorflow

Last synced: 21 Dec 2024

https://github.com/faizantkhan/restaurant-name-menu-generator-using-streamlit_langchain_hugging-face-transformer

Restaurant Name and Menu Generator is a web app that uses Streamlit, Hugging Face Transformers, and LangChain to generate unique restaurant names and customized menus based on different cuisines. Enter a country's name to receive creative restaurant ideas and menu options.

fine-tuning huggingface-transformers langchain langchain-python llm llm-training open-source streamlit streamlit-application transformer

Last synced: 21 Dec 2024

https://github.com/shwetam19/ai-text-tools

WordSmith is an AI-driven tool designed for efficient text summarization, grammar correction, and spelling enhancement. Built using by Python, Hugging Face Transformers, Streamlit, and NLP models.

grammar-checker huggingface-transformers nlp python streamlit summarizer

Last synced: 07 Jan 2025

https://github.com/anurima-saha/yelp_review_classification_with_roberta

Project begins with webscrapping Yelp reviews and rating with 'BeautifulSoup' in Python, followed by Natural Language Processing (text cleaning, removing stopwords, tokenization and lemmatization) using 'NLTK'. RoBERTa from 'HuggingFace' has been fine-tuned for text classification with early stopping and regularization using Pytorch.

beautifulsoup4 deep-learning early-stopping fine-tuning huggingface-transformers large-language-model natural-language-processing nltk-python pytorch roberta-model roberta-tokenizer webscapping

Last synced: 29 Dec 2024

https://github.com/mbappeenjoyer/gif-qa

Documentation of the approach employed to tackle the task of GIF Question Answering

clip faiss huggingface-transformers multimodal-deep-learning nlp

Last synced: 30 Dec 2024

https://github.com/uday160386/image-audio-hf-openai

generate a meaningful audio from uploaded photo using HuggingFace + Langchain+ Open AI

huggingface-transformers langchain openai text-audio

Last synced: 14 Nov 2024

https://github.com/sanu0711/object-detection-using-the-yolo-model

The objective of this project is to demonstrate the implementation of object detection using the YOLO model, transformers library, and OpenCV. The provided Python script utilizes a pre-trained YOLO model (hustvl/yolos-tiny) for detecting objects in images.

bounding-boxes huggingface-transformers jupyter-notebook matplotlib object-detection opencv-python pil python3 transformer yolo yolov4-tiny yolov5

Last synced: 16 Nov 2024

https://github.com/garystafford/huggingface-sagemaker-transformer-demo

Explore the capabilities of transformer models available on Hugging Face to accomplish common NLP tasks on Amazon SageMaker using real-time and batch inference.

amazon-sagemaker amazon-sagemaker-studio aws huggingface huggingface-transformers inference

Last synced: 06 Dec 2024

https://github.com/prgrmcode/ai-dungeon-game

AI powered Dungeon adventure game is an advanced text-based adventure game powered by Large Language Models.

gradio huggingface-transformers llama3 llms python safety

Last synced: 08 Jan 2025

https://github.com/asawirshafiq/gradio-tweet-classification

This project involves NLP tweet classification utilizing a model from HuggingFace. The backend is developed with FastAPI and MongoDB, ensuring efficient data handling and scalable API services. The user interface is designed using Gradio, providing an intuitive and interactive experience for users to classify and analyze tweets.

bert fastapi gradio-interface huggingface-transformers nlp-machine-learning

Last synced: 12 Nov 2024

https://github.com/saba-gul/generating-recipes-from-food-images-using-langchain-and-openai

Generating Recipes from Food Images Using LangChain and OpenAI and Converting them into Audio

genai-usecase generative-ai huggingface-transformers langchain llms openai-api

Last synced: 14 Nov 2024

https://github.com/kavayk29/text-summarization-fine-tuning-pegasus-model

This project uses the Pegasus model to generate concise, coherent text summaries. Fine-tuned on large datasets, it excels in abstractive summarization, ideal for automating tasks like summarizing articles and research papers.

datasets huggingface-transformers matplotlib nltk numpy pandas teansform tqdm

Last synced: 08 Jan 2025

https://github.com/raul23/chinese-segmenter-translator

Python script for segmenting Chinese text into individual words and translating them into English

chinese chinese-segmenter chinese-translation huggingface huggingface-transformers pinyin python text-segmentation translation

Last synced: 14 Nov 2024

https://github.com/hrolive/large-language-models-on-supercomputers

Comprehensive exploration of LLMs, including cutting-edge techniques and tools such as parameter-efficient fine-tuning (PEFT), quantization, zero redundancy optimizers (ZeRO), fully sharded data parallelism (FSDP), DeepSpeed, and Huggingface accelerate.

deepspeed evaluation-metrics fsdp high-performance-computing hpc huggingface huggingface-transformers jupyter llm llm-inference llm-training monitoring peft python quantization slurm tokenization transformer unsloth

Last synced: 04 Jan 2025

https://github.com/jt11-11/ai_bank_statement_convertor

A small project to increase efficiency using hugging face model to reduce the need for data entry

huggingface huggingface-transformers pandas python

Last synced: 09 Jan 2025

https://github.com/nluninja/bert4sentiment_pytorch

a sentiment analysis use case with Bert by a pytorch implementation - uses Transformers library 4.0

huggingface-transformers pytorch sentiment-analysis

Last synced: 05 Jan 2025

https://github.com/notyusheng/huggingface-tutorial

A collection of Python scripts using Hugging Face Transformers for various tasks

huggingface-transformers

Last synced: 05 Jan 2025

https://github.com/pavankethavath/pdf_question_answering_chatbot_using_rag

A PDF Question Answering System leveraging Retrieval-Augmented Generation (RAG) and advanced natural language processing. Combines vector-based indexing, semantic similarity, and HuggingFace Transformers to deliver precise insights from PDFs. Streamlit interface ensures seamless, data-driven exploration. Built with Python.

huggingface huggingface-transformers llama llamaindex llm qwen rag vector-database vectorstoreindex

Last synced: 22 Dec 2024

https://github.com/ayushverma135/llama-custom-x

Llama Custom X is a Streamlit-based AI chatbot that interacts with CSV datasets using conversational AI. It offers data-driven insights, intelligent responses, and visualizations for enhanced data analysis. Perfect for cybersecurity data exploration.

chatbot ctransformers gpt4all huggingface-transformers llama2 meta python

Last synced: 22 Dec 2024

https://github.com/rahulunair/simpsons_llm_xpu

Finetune an LLM on intel discrete GPUs to generate dialogues based on the simpsons dataset

huggingface-transformers intel-arc intel-gpu intel-gpu-max ipex llm-inference llm-training lora pytorch

Last synced: 14 Nov 2024

https://github.com/mafda/lightweight_fine_tuning_project

This repository provides a Jupyter notebook demonstrating parameter-efficient fine-tuning (PEFT) with LoRA on Hugging Face models.

huggingface huggingface-datasets huggingface-transformers lora peft peft-fine-tuning-llm pytorch

Last synced: 16 Nov 2024

https://github.com/vamoruso/webappai

The project applies some of the potential of artificial intelligence to management software through practical examples.

ai bootstrap5 handlebars huggingface-transformers jquery python3 spacy-nlp

Last synced: 13 Nov 2024

https://github.com/dmickelson/sentimentanalysiswithhuggingfaceproject

This project demonstrates how to use the HuggingFace Transformers library to perform sentiment analysis on text data. Specifically, we classify reviews as either _Positive_ or _Negative_ using a pre-trained model.

huggingface-transformers python sentiment-analysis

Last synced: 13 Nov 2024

https://github.com/matteo-stat/transformers-nlp-multi-label-classification

This repo provides scripts for fine-tuning HuggingFace Transformers, setting up pipelines and optimizing multi-label classification models for inference. They are based on my experience developing a custom chatbot, I’m sharing these in the hope they will help others to quickly fine-tune and use models in their projects! 😊

fine-tuning huggingface huggingface-pipelines huggingface-transformers inference-optimization multi-label-classification nlp onnx onnxruntime text-classification transformers

Last synced: 13 Nov 2024

https://github.com/matteo-stat/transformers-llm-llama3.1-fine-tuning-qlora

This repo offers scripts for fine-tuning LLaMA 3.1 models with QLoRA, running inference, and export models. It’s based on my experience building a custom chatbot, and I’m sharing it to help others fine-tune and deploy LLMs on consumer hardware with ease! 😊

fine-tuning huggingface huggingface-transformers large-language-models llama3-1 llama3-1-8b-finetuning llm transformers unsloth

Last synced: 13 Nov 2024

https://github.com/matteo-stat/transformers-nlp-ner-token-classification

This repo provides scripts for fine-tuning HuggingFace Transformers, setting up pipelines and optimizing token classification models for inference. They are based on my experience developing a custom chatbot, I’m sharing these in the hope they will help others to quickly fine-tune and use models in their projects! 😊

fine-tuning huggingface huggingface-pipelines huggingface-transformers inference-optimization named-entity-recognition ner nlp onnx onnxruntime token-classification transformers

Last synced: 13 Nov 2024

https://github.com/mohammed-majid/llm-chatbot

Fullstack Chatbot using open source LLM (Huggingface)

chatbot huggingface-transformers llama3

Last synced: 22 Dec 2024

https://github.com/gh640/google-gemma-samples-ja

Google の Gemma モデルのサンプル集

google-gemma huggingface huggingface-transformers

Last synced: 14 Nov 2024

https://github.com/jatin-mehra119/plagiarism-detector-using-smollm-

A web app for detecting plagiarism between two PDFs. Users can upload PDF files, and the app will detect plagiarism by leveraging a fine-tuned LLM model (SmolLM2-135M) trained on the MIT Plagiarism Detection Dataset.

huggingface-transformers llm-fine-tuning llm-training

Last synced: 16 Nov 2024

https://github.com/paragekbote/hugging_face_docs

Documentation support for Hugging Face libraries.

docs documentation huggingface huggingface-transformers

Last synced: 17 Nov 2024

https://github.com/letsdoitbycode/youtube-video-summarization-app

This Flask web application takes a YouTube video URL, retrieves the video's transcript, and generates a concise summary using Hugging Face’s Transformer summarization pipeline. This app is ideal for creating quick, digestible summaries of long-form video content.

flask-application huggingface-transformers machine-learning-algorithms summarisation-systems video-summarization youtube-api

Last synced: 15 Nov 2024

https://github.com/rs-py/howtofinetuneanllm

This is a step by step example of how to quickly finetune an LLM without access to robust hardware using simple text data. For a more in depth format read the article on medium that is linked below.

fine-tuning huggingface huggingface-transformers llama llm llm-inference

Last synced: 17 Nov 2024

https://github.com/arij01/chat4pcos

Chat4PCOS is a chatbot application designed to assist patiens with questions related to Polycystic Ovary Syndrome (PCOS). It integrates data from a Neo4j graph database with a Hugging Face model to provide accurate and contextually relevant responses.

fastapi gpt-2 huggingface-transformers neo4j react

Last synced: 27 Dec 2024

https://github.com/codealchemyml/translaite

A translator that translates text of any language to English.

generative-ai huggingface-transformers transformers-models

Last synced: 17 Nov 2024

https://github.com/ehavener/concise

Concise is a full stack application that summarizes YouTube videos.

huggingface-transformers java large-language-models natural-language-processing nextjs python spring-boot youtube

Last synced: 18 Nov 2024

https://github.com/gopikrsmscs/isebetter

A semantic search transformer model fine-tuned on the PyTorch GitHub issues dataset, hosted on Hugging Face, and integrated with Streamlit for easy use.

embedding-vectors huggingface-transformers nlp-machine-learning strea training tran

Last synced: 18 Nov 2024

https://github.com/elkronos/face_hugger

R functions to interact with hugging face

data-science functions hugging-face huggingface huggingface-transformers r

Last synced: 15 Dec 2024

https://github.com/adadalshabab/text-generation-llm-app-using-huggingface-transformers

These app are built using pre-trained Large Language Models. Ask any question & this will generate description according to your question.

gradio huggingface huggingface-transformers machine-learning machinelearning

Last synced: 20 Nov 2024

https://github.com/eljandoubi/copilot

Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.

8bit-optimizer gradiio huggingface-accelerate huggingface-datasets huggingface-peft huggingface-transformers lion-optimizer paged-optimizer pytorch

Last synced: 25 Nov 2024

https://github.com/eljandoubi/ai-photo-editing-with-inpainting

A web app that allows you to select a subject and then change its background, OR keep the background and change the subject.

bitsandbytes gradio-interface huggingface-accelerate huggingface-diffusers huggingface-transformers pytroch

Last synced: 25 Nov 2024