Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.
Awesome Lists | Featured Topics | Projects
https://github.com/rohan-paul/llm-finetuning-large-language-models

LLM (Large Language Model) FineTuning
https://github.com/rohan-paul/llm-finetuning-large-language-models
gpt-3 gpt3-turbo large-language-models llama2 llm llm-finetuning llm-inference llm-serving llm-training mistral-7b open-source-llm pytorch
Last synced: about 1 month ago
JSON representation
LLM (Large Language Model) FineTuning
Host: GitHub
URL: https://github.com/rohan-paul/llm-finetuning-large-language-models
Owner: rohan-paul
Created: 2023-10-22T22:04:09.000Z (about 1 year ago)
Default Branch: main
Last Pushed: 2024-05-19T21:43:08.000Z (6 months ago)
Last Synced: 2024-10-10T06:06:41.986Z (about 1 month ago)
Topics: gpt-3, gpt3-turbo, large-language-models, llama2, llm, llm-finetuning, llm-inference, llm-serving, llm-training, mistral-7b, open-source-llm, pytorch
Language: Jupyter Notebook
Homepage:
Size: 11.4 MB
Stars: 452
Watchers: 9
Forks: 109
Open Issues: 2
Metadata Files:
- Readme: README.md
Awesome Lists containing this project

README

        # LLM (Large Language Models) FineTuning Projects and notes on common practical techniques

![](/assets/devil2.png)

### Find me here..

- 🐦 TWITTER: https://twitter.com/rohanpaul_ai

- 🟠 YouTube: https://www.youtube.com/@RohanPaul-AI/featured

- 👨🏻‍💼 LINKEDIN: https://www.linkedin.com/in/rohan-paul-b27285129/

- 👨‍🔧 KAGGLE: https://www.kaggle.com/paulrohan2020

---

[logo]: https://raw.githubusercontent.com/rohan-paul/MachineLearning-DeepLearning-Code-for-my-Youtube-Channel/master/assets/yt_logo.png

### Fine-tuning LLM (and YouTube Video Explanations)

| Notebook | 🟠 **YouTube Video**|

| -------- | ---------------------- |

| [Finetune Llama-3-8B with unsloth 4bit quantized with ORPO](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Llama_3_Finetuning_ORPO_with_Unsloth.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=6ikUpJcDrPs&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=31) |

| [Llama-3 Finetuning on custom dataset with unsloth](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Llama-3_Finetuning_on_custom_dataset_with_unsloth.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=AmVEGPS9JIg&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=25) |

| [CodeLLaMA-34B - Conversational Agent ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/CodeLLaMA_34B_Conversation_with_Streamlit.py) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=815NpXvniIg&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=16&ab_channel=Rohan-Paul-AI) |

| [Inference Yarn-Llama-2-13b-128k with KV Cache to answer quiz on very long textbook](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Inference_Yarn-Llama-2-13b-128k_Github.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=RYTOQERqVsg&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=14&ab_channel=Rohan-Paul-AI)|

| [Mistral 7B FineTuning with_PEFT and QLORA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral_FineTuning_with_PEFT_and_QLORA.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=6DGYj1EEWOw&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=13&ab_channel=Rohan-Paul-AI)|

| [Falcon finetuning on openassistant-guanaco](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Falcon-7B_FineTuning_with_PEFT_and_QLORA.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=fEzuBFi35J4&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=11&ab_channel=Rohan-Paul-AI)|

| [Fine Tuning Phi 1_5 with PEFT and QLoRA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/FineTuning_phi-1_5_with_PRFT_LoRA.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=J0RbOtLrJhQ&list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI&index=10&ab_channel=Rohan-Paul-AI)|

| [Web scraping with Large Language Models (LLM)-AnthropicAI + LangChainAI](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Web%20scraping%20with%20Large%20Language%20Models%20(LLM)-AnthropicAI%20%2B%20LangChainAI.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=QAY82UvrsHg&list=PLxqBkZuBynVTiTEvP6-GYf35yA6OqIN7Y&index=2&ab_channel=Rohan-Paul-AI)|

---------------------------

### Fine-tuning LLM

| Notebook | Colab |

| -------- | ------------- |

| 📌 [Gemma_2b_finetuning_ORPO_full_precision](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/gemma-2b_ORPO_FineTuning_full_precision/v2_Colab_Gemma_2b_orpo.ipynb)|

| 📌 [Jamba_Finetuning_Colab-Pro](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/tinyllama_fine-tuning_Taylor_Swift.ipynb)|

| 📌 [Finetune codellama-34B with QLoRA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Finetune_codellama-34B-with-QLoRA.ipynb)|

| 📌 [Mixtral Chatbot with Gradio](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mixtral_Chatbot_with_Gradio)|

| 📌 [togetherai api to run Mixtral](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/togetherai-api-with_Mixtral.ipynb)|

| 📌 [Integrating TogetherAI with LangChain 🦙](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/TogetherAI_API_with_LangChain.ipynb)|

| 📌 [Mistral-7B-Instruct_GPTQ - Finetune on finance-alpaca dataset 🦙](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral-7B-Instruct_GPTQ-finetune.ipynb)|

| 📌 [Mistral 7b FineTuning with DPO Direct_Preference_Optimization](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral_7b_FineTuning_with_DPO_Direct_Preference_Optimization.ipynb)|

| 📌 [Finetune llama_2_GPTQ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Finetune_llama_2_GPTQ)

| 📌 [TinyLlama with Unsloth and_RoPE_Scaling dolly-15 dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/TinyLlama_with_Unsloth_and_RoPE_Scaling_dolly-15k.ipynb)|

| 📌 [Tinyllama fine-tuning with Taylor_Swift Song lyrics](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/tinyllama_fine-tuning_Taylor_Swift.ipynb)|

---------------------------

### LLM Techniques and utils - Explained

| LLM Concepts |

| -------- |

| 📌 [DPO (Direct Preference Optimization) training and its datasets](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/DPOTrainer.ipynb)|

| 📌 [4-bit LLM Quantization with GPTQ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/4-bit_LLM_Quantization_with_GPTQ.ipynb)|

| 📌 [Quantize with HF Transformers](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Quantize_with_HF_transformers)|

| 📌 [Understanding rank r in LoRA and related Matrix_Math](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Understanding_rank_r_in_LoRA_and_related_Matrix_Math.ipynb)|

| 📌 [Rotary Embeddings (RopE) is one of the Fundamental Building Blocks of LlaMA-2 Implementation](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/RoPE-As-Implemented-in-LlaMa-Source-Code.ipynb)|

| 📌 [Chat Templates in HuggingFace](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/apply_chat_template.ipynb)|

| 📌 [How is Mixtral 8x7B is a dense 47Bn param model](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/MOE-Mixture-of-Experts/Mixtral_8x7B_MoE_Why_47Bn_param_by_Shared_Param.md)|

| 📌 [The concept of **validation log perplexity** in LLM training - a note on fundamentals.](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Validation_log_perplexity.md)|

| 📌 [Why we need to identify `target_layers` for LoRA/QLoRA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/targets_layers_in_peft_and_meaning_of_Rank_of_a_Matrix.ipynb)|

| 📌 [Evaluate Token per sec](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Evaluate_token_per_sec.ipynb)|

| 📌 [traversing through nested attributes (or sub-modules) of a PyTorch module](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Traverse_through_sub-modules_of_PyTorch_Model.ipynb)|

| 📌 [Implementation of Sparse Mixtures-of-Experts layer in PyTorch from Mistral Official Repo](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/MoE_implementation_Mistral_official_Repo.ipynb)|

| 📌 [Util method to extract a specific token's representation from the last hidden states of a transformer model.](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Select_last_meaningful_token_from_each_sequence.ipynb)|

| 📌 [Convert PyTorch model's parameters and tensors to half-precision floating-point format](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Convert_Pytorch_model_to_half_precision.ipynb)|

| 📌 [Quantizing 🤗 Transformers models with the GPTQ method](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Quantizing_Transformers_with_GPTQ.ipynb)|

| 📌 [Quantize Mixtral-8x7B so it can run in 24GB GPU](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Quantize_mixtral-instruct-awq_in_so_it_can_run_in_24GB.ipynb)|

| 📌 [What is GGML or GGUF in the world of Large Language Models ?](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/GGUF_GGML_GPTQ-basics.md)|

---------------------------

## Other Smaller Language Models

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=-rqmj_tfQLo&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=34&ab_channel=Rohan-Paul-AI) [DeBERTa Fine Tuning for Amazon Review Dataset Pytorch](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/DeBERTa%20Fine%20Tuning-for%20Amazon%20Review%20Dataset%20Pytorch.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=4nNbg4bWDrQ&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=32&ab_channel=Rohan-Paul-AI) [FineTuning BERT for Multi-Class Classification on custom Dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/FineTuning_BERT_for_Multi_Class_Classification_Turkish)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=91msLyGC-LI&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=28&ab_channel=Rohan-Paul-AI) [Document STRIDE when Tokenizing with HuggingFace Transformer for NLP Projects](https://www.youtube.com/watch?v=91msLyGC-LI&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=28&ab_channel=Rohan-Paul-AI)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=cplo2UyNw24&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=31&ab_channel=Rohan-Paul-AI) [Fine-tuning of a PreTrained Transformer model - what really happens to the weights (parameters)]()

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=pqpaHeCsuVI&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=30&ab_channel=Rohan-Paul-AI) [Cerebras-GPT New Large Language Model Open Sourced with Apache 2.0 License](https://www.youtube.com/watch?v=pqpaHeCsuVI&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=30&ab_channel=Rohan-Paul-AI)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=6X0xfXMKCjM&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=29&ab_channel=Rohan-Paul-AI) [Roberta-Large Named Entity Recognition on Kaggle NLP Competition with PyTorch](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Roberta-Large-NER-on-Kaggle-NLP%20Competition)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=EHtHF9Kvm0Y&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=28&ab_channel=Rohan-Paul-AI) [Longformer end to end with Kaggle NLP competition](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Longformer%20end%20to%20end%20with%20Kaggle%20NLP%20competition)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=tvdIF1FU7fg&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=24) [Zero Shot Multilingual Sentiment Classification with PyTorch Lightning](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/zero_shot_multilingual_sentiment_classification_with_USEm)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=CwLPglxw1WA&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=23) [Fine Tuning Transformer (BERT) for Customer Review Prediction | NLP | HuggingFace ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fine_Tuning_HuggingFace_Transformer_BERT_Yelp_Customer_Review_Predictions)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=30zPz5Xz-8g&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=21) [Understanding BERT Embeddings and Tokenization | NLP | HuggingFace](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Understing_BERT_Embedding_Vector)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=fl0ow-nD8FM&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=20) [Topic Modeling with BERTopic | arxiv-abstract dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Topic-modeling-with-bertopic-arxiv-abstract)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=vrDdnQfav0s&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=21) [Latent Dirichlet Allocation (LDA) for Topic Modeling](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Topic_Modeling_with_LDA.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=iCL1TmRQ0sk&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=19) [Adding a custom task-specific Layer to a HuggingFace Pretrained Model](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Add-task_specific_custom_layer_to_model.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=ZvsH09XGuZ0&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=18) [Fine Tuning DistilBERT for Multiclass Text Classification](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Multi-class-text-classifica_fine-tuning-distilbert.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=dzyDHMycx_c&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=18) [Fine Tuning BERT for Named Entity Recognition (NER)](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/YT_Fine_tuning_BERT_NER_v1.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=fLqiPks4neU&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=15) [Text Summarization by Fine Tuning Transformer Model | NLP ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fine_Tuning_Pegasus_for_Text_Summarization.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=HDSNjrxSwqw&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=14) [Text Summarization with Transformer - BART + T5 + Pegasus

  ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Text_Summarization_%20BART%20_T5_Pegasus.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=oxEXBJQG27A&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=13) [Debarta-v3-large model fine tuning for Kaggle Competition Feedback-Prize | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Other-Language_Models_BERT_related/Deberta-v3-large-For_Kaggle_Competition_Feedback-Prize/deberta-v3-large-For_Kaggle_Competition_Feedback-Prize.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=SmWbKiueYVU&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=12) [Topic Modeling with BERT and Automatic Cluster Labeling](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Topic_Modeling_with_BERT_and_Automatic_cluster_labeling/Topic_Modeling.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=Ua_ToM-CG5Q&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=11) [Decoding strategies while generating text with GPT-2](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Decoding_Strategies_for_text_generation/Decoding_Strategies_for_text_generation.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=VrJwKdls6d4&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=12) [Fake News Classification with LSTM and Tensorflow](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fake_News_Classification_with_LSTM_Tensorflow.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=hgg2GAgDLzA&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=11) [FinBERT Sentiment Analysis for very Long Text (more than 512 Tokens) | PART 2](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/FinBERT_Long_Text_Part_2.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=WEAAs_0etJQ&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=9) [FinBERT Sentiment Analysis for very Long Text Corpus (more than 512 Tokens) | PART-1](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/FinBERT_Long_Text_Part_2.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=fwDTLQDKJTE&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=8) [Cosine Similarity between sentences with Transformers HuggingFace](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Cosine_Similarity_between_sentences_with_Transformers.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=urMUa4Nw_B8&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=7) [Zero Shot Learning - Cross Lingual Named Entity Recognition with XLM-Roberta](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Zero_Shot_Learning_multilingual-NER.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=Hp8_Enwzdxk&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=6) [BERT from Hugging Face - Few Baseline Application | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/BERT_HuggingFace_Basic_Usages.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=CHFiTTPeyUw&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=9) [Transformer Encoder with Scaled Dot Product from Scratch](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Transformer_From_Scratch/Transformer_From_Scratch.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=_IGdekeBCoE&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=7) [Fuzzy String Matching in Natural Language Processing | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fuzzy-String-Matching.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=SzSANHjYhfg&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=6) [Understanding Word Vectors usage with Spacy Word and Sentence Similarity](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Word-Vectors-Understanding-with-Spacy.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=TxTxWAohW7E&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=5) [Named Entity Recognition NER using spaCy - Extracting Subject Verb Action](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Named_Entity_Recognition_NER_using_spaCy%20-%20Extracting_Subject_Verb_Action.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=zcW2HouIIQg&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=5) [Fine-Tuning-DistilBert - Hugging Face Transformer for Poem Sentiment Prediction | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Other-Language_Models_BERT_related/Fine_Tuning_DistilBert_Poem_Sentiments.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=0Y03waAL4Gw&list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK&index=4) [Fine Tuning BERT-Based-Uncased Hugging Face Model on Kaggle Hate Speech Dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/bert-base-uncased-fine-tuned-kaggle-hate-speech-dataset.ipynb)

- [![Youtube Link][logo]](https://www.youtube.com/watch?v=DpzQNQI-S3s&list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N&index=3) [Text Analytics of Tweet Emotion - EDA with Plotly](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Text%20Analytics%20of%20Tweet%20Emotion%20-%20EDA%20with%20Plotly.ipynb)

- [![Youtube Link][logo]](https://bit.ly/3Nk0zRA) [Sentiment analysis using TextBlob and Vader](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/sentiment_analysis_textblob_Vader.ipynb)