{"id":15829116,"url":"https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models","last_synced_at":"2025-10-16T21:31:23.807Z","repository":{"id":205823869,"uuid":"708552127","full_name":"rohan-paul/LLM-FineTuning-Large-Language-Models","owner":"rohan-paul","description":"LLM (Large Language Model) FineTuning","archived":false,"fork":false,"pushed_at":"2025-04-01T21:05:06.000Z","size":11872,"stargazers_count":563,"open_issues_count":2,"forks_count":136,"subscribers_count":8,"default_branch":"main","last_synced_at":"2025-10-14T15:16:35.283Z","etag":null,"topics":["gpt-3","gpt3-turbo","large-language-models","llama2","llm","llm-finetuning","llm-inference","llm-serving","llm-training","mistral-7b","open-source-llm","pytorch"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rohan-paul.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-10-22T22:04:09.000Z","updated_at":"2025-10-10T15:16:37.000Z","dependencies_parsed_at":null,"dependency_job_id":"e702570e-76f2-4cf4-9136-226dd700118d","html_url":"https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models","commit_stats":{"total_commits":164,"total_committers":2,"mean_commits":82.0,"dds":"0.0060975609756097615","last_synced_commit":"224a236e5ae377f634dcce44ad9d77defb50be55"},"previous_names":["rohan-paul/llm-finetuning-code-for-my-youtube-channel","rohan-paul/llm-finetuning-large-language-models-"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/rohan-paul/LLM-FineTuning-Large-Language-Models","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-paul%2FLLM-FineTuning-Large-Language-Models","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-paul%2FLLM-FineTuning-Large-Language-Models/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-paul%2FLLM-FineTuning-Large-Language-Models/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-paul%2FLLM-FineTuning-Large-Language-Models/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rohan-paul","download_url":"https://codeload.github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rohan-paul%2FLLM-FineTuning-Large-Language-Models/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279091119,"owners_count":26101404,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-15T02:00:07.814Z","response_time":56,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gpt-3","gpt3-turbo","large-language-models","llama2","llm","llm-finetuning","llm-inference","llm-serving","llm-training","mistral-7b","open-source-llm","pytorch"],"created_at":"2024-10-05T11:00:37.473Z","updated_at":"2025-10-16T21:31:23.801Z","avatar_url":"https://github.com/rohan-paul.png","language":"Jupyter Notebook","funding_links":[],"categories":["A01_文本生成_文本对话"],"sub_categories":["大语言对话模型及数据"],"readme":"# LLM (Large Language Models) FineTuning Projects and notes on common practical techniques\n\n# [Find me in Twitter](https://twitter.com/rohanpaul_ai)\n\n## [📚 I write daily for my 112K+ readers on actionable AI developments. Get a 1300+ page Python book as soon as you subscribing (its FREE) ↓↓)](https://www.rohan-paul.com/s/daily-ai-newsletter/archive?sort=new)\n\n[logo]: https://github.com/rohan-paul/rohan-paul/blob/master/assets/newsletter_rohan.png\n\n[![Rohan's Newsletter][logo]](https://www.rohan-paul.com/) \u0026nbsp;\n\n\n\n### Fine-tuning LLM (and YouTube Video Explanations)\n\n| Notebook | 🟠 **YouTube Video**|\n| -------- | ---------------------- |\n| [Finetune Llama-3-8B with unsloth 4bit quantized with ORPO](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Llama_3_Finetuning_ORPO_with_Unsloth.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=6ikUpJcDrPs\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=31) |\n| [Llama-3 Finetuning on custom dataset with unsloth](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Llama-3_Finetuning_on_custom_dataset_with_unsloth.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=AmVEGPS9JIg\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=25) |\n| [CodeLLaMA-34B - Conversational Agent ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/CodeLLaMA_34B_Conversation_with_Streamlit.py) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=815NpXvniIg\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=16\u0026ab_channel=Rohan-Paul-AI) |\n| [Inference Yarn-Llama-2-13b-128k with KV Cache to answer quiz on very long textbook](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Inference_Yarn-Llama-2-13b-128k_Github.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=RYTOQERqVsg\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=14\u0026ab_channel=Rohan-Paul-AI)|\n| [Mistral 7B FineTuning with_PEFT and QLORA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral_FineTuning_with_PEFT_and_QLORA.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=6DGYj1EEWOw\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=13\u0026ab_channel=Rohan-Paul-AI)|\n| [Falcon finetuning on openassistant-guanaco](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Falcon-7B_FineTuning_with_PEFT_and_QLORA.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=fEzuBFi35J4\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=11\u0026ab_channel=Rohan-Paul-AI)|\n| [Fine Tuning Phi 1_5 with PEFT and QLoRA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/FineTuning_phi-1_5_with_PRFT_LoRA.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=J0RbOtLrJhQ\u0026list=PLxqBkZuBynVTzqUQCQFgetR97y1X_1uCI\u0026index=10\u0026ab_channel=Rohan-Paul-AI)|\n| [Web scraping with Large Language Models (LLM)-AnthropicAI + LangChainAI](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Web%20scraping%20with%20Large%20Language%20Models%20(LLM)-AnthropicAI%20%2B%20LangChainAI.ipynb) | [![Youtube Link][logo]](https://www.youtube.com/watch?v=QAY82UvrsHg\u0026list=PLxqBkZuBynVTiTEvP6-GYf35yA6OqIN7Y\u0026index=2\u0026ab_channel=Rohan-Paul-AI)|\n\n\n---------------------------\n\n### Fine-tuning LLM\n\n| Notebook | Colab |\n| -------- | ------------- |\n| 📌 [Gemma_2b_finetuning_ORPO_full_precision](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/gemma-2b_ORPO_FineTuning_full_precision/v2_Colab_Gemma_2b_orpo.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/gemma-2b_ORPO_FineTuning_full_precision/Gemma_2b_orpo_full_precision_Colab.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Jamba_Finetuning_Colab-Pro](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/tinyllama_fine-tuning_Taylor_Swift.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Jamba_Finetuning_Colab-Pro.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Finetune codellama-34B with QLoRA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Finetune_codellama-34B-with-QLoRA.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Finetune_codellama-34B-with-QLoRA.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Mixtral Chatbot with Gradio](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mixtral_Chatbot_with_Gradio)|\n| 📌 [togetherai api to run Mixtral](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/togetherai-api-with_Mixtral.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/togetherai-api-with_Mixtral.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Integrating TogetherAI with LangChain 🦙](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/TogetherAI_API_with_LangChain.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/TogetherAI_API_with_LangChain.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Mistral-7B-Instruct_GPTQ - Finetune on finance-alpaca dataset 🦙](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral-7B-Instruct_GPTQ-finetune.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral_7B_Instruct_GPTQ_finetune.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Mistral 7b FineTuning with DPO Direct_Preference_Optimization](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral_7b_FineTuning_with_DPO_Direct_Preference_Optimization.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Mistral_7b_FineTuning_with_DPO_Direct_Preference_Optimization.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Finetune llama_2_GPTQ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Finetune_llama_2_GPTQ)\n| 📌 [TinyLlama with Unsloth and_RoPE_Scaling dolly-15 dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/TinyLlama_with_Unsloth_and_RoPE_Scaling_dolly-15k.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/TinyLlama_with_Unsloth_and_RoPE_Scaling_dolly-15k.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n| 📌 [Tinyllama fine-tuning with Taylor_Swift Song lyrics](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/tinyllama_fine-tuning_Taylor_Swift.ipynb)|\u003ca href=\"https://colab.research.google.com/github/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/tinyllama_fine-tuning_Taylor_Swift.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e\u003c/a\u003e\n\n\n\n\n---------------------------\n\n### LLM Techniques and utils - Explained\n\n| LLM Concepts |\n| -------- |\n| 📌 [DPO (Direct Preference Optimization) training and its datasets](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/DPOTrainer.ipynb)|\n| 📌 [4-bit LLM Quantization with GPTQ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/4-bit_LLM_Quantization_with_GPTQ.ipynb)|\n| 📌 [Quantize with HF Transformers](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Quantize_with_HF_transformers)|\n| 📌 [Understanding rank r in LoRA and related Matrix_Math](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Understanding_rank_r_in_LoRA_and_related_Matrix_Math.ipynb)|\n| 📌 [Rotary Embeddings (RopE) is one of the Fundamental Building Blocks of LlaMA-2 Implementation](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/RoPE-As-Implemented-in-LlaMa-Source-Code.ipynb)|\n| 📌 [Chat Templates in HuggingFace](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/apply_chat_template.ipynb)|\n| 📌 [How is Mixtral 8x7B is a dense 47Bn param model](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/MOE-Mixture-of-Experts/Mixtral_8x7B_MoE_Why_47Bn_param_by_Shared_Param.md)|\n| 📌 [The concept of **validation log perplexity** in LLM training - a note on fundamentals.](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Validation_log_perplexity.md)|\n| 📌 [Why we need to identify `target_layers` for LoRA/QLoRA](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/targets_layers_in_peft_and_meaning_of_Rank_of_a_Matrix.ipynb)|\n| 📌 [Evaluate Token per sec](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Evaluate_token_per_sec.ipynb)|\n| 📌 [traversing through nested attributes (or sub-modules) of a PyTorch module](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Traverse_through_sub-modules_of_PyTorch_Model.ipynb)|\n| 📌 [Implementation of Sparse Mixtures-of-Experts layer in PyTorch from Mistral Official Repo](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/MoE_implementation_Mistral_official_Repo.ipynb)|\n| 📌 [Util method to extract a specific token's representation from the last hidden states of a transformer model.](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Select_last_meaningful_token_from_each_sequence.ipynb)|\n| 📌 [Convert PyTorch model's parameters and tensors to half-precision floating-point format](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Convert_Pytorch_model_to_half_precision.ipynb)|\n| 📌 [Quantizing 🤗 Transformers models with the GPTQ method](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Quantizing_Transformers_with_GPTQ.ipynb)|\n| 📌 [Quantize Mixtral-8x7B so it can run in 24GB GPU](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/Quantize_mixtral-instruct-awq_in_so_it_can_run_in_24GB.ipynb)|\n| 📌 [What is GGML or GGUF in the world of Large Language Models ?](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/LLM_Techniques_and_utils/GGUF_GGML_GPTQ-basics.md)|\n\n\n\n\n\n---------------------------\n\n## Other Smaller Language Models\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=-rqmj_tfQLo\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=34\u0026ab_channel=Rohan-Paul-AI) [DeBERTa Fine Tuning for Amazon Review Dataset Pytorch](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/DeBERTa%20Fine%20Tuning-for%20Amazon%20Review%20Dataset%20Pytorch.ipynb)\n\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=4nNbg4bWDrQ\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=32\u0026ab_channel=Rohan-Paul-AI) [FineTuning BERT for Multi-Class Classification on custom Dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/FineTuning_BERT_for_Multi_Class_Classification_Turkish)\n\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=91msLyGC-LI\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=28\u0026ab_channel=Rohan-Paul-AI) [Document STRIDE when Tokenizing with HuggingFace Transformer for NLP Projects](https://www.youtube.com/watch?v=91msLyGC-LI\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=28\u0026ab_channel=Rohan-Paul-AI)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=cplo2UyNw24\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=31\u0026ab_channel=Rohan-Paul-AI) [Fine-tuning of a PreTrained Transformer model - what really happens to the weights (parameters)]()\n\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=pqpaHeCsuVI\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=30\u0026ab_channel=Rohan-Paul-AI) [Cerebras-GPT New Large Language Model Open Sourced with Apache 2.0 License](https://www.youtube.com/watch?v=pqpaHeCsuVI\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=30\u0026ab_channel=Rohan-Paul-AI)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=6X0xfXMKCjM\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=29\u0026ab_channel=Rohan-Paul-AI) [Roberta-Large Named Entity Recognition on Kaggle NLP Competition with PyTorch](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Roberta-Large-NER-on-Kaggle-NLP%20Competition)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=EHtHF9Kvm0Y\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=28\u0026ab_channel=Rohan-Paul-AI) [Longformer end to end with Kaggle NLP competition](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Longformer%20end%20to%20end%20with%20Kaggle%20NLP%20competition)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=tvdIF1FU7fg\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=24) [Zero Shot Multilingual Sentiment Classification with PyTorch Lightning](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/zero_shot_multilingual_sentiment_classification_with_USEm)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=CwLPglxw1WA\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=23) [Fine Tuning Transformer (BERT) for Customer Review Prediction | NLP | HuggingFace ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fine_Tuning_HuggingFace_Transformer_BERT_Yelp_Customer_Review_Predictions)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=30zPz5Xz-8g\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=21) [Understanding BERT Embeddings and Tokenization | NLP | HuggingFace](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Understing_BERT_Embedding_Vector)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=fl0ow-nD8FM\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=20) [Topic Modeling with BERTopic | arxiv-abstract dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Topic-modeling-with-bertopic-arxiv-abstract)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=vrDdnQfav0s\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=21) [Latent Dirichlet Allocation (LDA) for Topic Modeling](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Topic_Modeling_with_LDA.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=iCL1TmRQ0sk\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=19) [Adding a custom task-specific Layer to a HuggingFace Pretrained Model](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Add-task_specific_custom_layer_to_model.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=ZvsH09XGuZ0\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=18) [Fine Tuning DistilBERT for Multiclass Text Classification](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Multi-class-text-classifica_fine-tuning-distilbert.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=dzyDHMycx_c\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=18) [Fine Tuning BERT for Named Entity Recognition (NER)](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/YT_Fine_tuning_BERT_NER_v1.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=fLqiPks4neU\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=15) [Text Summarization by Fine Tuning Transformer Model | NLP ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fine_Tuning_Pegasus_for_Text_Summarization.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=HDSNjrxSwqw\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=14) [Text Summarization with Transformer - BART + T5 + Pegasus\n  ](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Text_Summarization_%20BART%20_T5_Pegasus.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=oxEXBJQG27A\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=13) [Debarta-v3-large model fine tuning for Kaggle Competition Feedback-Prize | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Other-Language_Models_BERT_related/Deberta-v3-large-For_Kaggle_Competition_Feedback-Prize/deberta-v3-large-For_Kaggle_Competition_Feedback-Prize.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=SmWbKiueYVU\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=12) [Topic Modeling with BERT and Automatic Cluster Labeling](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Topic_Modeling_with_BERT_and_Automatic_cluster_labeling/Topic_Modeling.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=Ua_ToM-CG5Q\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=11) [Decoding strategies while generating text with GPT-2](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Decoding_Strategies_for_text_generation/Decoding_Strategies_for_text_generation.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=VrJwKdls6d4\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=12) [Fake News Classification with LSTM and Tensorflow](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fake_News_Classification_with_LSTM_Tensorflow.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=hgg2GAgDLzA\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=11) [FinBERT Sentiment Analysis for very Long Text (more than 512 Tokens) | PART 2](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/FinBERT_Long_Text_Part_2.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=WEAAs_0etJQ\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=9) [FinBERT Sentiment Analysis for very Long Text Corpus (more than 512 Tokens) | PART-1](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/FinBERT_Long_Text_Part_2.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=fwDTLQDKJTE\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=8) [Cosine Similarity between sentences with Transformers HuggingFace](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Cosine_Similarity_between_sentences_with_Transformers.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=urMUa4Nw_B8\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=7) [Zero Shot Learning - Cross Lingual Named Entity Recognition with XLM-Roberta](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Zero_Shot_Learning_multilingual-NER.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=Hp8_Enwzdxk\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=6) [BERT from Hugging Face - Few Baseline Application | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/BERT_HuggingFace_Basic_Usages.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=CHFiTTPeyUw\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=9) [Transformer Encoder with Scaled Dot Product from Scratch](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Transformer_From_Scratch/Transformer_From_Scratch.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=_IGdekeBCoE\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=7) [Fuzzy String Matching in Natural Language Processing | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Fuzzy-String-Matching.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=SzSANHjYhfg\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=6) [Understanding Word Vectors usage with Spacy Word and Sentence Similarity](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Word-Vectors-Understanding-with-Spacy.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=TxTxWAohW7E\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=5) [Named Entity Recognition NER using spaCy - Extracting Subject Verb Action](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Named_Entity_Recognition_NER_using_spaCy%20-%20Extracting_Subject_Verb_Action.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=zcW2HouIIQg\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=5) [Fine-Tuning-DistilBert - Hugging Face Transformer for Poem Sentiment Prediction | NLP](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/Other-Language_Models_BERT_related/Fine_Tuning_DistilBert_Poem_Sentiments.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=0Y03waAL4Gw\u0026list=PLxqBkZuBynVTn2lkHNAcw6lgm1MD5QiMK\u0026index=4) [Fine Tuning BERT-Based-Uncased Hugging Face Model on Kaggle Hate Speech Dataset](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/bert-base-uncased-fine-tuned-kaggle-hate-speech-dataset.ipynb)\n\n- [![Youtube Link][logo]](https://www.youtube.com/watch?v=DpzQNQI-S3s\u0026list=PLxqBkZuBynVQEvXfJpq3smfuKq3AiNW-N\u0026index=3) [Text Analytics of Tweet Emotion - EDA with Plotly](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/Text%20Analytics%20of%20Tweet%20Emotion%20-%20EDA%20with%20Plotly.ipynb)\n\n- [![Youtube Link][logo]](https://bit.ly/3Nk0zRA) [Sentiment analysis using TextBlob and Vader](https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/tree/main/Other-Language_Models_BERT_related/sentiment_analysis_textblob_Vader.ipynb)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frohan-paul%2FLLM-FineTuning-Large-Language-Models","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frohan-paul%2FLLM-FineTuning-Large-Language-Models","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frohan-paul%2FLLM-FineTuning-Large-Language-Models/lists"}