https://github.com/zeyadusf/topics-in-nlp-llm

In this repo I will share different topics on anything I want to know in nlp and llms
https://github.com/zeyadusf/topics-in-nlp-llm

bpe llms lora nlp peft peft-fine-tuning-llm quantization

Last synced: 4 months ago
JSON representation

In this repo I will share different topics on anything I want to know in nlp and llms

• Host: GitHub
• URL: https://github.com/zeyadusf/topics-in-nlp-llm
• Owner: zeyadusf
• Created: 2024-08-02T15:09:36.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-09-16T11:07:13.000Z (9 months ago)
• Last Synced: 2025-01-07T17:28:26.136Z (5 months ago)
• Topics: bpe, llms, lora, nlp, peft, peft-fine-tuning-llm, quantization
• Homepage:
• Size: 51.8 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
 

  

  # Topics in NLP and LLMs






In this repo I will share different topics on anything I want to know in nlp and llms  


### Topics :

> - **[PEFT (Parameter-Efficient Fine-Tuning)](https://github.com/zeyadusf/topics-in-nlp-llm/tree/main/PEFT%20(Parameter-Efficient%20Fine-Tuning))**

>    - [LoRA](https://github.com/zeyadusf/topics-in-nlp-llm/tree/main/PEFT%20(Parameter-Efficient%20Fine-Tuning)/LoRA)

>    -  QLoRA

>  -  Quantization

> - Byte Pair Encoding (BPE).

>  - Relative positional embedding vs Absolute positional embedding.

---

### Related Repositories

**[`LLMs from Scratch`](https://github.com/zeyadusf/LLMs-from-Scratch)**

**[`FineTuning Large Language Models`](https://github.com/zeyadusf/FineTuning-LLMs)**



## 📞 Contact :