https://github.com/tcapelle/llm_recipes

A set of scripts and notebooks on LLM finetunning and dataset creation
https://github.com/tcapelle/llm_recipes

Last synced: about 20 hours ago
JSON representation

A set of scripts and notebooks on LLM finetunning and dataset creation

• Host: GitHub
• URL: https://github.com/tcapelle/llm_recipes
• Owner: tcapelle
• License: mit
• Created: 2023-10-10T20:56:55.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-09-27T09:03:12.000Z (about 2 months ago)
• Last Synced: 2024-10-31T04:03:02.609Z (15 days ago)
• Language: Jupyter Notebook
• Size: 15.8 MB
• Stars: 92
• Watchers: 1
• Forks: 24
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LLM Recipes

This repo contains my own exploration of the LLM world right now.

I am interested mostly in fine-tuning LMs for text generation tasks. This implies:

- Dataset preparation and preprocessing

- Model fine-tuning with libraries like Axolotl, HuggingFace, etc.

- Model evaluation