https://github.com/habout632/llms

llms related stuff , including code, docs
https://github.com/habout632/llms

Last synced: 2 months ago
JSON representation

llms related stuff , including code, docs

• Host: GitHub
• URL: https://github.com/habout632/llms
• Owner: habout632
• Created: 2024-08-26T03:44:13.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-09-05T10:21:19.000Z (5 months ago)
• Last Synced: 2024-09-05T13:29:34.461Z (5 months ago)
• Language: Python
• Size: 21.5 MB
• Stars: 3
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# llms

llms related stuff , including 

code, 

docs

[llm pretrain frameworks](docs/llm_frameworks.md)

[sft](docs/sft.md)

[rlhf](docs/rlhf.md)

[inference frameworks]()

datasets

[papers](docs/papers.md)

reproduce gpt2 

test local work

for gpt2 code its highly inspired by building llm from scratch

to do list reproduce:

- [x] gpt2

- []  gpt3

- [] llama3

- [] phi3.5

reference another markdown in this project

Hugging Face Images

https://blog.csdn.net/TonyNotes/article/details/135828795

pip image

https://blog.csdn.net/MissOfSpring/article/details/133984239