https://github.com/khangich/llm-tldr
Short description of LLM research and development
https://github.com/khangich/llm-tldr
Last synced: 3 months ago
JSON representation
Short description of LLM research and development
- Host: GitHub
- URL: https://github.com/khangich/llm-tldr
- Owner: khangich
- Created: 2024-05-02T20:59:08.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-03T13:07:07.000Z (over 1 year ago)
- Last Synced: 2025-06-10T08:40:50.428Z (4 months ago)
- Language: Python
- Size: 15.6 KB
- Stars: 5
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# llm-tldr
Short description of LLM research and development
# Papers
## Chain of Thought (Jason Wei 2023)
Paper: [Chain Of Thought](https://proceedings.neurips.cc/paper_files/paper/2022/file/9d5609613524ecf4f15af0f7b31abca4-Paper-Conference.pdf)
A new prompting technique to improve LLM reasoning performance.
- Example 1:
- Example 2:
- Result: for Math, CoT can improve 2x solve rate
- One liner command
```
curl -X POST "https://api.openai.com/v1/chat/completions" \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "gpt-3.5-turbo",
"messages": [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Explain the steps to find the least common multiple (LCM) of these numbers: [12, 15, 18] and provide the answer in JSON format with your thoughts and the final answer."}
],
"max_tokens": 250,
"temperature": 0.3,
"n": 1,
"stop": null
}'
```
[Github Workspace][https://github.com/codespaces/new/khangich/llm-tldr]
## ReAct (Shunyu Yao 2023)
Paper: [ReAct](https://arxiv.org/pdf/2210.03629)
- Example 1:
- Example 2:
- Result
- Weblink diagram
```
+-------------------+ +-------------------+ +-------------------+
| Reset Env with | | Generate Thought| | Execute Action |
| Question (idx) |----->| & Action using |----->| in Environment |
| | | LLM Function | | & Get Obs |
+-------------------+ +-------------------+ +-------------------+
| | |
| | |
v v v
+-------------------+ +-------------------+ +-------------------+
| Update Prompt |<-----| Format Response |<-----| Check if Done |
| with Question | | & Handle Errors | | & Update Prompt |
+-------------------+ +-------------------+ +-------------------+
```