Awesome-RL-based-LLM-Reasoning
Awesome RL-based LLM Reasoning
https://github.com/bruno686/Awesome-RL-based-LLM-Reasoning
Last synced: about 1 month ago
JSON representation
Cloud GPU
Surveys
Introduction to Reinforcement Learning
Surveys
Open-Source Project
Surveys
- TinyZero Stars - Pan/TinyZero) (4*4090 is enough for 0.5B LLM, but can't observe aha moment)
- Open-r1 Stars - r1](https://github.com/huggingface/open-r1)
- Logic-RL Stars - RL](https://github.com/Unakar/Logic-RL)
- Unsloth-GRPO Stars - GRPO](https://colab.research.google.com/drive/11t4njE3c4Lxl-07OD8lJSMKkfyJml3Tn?usp=sharing) (simplest r1 implementation)
- OpenR
- DeepSeek-RL-Qwen-0.5B-GRPO-gsm8k
- deepseek_r1_train
Other Interesting RL-based Reasoning Repository
Surveys
Papers
Other Newest Interesting Papers about LLM Reasoning
- 2504
- 2504
- 2503
- 2504
- 2503
- 2503
- 2503
- 2503
- 2502
- 2502
- 2502 - Yuandong Tian)
- 2502
- 2502
- 2502 - Plank)
- 2502
- 2502
- 2502 - play generate data) (LSE)
- 2501
- 2501
- 2412
- 2412
- 2412
- 2408
- 2502
- 2412 - Yuandong Tian)
Outcome-based Reward Model
Process-based Reward Model
Question about LLM Reasoning Ability
- 2504
- 2504 - o1 and DeepSeek-R1 can suffer 60% performance loss on elementary school-level arithmetic and reasoning problems)
- 2503
Reinforcement learning
- 2504
- 2504
- 2504
- 2504
- 2503
- 2503
- 2503
- 2502 - based (VB) is better than verifier-free (VF))
- 2502
- 2502
- 2502 - Play) (MIT)
- 2502
- 2409
- 2506
Search algorithms (Monte Carlo Tree Search or Beam Search)
- 2502
- 2408
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
- 2310
Surveys
Slides and Discussion
Surveys
- Self-improvement of LLM agents through Reinforcement Learning at Scale
- Understanding Reasoning LLMs Methods and Strategies for Building and Refining Reasoning Models
- What is the difference between large reasoning model and LLM?
- LLM Reasoning: Key Ideas and Limitations - DeepMind (Video)
- Towards Reasoning in Large Language Models - UIUC
- Can LLMs Reason & Plan? - ASU
- Inference-Time Techniques for LLM Reasoning - DeepMind
- Chain-of-Thought Reasoning In Language Models - SJTU
- Learning to Self-Improve & Reason with LLMs - Meta & NYU
- 为什么在Deepseek-R1-ZERO出现前,无人尝试放弃微调对齐,通过强化学习生成思考链推理模型?
- Kimi Flood Sung
- Deepseek系列文章梳理
- ChatGPT and The Art of Post-Training - 25/02/18
Video
Surveys
- [LLM+RL
- [LLM+RL
- LLM-Based Reasoning: Opportunities and Pitfalls (LAVA Workshop in ACCV 2024)
- Reinforcement Learning in DeepSeek r1 Visualized - 2-2.click&vd_source=228d782c60d8b392d7077abd8d7a1fee))
- EZ撸paper: DeepSeek-R1 论文详解 part 3:GPT发展史 | scaling law | 训练范式 | emergent ability
- EZ撸paper: DeepSeek-R1 论文详解 part 2:AGI是什么? | Reinforcement Learning快速入门 | AlphaGo介绍
- EZ撸paper: DeepSeek-R1 论文详解 part 1:比肩 OpenAI-o1,如何做到的?
- [GRPO Explained
- DeepSeek R1 Explained to your grandma
- EZ撸paper: DeepSeek-R1 论文详解 part 3:GPT发展史 | scaling law | 训练范式 | emergent ability
- EZ撸paper: DeepSeek-R1 论文详解 part 1:比肩 OpenAI-o1,如何做到的?
- DeepSeek R1 Explained to your grandma