https://github.com/zcccccz/awesome-llm-implicit-reasoning
Papers of Implicit Reasoning in LLMs.
https://github.com/zcccccz/awesome-llm-implicit-reasoning
List: awesome-llm-implicit-reasoning
awesome chain-of-thought deepseek-r1 hidden implicit latent-space llm-inference openai-o1 reasoning
Last synced: 7 months ago
JSON representation
Papers of Implicit Reasoning in LLMs.
- Host: GitHub
- URL: https://github.com/zcccccz/awesome-llm-implicit-reasoning
- Owner: zcccccz
- License: mit
- Created: 2025-03-06T17:35:40.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-03-07T06:56:27.000Z (7 months ago)
- Last Synced: 2025-03-07T07:32:07.995Z (7 months ago)
- Topics: awesome, chain-of-thought, deepseek-r1, hidden, implicit, latent-space, llm-inference, openai-o1, reasoning
- Homepage:
- Size: 2.93 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Awesome LLM Implicit Reasoning
A collection of papers that unlock the implicit reasoning ability of LLMs.
### 2025
1. **[Efficient Reasoning with Hidden Thinking](https://arxiv.org/abs/2501.19201)**
*Xuan Shen, Yizhou Wang, Xiangxi Shi, Yanzhi Wang, Pu Zhao, Jiuxiang Gu.* Preprint'25
2. **[Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach](https://arxiv.org/abs/2502.05171)**
*Jonas Geiping, Sean McLeish, Neel Jain, John Kirchenbauer, Siddharth Singh, Brian R. Bartoldson, Bhavya Kailkhura, Abhinav Bhatele, Tom Goldstein.* Preprint'25
3. **[CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation](https://arxiv.org/abs/2502.21074)**
*Zhenyi Shen, Hanqi Yan, Linhai Zhang, Zhanghao Hu, Yali Du, Yulan He.* Preprint'25
4. **[SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs](https://arxiv.org/abs/2502.12134)**
*Yige Xu, Xu Guo, Zhiwei Zeng, Chunyan Miao.* Preprint'25
5. **[Scalable Language Models with Posterior Inference of Latent Thought Vectors](https://arxiv.org/abs/2502.01567)**
*Deqian Kong, Minglu Zhao, Dehong Xu, Bo Pang, Shu Wang, Edouardo Honig, Zhangzhang Si, Chuan Li, Jianwen Xie, Sirui Xie, Ying Nian Wu.* Preprint'25
6. **[Reasoning with Latent Thoughts: On the Power of Looped Transformers](https://arxiv.org/abs/2502.17416)**
*Nikunj Saunshi, Nishanth Dikkala, Zhiyuan Li, Sanjiv Kumar, Sashank J. Reddi.* ICLR'25
7. **[TokenSkip: Controllable Chain-of-Thought Compression in LLMs](https://arxiv.org/abs/2502.12067)**
*Heming Xia, Yongqi Li, Chak Tou Leong, Wenjie Wang, Wenjie Li.* Preprint'25
8. **[LightThinker: Thinking Step-by-Step Compression](https://arxiv.org/abs/2502.15589)**
*Jintian Zhang, Yuqi Zhu, Mengshu Sun, Yujie Luo, Shuofei Qiao, Lun Du, Da Zheng, Huajun Chen, Ningyu Zhang.* Preprint'25
9. **[Beyond Words: A Latent Memory Approach to Internal Reasoning in LLMs](https://arxiv.org/abs/2502.21030v1)**
*José I. Orlicki.* Preprint'25
### 2024
1. **[From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step](https://arxiv.org/abs/2405.14838)**
*Yuntian Deng, Yejin Choi, Stuart Shieber.* Preprint'24
2. **[Training Large Language Models to Reason in a Continuous Latent Space](https://arxiv.org/abs/2412.06769)**
*Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason Weston, Yuandong Tian.* Preprint'24
3. **[Compressed Chain of Thought: Efficient Reasoning Through Dense Representations](https://arxiv.org/abs/2412.13171)**
*Jeffrey Cheng, Benjamin Van Durme.* Preprint'24
### 2023
1. **[Implicit Chain of Thought Reasoning via Knowledge Distillation](https://arxiv.org/abs/2311.01460)**
*Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber.* Preprint'23