Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/win4r/o1

Using Groq or OpenAI or Ollama to create o1-like reasoning chains
https://github.com/win4r/o1

Last synced: 1 day ago
JSON representation

Using Groq or OpenAI or Ollama to create o1-like reasoning chains

Awesome Lists containing this project

README 

        
# o1: Using LLMs to create o1-like reasoning chains



[Video Demo](https://github.com/user-attachments/assets/db2a221f-f8eb-48c3-b5a7-8399c6300243)



This is an early prototype of using prompting strategies to improve LLM reasoning capabilities through o1-like reasoning chains. This allows the LLM to "think" and solve logical problems that usually otherwise stump leading models. Unlike o1, all the reasoning tokens are shown, and the app supports multiple LLM backends.



o1 is experimental and being open sourced to help inspire the open source community to develop new strategies to produce o1-like reasoning. This experiment helps show the power of prompting reasoning in visualized steps, not a comparison to or full replication of o1, which uses different techniques. OpenAI's o1 is instead trained with large-scale reinforcement learning to reason using Chain of Thought, achieving state-of-the-art performance on complex PhD-level problems. 



o1 demonstrates the potential of prompting alone to overcome straightforward LLM logic issues like the Strawberry problem, allowing existing models to benefit from dynamic reasoning chains and an improved interface for exploring them.



## Supported Models



### Llama-3.1 70b on Groq



The original implementation uses Llama-3.1 70b hosted on Groq to create reasoning chains.



### OpenAI GPT-4o



This version supports OpenAI's GPT-4o model, allowing users to leverage OpenAI's advanced language model for reasoning chains.



### Ollama Local Models



For users who prefer to run models locally, this version also supports Ollama, enabling the use of various open-source models on your local machine.



## How it works



o1 creates reasoning chains, in principle a dynamic Chain of Thought, that allows the LLM to "think" and solve some logical problems that usually otherwise stump leading models.



At each step, the LLM can choose to continue to another reasoning step, or provide a final answer. Each step is titled and visible to the user. The system prompt also includes tips for the LLM. There is a full explanation under Prompt Breakdown, but a few examples are asking the model to "include exploration of alternative answers" and "use at least 3 methods to derive the answer".



The reasoning ability of the LLM is therefore improved through combining Chain-of-Thought with the requirement to try multiple methods, explore alternative answers, question previous draft solutions, and consider the LLM's limitations. This alone, without any training, is sufficient to achieve ~70% accuracy on the Strawberry problem (n=10, "How many Rs are in strawberry?"). Without prompting, Llama-3.1-70b had 0% accuracy and ChatGPT-4o had 30% accuracy.



## Examples



> [!IMPORTANT]

> o1 is not perfect, but it can perform significantly better than LLMs out-of-the-box. From initial testing, o1 accurately solves simple logic problems 60-80% of the time that usually stump LLMs. However, accuracy has yet to be formally evaluated. See examples below.



[Examples section remains unchanged]



## Quickstart



### For Groq (original version)



[Quickstart instructions for Groq remain unchanged]



### For OpenAI GPT-4o



To use the Streamlit UI with OpenAI's GPT-4o, follow these instructions:



```bash

python3 -m venv venv

source venv/bin/activate

pip3 install -r requirements.txt

export OPENAI_API_KEY=your_api_key_here

streamlit run app_openai.py

```



### For Ollama Local Models



To use the Streamlit UI with Ollama local models, follow these instructions:



```bash

python3 -m venv venv

source venv/bin/activate

pip3 install -r requirements.txt

# Set up your .env file with OLLAMA_URL and OLLAMA_MODEL

streamlit run app_ollama.py

```



### 👉👉👉如有问题请联系我的徽信 stoeng

### 👉👉👉我的哔哩哔哩频道 https://space.bilibili.com/3493277319825652

### 👉👉👉我的YouTube频道 https://www.youtube.com/@AIsuperdomain



## Prompting Strategy



[Prompting Strategy section remains unchanged]



## Top Forks

* Mult1: Using multiple AI providers to create o1-like reasoning chains ([GitHub Repository](https://github.com/tcsenpai/multi1))



## Credits



This app was originally developed by [Benjamin Klieger](https://x.com/benjaminklieger) and has been extended by the open-source community to support multiple LLM backends.g1