https://github.com/almogtavor/facts-checker-gpt
Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.
https://github.com/almogtavor/facts-checker-gpt
alpaca chatgpt fake-news gpt gpt-3 llm
Last synced: 2 months ago
JSON representation
Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.
- Host: GitHub
- URL: https://github.com/almogtavor/facts-checker-gpt
- Owner: almogtavor
- License: apache-2.0
- Created: 2023-04-15T17:36:01.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-04-22T19:13:46.000Z (over 2 years ago)
- Last Synced: 2025-05-25T08:03:59.423Z (5 months ago)
- Topics: alpaca, chatgpt, fake-news, gpt, gpt-3, llm
- Language: Python
- Homepage:
- Size: 149 KB
- Stars: 12
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# 🦙⚖️ FactsCheckerGPT
Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.
FactsCheckerGPT enables you to talk to ChatGPT, and to validate each response against an "army" of LLMs.
As the FactChecker Agent2, the user can choose a different LLM, such as GPT3.5 / Alpaca (more to be added soon).
Currently, there is no support for multiple FactCheckers.
## 🔧 Usage
Run the `facts_checker_gpt` Python module in your terminal:
_(Type this into your CMD window)_
```
python -m facts_checker_gpt
```
You can start asking questions:
## 🦙 Enable Alpaca
To use Alpaca, follow the getting started guide of [alpaca.cpp](https://github.com/antimatter15/alpaca.cpp#get-started-7b).
After you've downloaded both files, update your `.env` file:
```env
ALPACA_MODEL_PATH=C:\alpaca.cpp\chat\ggml-alpaca-7b-q4.bin
ALPACA_EXECUTABLE_PATH=C:\alpaca.cpp\chat\chat.exe
AGENT1_MODEL=alpaca
AGENT2_MODEL=gpt-3.5-turbo-0301
```
Currently, the alpaca model doesn't perform well as a verifier (tested with the version of the 7B parameters).