https://github.com/gianlucatruda/gptools
Composable tools for doing useful things with GPT-4 (from the command line).
https://github.com/gianlucatruda/gptools
Last synced: 3 months ago
JSON representation
Composable tools for doing useful things with GPT-4 (from the command line).
- Host: GitHub
- URL: https://github.com/gianlucatruda/gptools
- Owner: gianlucatruda
- License: gpl-3.0
- Created: 2023-06-16T14:00:18.000Z (about 2 years ago)
- Default Branch: master
- Last Pushed: 2023-06-16T18:00:52.000Z (about 2 years ago)
- Last Synced: 2025-02-08T15:48:07.883Z (5 months ago)
- Language: Python
- Size: 25.4 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# GPTools
Composable tools for doing useful things with GPT-4 (from the command line).
## Tools
* [Web2MD](/web2md): a Python CLI tool that extracts human-readable text from a webpage and converts it into Markdown format. This is useful when you want to scrape webpages to pipe into GPT.
* [ChunkGPT](/chunkgpt): a Python CLI tool that takes a Markdown file or content as input, splits it into smaller chunks, and uses OpenAI's GPT-3.5-turbo model to generate summaries for each chunk. This tool is useful for summarising large text files or generating concise summaries of lengthy content.
## Examples
Scrape a webpage to markdown with `web2md` and then pipe the output into `chunkgpt` to summarise each section and write it to `summary.md`
```bash
python3 web2md/web2md.py "https://en.wikipedia.org/wiki/OpenAI" --ignore_images | \
python3 chunkgpt/chunkgpt.py --chunk_size 500 --temperature 0.3 --max_tokens 500 \
--sys_message "You are Assistant who summarises any text" -o summary.md
```
## Installation
```bash
git clone [email protected]:gianlucatruda/GPTools.git
cd GPTools
pip install -r requirements.txt
export OPENAI_API_KEY=""
```
## Contributions
Feel free to submit PRs.