Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/drewthomasson/doc2interview
This is an interface that will offline convert anything pdf document you give it into an interview between two people discussing it.
https://github.com/drewthomasson/doc2interview
generative-ai ollama pdf tts xtts
Last synced: 27 days ago
JSON representation
This is an interface that will offline convert anything pdf document you give it into an interview between two people discussing it.
- Host: GitHub
- URL: https://github.com/drewthomasson/doc2interview
- Owner: DrewThomasson
- Created: 2024-08-24T05:39:36.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2024-09-07T06:26:05.000Z (2 months ago)
- Last Synced: 2024-10-12T18:02:14.652Z (27 days ago)
- Topics: generative-ai, ollama, pdf, tts, xtts
- Language: Python
- Homepage:
- Size: 589 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# 🎙️ doc2interview
Welcome to the Interview Audio Generator!
This innovative tool automatically transforms PDF documents or online articles into engaging interview-style audio files.
It's perfect for auditory learners or anyone who enjoys consuming content on the go!
And best of all it runs entirly locally on your computer! No paid api services or anything.
## 📋 Prerequisites
Ensure you have the following installed:
- Python 3.8+
- Ollama with the `phi3.5` model pulled
- For faster results have a cuda capable machine so xtts can generate faster with a minimum of 4gb Vram
## 🛠️ Installation
1. **Clone the repository**:
```bash
git clone https://github.com/DrewThomasson/doc2interview.git
cd doc2interview
```
2. **Install required Python packages**:
- Install all necessary Python packages using the following command:
```bash
pip install -r requirements.txt
```
3. **Setup Ollama**:
- Install Ollama following the official documentation. [link here](https://ollama.com)
- Pull the `phi3.5` model necessary for running the script:
```bash
ollama pull phi3.5
```
## 🚀 Quick Start
1. **Start the script**:
```bash
python summarize_local.py # Replace with your actual script name
```
2. **Open the Gradio interface**:
- The interface will be available in your web browser.
- Upload a PDF or enter an article URL.
- Choose the language and let the magic happen!
## 📁 Output
The generated audio files will be stored in:
- **Chapter-wise audio**: `./output_audio/`
- **Final combined audio**: `./final_output_audio_dir/final_output_audio.wav`
Feel free to explore the audio files and use them as needed!
## 🎧 Demo
Check out this sample audio from a generated interview:
https://github.com/user-attachments/assets/77e6046d-18e0-41dd-b034-7cdd709b9daf
[Generated from this article](https://www.chosun.com/english/industry-en/2024/08/21/GGIYIGY43VHHVA2J74VAVWLEDQ/)
## To-Do List
- [ ] **Attempt to find a way to remove any ramlbings at the end.**
For more details, see the issue request [here](https://github.com/DrewThomasson/doc2interview/issues/2#issue-2501722522).
- [ ] **Allow users to easily swap the ref audio for either voice actors in gui.**
- [ ] **Find a way for the program to be able to determine which speakers in generated dialog are male or female.**
Possably by just asking the llm.
- [ ] **Allow user to see streaming llm outout**
Right now you cant see the llm working live in the terminal, and only see the llm output once its finished writing the dialog script.
- [ ] **Have program automatically run the ollama pull command if the specified model isnt found?**
Not that huge of an issue though.
- [ ] **Have a bulk process mulitple files or documents feature**
## 🤝 Contributing
Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.
## 📖 License
Distributed under the MIT License. See `LICENSE` for more information.
## ❓ Support
Got questions? Feel free to open an issue or contact me directly at [email protected].
## 🌟 Show your support
Give a ⭐️ if this project helped you!
## Inspired by
AiPeterWorld with his non-offline version which used gemini flash and openai voice for tts
https://huggingface.co/spaces/AIPeterWorld/Doc-To-Dialogue