Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/video-db/PromptClip
Instantly create video clips from LLM prompts
https://github.com/video-db/PromptClip
ai editing-videos llm prompt-engineering prompt-toolkit video
Last synced: 3 months ago
JSON representation
Instantly create video clips from LLM prompts
- Host: GitHub
- URL: https://github.com/video-db/PromptClip
- Owner: video-db
- License: mit
- Created: 2024-02-05T14:51:07.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-07-08T16:28:10.000Z (4 months ago)
- Last Synced: 2024-07-08T20:51:41.424Z (4 months ago)
- Topics: ai, editing-videos, llm, prompt-engineering, prompt-toolkit, video
- Language: Jupyter Notebook
- Homepage: https://docs.videodb.io/build-with-videodb-35
- Size: 33.2 KB
- Stars: 89
- Watchers: 4
- Forks: 11
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[![PyPI version][pypi-shield]][pypi-url]
[![Stargazers][stars-shield]][stars-url]
[![Issues][issues-shield]][issues-url]
[![Website][website-shield]][website-url]
PromptClip ✄
Create video clips using LLM prompts
🐞Report a Bug
·
💡Suggest a Feature
# PromptClip: Create Instant Video Clips with LLM Prompts 🍭
## What does it do? 🤔
It allows any developer to:
* 📚 Upload a video from any source (Local Files, Youtube, S3 etc.)
* 🔍 Prompt that video in natural language with queries like `Show funny moments in the video`
or `find the moments useful for social media trailer`
* 🎛️ Use any LLM of your choice like OpenAI, Claude or Gemeni Pro.
* 🌟 Instantly watch the clip of those moments.
* 🛠️ Finetune the clip or supercut by ranking results, managing length of the clip etc.
* 🎸 Add music or image overlay to the clip.
---
## Results 🎉
Checkout these prompts and the results 👉🏼
| Original Video | Prompt | Link |
|--------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------|
| [Shark Tank](https://www.youtube.com/watch?v=HpUR7-Oe1ss) | Find every moment where a deal was offered | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/46c983a6-7b73-4876-8082-5dc79ecbb972.m3u8) |
| [Useful Gadgets](https://www.youtube.com/watch?v=bGmXrMW9ucU) | Show me moments in the video where the host discusses or reveals the pricing of the gadgets | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/5c4f4752-eca4-4f76-9d68-1a855d75de88.m3u8) |
| [Sponsorship Details of Huberman Podcast](https://www.youtube.com/watch?v=LYYyQcAJZfk) | Find details about every sponsor | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/588bbe2f-1f14-4a9f-b62f-7f1132eed3f2.m3u8) |
| [Highlights from Masterchef Episode](https://www.youtube.com/watch?v=4JVzznqOF0k) | Show me the feedback from every judge | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/33b3e620-ca32-4895-847b-8aaf7cbf1e74.m3u8) |
| [Important Topics/Advice from a Lecture](https://www.youtube.com/watch?v=HAnw168huqA) | Find sentences where anxiety is discussed | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/61203892-7607-4089-8302-dd802efe183e.m3u8) |
| [Tech Review Video](https://www.youtube.com/watch?v=dtp6b76pMak) | Find sentences where host explains about the battery | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/e6ce8133-ed7d-4dad-a070-ead778a0d2d3.m3u8) |
| [Travel Video](https://www.youtube.com/watch?v=sV1Z2LXtHqc) | What are some popular tourist destinations in Sri Lanka | [watch](https://console.videodb.io/player?url=https://stream.videodb.io/v3/published/manifests/36aba200-e4e6-40c0-aa45-8eafdf844fe0.m3u8) |
## How do I use it? 🛠️
- **Get your API key:** Sign up on [VideoDB console](https://console.videodb.io) (Free for the first 50 uploads, no
credit card required). 🆓
- **Set `VIDEO_DB_API_KEY`:** Enter your key in the `env` file.
- **Set `OPENAI_API_KEY` or `ANTHROPIC_KEY`:** Add your LLM API Key in the `env` file.
- **Install dependencies:** Run `pip install -r requirements.txt` in your terminal.
- **Run locally:** Run the notebook `PromptClip.ipynb` and experiment with your prompts and ranking of results.
---
## Roadmap 🛣️
1. Add support for music generation models to jazzup the cuts.
2. Integrate with other projects like Pika Labs and Midjourney.
3. Add support for Text Overlays from VideoDB.
---
## Contributing 🤝
Your contributions make the open-source community an incredible place for learning, inspiration, and creativity. We
welcome and appreciate your input! Here's how you can contribute:
- Open issues to share your use cases.
- Participate in brainstorming solutions for our roadmap.
- Suggest improvements to the codebase.
### Contribution Steps
1. Fork the Project 🍴
2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)
3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)
4. Push to the Branch (`git push origin feature/AmazingFeature`)
5. Open a Pull Request 📬
---
[pypi-shield]: https://img.shields.io/pypi/v/videodb?style=for-the-badge
[pypi-url]: https://pypi.org/project/videodb/
[python-shield]:https://img.shields.io/pypi/pyversions/videodb?style=for-the-badge
[stars-shield]: https://img.shields.io/github/stars/video-db/promptClip.svg?style=for-the-badge
[stars-url]: https://github.com/video-db/promptClip/stargazers
[issues-shield]: https://img.shields.io/github/issues/video-db/videodb-python.svg?style=for-the-badge
[issues-url]: https://github.com/video-db/promptClip/issues
[website-shield]: https://img.shields.io/website?url=https%3A%2F%2Fvideodb.io%2F&style=for-the-badge&label=videodb.io
[website-url]: https://videodb.io/