Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/djdefrag/realscaler
RealScaler - image/video AI upscaler app (Real-ESRGAN)
https://github.com/djdefrag/realscaler
amd anime compression-artifact-reduction deep-learning directx-12 gpu gui-application intel manga noise-reduction nvidia opencv python pytorch pytorch-directml super-resolution video video-processing windows
Last synced: 3 days ago
JSON representation
RealScaler - image/video AI upscaler app (Real-ESRGAN)
- Host: GitHub
- URL: https://github.com/djdefrag/realscaler
- Owner: Djdefrag
- License: mit
- Created: 2022-11-19T10:31:03.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-24T09:45:11.000Z (3 months ago)
- Last Synced: 2024-11-06T02:37:42.410Z (7 days ago)
- Topics: amd, anime, compression-artifact-reduction, deep-learning, directx-12, gpu, gui-application, intel, manga, noise-reduction, nvidia, opencv, python, pytorch, pytorch-directml, super-resolution, video, video-processing, windows
- Language: Python
- Homepage:
- Size: 15.6 MB
- Stars: 271
- Watchers: 6
- Forks: 17
- Open Issues: 14
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## What is RealScaler?
RealScaler is a Windows app powered by RealESRGAN AI to enhance, upscale and de-noise photos and videos.## Other AI projects.🤓
- https://github.com/Djdefrag/QualityScaler / QualityScaler - image/video AI upscaler app
- https://github.com/Djdefrag/FluidFrames.RIFE / FluidFrames.RIFE - video AI interpolation app (RIFE-HDv3)## Credits.
Real-ESRGAN - https://github.com/xinntao/Real-ESRGAN## How is made. ðŸ›
RealScaler is completely written in Python, from backend to frontend.
External packages are:
- AI -> torch / onnxruntime-directml
- GUI -> customtkinter
- Image/video -> OpenCV / moviepy
- Packaging -> nuitka## Requirements. 🤓
- Windows 11 / Windows 10
- RAM >= 8Gb
- Any Directx12 compatible GPU with >= 4GB VRAM## Features.
- [x] Elegant and easy to use GUI
- [x] Image and Video upscale
- [x] Multiple GPUs support
- [x] Compatible images - jpg, png, tif, bmp, webp, heic
- [x] Compatible video - mp4, wemb, mkv, flv, gif, avi, mov, mpg, qt, 3gp
- [x] Automatic image tilling to avoid gpu VRAM limitation
- [x] Resize image/video before upscaling
- [x] Interpolation beetween original file and upscaled file
- [x] Video upscaling STOP&RESUME
- [x] PRIVACY FOCUSED - no internet connection required / everything is on your PC## Next steps. 🤫
- [x] 1.X versions
- [x] Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
- [x] New GUI with Windows 11 style
- [x] Include audio for upscaled video
- [x] Optimizing video frame resize and extraction speed
- [x] Multi GPU support (for pc with double GPU, integrated + dedicated)
- [x] Python 3.10 (expecting ~10% more performance)
- [x] 2.X versions
- [x] New, completely redesigned graphical interface based on @customtkinter
- [x] Upscaling images and videos at once (currently it is possible to upscale images or single video)
- [x] Upscale multiple videos at once
- [x] Choose upscaled video extension
- [x] Interpolation between the original and upscaled image/video
- [x] More Interpolation levels (Low, Medium, High)
- [x] Show the remaining time to complete video upscaling
- [x] Support for SRVGGNetCompact AI architecture
- [x] Metadata extraction and application from original file to upscaled file (via exiftool)
- [ ] 3.X versions
- [x] New AI engine powered by onnxruntime-directml (https://github.com/microsoft/onnxruntime))
- [x] Python 3.11 (performance improvements)
- [x] Python 3.12 (performance improvements)
- [x] Display images/videos upscaled resolution in the GUI
- [x] Updated FFMPEG to version 7.x (latest release)
- [x] Saving user settings (AI model, GPU, CPU etc.)
- [x] Video multi-threading AI upscale
- [x] Video upscaling STOP&RESUME### Some Examples.
#### Videos
- Original![boku-no-hero-my-hero-academia](https://user-images.githubusercontent.com/32263112/209639439-94c8774d-354e-4d56-9123-e1aa4af95e08.gif)
- RealESRGANx4 - upscaled in 3 minutes and 23 seconds
https://user-images.githubusercontent.com/32263112/209639499-83eb4609-a842-43f9-b8a2-9fffd23e1d2c.mp4
- RealESR_Gx4 - upscaled in 57 seconds
https://user-images.githubusercontent.com/32263112/209639569-c201a965-c6bf-4b7c-9904-61114b5bf4d5.mp4
#### Images!
![test1](https://user-images.githubusercontent.com/32263112/223775329-2400f251-d6a3-45bb-ae94-09e40c55a6e1.png)
![test2](https://user-images.githubusercontent.com/32263112/223775065-2c304b76-ca1b-4efc-83d5-16c091be0cd1.png)
![test5](https://user-images.githubusercontent.com/32263112/203338133-0d0945f1-0129-4b36-8801-1510cf8892b8.png)
![a](https://user-images.githubusercontent.com/32263112/206723952-3f3110c9-9328-4bcc-94e0-8aaec0279eeb.png)