RealScaler

RealScaler

RealScaler - image/video AI upscaler app (Real-ESRGAN)

Stars: 249

Visit
 screenshot

RealScaler is a Windows app powered by RealESRGAN AI to enhance, upscale, and de-noise photos and videos. It provides an easy-to-use GUI for upscaling images and videos using multiple AI models. The tool supports automatic image tiling and merging to avoid GPU VRAM limitations, resizing images/videos before upscaling, interpolation between original and upscaled content, and compatibility with various image and video formats. RealScaler is written in Python and requires Windows 11/10, at least 8GB RAM, and a Directx12 compatible GPU with 4GB VRAM. Future versions aim to enhance performance, support more GPUs, offer a new GUI with Windows 11 style, include audio for upscaled videos, and provide features like metadata extraction and application from original to upscaled files.

README:




RealScaler - image/video AI upscaler app (Real-ESRGAN)


What is RealScaler?

RealScaler is a Windows app powered by RealESRGAN AI to enhance, upscale and de-noise photos and videos.

Other AI projects.🤓

Credits.

Real-ESRGAN - https://github.com/xinntao/Real-ESRGAN

How is made. 🛠

RealScaler is completely written in Python, from backend to frontend. External packages are:

  • AI -> torch / onnxruntime-directml
  • GUI -> customtkinter
  • Image/video -> OpenCV / moviepy
  • Packaging -> nuitka

Requirements. 🤓

  • Windows 11 / Windows 10
  • RAM >= 8Gb
  • Any Directx12 compatible GPU with >= 4GB VRAM

Features.

  • [x] Elegant and easy to use GUI
  • [x] Image and Video upscale
  • [x] Multiple GPUs support
  • [x] Compatible images - jpg, png, tif, bmp, webp, heic
  • [x] Compatible video - mp4, wemb, mkv, flv, gif, avi, mov, mpg, qt, 3gp
  • [x] Automatic image tilling to avoid gpu VRAM limitation
  • [x] Resize image/video before upscaling
  • [x] Interpolation beetween original file and upscaled file
  • [x] Video upscaling STOP&RESUME
  • [x] PRIVACY FOCUSED - no internet connection required / everything is on your PC

Next steps. 🤫

  • [x] 1.X versions
    • [x] Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
    • [x] New GUI with Windows 11 style
    • [x] Include audio for upscaled video
    • [x] Optimizing video frame resize and extraction speed
    • [x] Multi GPU support (for pc with double GPU, integrated + dedicated)
    • [x] Python 3.10 (expecting ~10% more performance)
  • [x] 2.X versions
    • [x] New, completely redesigned graphical interface based on @customtkinter
    • [x] Upscaling images and videos at once (currently it is possible to upscale images or single video)
    • [x] Upscale multiple videos at once
    • [x] Choose upscaled video extension
    • [x] Interpolation between the original and upscaled image/video
    • [x] More Interpolation levels (Low, Medium, High)
    • [x] Show the remaining time to complete video upscaling
    • [x] Support for SRVGGNetCompact AI architecture
    • [x] Metadata extraction and application from original file to upscaled file (via exiftool)
  • [ ] 3.X versions
    • [x] New AI engine powered by onnxruntime-directml (https://github.com/microsoft/onnxruntime))
    • [x] Python 3.11 (performance improvements)
    • [x] Python 3.12 (performance improvements)
    • [x] Display images/videos upscaled resolution in the GUI
    • [x] Updated FFMPEG to version 7.x (latest release)
    • [x] Saving user settings (AI model, GPU, CPU etc.)
    • [x] Video multi-threading AI upscale
    • [x] Video upscaling STOP&RESUME

Some Examples.

Videos

  • Original

boku-no-hero-my-hero-academia

  • RealESRGANx4 - upscaled in 3 minutes and 23 seconds

https://user-images.githubusercontent.com/32263112/209639499-83eb4609-a842-43f9-b8a2-9fffd23e1d2c.mp4

  • RealESR_Gx4 - upscaled in 57 seconds

https://user-images.githubusercontent.com/32263112/209639569-c201a965-c6bf-4b7c-9904-61114b5bf4d5.mp4

Images!

test1

test2

test5

a

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for RealScaler

Similar Open Source Tools

For similar tasks

For similar jobs