Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/georgmartius/vid.stab

Video stabilization library
https://github.com/georgmartius/vid.stab

Last synced: 5 days ago
JSON representation

Video stabilization library

Host: GitHub
URL: https://github.com/georgmartius/vid.stab
Owner: georgmartius
License: other
Created: 2011-11-24T22:36:10.000Z (almost 13 years ago)
Default Branch: master
Last Pushed: 2024-06-15T20:39:37.000Z (5 months ago)
Last Synced: 2024-08-02T16:32:44.583Z (3 months ago)
Language: C
Homepage: http://public.hronopik.de/vid.stab/
Size: 672 KB
Stars: 840
Watchers: 39
Forks: 109
Open Issues: 56
Metadata Files:
- Readme: README.md
- Changelog: Changelog
- License: LICENSE

Awesome Lists containing this project

README

# VidStab

[![C/C++ CI](https://github.com/georgmartius/vid.stab/actions/workflows/c-cpp.yml/badge.svg)](https://github.com/georgmartius/vid.stab/actions/workflows/c-cpp.yml)

Vidstab is a video stabilization library which can be plugged-in with Ffmpeg and Transcode.

**Why is it needed**

A video acquired using a hand-held camera or a camera mounted on a vehicle, typically suffers from undesirable shakes and jitters. Activities such as surfing, skiing, riding and walking while shooting videos are especially prone to erratic camera shakes. Vidstab targets these video contents to help create smoother and stable videos.

**Some of the features include:**

* Fast detection of subsequent transformations e.g. translation and rotations up to a given extent.
* Low pass filtered smoothing with adjustable horizon.
* Detection algorithms:
* Smart and fast multi measurement fields algorithm with contrast selection.
* Brute force algorithm only for translations.
* Clipping options: keep blank (black) or keep from previous frames.
* Optional drawing of measurement fields and detected transformations for visual analysis.
* Zooming possible to get rid of jiggling borders (automatic mode).
* Resulting images are interpolated (different algorithms).
* Sharpening of the stabilized movie to compensate for interpolation effects due to rotation/zooming (only with Transcode).
* Single pass filter for streaming applications(only with Transcode).
* Virtual-tripod-mode to get a tripod experience.

**NOTE:** This readme focuses mainly on using vidstab with Ffmpeg. See
[here](http://public.hronopik.de/vid.stab) for information regarding installation, usage and examples for using vidstab with Transcode. Or contact me at georg dot martius @ web dot de

## System Requirements
* A Linux-based system
* ffmpeg source code
* Cmake

## Installation Instructions

For using vidstab library with ffmpeg, ffmpeg must to be configured using `--enable-libvidstab ` option.

### Default Build and Installation:
##### Installing vidstab library:

```shell
cd path/to/vid.stab/dir/
cmake .
make
sudo make install
```

##### Installing ffmpeg:

```shell
cd path/to/ffmpeg/dir/
./configure --enable-gpl --enable-libvidstab
make
sudo make install
```

### Alternatively one can install vidstab into a custom directory this way:
##### Installing vidstab library:

```shell
cd path/to/vid.stab/dir/
cmake -DCMAKE_INSTALL_PREFIX:PATH=path/to/install_dir/
make
sudo make install
```

##### Installing ffmpeg:

```shell
cd path/to/ffmpeg/dir/
PKG_CONFIG_PATH="path/to/install_dir/lib/pkgconfig" \
./configure --enable-gpl --enable-libvidstab
make
sudo make install
```

Before running ffmpeg for the first time, make sure to export `LD_LIBRARY_PATH` to point to vidstab library, e.g.,

```shell
export LD_LIBRARY_PATH=path/to/install_dir/lib:$LD_LIBRARY_PATH
```

## Usage instructions

**Currently with ffmpeg, vidstab library must run in two-pass mode.** The first pass employs the **vidstabdetect** filter and the second pass uses the **vidstabtransform** filter.

*Single pass filter with vidstab library is only available with Transcode. The
[deshake](http://www.ffmpeg.org/ffmpeg-filters.html#deshake) filter of ffmpeg can be used for a single-pass encoding, though using the vidstab two-pass filters will give superior results.*

The vidstabdetect filter (in first pass) will generate a file with relative-translation and rotation-transform information about subsequent frames. This information will then be read by vidstabtransform filter (in second pass) to compensate for the jerky motions and produce a stable video output.

Make sure that you use [unsharp](http://www.ffmpeg.org/ffmpeg-filters.html#unsharp-1) filter provided by ffmpeg for best results (only in second pass).

*See [the list of ffmpeg filters](http://www.ffmpeg.org/ffmpeg-filters.html) to know more about vidstabdetect, vidstabtransform and all other filters available with ffmpeg.*

### Available options with vidstab filters:

##### First pass (vidstabdetect filter):

result: Set the path to the file used to write the transforms information. Default value is transforms.trf.
shakiness: Set the shakiness of input video or quickness of camera. It accepts an integer in the range 1-10, a value of 1 means little shakiness, a value of 10 means strong shakiness. Default value is 5.
accuracy: Set the accuracy of the detection process. It must be a value in the range 1-15. A value of 1 means low accuracy, a value of 15 means high accuracy. Default value is 15.
stepsize: Set stepsize of the search process. The region around minimum is scanned with 1 pixel resolution. Default value is 6.
mincontrast: Set minimum contrast. Any measurement field having contrast below this value is discarded. Must be a floating point value in the range 0-1. Default value is 0.3.
tripod: Set reference frame number for tripod mode. If enabled, the motion of the frames is compared to a reference frame in the filtered stream, identified by the specified number. The intention is to compensate all movements in a more-or-less static scene and keep the camera view absolutely still. If set to 0, it is disabled. The frames are counted starting from 1.

NOTE: If this mode is used in first pass then it should also be used in second pass.
show: Show fields and transforms in the resulting frames for visual analysis. It accepts an integer in the range 0-2. Default value is 0, which disables any visualization.

##### Examples:
Use default values:
```shell
ffmpeg -i input.mp4 -vf vidstabdetect -f null -
```

*` -f null - ` makes sure that no output is produced as this is just the first pass. This in-turn results in faster speed.*

Analyzing strongly shaky video and putting the results in file `mytransforms.trf`:
```shell
ffmpeg -i input.mp4 -vf vidstabdetect=shakiness=10:accuracy=15:result="mytransforms.trf" -f null -
```

Visualizing the result of internal transformations in the resulting video:
```shell
ffmpeg -i input.mp4 -vf vidstabdetect=show=1 dummy_output.mp4
```

Analyzing a video with medium shakiness:
```shell
ffmpeg -i input.mp4 -vf vidstabdetect=shakiness=5:show=1 dummy_output.mp4
```

##### Second pass (vidstabtransform filter):

input: Set path to the file used to read the transforms. Default value is transforms.trf.
smoothing: Set the number of frames (value*2 + 1), used for lowpass filtering the camera movements. Default value is 10.
For example, a number of 10 means that 21 frames are used (10 in the past and 10 in the future) to smoothen the motion in the video. A larger value leads to a smoother video, but limits the acceleration of the camera (pan/tilt movements). 0 is a special case where a static camera is simulated.
optalgo: Set the camera path optimization algorithm. Accepted values are:

gauss: Gaussian kernel low-pass filter on camera motion (default).

avg: Averaging on transformations.
maxshift: Set maximal number of pixels to translate frames. Default value is -1, meaning: no limit.
maxangle: Set maximal angle in radians (degree*PI/180) to rotate frames. Default value is -1, meaning: no limit.
crop: Specify how to deal with empty frame borders that may be shrinked-in due to movement compensation. Available values are:

keep: Keep image information from previous frame (default).

black: Fill the border-areas black.
invert: Invert transforms if set to 1. Default value is 0.
relative: Consider transforms as relative to previous frame if set to 1, absolute if set to 0. Default value is 0.
zoom: Set percentage to zoom. A positive value will result in a zoom-in effect, a negative value in a zoom-out effect. Default value is 0 (no zoom).
optzoom: Set optimal zooming to avoid blank-borders. Accepted values are:

0: Disabled.

1: Optimal static zoom value is determined (only very strong movements will lead to visible borders) (default).

2: Optimal adaptive zoom value is determined (no borders will be visible), see zoomspeed.

Note that the value given at zoom is added to the one calculated here.
zoomspeed: Set percent to zoom maximally each frame (enabled when optzoom is set to 2). Range is from 0 to 5, default value is 0.25.
interpol: Specify type of interpolation. Available values are:

no: No interpolation.

linear: Linear only horizontal.

bilinear: Linear in both directions (default).

bicubic: Cubic in both directions (slow speed).
tripod: Enables virtual tripod mode if set to 1, which is equivalent to relative=0:smoothing=0. Default value is 0.

NOTE: If this mode has been used in first pass then only it should be used in second pass.
debug: Increase log verbosity if set to 1. Also the detected global motions are written to the temporary file global_motions.trf . Default value is 0.

##### Examples:
Using default values:
```shell
ffmpeg -i input.mp4 -vf vidstabtransform,unsharp=5:5:0.8:3:3:0.4 out_stabilized.mp4
```
Note the use of the ffmpeg's unsharp filter which is always recommended.

Zooming-in a bit more and load transform data from a given file:
```shell
ffmpeg -i input.mp4 -vf vidstabtransform=zoom=5:input="mytransforms.trf" out_stabilized.mp4
```

Smoothening the video even more:
```shell
ffmpeg -i input.mp4 -vf vidstabtransform=smoothing=30:input="mytransforms.trf" out_stabilized.mp4
```
## Developement/Contributing

Vidstab is an open source library - pull requests are very welcome. Some things you might like to help us out with:

* Specific video clips where vidstab is not up-to the mark.
* Bugs/fixes.
* New features and improvements.
* Documentation.

## License

See [LICENSE](./LICENSE).