Automatic local color correction in S3D video

Stereo video may contain a huge color discrepancy. Most of the problems are hard to eliminate because of possible different distortions in each area in the frame.

Example of color distortion, "Spy Kids 3D: Game Over", 0:14:19
Color distortion in released “Spy Kids 3D: Game Over”, 0:14:19

Color difference between views
Color difference between views

Corrected colors
Result of automatic correction by the proposed algorithm

Description of algorithm

Our algorithm is based on global color correction using histogram matching, block-matching between views and local distortion eliminations. All corrections listed below were made automatically.

Results

The algorithm was compared with Ocula 3.0 (for Nuke 7.0) in Minimum Correction and Average Correction modes and YuvSoft Stereo Processing Suite Pro 1.0 (Adobe After Effects CS 5.5)

Objective comparison

  Ocula 3.0 Average Ocula 3.0 Minimum YuvSoft SPS 1.0 Proposed method
SSIM 0.9981 0.9980 0.9951 0.9992
Y-PSNR 31.786 39.772 33.289 45.707
Speed, FPS 0.09 0.11 0.25 1.37

Artificially made distortions

Before color correction:

Artificial distortion

Result of the proposed algorithm:

Automatically corrected colors

Comparison between algorithms (difference with original frame):

Comparison of color difference

Distortions in real video

Frame from “Pirates of the Caribbean: On Stranger Tides” trailer.

Before color correction. Look at the right side of the picture:

Distortions in real video

Result of the proposed algorithm:

Automatically corrected colors

Comparison between algorithms (difference with compensated frame):

Comparison of color difference

29 May 2019
See Also
Call for HEVC codecs 2019
Fourteen modern video codec comparison
Swapped views detection in S3D movies
Channel mismatch is one of the most painful-for-viewer problems in stereo 3D movies. This problem is very hard to detect and simply to eliminate: just swap the views.
Automatic sharpness mismatch detection and compensation in stereo
Algorithm works frame-wise: for a pair of source image's views it outputs whether it contains significant sharpness mismatch or no.
MSU 3D-video Quality Analysis (MSU Video Quality Measurement Tool 3D Project: VQMT3D)
MSU 3D-video Quality Analysis. Report 9
MSU 3D-video Quality Analysis. Report 8
Site structure