MSU 3D Video Capture for glasses-free 3D displays

Introduction

The technology of the 3D video creating has long history. Playback equipment imperfections and the complexity of the creating three-dimensional films always prevented the spread of the 3D video technology. Scientists are near to the solution of the first problem: they have already developed monitors which don’t require neither special glasses nor other extra devices for viewing. 3D video making still requires expensive high-quality equipment and therefore it’s almost inaccessible for general users. our laboratory was challenged to make a 3d film using cheap widespread devices - web-cameras.

Equipment

We used two web-cameras for the video capture and monitor Spatial View 19’’ for camera tunning and video demonstration.

Spatial View 19''
Autostereoscopic monitor

Work description

The given display creates 3D effect using 5 views from different camera points. We got two of them directly from the cameras and the rest views were generated by MSU Stereo To Multiview Conversion method developed by our library. Similar video sequence was generated for 9-view monitor.

Interpolation of the intermediate views
Interpolation of the intermediate views

Video from cameras have significant brightness/white balance difference. It can cause conversion artefacts. So preprocessing is required. Semiautomatic video-filter for the smoothing of the differences in the color rendition between the cameras was developed.

Color correction
Color correction

Screenshot

5-view frame
5-view frame
9-view frame
9-view frame

How to view 3D video

To view 3D images you need autostereoscopic monitor and specialized player. Depending on how many views does your monitor support you should download 5-view or 9-view video. View order is also important. You should choose view order (from left to right OR from right to left) supported by your player.

5 view alignment: 9 view alignment:
5 view alignment. From left to right. 9 view alignment. From left to right. 9 view alignment. From right to left.
From left to right From left to right From right to left

Conversion output format can be also specified to be a sequence of numbered views or other appropriate way.

Results

As a result of the work the method of 3D video creating using web-cameras was developed and two versions of demo video were created (for 5-view and 9-view monitors). Video sequences are available for download (See link below).

MSU 3D Demo Video 5 Views. From left to right.
Frame 600

MSU 3D Demo Video 5 Views. From right to left.
Frame 600

MSU 3D Demo Video 9 Views. From left to right.
Frame 600

MSU 3D Demo Video 9 Views. From right to left.
Frame 600

All videos encoded by XVID codec.

3D videos were generated by MSU Stereo To Multiview Conversion algorithm developed by our laboratory.

Contacts

For questions and proposition please contact us

E-mail: 3dvideo@compression.ru

29 Jul 2011
See Also
Call for HEVC codecs 2019
Fourteen modern video codec comparison
Automatic local color correction in S3D video
Stereo video may contain a huge color discrepancy. Most of the problems are hard to eliminate because of possible different distortions in each area in the frame.
Swapped views detection in S3D movies
Channel mismatch is one of the most painful-for-viewer problems in stereo 3D movies. This problem is very hard to detect and simply to eliminate: just swap the views.
Automatic sharpness mismatch detection and compensation in stereo
Algorithm works frame-wise: for a pair of source image's views it outputs whether it contains significant sharpness mismatch or no.
MSU 3D-video Quality Analysis (MSU Video Quality Measurement Tool 3D Project: VQMT3D)
MSU 3D-video Quality Analysis. Report 9
Site structure