4DLFVD: A 4D Light Field Video Dataset

We present a 4D Light Field (LF) video dataset collected by the camera matrix, to be used for designing and testing algorithms and systems for LF video coding and processing. For collecting these videos, a 10x10 LF capture matrix composed of 100 cameras is designed and implemented, and the resolution of each camera is 1920x1056. The videos are taken in real and varying illumination conditions. The dataset contains a total of nine groups of LF videos, of which eight groups are collected with a fixed camera matrix position and a fixed orientation. The last group was collected by rotating around an outdoor specific target. Each group of LF videos consists of 100 video streams, which are encoded by H.265. Both static scenes (indoor potted plants and furniture, etc.) and dynamic scenes (roadside vehicles and pedestrians, etc.) are included, which can increase the diversity of our dataset. As a benchmark, we present the results of a depth estimation method designed by ourselves, and show that our dataset can be used for further processing and applications, such as objection detection and 3D modeling. The revised stone_tablet sequences have also been provided in a new zip file.

The dataset has been accepted by MMSys'21 Open Dataset and Software Track:

Xinjue Hu, Chenchen Wang, Yuxuan Pan, Yunming Liu, Yumei Wang, YuLiu, Lin Zhang, and Shervin Shirmohammadi. 2021. 4DLFVD: A 4D LightField Video Dataset. In12th ACM Multimedia Systems Conference (MMSys’21) (MMSys 21), September 28-October 1, 2021, Istanbul, Turkey.ACM, NewYork, NY, USA, 6 pages. https://dl.acm.org/doi/10.1145/3458305.3478450