Our research team focuses on the representation, processing, compression, and interactive delivery of emerging visual media formats. These formats are drastically evolving beyond traditional 2D images or video, such as 360° video, multi-view stereo/3D video, Augmented or Virtual Reality (AR/VR), Light Fields, or holography. Next to the obvious but significant increase in data rates, these formats are posing significant challenges with respect to data dimensionality and interactivity demands:
- Dimensionality. Whereas traditional video data has 3 dimensions, the full plenoptic function has 6. Current (traditional) compression techniques do not scale with dimensionality and are unable to efficiently exploit the redundancies at hand. Even for multi-view video (only 4D), current video coding techniques are inadequate. Radically new techniques are necessary in order to achieve an efficient sparse representation for high-dimensional visual data.
- Interactivity demands. When data volumes increase beyond the physical limits of rendering and transmission systems/hardware (e.g., memory, computing power, bandwidth), interactivity becomes problematic. As such, appropriate (scalable) data representations are required that offer features such as regions of interest, random access, and level of detail. On top of that, networked environments pose additional challenges related to bandwidth and low-delay processing.
IDLab-MEDIA has more than 15+ years of research experience in the domains of data compression, image and video coding, 3D computer graphics, and networked multimedia systems, and has a wide range of activities, including
- fundamental, basic/strategic, and applied research;
- contract-based research with industrial partners;
- scientific consultancy for both industrial and governmental partners;
- standardization (JPEG, MPEG, VQEG).
These activities resulted, a.o., in 80+ articles in peer-reviewed scientific journals, 200+ articles in peer-reviewed international scientific conferences, 4 patent applications (1 granted), and 1 spin-off company (Graphine Software, recently acquired by Unity Technologies).