IDLab-MEDIA
Towards Immersive Video - AI in Digital Arts, Game Dev & Entertainment Meetup

Glenn Van Wallendael and Bert Ramlot presented the work of the IDLab-MEDIA group at the AI in Digital Arts, Game Dev & Entertainment #3 Meetup at the Vlaamse Radio- en Televisieomroeporganisatie (VRT) in Brussels.

AI in Digital Arts, Game Dev & Entertainment #3 Meetup

Presentation

During this presentation, we talked about:

  • Synthetic Immersive Large-Volume Plenoptic Dataset, a dataset of light field images for six-degrees-of-freedom navigation in large fully-immersive volumes.
  • Multi-camera setup, consisting of 6 panels, each having 9 cameras filming a scene to immersively walk around in afterwards.
  • The work on compression of 3D Gaussian Splatting.
  • Steered Mixture of Experts, a universal approach for immersive experiences of camera-captured scenes.
  • Monocular and multi-view depth map generation.
  • OpenDIBR, an applications that allows a viewer to freely move around in a scene reconstructed from camera captures (images/videos) and their corresponding depth maps.

Example OpenDIBR output generated in real-time from dataset Group

We showed live demonstrations of:

  • Real-time rendering of immersive light fields using our in house Steered-Mixture-of-Experts renderer.
  • The modelling process of 3D Gaussian Splatting.
  • Real-time monocular depth map generation from a webcam capture.
  • Depth-Image-based Rendering (DIBR) in real time. If you want to try out our real-time light field renderer for yourself, visit https://github.com/IDLabMedia/open-dibr for the code, datasets and clear guidelines.

The slides of this presentation can be downloaded here.