IDLab-MEDIA
Dimensionality Reduction for Real-Time Light-Field View Synthesis of Kernel-Based Models

Our paper titled Dimensionality Reduction for the Real-Time Light-Field View Synthesis of Kernel-Based Models was accepted at MDPI Electronics.

We introduce a novel GPU-accelerated real-time 4D planar light-field renderer based on Steered Mixture-of-Experts (SMoE). Our proposed GPU graphics pipeline achieves real-time view-synthesis while retaining SMoE’s quality almost perfectly. At 180 to 290 frames per second for a resolution of 2048x2048 pixels (using an NVIDIA RTX 2080Ti), our method is VR-ready and by far the fastest kernel-based renderer.

Results video of spin movement within Barbershop scene.

Additionally our proposed method:

  • has a minimal memory and disk footprint with scenes typically being under 5 MB.
  • has rendering performance independent of the scene’s geometry, making performance consistent across scenes.
  • is the only kernel based method with linear time complexity in both the number of pixels and the number of components.

Our results can be downloaded here.

Paper: Dimensionality Reduction for the Real-Time Light-Field View Synthesis of Kernel-Based Models