Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping
Christian Siegl1     Matteo Colaianni1     Lucas Thies1     Justus Thies2     Michael Zollhöfer3     Shahram Izadi4     Marc Stamminger1     Frank Bauer1    
    1University of Erlangen-Nuremberg     2Technical University of Munich     3Facebook Reality Labs     4Microsoft Research
ACM Transactions on Graphics 2015 (TOG)

Using projection mapping enables us to bring virtual worlds into shared physical spaces. In this paper, we present a novel, adaptable and real-time projection mapping system, which supports multiple projectors and high quality rendering of dynamic content on surfaces of complex geometrical shape. Our system allows for smooth blending across multiple projectors using a new optimization framework that simulates the diffuse direct light transport of the physical world to continuously adapt the color output of each projector pixel. We present a real-time solution to this optimization problem using off-the-shelf graphics hardware, depth cameras and projectors. Our approach enables us to move projectors, depth camera or objects while maintaining the correct illumination, in realtime, without the need for markers on the object. It also allows for projectors to be removed or dynamically added, and provides compelling results with only commodity hardware.