Image-based rendering with post-lighting simulations

Image-based rendering generates views of scene by 2D image transformation instead of difficult physical simulation of conventional graphics with a difficult reconstruction problem, as greatly improves the performance of virtual reality (VR) applications. In this paper we develop efficient methods for synthesizing novel views and adding simulated shading to these novel views, given a collection of example images with depths or in correspondence. The example images are warped to compress storage based on overlap of FOV (field of view). Derived views are generated by warping the compressed images and are passed to the next step in which lighting is added by a post-lighting simulation method to produce the final images. It has two significant advantages. Firstly, it generates warped images from multiple sample images in real time. Secondly, it adds simulated shading in final images, as not only improves the reality of the artificial scene, but also achieves faultless combination of the real and the artificial scenes.