影像繪圖在虛擬實境或電腦繪圖等應用之中，由於記錄了實際環境中所見到的景象，因此可以建立出相當真實的效果。當利用影像及幾何的資訊後，我們可以建立一個貼近真實環境的場景模型，除了可以悠遊於其中外，也可以添加新的物件至此三維模型，特別是增加新的光源或減少光源，將會改變部分或全部場景的亮度。
在本篇論文中，希望一個已建立完成且結合幾何資訊和影像繪圖建立出來的場景模型，在套用新的光源條件下，例如增加及減少光源、套用另一場景的光源配置，能夠正確模擬出新光源的效果，並且將這個效果添加在我們已有的場景模型上。其中新光源的效果，是利用事先蒐集的光源及材質資訊，經過運算模擬其效果。當使用者在此場景模型中遊走時，也會根據使用者的觀察位置，將光源的效果予以更新，得到符合觀看時景象的模型貼圖。
而事先蒐集的光源資訊，我們會將光源放置於設定好的位置，拍攝牆壁在光源位置不同時的影像，藉以記錄此一材質對光源的表現。設定的光源位置越多，可以蒐集到越詳盡的光線資訊，但資料較龐大，且蒐集此光線資訊的過程將會耗費很多時間，因此我們也依不同光源的特性，簡化蒐集光線資訊的過程，最後在模擬新光源效果時，仍可以維持相當接近原來不簡化時的效果。

In applications like virtual reality and computer graphics, due to acquiring the information of the real scene by sampling the real scene, image-based rendering (IBR) techniques can render the scene very realistic. Nevertheless, using both geometric information and images, the model can be created as well as geometrically correct one. We can have a walkthrough in the model and add new objects into it. Adding or removing lights from the model will cause obvious change the illumination of the model.
In this thesis, we want to apply a new lighting condition to the scene modeled by combining geometric information and IBR technique. When adding or removing lights or applying a lighting condition of another scene, we can synthesize the lighting effects appropriately and apply the effects on the model. The lighting effects are calculated and synthesized with pre-collected lighting and textural information. In order to match the correct view when users have a walkthrough in the model, we will update the lighting effects depending on user’s position in the model.

[1] Adelson, E. H. and Bergen, J. The plenoptic function and elements of early vision. In Computational Models of Visual Processing. Cambridge, MA: MIT Press, pages 3-20, 1991.
[2] Smith, B., and Rowe, L. Compressed domain processing of JPEG-encoded images. Real-Time Imaging 2, pages 3-17, 1996.
[3] Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., and Sarokin, W. Acquiring the Reflectance Field of a Human Face. In Proc. SIGGRAPH 2000, pages 145-156, July 2000.xxxx.
[4] Nimeroff, J. S., Simoncelli, E., and Dorsey, J. Efficient re-rendering of naturally illuminated environments. Fifth Eurographics Workshop on Rendering, pages 359-373, June 1994.
[5] Haeberli, P. Synthetic lighting for photography. Available at http://www.sgi.com/misc/grafica/synth/ , January 1992.
[6] Wong, T.-T., Heng, P.-A., Or, S.-H., and Ng, W.-Y. Image-based rendering with controllable illumination. Eurographics Rendering Workshop 1997, pages13-22, June 1997.
[7] Levoy, M. and Hanrahan, P. Light field rendering. In SIGGRAPH 96, pages 31-42, 1996.
[8] Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. The Lumigraph. In SIGGRAPH 96, pages 43-54, 1996.
[9] McMillan, L. and Bishop, U. Plenoptic modeling: An image-based rendering system. In Proc. ACM Annu. Computer Graphics Conf., pages 39-46, August 1995.
[10] Shum, H.-Y. and He, L.-W. Rendering with concentric mosaics. In ACM SIGGRAPH ’99, pages 299-306, August 1999.
[11] Chen, S. E. QuickTime VR-an image-based approach to virtual environment navigation. In Proc. ACM Annu. Computer Graphics Conf., pages 29-38, 1995.
[12] Szeliski, R. and Shum, H.-Y. Creating full view panoramic image mosaics and texture-mapped models. In Proc. ACM Computer Graphics Conf., pages 251-258, 1997.
[13] Hara, K., Nishino K. and Ikeuchi, K. Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption. IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 493-505, April 2005.
[14] Ramamoorthi, R. and Hanrahan, P. A signal processing framework for inverse rendering. In Proc. SIGGRAPH’01, pages 117-128, 2001.
[15] Nishino, K. Photometric object modeling –rendering from a dense/sparse set of images. Ph.D thesis, The University of Tokyo, 2002.
[16] Debevec, P. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proc. SIGGRAPH 98 (July 1998).
[17] Liu, Y.-C. Model-based IBR for Indoor Virtual Walkthrough. Master thesis, National Tsing-Hua University, 2005.