研究生: |
林鈞義 Lin, Chun-Yi |
---|---|
論文名稱: |
偽多重曝光並增強高亮度區域之高動態範圍影片處理 High Dynamic Range Video Processing Using Pseudo-Multiple-Exposures with Local Specular Region Enhancement |
指導教授: |
邱瀞德
Chiu, Ching-Te |
口試委員: |
賴尚宏
Lai, Shang-Hong 李國君 Lee, Gwo-Giun |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 通訊工程研究所 Communications Engineering |
論文出版年: | 2015 |
畢業學年度: | 103 |
語文別: | 英文 |
論文頁數: | 61 |
中文關鍵詞: | 高動態範圍 、逆色調映射 、影片處理 、光亮區域增強 |
外文關鍵詞: | High Dynamic Range (HDR), Inverse Tone Mapping, Video Processing, Specular Region Enhancement |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
當高動態範圍顯示器成為未來的趨勢,高動態範圍影片的需求將增加,但現
有的影片大多為傳統的低動態範圍影片。為了迎合此趨勢,我們提出一個偽多重
曝光的區域增強演算法來利用低動態範圍影片產生高動態範圍影片,利用產生偽
多重曝光的影像並結合不同區域清晰的細節,我們可以得到一高品質的高動態範
圍影片。我們也提出了一個亮光圖並與最暗偽曝光的影像作內插來進一步增強高
亮度的區域。
跟不同方法的比較並作定性分析的結果顯示我們的方法在高動態範圍亮度
有較平穩的表現並能避免影片閃爍的問題,並且我們提出的方法可以在很短的時
間內產生視覺上高品質的高動態範圍影片,根據與參考圖比較得出的對比變化值,
我們的值為最小的。我們產生的亮光圖的速度為Rempel 等人的方法的78 倍快,
並且是Banterle 等人的方法的286 倍速快。
As the high dynamic range displays becoming the future trend, the need for HDR
videos increases. However, most videos nowadays are the legacy low dynamic range
(LDR) videos. In order to meet this trend, we proposed a region-based enhancement
of the pseudo-exposures to generate a HDR video out of an existing LDR video. By
the generation of pseudo-multiple-exposure images and the fusion of different regions
with clear details, we can get a high-quality HDR video sequence. We also proposed a
specular map to further enhance the high-luminance areas by interpolate with the
darkest pseudo-exposure image.
We compare our method with other inverse tone mapping operators, and several
evaluations show that our method has a more stable performance in HDR luminance
and avoids flickering artifacts. Also, our proposed method is able to generate visually
high quality HDR videos with a small amount of time, which could be shown in the
smallest value of overall contrast change comparing to the reference images. The
generation of our specular map is 78x faster than Rempel et al.’s expand map and
286x faster than Banterle et al.’s map.
[1] Erik Reinhard, Timo Kunkel, Yoann Marion, Jonathan Brouillat, Remi Cozot,
and Kadi Bouatouch, \Image display algorithms for high and low dynamic
range display devices," Journal of the Society for Information Display,
vol. 15, no. 12, pp. 997{1014, December 2007.
[2] Erik Reinhard, Greg Ward, Sumanta N. Pattanaik, Paul E. Debevec, and
Wolfgang Heidrich, High Dynamic Range Imaging - Acquisition, Display,
and Image-Based Lighting (2. ed.), Academic Press, 2010.
[3] Francesco Banterle, Alessandro Artusi, Kurt Debattista, and Alan Chalmers,
Advanced High Dynamic Range Imaging: Theory and Practice, AK Peters
(CRC Press), Natick, MA, USA, 2011.
[4] H. Seetzen, L. Whitehead, and G.Ward, \A high dynamic range display using
low and high resolution modulators," Tech. Rep., In Society for Information
Display Internatiational Symposium Digest, 2003.
[5] H. Seetzen, H. Li, L. Ye, W. Heidrich, L. Whitehead, and G. Ward, \25.3:
Observations of luminance, contrast and amplitude resolution of displays,"
In Society for Information Display (SID) Digest, pp. 1229{1233, 2006.
57
[6] S Nayar and T Mitsunaga, \High dynamic range imaging: Spatially varying
pixel exposures," in IEEE Computer Society Conference on Computer Vision
and Pattern Recognition, 2000, vol. 1, pp. 472{479.
[7] Jonas Unger, Stefan Gustavson, and Anders Ynnerman, \High dynamic range
video for photometric measurement of illumination," in Sensors, Cameras,
and Systems for Scientic/Industrial Applications VIII :. 2007, number Vol.
6501 in Proceedings of SPIE - International Society for Optical Engineering,
pp. 65010E{1{65010E{10, SPIEThe International Society for Optical Engineering
& IS&TThe Society for Imaging Science and Technology.
[8] Michael D. Tocci, Chris Kiser, Nora Tocci, and Pradeep Sen, \A versatile
hdr video production system," in ACM SIGGRAPH 2011 Papers, New York,
NY, USA, 2011, SIGGRAPH '11, pp. 41:1{41:10, ACM.
[9] Joel Kronander, Stefan Gustavson, Gerhard Bonnet, and Jonas Unger, \Uni-
ed hdr reconstruction from raw cfa data," in ICCP'13, 2013, pp. 1{9.
[10] Sing Bing Kang, Matthew Uyttendaele, Simon A. J. Winder, and Richard
Szeliski, \High dynamic range video.," ACM Trans. Graph., vol. 22, no. 3,
pp. 319{325, 2003.
[11] Stephen Mangiat and Jerry D. Gibson, \Spatially adaptive ltering for registration
artifact removal in hdr video.," in ICIP, Benot Macq and Peter
Schelkens, Eds. 2011, pp. 1317{1320, IEEE.
[12] Nima Khademi Kalantari, Eli Shechtman, Connelly Barnes, Soheil Darabi,
Dan B. Goldman, and Pradeep Sen, \Patch-based high dynamic range
video.," ACM Trans. Graph., vol. 32, no. 6, pp. 202:1{202:8, 2013.
58
[13] Francesco Banterle, Patrick Ledda, Kurt Debattista, and Alan Chalmers,
\Expanding low dynamic range videos for high dynamic range applications,"
in Proceedings of the 24th Spring Conference on Computer Graphics, New
York, NY, USA, 2010, SCCG '08, pp. 33{41, ACM.
[14] A. G. Rempel, M. Trentacoste, H. Seetzen, and H. D. Young, \Ldr2hdr:
On-the-
y reverse tone mapping of legacy video and photographs," ACM
Transactions on Graph, vol. 26, no. 3, pp. 39.1{39.6, 2007.
[15] Piotr Didyk, Rafa l Mantiuk, Matthias Hein, and Hans-Peter Seidel, \Enhancement
of bright video features for hdr displays," Computer Graphics
Forum (Proceedings Eurographics Symposium on Rendering 2008, Sarajevo,
Bosnia and Herzegovina), vol. 27, no. 4, pp. 1265{1274, 2008.
[16] T. Aydin, R. Mantiuk, K. Myszkowski, and H. Seidel, \Dynamic range independent
image quality assessment," in SIGGRAPH, 2008, pp. 1{10.
[17] Laurence Meylan, Scott Daly, and Sabine Susstrunk, \The Reproduction of
Specular Highlights on High Dynamic Range Displays," in IS&T/SID 14th
Color Imaging Conference (CIC), 2006.
[18] Ahmet Oguz Akyuz, Roland Fleming, Bernhard E. Riecke, Erik Reinhard,
and Heinrich H. Bultho, \Do hdr displays support ldr content: a psychophysical
evaluation," ACM Trans. Graph., vol. 26, no. 3, July 2007.
[19] Scott Daly and Xiaofan Feng, \Bit depth extension using spatiotemporal microdither
based on models of theequivalent input noise of the visual system,"
in Proceedings of Color Imaging VIII: Processing, Hardcopy, and Applica-
tions, Bellingham, WA, USA, 2003, pp. 455{466, SPIE.
59
[20] Daly Scoot and Feng Xiaofan, \Decontouring: Prevention and removal of
false contour artifacts," in Proceeding of Human Vision. pp. 130{149, SPIE.
[21] F. Banterle, P. Ledda, K. Debattista, and A. Chalmers, \Inverse tone mapping,"
in Proc. of GRAPHITE '06, 2006, pp. 349{356.
[22] Lvdi Wang, Li-Yi Wei, Kun Zhou, Baining Guo, and Heung-Yeung Shum,
\High dynamic range image hallucination," in ACM SIGGRAPH 2007
sketches, New York, NY, USA, 2007, SIGGRAPH '07, ACM.
[23] Belen Masia, Sandra Agustin, Roland W. Fleming, Olga Sorkine, and Diego
Gutierrez, \Evaluation of reverse tone mapping through varying exposure
conditions," ACM Transactions on Graphics (Proc. of SIGGRAPH Asia),
vol. 28, no. 5, pp. 160:1{160:8, 2009.
[24] Hayden Landis, \Production-ready global illumination," in SIGGRAPH
Course Notes 16, 2002, pp. 87{101.
[25] E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, \Photographic tone
reproduction for digital images," ACM Trans. Graph. (Proc. of ACM SIG-
GRAPH), vol. 21, no. 3, pp. 267{276, 2002.
[26] Rafael Kovaleski and Manuel M. Oliveira, \High-quality brightness enhancement
functions for real-time reverse tone mapping," The Visual Computer,
vol. 25, pp. 539{547, 2009.
[27] Yongqing Huo, Fan Yang, and Vincent Brost, \An inverse tone mapping
method for displaying legacy images on hdr monitor," in Proceedings of the 9th
60
International Symposium on Linear Drives for Industry Applications, 2014,
pp. 733{741.
[28] Rafat Mantiuk, Kil Joong Kim, Allan G. Rempel, and Wolfgang Heidrich,
\Hdr-vdp-2: a calibrated visual metric for visibility and quality predictions
in all luminance conditions," in ACM SIGGRAPH 2011 papers, New York,
NY, USA, 2011, SIGGRAPH '11, pp. 40:1{40:14, ACM.
[29] R. Mantiuk, S. Daly, K. Myszkowski, and H. P. Seidel, \Predicting visible differences
in high dynamic range images - model and its calibration," in Human
Vision and Electronic Imaging X, IS&T/SPIE's 17th Annual Symposium on
Electronic Imaging, 2005, pp. 204{214.
[30] Tsun-Hsien Wang, Cheng-Wen Chiu, Wei-Chen Wu, Jen-Wen Wang, Chun-
Yi Lin, Ching-Te Chiu, and Jing-Jia Liou, \Pseudo-multiple-exposure-based
tone fusion with local region adjustment," IEEE Transactions on Multimedia,
vol. 17, no. 4, pp. 470{484, 2015.
[31] G. Messina, A. Catorina, S. Battiato, and A. Bosco, \Image quality improvement
by adaptive exposure correction techniques," in IEEE ICME 2003,
2003, pp. 549{559.
[32] Ji Won Lee, Rae-Hong Park, and Soonkeun Chang, \Local tone mapping
using the k-means algorithm and automatic gamma setting," Consumer Elec-
tronics, IEEE Transactions on, vol. 57, no. 1, pp. 209 {217, february 2011.
[33] Gabriel Eilertsen, Robert Wanat, Rafal K. Mantiuk, and Jonas Unger, \Evaluation
of tone mapping operators for hdr-video.," Comput. Graph. Forum, ,
no. 7, 2013.