3維電視(3D-TV)被期待是電視改進過程中的下一部。許多國內外知名大學與研究機構已經開始著力於如何設計具兼容性與彈性化的3DTV廣播系統。視訊的壓縮跟網路上的強健傳輸在3D-TV更是重要的課題之一。另外，立體影像如何呈現也是另一個熱門話題。未來，3D-TV技術可透過廣告看板、電影院、家庭電視、電腦螢幕等呈現，影像內容將會變得更逼真生動。但，由於頻寬有限，將所有視角的影像全部都傳輸過來勢必是行不通的，Depth image based rendering(DIBR)這項技術於是被提出，這個技術主要是利用一張已知視角的影像與其相對應的深度圖(depth map)來提供觀賞者一張不同視角的影像。
Disocclusion是DIBR中持續被研究解決的問題。利用位移像素(shift pixels)來建立新視角，有些區域(disoccluded regions)會暴露出來，如果沒有適當的填補這些洞，影像的品質會大大的降低。許多文獻提出不同的方法要來填補這些洞(Hole-filling)，我們將分析幾種較常用的補洞方法，包含：(a)constant color filling、(b)horizontal interpolation、(c) horizontal extrapolation using depth information、(d)variational inpainting using depth information 和(e) smoothing of depth maps，分析這些方法用來硬體實現的可行性。最後，利用軟體模擬各演算法的結果，選擇一個較適合的演算法，使用硬體描述語言去設計其硬體架構，並在Xilinx多媒體版來實現設計的原型。

Three dimensional television (3D-TV) is expected to be the next step in the advancement of television. Many famous universities and research organizations all over the world have concentrated on how to design a compatible and flexible broadcasting system of 3D-TV. Besides, another popular topic is the stereo image rendering. In the future, the technology of 3D-TV will be presented by advertisement boards, movie theaters, home TVs, and LCD monitors. Their contents become more photographic than before. But, it is impractical to transmit images of all view angles due to the limitation of bandwidth. Depth image based rendering (DIBR) is a commonly used technique to generate virtual views of a scene from a known view and an associated depth map.
However, a major problem with DIBR is that the shifted pixels now occupy new positions and leave areas that they originally occupied ”empty”. These disoccluded regions have to be filled properly, otherwise they can degrade image quality. There are many proposals to deal with the problem. We analyze different methods for filling the disoccluded regions, including (a) constant color filling, (b) horizontal interpolation, (c) horizontal extrapolation using depth information, (d) variational inpainting using depth information and (e) smoothing of depth maps. It is analyzed about the feasibility of using these methods for hardware implementation. Finally, we compare the results of software simulation for visible perspective of human and use Verilog HDL to develop the hardware architecture of the suitable algorithm and implement the prototype on Xilinx multimedia board.

[1] Peter Hohenstatt, Leonardo da Vinci, 1998.
[2] Ubersicht, http://www.3d-historisch.de/
[3] Ubersicht, http://www.stereoviews.com/
[4] http://www.inition.co.uk
[5] http://sharp-world.com
[6] C.Fehn,“Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3DTV,”in Proc. of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems, vol. 5291, pp. 93-104, San José, CA, May 2004.
[7] J.Flack, P.Harman and S.Fox, “Low bandwidth stereoscopic image encoding and transmission,” in Proc. of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems X, vol. 5006, pp. 206-214, CA, U.S.A., Jan. 2003.
[8] A.Redert, M.Op de Beeck, C.Fehn, W.IJsselsteijn, M.Pollefeys, L.Van Gool, E.Ofek, I.Sexton and P.Surman, “ATTEST—advanced three-dimensional television system techniques,” in Proc. 3DPVT’ 02, pp. 313-319, Padova, Italy, Jun. 2002.
[9] M.Ziegler, L.Falkenhagen, R.Horst and D.Kalivas, “Evolution of stereoscopic and three-dimensional video,” Signal Processing: Image Communication, vol. 14, pp. 173-194, 1998.
[10] C.Fehn, K.Hopf and Q.Quante, "Key Technologies for an Advanced 3D-TV System." In Proc. of SPIE Three-Dimensional TV, Video and Display III, vol.5599, pp. 66-80, Philadephia, PA, USA, Oct. 2004.
[11] L.Lipton, Foundations of the Stereoscopic Cinema – A Study in Depth, Van Nostrand Reinhold, New York, NY, USA, 1982.
[12] A.Woods, T.Docherty and R.Koch,“Image Distortions in Stereoscopic Video Systems,”in Proc. of SPIE Stereoscopic Displays and Applications ’93, pp. 36-48, San José, CA, USA, Feb. 1993.
[13] P.Harman, J.Flack, S.Fox and M.Dowley,“Rapid 2d to 3d conversion,”in Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems IX ,vol. 4660, pp. 78-86, May 2002.
[14] W.J.Tam, A.Soung Yee, J.Ferreira, S.Tariq and F.Speranza, "Stereoscopic image rendering based on depth maps created from blur and edge information," In Proc. of SPIE: Stereoscopic Displays and Applications XII, vol. 5664, pp.104-115, 2005.
[15] S.Cho, W.J.Tam, F.Speranza, R.Renaud, N.Hur and S.I.Lee, "Depth maps created from blur information using images with focus at near and at far," In Proc. of SPIE: Stereoscopic Displays and Virtual Reality Systems XII, vol. 6055, 60551D-1~11, 2006.
[16] Y.Lu, J.Z.Zhang, Q.M.J.Wu, and Z.-N.Li,“A survey of motion-parallax-based 3-d reconstruction algorithms,”IEEE Transactions on Systems, MAN and Cybernetics-Part C: Applications and Reviews 34, Nov. 2004.
[17] G.J.Iddan and G.Yahav,“3D Imaging in the Studio (and Elsewhere ...),”in Proc. of SPIE Videometrics and Optical Methods for 3D Shape Measurements ’01, pp. 48-55, San José, CA, USA, Jan. 2001.
[18] L.Zhang and W.J.Tam,“Stereoscopic image generation based on depth images for 3D TV,”IEEE Transactions On Broadcast, vol. 51, pp. 191-199, June 2005.
[19] C.Vázques, W.Tam, and F.Speranza,“Stereoscopic imaging:Filling disoccluded areas in depth image-based rendering,”in Proc. of SPIE Three-Dimensional TV, Video, and Display (ITCOM), vol.6392, pp. 63920D, Boston, MA, Oct. 2006.
[20] D.Tschumperlé and R.Deriche,“Vector-valued image regularization with PDEs : A common framework for different applications,”IEEE Transactions On Pattern ANALYSIS AND MACHINE INTELLIGENCE, vol. 27, no. 4, pp. 506-517, Apr. 2005.
[21] W.J.Tam, G.Alain, L.Zhang, T.Martin and R. Renaud, “Smoothing depth maps for improved stereoscopic image quality,” in Proc. of SPIE Conference On Three-Dimensional TV, Video, and Display III, vol. 5599, pp. 162-172, Philadelphia, U.S.A., Oct. 2004.
[22] http://vision.middlebury.edu/stereo/
[23] http://www.3dtv-research.org/3dav/3DAV_Test_Data/
[24] XILINX, “Virtex-Ⅱ Platform FPGA User Guide”, UG002(v1.4) Nov. 1, 2002.
[25] XILINX, “MicroBlaze and Multimedia Development Board User Guide”, UG020(v1.0) Aug. 29, 2002.