簡易檢索 / 詳目顯示

研究生: 何青龍
Ho, Ching-Lung
論文名稱: Strategic Selections of Temporal and Spatial Error Concealment Methods using Cooperative Game Structure
運用合作賽局結構之時間域及空間域策略性方法選擇之錯誤隱藏
指導教授: 張隆紋
Chang, Long-Wen
口試委員: 孫明廷
廖弘源
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 資訊工程學系
Computer Science
論文出版年: 2011
畢業學年度: 99
語文別: 英文
論文頁數: 39
中文關鍵詞: 錯誤隱藏賽局理論
外文關鍵詞: error concealment, game theory
相關次數: 點閱:1下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在容易發生錯誤的傳輸環境下,因為雜訊及封包遺失的影響,影像的品質會受到破壞。而因為有越來越多即時影像的應用所需,所以有一些視訊壓縮標準已經可以達成高壓縮率,像是H.264或MPEG4。而這也會造成視訊流對於錯誤的抵抗力變得更脆弱,而且這些錯誤還會傳遞到後續的影像中。為了不增加編碼端的複雜度,錯誤隱藏的技術就被提出來了,它是一個在解碼端作後端處理的概念。它運用了時間或空間域上的資訊來恢復損壞的資料,而在最近幾年當中有越來越多的時間域,空間域或甚至混和型的錯誤隱藏方法被提出來。
    我們提出了兩個時間域的錯誤隱藏方法,它們運用了雙向濾波器來恢復遺失的區塊。雙向濾波器主要是用來處理去除雜訊的問題。因此,我們會運用去除雜訊的演算法來解決我們的錯誤隱藏問題。
    之後,我們提出一個合作賽局性的錯誤隱藏架構來適應性地選擇適當的演算法去修補錯誤的區塊。藉由合作賽局,我們可以有效地利用時間域和空間域上的資訊來做錯誤隱藏。因此,比起單獨用一種錯誤隱藏的方法來補,我們方法補出來的結果,其視覺品質會比較好。最後,因為在把遺失區塊換成修補過的區塊之後,可能會產生方塊效應,所以我們也有介紹一個去除方塊的結構來偵測和移除方塊效應,以求更好的影像品質。

    In the error-prone transmission environment, the quality of a video sequence may be damaged because of noise or packet loss. Moreover, since more and more real time video stream applications are needed, high compression rates of video streams have been reached by some video coding standards such as H.264 or MPEG4. It will make the video stream more vulnerable against stream error, and the error will also propagate to the successive frames. In order not to increase the complexity of the encoder, error concealment techniques were proposed, and it is a post-processing concept on the decoder. It utilizes the temporal or spatial information to recover the damaged data, and more and more temporal, spatial or even hybrid error concealment methods were proposed over the years.
    We propose two temporal error concealment methods, which use bilateral filter as a tool to reconstruct the lost macro-block. Bilateral filter is mainly used to deal with de-noising problem. Therefore, we apply the de-noising algorithm to tackle our error concealment problem.
    Afterward, we propose a cooperative game theoretic error concealment structure to adaptively select the proper algorithms to reconstruct the error macro-block. By applying the cooperative game theory, we can effectively take advantages of both temporal and spatial information to do error concealment. Therefore, the result using our method can achieve better visual quality compared with using single error concealment method. Finally, because the blocking effect may occur after replacing the missing macro-block with the concealed macro-block; therefore, we also introduce a de-blocking scheme to detect and remove the blocking effect for better image quality.


    In the error-prone transmission environment, the quality of a video sequence may be damaged because of noise or packet loss. Moreover, since more and more real time video stream applications are needed, high compression rates of video streams have been reached by some video coding standards such as H.264 or MPEG4. It will make the video stream more vulnerable against stream error, and the error will also propagate to the successive frames. In order not to increase the complexity of the encoder, error concealment techniques were proposed, and it is a post-processing concept on the decoder. It utilizes the temporal or spatial information to recover the damaged data, and more and more temporal, spatial or even hybrid error concealment methods were proposed over the years.
    We propose two temporal error concealment methods, which use bilateral filter as a tool to reconstruct the lost macro-block. Bilateral filter is mainly used to deal with de-noising problem. Therefore, we apply the de-noising algorithm to tackle our error concealment problem.
    Afterward, we propose a cooperative game theoretic error concealment structure to adaptively select the proper algorithms to reconstruct the error macro-block. By applying the cooperative game theory, we can effectively take advantages of both temporal and spatial information to do error concealment. Therefore, the result using our method can achieve better visual quality compared with using single error concealment method. Finally, because the blocking effect may occur after replacing the missing macro-block with the concealed macro-block; therefore, we also introduce a de-blocking scheme to detect and remove the blocking effect for better image quality

    Chapter 1 Chapter 2 Related Works Chapter 3 Proposed Methods 3.1 Bilateral filter 3.2 Weighted Minimum SAD Blocks 3.3 Weighted Two Combined Blocks 3.4 Error concealment using cooperative game 3.4.1 Introduction of Game Theory 3.4.2 The Proposed Game Structure 3.4.3 The strategies in TEC and SEC 3.4.4 Payoff Functions in the Proposed Game 3.5 The De-blocking algorithm Chapter 4 Experiment Results Chapter 5 Conclusions Reference

    [1] J. Wu, X. Liu, K. Y. Yoo, “A Temporal Error Concealment Method for H.264/AVC Using Motion Vector Recovery,” IEEE Transactions on Consumer Electronics, Vol. 54 , issue.4 , pp. 1880 – 1885, 2008
    [2] Xiaoyu Deng, Yi Liu, Chaoqun Hong, Jiajun Bu, Chun Chen“A temporal error concealment algorithm for H.264/AVC based on edge directions” Image Processing (ICIP), pp.941 – 944, 2009
    [3] Mingjing Ai,Qixing Jiang, “Weighted Motion Vectors of double Candidate Blocks Based Temporal Error Concealment Method for Video Transmission over Wireless Network”2010 International Conference on Educational and Network Technology (ICENT 2010), pp. 478 – 481, 2010
    [4] Tung-Hsing Wu, Guan-Lin Wu,Ching-Yi Chen, Shao-Yi Chien, “Enhanced Temporal Error Concealment Algorithm with Edge-Sensitive Processing Order” IEEE International Symposium on Circuits and Systems, 2008, pp. 3466-3469, 2008.
    [5] Xuanguo Wu, Hong Shen, “Block-Based Weighted Pixel-Value Superposition Algorithm for Inter-Frame Error Concealment” Future Computer and Communication (ICFCC), pp. V2-619 - V2-623, 2010
    [6] Jae-Won Suh,Yo-Sung Ho, “error concealment based on directional interpolation”Consumer Electronics, IEEE Transactions, Vol.43 , issue. 3, pp. 295 – 302, 1997
    [7] W. Kwok, H. Sun, “Multi-directional Interpolation for Spatial Error Concealment,” IEEE Transactions on Consumer Electronics, vol. 39, issue. 3, pp. 455-460, 1993
    [8] Hongtao Yang, Bo Yan, “A Novel Spatial Error Concealment Method for Wireless Video Transmission” Wireless Communications, Networking and Mobile Computing, 2009.WiCom '09. 5th International Conference, pp.1-4, 2009
    [9] Yue Shi, Xuhui Zhu, Jun Xia, Hanchun Yin, “A Fast and Efficient Spatial Error Concealment for Intra-coded Frames,” Congress on Image and Signal Processing, vol. 1, pp.264 – 267, 2008.
    [10] M. Lindenbaum, M. Fischer, and A. Bruckstein.“On gabor contribution to image enhancement”.Pattern Recognition,27:1–8, 1994.
    [11] P. Perona and J. Malik, “Scale-space and edge detection using anistropic diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629–639, July 1990.
    [12] C. Tomasi and R. Manduchi, “Bilateral filtering for gray and color images,” in Proc. Int. Conf. Computer Vision, 1998, pp.839–846.
    [13] Buades, A.,Coll, B., Morel, J.-M., “A non-local algorithm for image de-noising”Computer Vision and Pattern Recognition, 2005.CVPR 2005. IEEE Computer Society Conference, pp.60 – 65, vol. 2, 2005
    [14] Ming Zhang,Gunturk, B.“A new image denoising method based on the bilateral filter”Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference, pp. 929 – 932, 2008
    [15] Petrov, A.,Kartalov, T.,Ivanovski, Z, “Blocking effect reduction in low bitrate video on a mobile platform”Image Processing (ICIP), 2009 16th IEEE International Conference, pp. 3937 – 3940, 2009
    [16] G. Zhai, J. Cai, W. Lin, X. Yang, and W. Zhang, “Image Error Concealment via Block-based Bilateral Filtering,” IEEE Int. Conf. Multimedia and Expo, pp. 621-624, Jun. 2008.
    [17] Y. Xu, and Y. Zhou, “Adaptive Temporal Error Concealment Scheme for H.264/AVC Video Decoder,” IEEE Trans. Consumer Electronics, Vol.54 , issue. 4, pp: 1846-1851, Nov. 2008
    [18] Lam, W.M.,Reibman, A.R., Liu, B, “Recovery of lost or erroneously received motion vectors” Acoustics, Speech, and Signal Processing, 1993. ICASSP-93., 1993 IEEE International Conference, Vol. 5, pp. 417 – 420
    [19] J. S. Lu, “Novel Temporal and Spatial Error Concealment with Game Theory,” NTHU, VIP Lab, 2009
    [20] T. K. Lai, “Strategic Error Concealment Method Based on Edge Information” NTHU, VIP Lab, 2010
    [21] W. T. Chen, “Adaptive Temporal and Spatial Error Concealment with Game Theory” NTHU, VIP Lab, 2010
    [22] Game theory from Wikipedia (http://en.wikipedia.org/wiki/Game_theory)
    [23] T. Wiegand, G. J. Sullivan, G. Bjntegaard, A. Luthra, “Overview of the H.264/AV video coding standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, issue 7, pp. 560- 576, 2003

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE