簡易檢索 / 詳目顯示

研究生: 亞魯
ARULMURUGAN AMBIKAPATHI
論文名稱: Chance Constrained Robust Unmixing Algorithms and Estimation of Number of Endmembers in Hyperspectral Images
指導教授: 祁忠勇
Chi, Chong-Yung
口試委員: 陳錕山
任玄
郭伯臣
張陽郎
祁忠勇
學位類別: 博士
Doctor
系所名稱: 電機資訊學院 - 通訊工程研究所
Communications Engineering
論文出版年: 2011
畢業學年度: 99
語文別: 英文
論文頁數: 110
中文關鍵詞: Robust hyperspectral unmixingChance constraintsEstimation of number of endmembersNeyman-Pearson hypothesis testingAVIRIS Cuprite data
相關次數: 點閱:2下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • Abstract
    Hyperspectral remote sensing is a powerful technique to identify the materials and their composition in an area by exploiting the spectral diversity of the observed hyperspectral data. The analysis of hyperspectral images obtained for the purpose of mineral identification and quantification is considered in this thesis. The limited
    spatial resolution of the sensor used for hyperspectral imaging and the presence of noise in the measured hyperspectral data demand an effective hyperspectral unmixing (HU) scheme to extract the underlying endmember signatures and the associated abundance maps distributed over a scene of interest. Existing HU algorithms are basically devised under either of the two famous unmixing
    criteria, namely Winter’s criterion and Craig’s criterion. However, the presence of additive Gaussian noise in the observations expands the actual data cloud and as a consequence, the endmember estimates obtained by applying either Winter’s or Craig’s criterion based algorithms to the noisy data may no longer be in close proximity to the true endmember signatures. Hence, we propose two robust algorithms, they are Winter’s criterion based robust alternating volume maximization (RAVMAX) algorithm and Craig’s criterion based robust minimum volume enclosing
    simplex (RMVES) algorithm. The robust algorithms account for the noise effects in the observations by employing chance constraints, and employ the notion of alternating
    optimization to handle the resulting non-convex optimization problems. In RAVMAX algorithm, the subproblems involved in each alternating optimization turn out to be convex problems and they can be effectively solved using available convex optimization solvers. On the other hand, the subproblems involved in RMVES algorithm are non-convex and are hence dealt using available sequential quadratic
    programming solvers. The HU results can be completely interpretable, only when the number of substances
    (or endmembers) present in that area is given a priori, which however is unknown in practice. Considering the linear mixing model, we propose a hyperspectral
    data geometry based approach for estimating the number of endmembers by utilizing a successive endmember extraction algorithm (EEA). The approach is fulfilled by two novel algorithms, namely geometry based estimation of number of
    endmembers - convex hull (GENE-CH) algorithm and affine hull (GENE-AH) algorithm. The GENE-CH and GENE-AH algorithms are based on the fact that all the observed pixel vectors lie in the convex hull and affine hull of the endmember signatures, respectively. The proposed GENE algorithms estimate the number of endmembers by using the Neyman-Pearson hypothesis testing over the endmember
    estimates provided by a successive EEA until the estimate of the number of endmembers is obtained. Since the estimation accuracies of the proposed GENE algorithms
    depend on the performance of the EEA used, a reliable, reproducible, and successive EEA, called p-norm based pure pixel identification (TRI-P) algorithm is then proposed.
    Monte-Carlo simulations and real data experiments on AVIRIS hyperspectral data obtained over the Cuprite mining site, Nevada are performed to demonstrate the efficacy of the proposed RAVMAX, RMVES, GENE, and TRI-P algorithms.
    We believe that the proposed chance constrained robust algorithms for hyperspectral unmixing, and data geometry based algorithms for estimating the number of endmembers, will provide a new dimension in analyzing hyperspectral data where noise is always present.


    Table of Contents Abstract ii Acknowledgments iv List of Figures viii List of Tables x List of Notations xiii 1 Introduction 1 2 Linear Mixing Model for Hyperspectral Data 10 2.1 Data Preprocessing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 3 Robust Alternating Volume Maximization Algorithm 18 3.1 Brief review of AVMAX algorithm . . . . . . . . . . . . . . . . . . . . 19 3.2 Robust AVMAX Formulation and Algorithm . . . . . . . . . . . . . . 21 3.2.1 Restructuring the AVMAX algorithm . . . . . . . . . . . . . . 22 3.2.2 Robust AVMAX Algorithm . . . . . . . . . . . . . . . . . . . 24 3.3 Simulations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3.3.1 Uniform Gaussian noise case . . . . . . . . . . . . . . . . . . . 29 3.3.2 Non-uniform Gaussian noise case . . . . . . . . . . . . . . . . 30 3.4 Real data experiments . . . . . . . . . . . . . . . . . . . . . . . . . . 31 3.5 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 4 Robust Minimum Volume Enclosing Simplex Algorithm 39 4.1 Brief review of MVES Algorithm . . . . . . . . . . . . . . . . . . . . 41 4.2 Robust MVES Formulation and Algorithm . . . . . . . . . . . . . . . 43 4.3 Simulations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 4.3.1 Uniform Gaussian noise case . . . . . . . . . . . . . . . . . . . 53 4.3.2 Non-uniform Gaussian noise case . . . . . . . . . . . . . . . . 56 4.3.3 Local optimality issues . . . . . . . . . . . . . . . . . . . . . . 56 4.4 Real data experiments . . . . . . . . . . . . . . . . . . . . . . . . . . 59 4.5 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 5 Estimation of Number of Endmembers Using p−norm Based Pure Pixel Identification Algorithm 67 5.1 Dimension reduction-revisited . . . . . . . . . . . . . . . . . . . . . . 68 5.1.1 Convex geometry of the hyperspectral data . . . . . . . . . . . 70 5.2 Geometry based estimation of number of endmembers (GENE) . . . . 71 5.2.1 GENE-Convex Hull (GENE-CH) Algorithm . . . . . . . . . . 72 5.2.2 GENE-Affine Hull (GENE-AH) Algorithm . . . . . . . . . . . 76 5.3 p-norm based Pure Pixel Identification (TRI-P) Algorithm . . . . . . 81 5.4 Simulations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85 5.4.1 Evaluation of TRI-P algorithm . . . . . . . . . . . . . . . . . 87 5.4.2 Evaluation of GENE-CH and GENE-AH algorithms . . . . . . 87 5.5 Real data experiments . . . . . . . . . . . . . . . . . . . . . . . . . . 90 5.6 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 6 Conclusions and Future Works 100 Bibliography 102 Publication List of The Author 109

    [1] N. Keshava and J. Mustard, “Spectral unmixing,” IEEE Signal Process. Mag., vol. 19, no. 1,
    pp. 44-57, Jan. 2002.
    [2] V. P. Pauca, J. Piper, and R. J. Plemmons, “Nonnegative matrix factorization for spectral
    data analysis,” Elsevier Journal of Linear Algebra and Its Applications, vol. 416, no. 1, pp.
    29-47, July 2006.
    [3] M. B. Lopes, J. C. Wolff, J. B. Dias, and M. Figueiredo, “NIR hyperspectral unmixing based
    on a minimum volume criterion for fast and accurate chemical characterisation of counterfeit
    tablets,” Analytical Chemistry, vol. 82, no. 4, pp. 1462-1469, Jan. 2010.
    [4] W. R. Johnson, D. W. Wilson, and W. Fink, “Snapshot hyperspectral imaging in opthomology,”
    Journal of Biomedical Optics, published online on Feb. 2007.
    [5] M. O. Smith, P. E. Johnson, and J. B. Adams, “Quantitative determination of mineral types
    and abundances from reflectance spectra using principal component analysis,” Journal Geophys.
    Res., vol. 90, no. 2, pp. C797-C804, Feb. 1985.
    [6] A. A. Green, “A transformation for ordering multispectral data in terms of image quality with
    implications for noise removal,” IEEE Trans. Geosci. Remote Sens., vol. 32, no. 1, pp. 65-74,
    May 1988.
    [7] I. K. Fodor, “A survey of dimension reduction techniques,” Techical Report, Lawrence Livermore
    National Laboratory, May 2002.
    [8] J. W. Boardman, F. A. Kruse, and R. O. Green, “Mapping target signatures via partial
    unmixing of AVIRIS data,” in Proc. Summ. JPL Airborne Earth Sci. Workshop, Pasadena,
    CA, Dec. 9-14, 1995, pp. 23-26.
    [9] M. E.Winter, “N-findr: An algorithm for fast autonomous spectral end-member determination
    in hyperspectral data,” in Proc. SPIE Conf. Imaging Spectrometry, Pasadena, CA, Oct. 1999,
    pp. 266-275.
    [10] C. I. Chang, C. C. Wu, W. M. Liu, and Y. C. Ouyang, “A new growing method for simplexbased
    endmember extraction algorithm,” IEEE Trans. Geosci. Remote Sens., vol. 44, no. 10,
    pp. 2804-2819, Oct. 2006.
    [11] C. I. Chang, C. C. Wu, C. S. Lo, and M. L. Chang, “Real-time simplex growing algorithms for
    hyperspectral endmember extraction,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 4, pp.
    1834-1850, Apr. 2010.
    [12] J. M. P. Nascimento and J. M. B. Dias, “Vertex component analysis: A fast algorithm to
    unmix hyperspectral data,” IEEE Trans. Geosci. Remote Sens., vol. 43, no. 4, pp. 898-910,
    Apr. 2005.
    [13] T.-H. Chan, C.-Y. Chi, W.-K. Ma, and A. Ambikapathi “Hyperspectral unmixing from a
    convex analysis and optimization perspective,” in Proc. First IEEE WHISPERS, Grenoble,
    France, Aug. 26-28, 2009.
    [14] T.-H. Chan, W.-K. Ma, A. Ambikapathi, and C.-Y. Chi, “A simplex volume maximization
    framework for hyperspectral endmember extraction,” to appear in IEEE Trans. Geosci. Remote
    Sens.- Special Issue on Spectral Unmixing of Remotely Sensed Data, 2011.
    [15] D. Heinz and C.-I. Chang, “Fully constrained least squares linear mixture analysis for material
    quantification in hyperspectral imagery,” IEEE Trans. Geosci. Remote Sens., vol. 39, no. 3,
    pp. 529-545, Mar. 2001.
    [16] M. D. Craig, “Minimum-volume transforms for remotely sensed data,” IEEE Trans. Geosci.
    Remote Sens., vol. 32, no. 3, pp. 542-552, May 1994.
    [17] M. Berman, H. Kiiveri, R. Lagerstrom, A. Ernst, R. Dunne, and J. F. Huntington, “ICE: A
    statistical approach to identifying endmembers in hyperspectral images,” IEEE Trans. Geosci.
    Remote Sens., vol. 42, no. 10, pp. 2085-2095, Oct. 2004.
    [18] A. Zare and P. Gader, “PCE: Piecewise convex endmember detection,” IEEE Trans. Geosci.
    Remote Sens., vol. 48, no. 6, pp. 2620-2632, June 2010.
    [19] A. Zymnis, S.-J. Kim, J. Skaf, M. Parente, and S. Boyd, “Hyperspectral image unmixing via
    alternating projected subgradients,” in Proc. 41st Asilomar Conf. Signals, Syst., Pacific Grove,
    CA, Nov. 4-7, 2007, pp. 1164-1168.
    [20] L. Miao and H. Qi, “Endmember extraction from highly mixed data using minimum volume
    constrained nonnegative matrix factorization,” IEEE Trans. Geosci. Remote Sens., vol. 45, no.
    3, pp. 765-777, Mar. 2007.
    [21] A. Huck, M. Guillaume, and J. B. Talon, “Minimum dispersion constrained nonnegative matrix
    factorization to unmix hyperspectral data,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 6,
    pp. 2590-2602, June 2010.
    [22] J. Li and J. Bioucas-Dias, “Minimum volume simplex analysis: A fast algorithm to unmix
    hyperspectral data,” in Proc. IEEE Int. Geosci. Remote Sens. Symp., Boston, MA, Aug. 8-12,
    2008, vol. 4, pp. 2369-2371.
    [23] T.-H. Chan, C.-Y. Chi, Y.-M. Huang, and W.-K. Ma, “A convex analysis based minimumvolume
    enclosing simplex algorithm for hyperspectral unmixing,” IEEE Trans. Signal Processing,
    vol. 57, no. 11, pp. 4418-4432, Nov. 2009.
    [24] A. Plaza, P. Martinez, R. Perez, and J. Plaza, “Spatial/spectral endmember extraction by
    multidimensional morphological operations,” IEEE Trans. Geosci. Remote Sens., vol. 40, no.
    9, pp. 2025-2041, Sep. 2002.
    [25] M. Zortea and A. Plaza, “Spatial preprocessing for endmember extraction,” IEEE Trans.
    Geosci. Remote Sens., vol. 47, no. 8, pp. 2679-2693, Aug. 2009.
    [26] M. Parente and A. Plaza, “Survey of geometric and statistical unmixing algorithms for hyperspectral
    images,” in Proc. Second IEEE WHISPERS, Reykjavik, Iceland, June 14-16, 2010.
    [27] N. Dobigeon, S. Moussaoui, M. Coulon, J.-Y. Tourneret, and A. O. Hero, “Joint Bayesian
    endmember extraction and linear unmixing for hyperspectral imagery,” IEEE Trans. Signal
    Process., vol. 57, no. 11, pp. 4355-4368, Nov 2009.
    [28] J. Bioucas-Dias, “A variable splitting augmented Lagrangian approach to linear spectral unmixing,”
    in Proc. First IEEE WHISPERS, Grenoble, France, August 26-28, 2009.
    [29] S. Boyd and L. Vandenberghe, Convex Optimization, UK: Cambridge Univ. Press, 2004.
    [30] J. F. Sturm, “Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones”,
    Optimization Methods and Software vol. 11-12, pp. 625-653, 1999.
    [31] M. Grant and S. Boyd. CVX: Matlab software for disciplined convex programming, version
    1.21. http://cvxr.com/cvx, Oct. 2010.
    [32] MATLAB Optimization Toolbox - Version 7.6 (R2008a), The MathWorks, Inc., Natick, MA,
    USA.
    [33] P. Stoica, “Maximum likelihood parameter and rank estimation in reduced-rank multivariate
    linear regressions,” IEEE Trans. Signal Processing, vol. 44, no. 12, pp. 3069-3078, Dec. 1996.
    [34] C. Kuybeda, D. Malah, and M. Barzohar, “ Rank estimation and redundancy reduction of highdimensional
    noisy signals with preservation of rare vectors,” IEEE Trans. Signal Processing,
    vol. 55, no. 12, pp. 5579-5592, Dec. 2007.
    [35] P. Stoica and Y. Selen, “Model-order selection: A review of information criterion rules,” IEEE
    Signal Process. Mag., vol. 21, no. 4, pp. 36-47, July 2004.
    [36] K. P. Burnham, Model selection and multimodel inference: A practical information theoretic
    approach, Springer Publications, 2002.
    [37] H. Akaike, “A new look at the statistical model identification,” IEEE Trans. Automat. Control,
    vol. AC-19, no. 6, pp. 716-723, Dec. 1974.
    [38] J. Rissanen, “Modeling by shortest data description,” Automatica, vol. 14, no. 5, pp. 465-471,
    Sep. 1978.
    [39] G. Schwarz, “Estimating the dimension of a model,” The Annals of Statistics, vol. 6, no. 2,
    pp. 461-464, Mar. 1978.
    [40] M. W. Graham and D. J. Miller, “Unsupervised learning of parsimonious mixtures on large
    spaces with integrated feature and component selection,” IEEE Trans. Signal Processing, vol.
    54, no. 4, pp. 1289-1303, April 2006.
    [41] C.-I. Chang and Q. Du, “Estimation of number of spectrally distinct signal sources in hyperspectral
    imagery,” IEEE Trans. Geosci. Remote Sens., vol. 42, no. 3, pp. 608-619, Mar.
    2004.
    [42] M. Wax and T. Kailath, “Detection of signals by information criteria,” IEEE Trans. Acoustics,
    Speech, and Signal Process., vol. ASSP-33, pp. 387-392, April 1985.
    [43] P. R. Peres-Neto, D. A. Jackson, and K. M. Somers, “How many principal components? stopping
    rules for determining the number of non-trivial axes revisited,” Elsevier Journal of Comput.
    Stat. and Data Analysis, vol. 49, pp. 974-997, July 2004.
    [44] J. Harsanyi, W. Farrand, and C.-I Chang, “Determining the number and identity of spectral
    endmembers: An integrated approach using Neyman-Pearson eigenthresholding and iterative
    constrained RMS error minimization,” in Proc. 9th Thematic Conf. Geologic Remote Sensing,
    Feb. 1993.
    [45] J. M. B. Dias and J. M. P. Nascimento, “Hyperspectral subspace identification,” IEEE Trans.
    Geosci. Remote Sens., vol. 46, no. 8, pp. 2435-2445, Aug. 2008.
    [46] O. Eches, N. Dobigeon, and J.-Y. Tourneret, “Estimating the number of endmembers in hyperspectral
    images using the normal compositional model and a hierarchical Bayesian algorithm,”
    IEEE J. Sel. Topics Signal Processing, vol. 3, no. 3, pp. 582-591, June 2010.
    [47] A. Ambikapathi, T.-H. Chan, W.-K.Ma, and C.-Y. Chi, “A robust minimum-volume enclosing
    simplex algorithm for hyperspectral unmixing,” in Proc. IEEE ICASSP, Dallas, Texas, Mar.
    14-19, 2010, pp. 1202-1205.
    [48] A. Ambikapathi, T.-H. Chan, W.-K. Ma, and C.-Y. Chi, “A robust alternating volume maximization
    algorithm for endmember extraction in hyperspectral images,” in Proc. IEEE WHISPERS,
    Reykjavik, Iceland, June 14-16, 2010.
    [49] M. T. Eismann and R. C. Hardie, “Application of the stochastic mixing model to hyperspectral
    resolution enhancement,” IEEE Trans. Geosci. Remote Sens., vol. 42, no. 9, pp. 1924-1933,
    Sep. 2004.
    [50] G. Strang, Linear Algebra and Its Applications, CA: Thomson, 4th edition, 2006.
    [51] Tech. Rep [Online]. Available: http://speclab.cr.usgs.gov/cuprite.html
    [52] AVIRIS Data Products [Online]. Available: http://aviris.jpl.nasa.gov/html/aviris.
    freedata.html
    [53] R. N. Clark, G. A. Swayze, A. Gallagher, T. V. King, and W. M. Calvin, “The U.S. geological
    survey digital spectral library: Version 1: 0.2 to 3.0,” U. S. Geol. Surv., Open File Rep. pp.
    93-592, 1993.
    [54] R. N. Clarke, and G. A. Swayze, “Evolution in imaging spectroscopy analysis and sensor signalto-
    noise: An examination of how far we have come,” in Proc. 6th Annual JPL Airborne Earth
    Science Workshop, Mar. 4-8, 1996.
    [55] T. H. Chan, “Convex analysis based non-negative blind source separation for biomedical and
    hyperspectral image analysis,” Ph.D. dissertation, National Tsing Hua Univ., Taiwan, 2009.
    [56] J. M. P. Nascimento, “Unsupervised hyperspectral unmxing,” Ph.D. dissertation, Technical
    University of Lisbon, Lisbon, 2006.
    [57] T.-H. Chan, W.-K. Ma, C.-Y. Chi, and Y. Wang, “A convex analysis framework for blind
    separation of non-negative sources,” IEEE Trans. Signal Processing, vol. 56, no. 10, pp. 5120-
    5134, Oct. 2008.
    [58] W.-K. Ma, T.-H. Chan, C.-Y. Chi, and Y. Wang, “Convex analysis for non-negative blind
    source separation with application in imaging,” in Chapter 7, Convex Optimization in Signal
    Processing and Communications, Editors: D. P. Palomar and Y. C. Eldar, UK: Cambridge
    University Press, 2010.
    [59] F.-Y. Wang, C.-Y. Chi, T.-H. Chan, and Y. Wang, “Nonnegative least-correlated component
    analysis for separation of dependent sources by volume maximization,” IEEE Trans. Pattern
    Analysis and Machine Intelligence, vol. 32, no. 5, pp. 875-888, May 2010.
    [60] P. T. Boggs and J. W. Tolle, “Sequential quadratic programming,” Acta Numerica, pp. 1-51,
    1996.
    [61] S. Jia and Y. Qian “Constrained nonnegative matrix factorization for hyperspectral unmixing,”
    IEEE Trans. Geosci. Remote Sens., vol. 47, no. 1, pp. 161-173, Jan. 2009.
    [62] A. Ambikapathi, T.-H. Chan, W.-K. Ma, and C.-Y. Chi, “Chance constrained robust minimum
    volume enclosing simplex algorithm for hyperspectral unmixing,” to appear in IEEE Trans.
    Geosci. Remote Sens. - Special Issue on Spectral Unmixing of Remotely Sensed Data, 2011.
    [63] L. C. Ludeman, Random Processes Filtering, Estimation, and Detection, Wiley-Interscience
    Publication, 2003.
    [64] M. Evans, N. Hastings, and B. Peacock, Statistical Distributions, 2nd ed., Wiley-Interscience
    Publication, 1993.
    [65] G. Arfken and H. Weber, Mathematical Methods for Physicists, Harcourt Academic Press,
    2000.
    [66] C.-I. Chang, W. Xiong, W. Liu, M.-L. Chang, C.-C. Wu, and C.-C. Chen, “Linear spectral
    mixture analysis based approaches to estimation of virtual dimensionality in hyperspectral
    imagery,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 3960-3979, Nov. 2010.
    [67] M. E.Winter, “A proof of the N-FINDR algorithm for the automated detection of endmembers
    in a hyperspectral image,” in Proc. SPIE Conf. Algorithms and Technologies for Multispectral,
    Hyperspectral, and Ultraspectral Imagery, vol. 5425, Aug. 2004, pp. 31-41.
    [68] C.-C. Wu, S. Chu, and C.-I. Chang, “Sequential N-FINDR algorithms,” Proc. of SPIE, vol.
    7086, Aug. 2008, pp. 70860C1-70860C12.
    [69] Q. Du, N. Raksuntorn, N. H. Younan, and R. L. King, “Variants of N-FINDR algorithm for
    endmember extraction,” Proc. of SPIE, vol. 7109, Oct. 2008, pp. 71090G1-71090G8
    [70] H. Ren and C.-I. Chang, “Automatic spectral target recognition in hyperspectral imagery,”
    IEEE Trans. Aer. Elec. Sys., Vol. 39, no. 4, pp. 1232-1249, Oct. 2003.
    [71] C.-I. Chang, W. Xiong, H.-M. Chen, and J.-W. Chai, “Maximum orthogonal subspace projection
    appraoch to estimating the number of spectral signal sources in hyperspectral imagery,”
    IEEE J. Sel. Topics Signal Processing, vol. 5, no. 3, pp. 504-520, June 2011.

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE