研究生: |
亞魯 ARULMURUGAN AMBIKAPATHI |
---|---|
論文名稱: |
Chance Constrained Robust Unmixing Algorithms and Estimation of Number of Endmembers in Hyperspectral Images |
指導教授: |
祁忠勇
Chi, Chong-Yung |
口試委員: |
陳錕山
任玄 郭伯臣 張陽郎 祁忠勇 |
學位類別: |
博士 Doctor |
系所名稱: |
電機資訊學院 - 通訊工程研究所 Communications Engineering |
論文出版年: | 2011 |
畢業學年度: | 99 |
語文別: | 英文 |
論文頁數: | 110 |
中文關鍵詞: | Robust hyperspectral unmixing 、Chance constraints 、Estimation of number of endmembers 、Neyman-Pearson hypothesis testing 、AVIRIS Cuprite data |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
Abstract
Hyperspectral remote sensing is a powerful technique to identify the materials and their composition in an area by exploiting the spectral diversity of the observed hyperspectral data. The analysis of hyperspectral images obtained for the purpose of mineral identification and quantification is considered in this thesis. The limited
spatial resolution of the sensor used for hyperspectral imaging and the presence of noise in the measured hyperspectral data demand an effective hyperspectral unmixing (HU) scheme to extract the underlying endmember signatures and the associated abundance maps distributed over a scene of interest. Existing HU algorithms are basically devised under either of the two famous unmixing
criteria, namely Winter’s criterion and Craig’s criterion. However, the presence of additive Gaussian noise in the observations expands the actual data cloud and as a consequence, the endmember estimates obtained by applying either Winter’s or Craig’s criterion based algorithms to the noisy data may no longer be in close proximity to the true endmember signatures. Hence, we propose two robust algorithms, they are Winter’s criterion based robust alternating volume maximization (RAVMAX) algorithm and Craig’s criterion based robust minimum volume enclosing
simplex (RMVES) algorithm. The robust algorithms account for the noise effects in the observations by employing chance constraints, and employ the notion of alternating
optimization to handle the resulting non-convex optimization problems. In RAVMAX algorithm, the subproblems involved in each alternating optimization turn out to be convex problems and they can be effectively solved using available convex optimization solvers. On the other hand, the subproblems involved in RMVES algorithm are non-convex and are hence dealt using available sequential quadratic
programming solvers. The HU results can be completely interpretable, only when the number of substances
(or endmembers) present in that area is given a priori, which however is unknown in practice. Considering the linear mixing model, we propose a hyperspectral
data geometry based approach for estimating the number of endmembers by utilizing a successive endmember extraction algorithm (EEA). The approach is fulfilled by two novel algorithms, namely geometry based estimation of number of
endmembers - convex hull (GENE-CH) algorithm and affine hull (GENE-AH) algorithm. The GENE-CH and GENE-AH algorithms are based on the fact that all the observed pixel vectors lie in the convex hull and affine hull of the endmember signatures, respectively. The proposed GENE algorithms estimate the number of endmembers by using the Neyman-Pearson hypothesis testing over the endmember
estimates provided by a successive EEA until the estimate of the number of endmembers is obtained. Since the estimation accuracies of the proposed GENE algorithms
depend on the performance of the EEA used, a reliable, reproducible, and successive EEA, called p-norm based pure pixel identification (TRI-P) algorithm is then proposed.
Monte-Carlo simulations and real data experiments on AVIRIS hyperspectral data obtained over the Cuprite mining site, Nevada are performed to demonstrate the efficacy of the proposed RAVMAX, RMVES, GENE, and TRI-P algorithms.
We believe that the proposed chance constrained robust algorithms for hyperspectral unmixing, and data geometry based algorithms for estimating the number of endmembers, will provide a new dimension in analyzing hyperspectral data where noise is always present.
[1] N. Keshava and J. Mustard, “Spectral unmixing,” IEEE Signal Process. Mag., vol. 19, no. 1,
pp. 44-57, Jan. 2002.
[2] V. P. Pauca, J. Piper, and R. J. Plemmons, “Nonnegative matrix factorization for spectral
data analysis,” Elsevier Journal of Linear Algebra and Its Applications, vol. 416, no. 1, pp.
29-47, July 2006.
[3] M. B. Lopes, J. C. Wolff, J. B. Dias, and M. Figueiredo, “NIR hyperspectral unmixing based
on a minimum volume criterion for fast and accurate chemical characterisation of counterfeit
tablets,” Analytical Chemistry, vol. 82, no. 4, pp. 1462-1469, Jan. 2010.
[4] W. R. Johnson, D. W. Wilson, and W. Fink, “Snapshot hyperspectral imaging in opthomology,”
Journal of Biomedical Optics, published online on Feb. 2007.
[5] M. O. Smith, P. E. Johnson, and J. B. Adams, “Quantitative determination of mineral types
and abundances from reflectance spectra using principal component analysis,” Journal Geophys.
Res., vol. 90, no. 2, pp. C797-C804, Feb. 1985.
[6] A. A. Green, “A transformation for ordering multispectral data in terms of image quality with
implications for noise removal,” IEEE Trans. Geosci. Remote Sens., vol. 32, no. 1, pp. 65-74,
May 1988.
[7] I. K. Fodor, “A survey of dimension reduction techniques,” Techical Report, Lawrence Livermore
National Laboratory, May 2002.
[8] J. W. Boardman, F. A. Kruse, and R. O. Green, “Mapping target signatures via partial
unmixing of AVIRIS data,” in Proc. Summ. JPL Airborne Earth Sci. Workshop, Pasadena,
CA, Dec. 9-14, 1995, pp. 23-26.
[9] M. E.Winter, “N-findr: An algorithm for fast autonomous spectral end-member determination
in hyperspectral data,” in Proc. SPIE Conf. Imaging Spectrometry, Pasadena, CA, Oct. 1999,
pp. 266-275.
[10] C. I. Chang, C. C. Wu, W. M. Liu, and Y. C. Ouyang, “A new growing method for simplexbased
endmember extraction algorithm,” IEEE Trans. Geosci. Remote Sens., vol. 44, no. 10,
pp. 2804-2819, Oct. 2006.
[11] C. I. Chang, C. C. Wu, C. S. Lo, and M. L. Chang, “Real-time simplex growing algorithms for
hyperspectral endmember extraction,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 4, pp.
1834-1850, Apr. 2010.
[12] J. M. P. Nascimento and J. M. B. Dias, “Vertex component analysis: A fast algorithm to
unmix hyperspectral data,” IEEE Trans. Geosci. Remote Sens., vol. 43, no. 4, pp. 898-910,
Apr. 2005.
[13] T.-H. Chan, C.-Y. Chi, W.-K. Ma, and A. Ambikapathi “Hyperspectral unmixing from a
convex analysis and optimization perspective,” in Proc. First IEEE WHISPERS, Grenoble,
France, Aug. 26-28, 2009.
[14] T.-H. Chan, W.-K. Ma, A. Ambikapathi, and C.-Y. Chi, “A simplex volume maximization
framework for hyperspectral endmember extraction,” to appear in IEEE Trans. Geosci. Remote
Sens.- Special Issue on Spectral Unmixing of Remotely Sensed Data, 2011.
[15] D. Heinz and C.-I. Chang, “Fully constrained least squares linear mixture analysis for material
quantification in hyperspectral imagery,” IEEE Trans. Geosci. Remote Sens., vol. 39, no. 3,
pp. 529-545, Mar. 2001.
[16] M. D. Craig, “Minimum-volume transforms for remotely sensed data,” IEEE Trans. Geosci.
Remote Sens., vol. 32, no. 3, pp. 542-552, May 1994.
[17] M. Berman, H. Kiiveri, R. Lagerstrom, A. Ernst, R. Dunne, and J. F. Huntington, “ICE: A
statistical approach to identifying endmembers in hyperspectral images,” IEEE Trans. Geosci.
Remote Sens., vol. 42, no. 10, pp. 2085-2095, Oct. 2004.
[18] A. Zare and P. Gader, “PCE: Piecewise convex endmember detection,” IEEE Trans. Geosci.
Remote Sens., vol. 48, no. 6, pp. 2620-2632, June 2010.
[19] A. Zymnis, S.-J. Kim, J. Skaf, M. Parente, and S. Boyd, “Hyperspectral image unmixing via
alternating projected subgradients,” in Proc. 41st Asilomar Conf. Signals, Syst., Pacific Grove,
CA, Nov. 4-7, 2007, pp. 1164-1168.
[20] L. Miao and H. Qi, “Endmember extraction from highly mixed data using minimum volume
constrained nonnegative matrix factorization,” IEEE Trans. Geosci. Remote Sens., vol. 45, no.
3, pp. 765-777, Mar. 2007.
[21] A. Huck, M. Guillaume, and J. B. Talon, “Minimum dispersion constrained nonnegative matrix
factorization to unmix hyperspectral data,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 6,
pp. 2590-2602, June 2010.
[22] J. Li and J. Bioucas-Dias, “Minimum volume simplex analysis: A fast algorithm to unmix
hyperspectral data,” in Proc. IEEE Int. Geosci. Remote Sens. Symp., Boston, MA, Aug. 8-12,
2008, vol. 4, pp. 2369-2371.
[23] T.-H. Chan, C.-Y. Chi, Y.-M. Huang, and W.-K. Ma, “A convex analysis based minimumvolume
enclosing simplex algorithm for hyperspectral unmixing,” IEEE Trans. Signal Processing,
vol. 57, no. 11, pp. 4418-4432, Nov. 2009.
[24] A. Plaza, P. Martinez, R. Perez, and J. Plaza, “Spatial/spectral endmember extraction by
multidimensional morphological operations,” IEEE Trans. Geosci. Remote Sens., vol. 40, no.
9, pp. 2025-2041, Sep. 2002.
[25] M. Zortea and A. Plaza, “Spatial preprocessing for endmember extraction,” IEEE Trans.
Geosci. Remote Sens., vol. 47, no. 8, pp. 2679-2693, Aug. 2009.
[26] M. Parente and A. Plaza, “Survey of geometric and statistical unmixing algorithms for hyperspectral
images,” in Proc. Second IEEE WHISPERS, Reykjavik, Iceland, June 14-16, 2010.
[27] N. Dobigeon, S. Moussaoui, M. Coulon, J.-Y. Tourneret, and A. O. Hero, “Joint Bayesian
endmember extraction and linear unmixing for hyperspectral imagery,” IEEE Trans. Signal
Process., vol. 57, no. 11, pp. 4355-4368, Nov 2009.
[28] J. Bioucas-Dias, “A variable splitting augmented Lagrangian approach to linear spectral unmixing,”
in Proc. First IEEE WHISPERS, Grenoble, France, August 26-28, 2009.
[29] S. Boyd and L. Vandenberghe, Convex Optimization, UK: Cambridge Univ. Press, 2004.
[30] J. F. Sturm, “Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones”,
Optimization Methods and Software vol. 11-12, pp. 625-653, 1999.
[31] M. Grant and S. Boyd. CVX: Matlab software for disciplined convex programming, version
1.21. http://cvxr.com/cvx, Oct. 2010.
[32] MATLAB Optimization Toolbox - Version 7.6 (R2008a), The MathWorks, Inc., Natick, MA,
USA.
[33] P. Stoica, “Maximum likelihood parameter and rank estimation in reduced-rank multivariate
linear regressions,” IEEE Trans. Signal Processing, vol. 44, no. 12, pp. 3069-3078, Dec. 1996.
[34] C. Kuybeda, D. Malah, and M. Barzohar, “ Rank estimation and redundancy reduction of highdimensional
noisy signals with preservation of rare vectors,” IEEE Trans. Signal Processing,
vol. 55, no. 12, pp. 5579-5592, Dec. 2007.
[35] P. Stoica and Y. Selen, “Model-order selection: A review of information criterion rules,” IEEE
Signal Process. Mag., vol. 21, no. 4, pp. 36-47, July 2004.
[36] K. P. Burnham, Model selection and multimodel inference: A practical information theoretic
approach, Springer Publications, 2002.
[37] H. Akaike, “A new look at the statistical model identification,” IEEE Trans. Automat. Control,
vol. AC-19, no. 6, pp. 716-723, Dec. 1974.
[38] J. Rissanen, “Modeling by shortest data description,” Automatica, vol. 14, no. 5, pp. 465-471,
Sep. 1978.
[39] G. Schwarz, “Estimating the dimension of a model,” The Annals of Statistics, vol. 6, no. 2,
pp. 461-464, Mar. 1978.
[40] M. W. Graham and D. J. Miller, “Unsupervised learning of parsimonious mixtures on large
spaces with integrated feature and component selection,” IEEE Trans. Signal Processing, vol.
54, no. 4, pp. 1289-1303, April 2006.
[41] C.-I. Chang and Q. Du, “Estimation of number of spectrally distinct signal sources in hyperspectral
imagery,” IEEE Trans. Geosci. Remote Sens., vol. 42, no. 3, pp. 608-619, Mar.
2004.
[42] M. Wax and T. Kailath, “Detection of signals by information criteria,” IEEE Trans. Acoustics,
Speech, and Signal Process., vol. ASSP-33, pp. 387-392, April 1985.
[43] P. R. Peres-Neto, D. A. Jackson, and K. M. Somers, “How many principal components? stopping
rules for determining the number of non-trivial axes revisited,” Elsevier Journal of Comput.
Stat. and Data Analysis, vol. 49, pp. 974-997, July 2004.
[44] J. Harsanyi, W. Farrand, and C.-I Chang, “Determining the number and identity of spectral
endmembers: An integrated approach using Neyman-Pearson eigenthresholding and iterative
constrained RMS error minimization,” in Proc. 9th Thematic Conf. Geologic Remote Sensing,
Feb. 1993.
[45] J. M. B. Dias and J. M. P. Nascimento, “Hyperspectral subspace identification,” IEEE Trans.
Geosci. Remote Sens., vol. 46, no. 8, pp. 2435-2445, Aug. 2008.
[46] O. Eches, N. Dobigeon, and J.-Y. Tourneret, “Estimating the number of endmembers in hyperspectral
images using the normal compositional model and a hierarchical Bayesian algorithm,”
IEEE J. Sel. Topics Signal Processing, vol. 3, no. 3, pp. 582-591, June 2010.
[47] A. Ambikapathi, T.-H. Chan, W.-K.Ma, and C.-Y. Chi, “A robust minimum-volume enclosing
simplex algorithm for hyperspectral unmixing,” in Proc. IEEE ICASSP, Dallas, Texas, Mar.
14-19, 2010, pp. 1202-1205.
[48] A. Ambikapathi, T.-H. Chan, W.-K. Ma, and C.-Y. Chi, “A robust alternating volume maximization
algorithm for endmember extraction in hyperspectral images,” in Proc. IEEE WHISPERS,
Reykjavik, Iceland, June 14-16, 2010.
[49] M. T. Eismann and R. C. Hardie, “Application of the stochastic mixing model to hyperspectral
resolution enhancement,” IEEE Trans. Geosci. Remote Sens., vol. 42, no. 9, pp. 1924-1933,
Sep. 2004.
[50] G. Strang, Linear Algebra and Its Applications, CA: Thomson, 4th edition, 2006.
[51] Tech. Rep [Online]. Available: http://speclab.cr.usgs.gov/cuprite.html
[52] AVIRIS Data Products [Online]. Available: http://aviris.jpl.nasa.gov/html/aviris.
freedata.html
[53] R. N. Clark, G. A. Swayze, A. Gallagher, T. V. King, and W. M. Calvin, “The U.S. geological
survey digital spectral library: Version 1: 0.2 to 3.0,” U. S. Geol. Surv., Open File Rep. pp.
93-592, 1993.
[54] R. N. Clarke, and G. A. Swayze, “Evolution in imaging spectroscopy analysis and sensor signalto-
noise: An examination of how far we have come,” in Proc. 6th Annual JPL Airborne Earth
Science Workshop, Mar. 4-8, 1996.
[55] T. H. Chan, “Convex analysis based non-negative blind source separation for biomedical and
hyperspectral image analysis,” Ph.D. dissertation, National Tsing Hua Univ., Taiwan, 2009.
[56] J. M. P. Nascimento, “Unsupervised hyperspectral unmxing,” Ph.D. dissertation, Technical
University of Lisbon, Lisbon, 2006.
[57] T.-H. Chan, W.-K. Ma, C.-Y. Chi, and Y. Wang, “A convex analysis framework for blind
separation of non-negative sources,” IEEE Trans. Signal Processing, vol. 56, no. 10, pp. 5120-
5134, Oct. 2008.
[58] W.-K. Ma, T.-H. Chan, C.-Y. Chi, and Y. Wang, “Convex analysis for non-negative blind
source separation with application in imaging,” in Chapter 7, Convex Optimization in Signal
Processing and Communications, Editors: D. P. Palomar and Y. C. Eldar, UK: Cambridge
University Press, 2010.
[59] F.-Y. Wang, C.-Y. Chi, T.-H. Chan, and Y. Wang, “Nonnegative least-correlated component
analysis for separation of dependent sources by volume maximization,” IEEE Trans. Pattern
Analysis and Machine Intelligence, vol. 32, no. 5, pp. 875-888, May 2010.
[60] P. T. Boggs and J. W. Tolle, “Sequential quadratic programming,” Acta Numerica, pp. 1-51,
1996.
[61] S. Jia and Y. Qian “Constrained nonnegative matrix factorization for hyperspectral unmixing,”
IEEE Trans. Geosci. Remote Sens., vol. 47, no. 1, pp. 161-173, Jan. 2009.
[62] A. Ambikapathi, T.-H. Chan, W.-K. Ma, and C.-Y. Chi, “Chance constrained robust minimum
volume enclosing simplex algorithm for hyperspectral unmixing,” to appear in IEEE Trans.
Geosci. Remote Sens. - Special Issue on Spectral Unmixing of Remotely Sensed Data, 2011.
[63] L. C. Ludeman, Random Processes Filtering, Estimation, and Detection, Wiley-Interscience
Publication, 2003.
[64] M. Evans, N. Hastings, and B. Peacock, Statistical Distributions, 2nd ed., Wiley-Interscience
Publication, 1993.
[65] G. Arfken and H. Weber, Mathematical Methods for Physicists, Harcourt Academic Press,
2000.
[66] C.-I. Chang, W. Xiong, W. Liu, M.-L. Chang, C.-C. Wu, and C.-C. Chen, “Linear spectral
mixture analysis based approaches to estimation of virtual dimensionality in hyperspectral
imagery,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 3960-3979, Nov. 2010.
[67] M. E.Winter, “A proof of the N-FINDR algorithm for the automated detection of endmembers
in a hyperspectral image,” in Proc. SPIE Conf. Algorithms and Technologies for Multispectral,
Hyperspectral, and Ultraspectral Imagery, vol. 5425, Aug. 2004, pp. 31-41.
[68] C.-C. Wu, S. Chu, and C.-I. Chang, “Sequential N-FINDR algorithms,” Proc. of SPIE, vol.
7086, Aug. 2008, pp. 70860C1-70860C12.
[69] Q. Du, N. Raksuntorn, N. H. Younan, and R. L. King, “Variants of N-FINDR algorithm for
endmember extraction,” Proc. of SPIE, vol. 7109, Oct. 2008, pp. 71090G1-71090G8
[70] H. Ren and C.-I. Chang, “Automatic spectral target recognition in hyperspectral imagery,”
IEEE Trans. Aer. Elec. Sys., Vol. 39, no. 4, pp. 1232-1249, Oct. 2003.
[71] C.-I. Chang, W. Xiong, H.-M. Chen, and J.-W. Chai, “Maximum orthogonal subspace projection
appraoch to estimating the number of spectral signal sources in hyperspectral imagery,”
IEEE J. Sel. Topics Signal Processing, vol. 5, no. 3, pp. 504-520, June 2011.