研究生: |
柯軒造 Ke, Syuan-Zao |
---|---|
論文名稱: |
具帕爾曲線測試工作量分佈及變動點的軟體可靠度模型之量測與分析 Measurement and Analysis of Software Reliability Model with Parr-Curve Testing-Effort Distribution and Change-Points |
指導教授: |
黃慶育
Huang, Chin-Yu |
口試委員: |
蘇銓清
Sue, Chuan-Ching 林振緯 Lin, Jenn-Wei |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 資訊工程學系 Computer Science |
論文出版年: | 2012 |
畢業學年度: | 100 |
語文別: | 英文 |
論文頁數: | 58 |
中文關鍵詞: | 軟體可靠度成長模型 、測試心力函數 、非齊次蒲瓦松程序 、變動點 |
外文關鍵詞: | Software reliability growth model (SRGM), Testing-effort function, Non- homogeneous Poisson process (NHPP), Change-point |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在軟體測試階段,專案管理者需要精準的分配測試資源以滿足可接受的軟體品質並且減少測試成本。直到目前為止,有許多論文探討過測試成本預估的問題並且提出了許多模型,例如韋柏函數、瑞利函數和羅吉斯函數等等。在實務上,測試資源的消耗率深深受測試階段中一些無法預期的事件所影響。例如新測試人員的加入或是顧客要求產品提前完工。可惜的是,大部分的測試心力函數將測試資源消耗率視為常數。因此在此論文中,我們使用了變動點的概念改進帕爾曲線模型,並且預期此模型可以更有彈性的符合各種測試資源分配情形。另一方面,各種不同的測試資源分配深深影響著軟體可靠度的成長趨勢。因此,一個良好的測試心力函數可以提供充足的資源分配資訊來改善軟體可靠度成長模型的表現。在實驗中,我們以使用變動點的韋柏模型做為比較,並且檢驗軟體可靠度成長模型的效能,而這些軟體可靠度成長模型使用著我們提出的測試心力函數。為了確保實驗結果的正確性,我們使用了兩種參數估計方法,最小平方法以及最大概似估計法。最後我們使用提出的模型來討論最佳軟體釋放時間,並且基於可靠度以及測試成本這兩個限制來推導。
During software testing phase, the software manager has to accurately allocate testing resources to arrive at acceptable software quality and reduce the cost of testing. In the last twenty years, there have been many papers discussing the problem of testing-effort prediction, and also proposed many TEFs such as Weibull TEF, Rayleigh TEF and logistic TEF, etc. In practice, the testing effort consumption rate is strongly affected by unexpected events during the testing phase. For instance, the participation of new tester or the consumer advances the deadline, etc. However, most TEFs consider testing effort consumption rate as a constant value. Due to this reason, we proposed Parr curve TEF which incorporates the concept of multiple change points in the thesis, and expected the application of change points can make the Parr curve TEF more flexible to adapt to any situation of testing resource allocation. On the other hand, the testing resource allocation deeply influences the growth trend of software reliability. Thus a powerful TEF can provide sufficient testing-effort consumption information to enhance the capability of SRGMs. In the experiment, we compared to Weibull TEF with change points and examine the performance of SRGM with 1-CP Parr curve TEF. Besides, the 2-CP Parr curve is also implemented and induced in the experiment. In order to guarantee the correctness of experiment result, both parameter estimated methods are used, LSE & MLE. Finally, we discuss the policy of optimal release time based on the proposed SRGM. Dependent on constraints, reliability and testing cost, the optimal release time was induced.
[1] Pressman, R. S., Software Engineering: A Practitioner's Approach. McGraw- Hill, 2001.
[2] C. V. Ramamoorthy and F. B. Bastani, "Software reliability-Status and Perspectives,” IEEE Trans. on software engineering, vol. SE-8, no. 4, JULY 1982.
[3] C. Y. Huang and C. T. Lin, “Analysis of software reliability modeling considering testing compression factor and failure-to-fault relationship,” IEEE Trans. on Computers, vol. 59, no. 2, pp. 283–288, Feb.2010
[4] C. Y. Huang and M. R. Lyu, “Optimal testing resource allocation and sensitivity analysis in software development,” IEEE Trans. on Reliability, vol. 54, no. 4, pp. 592–603, Dec. 2005.
[5] Yamada, S., Hishitani, J., Osaki, S, “Software-reliability growth with a Weibull test-effort: a model & application,” IEEE Trans. on Reliability, vol. 42, no. 1, pp. 100-106, May. 1993.
[6] Huang, C. Y., Lyu, M. R., Kuo, S. Y., “A unified scheme of some non- homogenous Poisson process models for software reliability estimation,” IEEE Trans. on Software Engineering, vol. 29, no. 3, pp. 261-269, March 2003.
[7] Zhang, X., Pham, H., “Software field failure rate prediction before software deployment,” Journal of Systems and Software, vol. 79, no. 3, pp. 291-300.x, March 2006.
[8] Huang, C. Y., Lin, C. T., “Software reliability analysis by considering fault dependency and debugging time lag,” IEEE Transactions on Reliability, vol. 55, no. 3, pp. 36-450, Sept. 2006.
[9] Jeske, D. R., Zhang, X., “Some successful approaches to software reliability modeling in industry,” Journal of Systems and Software, vol. 74, no. 1, pp. 85-99, Jan. 2005.
[10] Z. Jelinski, P. B. Moranda, Software reliability research, in Statistical Computer Performance Evaluation, W. Freiberger, Ed., Academic Press, 1972, pp 465-484.
[11] P. B. Moranda, “Event-altered rate models for general reliability analysis,” IEEE Trans. Reliability, vol. R-28, pp. 376-381, Dec 1979.
[12] Camuffo, M., Maiocchi, M., Morselli, M., “Automatic software test generation,” Information and Software Technology, vol. 32, no. 5, pp. 337-346, Jun. 1990.
[13] Huang, C. Y., “Performance analysis of software reliability growth models with testing-effort and change-point,” Journal of Systems and Software, vol. 76, no. 2, pp. 181-194, 2005.
[14] Huang, C. Y., Kuo, S. Y., “Analysis of incorporating logistic testing-effort function into software reliability modeling,” IEEE Trans. on Reliability, vol. 51, no. 3, pp. 261-270, 2002.
[15] Musa, J. D., Iannino, A., Okumoto, K., Software Reliability, Measurement, Prediction and Application, McGraw-Hill, New York, 1987.
[16] Chang, Y. P., “Estimation of parameters for nonhomogeneous Poisson process software reliability with chang-point model,” Communications in Statistics– Simulation and Computation, vol. 30, no. 3, pp. 623-635, 2001.
[17] Shyur, H. J., “A Stochastic software reliability model with imperfect-debugging and change-point,” Journal of Systems and Software, vol. 66, no. 2, pp. 135-141, 2003.
[18] Zou, F. Z., “A change-point perspective on the software failure process,” Software Testing, Verification and Reliability, vol. 13, no. 2, pp. 85-93, 2003.
[19] Zhao, J., Liu, H. W., Cui, G, Yang, X. Z., “Software reliability growth model with change-point and environmental function,” Journal of Systems and Software, vol. 79, no. 11, pp. 1578-1587, 2006.
[20] F. Parr, “An Alternative to the Rayleigh Curve Model for Software Development Effort,” IEEE Trans. on Software Eng., vol. SE-6, no. 3, pp. 291-296, May 1980.
[21] C. Y. Huang, S. Y. Kuo and I. Y. Chen, “Analysis of a Software Reliability Growth Model with Logistic Testing-Effort Function,” in proceedings of the Eighth International Symposium on Software Reliability Engineering, pp. 378, 1997.
[22] S. Yamada, H. Ohtera, and H. Narihisa, “Software reliability growth models with testing-effort,” IEEE Trans. Reliability, vol. R-35, no. 1, pp. 19-23, Apr. 1986
[23] L. Putnam, "A macro estimating methodology for software development," in Proc. COMPCON 76, Washington, DC, Sept. 1976, pp.138-143.
[24] C. T. Lin and C. Y. Huang, “Enhancing and Measuring the Predictive Capabilities of the Testing-Effort Dependent Software Reliability Models,” Journal of Systems and Software, Vol. 81, Issue 6, pp. 1025-1038, June 2008
[25] Musa, J. D., Software Reliability Engineering: More Reliable Software, Faster and Cheaper, 2nd Edition. McGraw-Hill, 2004.
[26] Goel, A. L, Okumoto, K., “A time dependent error detection rate model for software reliability and other performance measures,” IEEE Trans. on Reliability, vol. R-28, no. 3, pp. 206-211, 1979.
[27] C. Y. Huang, S. Y. Kuo, and M. R. Lyu, “Optimal Software Release Policy Based on Cost, Reliability and Testing Efficiency,” Proceedings of the 23rd IEEE Annual International Computer Software and Applications Conference (COMPSAC'99), pp. 468-473, Oct. 1999
[28] M. Xie, “On the determination of optimum software release time,” in Proc. 2nd Int. Symp. on Software Reliability Engineering, 1991, pp. 218–224.
[29] P. K. Kapur and R. B. Garg, “Cost-reliability optimum release policies for a software system with TE,” International Journal of Systems Science, vol. 20, no. 12, pp. 2547–2562, 1989.
[30] Okumoto, K., Goel, A. L., “Optimal release time for software systems based on reliability and cost criteria,” Journal of Systems and Software, vol. 1, pp. 315-318, 1980.
[31] Tamura, Y., Yamada, S.., “A flexible stochastic differential equation model in distributed development environment,” European Journal of Operational Research, vol. 168, no. 1, pp. 143-152, 2006
[32] Jianfeng Yang, Zhouhui Deng, Rui Wang. “Web software reliability analysis with Yamada exponential testing-effort,” Process of IEEE Reliability, Maintainability and Safety (ICRMS), pp. 760-765, 2011.
[33] Jae Myung, “Tutorial on maximum likelihood estimation,” Journal of Mathematical Psychology, vol. 47, pp. 90-100, 2003.
[34] C. S. Kuo and C. Y. Huang, “A Study of Applying the Bounded Generalized Pareto Function to the Analysis of Software Fault Distribution,” Proceedings of the 2010 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM 2010), pp. 611-615
[35] Pillai, K., Nair, V. S. S., “A model for software development effort and cost estimation,” IEEE Trans. Software Engineering, vol. 23, no. 8, pp. 485-497, 1997.
[36] Lyu, M. R., Nikora, A., “Applying software reliability models more effectively,” IEEE Software, vol. 9, no. 4, pp. 43-52, 1992.
[37] Zhao, M., Xie, M., “On the log-power NHPP software reliability model,” in proceedings of the 3rd IEEE International Symposium on Software Reliability Engineering, Research Triangle Park, North Carolina, pp. 14-22, 1992.
[38] Li, P. L., Herbsleb, J., Shaw, M., Forecasting field defect rates using a combined time-based and metrics-based approach: A case study of OpenBSD. in proceedings of the 16th IEEE International Symposium on Software Reliability Engineering, Chicago, Illinois, pp. 193-202, 2005.
[39] Everitt, B.S., “The Cambridge Dictionary of Statistics,” Cambridge University Press International Symposium on Software Reliability Engineering (ISSRE'97), pp. 378-388, 2003.
[40] Hirotugu Akaike, “A New Look at the Statistical Model Identification,” IEEE Tran. Automatic Control, vol. AC-19, no. 6, December 1974.
[41] J. D. Musa, “Software Reliability Data, report and data base available from Data and Analysis Center for Software,” Rome Air Development Center, Rome, NY.
[42] Kazu Okumoto, Alcatel-Lucent. “Software Defect Prediction Based on Stability Test Data,” IEEE Quality, Reliability, Risk, Maintenance, and Safety Engineering (ICQR2MSE), pp. 385-387, 2011.
[43] S. Yamada, M. Ohba, and S. Osaki. “S-Shaped Reliability Growth Modeling for Software Error Detection,” IEEE Trans. Reliability, vol. R-32, no. 5, pp. 475-484, December, 1983.
[44] Yamada, S., Osaki, S., “Cost-reliability optimal release policies for software systems,” IEEE Trans. Reliability, vol. R-34, no. 5, pp. 422-424, 1985.