研究生: |
許兆榕 Hsu, Chao-Jung |
---|---|
論文名稱: |
Model-Based Effort and Reliability Measurement for Software Quality Assurance 基於工作量與可靠度量測模型之軟體品質保證研究 |
指導教授: |
黃慶育
Huang, Chin-Yu |
口試委員: |
黃慶育
Huang, Chin-Yu 王豐堅 Wang, Feng-Jian 陳朝欽 Chen, Chaur-Chin 張隆紋 Chang, Long-Wen 蘇銓清 Sue, Chuan-Ching |
學位類別: |
博士 Doctor |
系所名稱: |
電機資訊學院 - 資訊工程學系 Computer Science |
論文出版年: | 2011 |
畢業學年度: | 99 |
語文別: | 英文 |
論文頁數: | 149 |
中文關鍵詞: | 軟體專案管理 、軟體開發工作量預估 、軟體可靠度分析 、模組化軟體系統 、軟體品質保證 |
外文關鍵詞: | software project management, software effort estimation, software reliability analysis, modular software system, software quality assurance |
相關次數: | 點閱:3 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
During the planning phase of a new project, a challenge faced by software project managers is to predict software development effort and cost. The allocation of appropriate resources and the planning of reasonable schedules based on reliable estimations of effort then become necessary. Grey Relational Analysis (GRA) has been extensively used in the field of software effort estimation. However, we found that most of traditional GRA methods only consider non-weighted similarity measure for predicting software development effort. Therefore, this dissertation firstly proposes non-weighted, distance-based, correlative, linear, nonlinear, and maximal weights to be integrated into GRA for software effort estimation. The experimental results indicate that the weighted GRA performs better precision than the non-weighted GRA. The results also demonstrate that the weighted GRA can reduce the variance of predictions over other estimation techniques.
Software reliability analysis over testing and maintenance phases is performed by measuring the software quality before shipping a product. We have noticed that one of the most important parameters controlling software reliability growth is the fault reduction factor (FRF) proposed by Musa. During the software testing process, FRF could be influenced by many environmental factors, such as imperfect debugging, debugging time lag, etc. Thus, in this dissertation, we consider FRF to be a time-variable function and further study how to integrate time-variable FRF into software reliability growth modeling. Some experimental results show that the proposed models can improve the accuracy of software reliability estimation. Finally, the analytic results indicate that adjusting the value of FRF may affect the release time as well as the development cost.
For modular software systems, traditional software reliability methods are insufficient to analyze inter-component interactions of modular software systems. We propose an adaptive framework of incorporating path testing into reliability estimation for modular software systems. Three estimated methods based on common program structures, namely, sequence, branch, and loop structures, are proposed to calculate the path reliability. Consequently, the derived path reliabilities can be applied to the estimates of software reliability. Some experiments are performed based on two real systems and sensitivity analysis. Experimental results show that the path reliability has a high correlation to the actual software reliability. For software with loop structures, a smaller loop number can be assigned to derive an acceptable estimation of path reliability. Further, the sensitivity analysis can be used to identify critical modules and paths for resource allocation.
在軟體開發過程中,如何精確的預估軟體開發所需的工作量與成本往往是專案管理者面臨的最大挑戰;事實上,軟體開發工作量的預估為專案管理中一門重要的課題,亦如專案的人力資源分配與時程管理,都仰賴目前評估的軟體開發工作量度量值。過去幾年間,灰關聯分析方法(Grey Relational Analysis, GRA)已被廣泛應用於軟體開發工作量預估領域中,然而我們進而發現傳統的灰關聯分析方法只考慮未加權式相似度量(non-weighted similarity measure),因而容易造成不精確的預估結果。因此,本論文考量加權式相似度量,包含距離基準(distance-based)、關聯式(correlative)、線性關聯式(linear)、非線性關聯式(nonlinear)、與最大值基準(maximal)的加權式灰關聯分析方法;實驗的結果顯示,加權式灰關聯分析方法相較於未加權式灰關聯分析方法與其他預估方法擁有較精確的軟體開發工作量預估值,並且加權式灰關聯分析方法可以有效減少預估值的變異數。
軟體可靠度分析是一門基於量測軟體品質的科學研究,在軟體測試與維護過程之中,專案管理者可以採用軟體可靠度成長模型(Software Reliability Growth Model, SRGM)了解軟體錯誤行為發生與測試資源投入狀況,模型之中一個影響軟體可靠度成長的重要參數為錯誤減少因子(fault reduction factor, FRF),根據學者Musa的定義,錯誤減少因子為錯誤減少數(net fault reduction)與失效數(failures experienced)的比率,我們在軟體測試過程中發現錯誤減少因子容易受到許多測試因素影響,例如:不完美除錯(imperfect debugging)與除錯時間延遲(debugging time lag)等。因此,在本論文中,我們藉由分析許多軟體測試資料,進而提出整合時間變數的錯誤減少因子(time-variable FRF)於軟體可靠度成長模型之中;實驗結果顯示所提出的方法可以提昇軟體可靠度預估的精確度,並且敏感度分析顯示調整錯誤減少因子確實會影響釋放時程與開發成本。
於模組化軟體系統之中,由於往往所需的測試個案(test case)數量過多,傳統可靠度方法並不能有效分析模組間複雜地錯誤傳遞過程。因此,我們提出利用路徑測試(path testing)與可靠度評估於模組化軟體系統,基於序列式(sequence)、分支式(branch)、與廻圈(loop)式系統架構,我們提出的方法可適應(adaptive)於模組化軟體系統可靠度評估,進而在軟體開發早期分析路徑可靠度(path reliability);實驗過程採用二組系統真實個案研究與敏感度分析,結果顯示路徑可靠度和整體系統可靠度有著高度關聯性,若系統存在廻圈(loop)式系統架構,所提出的方法只需少量廻圈數即可得到準確的評估結果,此外,敏感度分析結果可用於找出系統架構中關鍵模組與路徑(critical module and path),並且幫助專案管理者做資源分配。
[Agrawal2007] M. Agrawal and K. Chari, "Software Effort, Quality, and Cycle Time: A Study of CMM Level 5 Projects," IEEE Transactions on Software Engineering,, vol. 33, no. 3, pp. 145-156, 2007.
[Almering2007] V. Almering, M. v. Genuchten, G. Cloudt, and P. J. M. Sonnemans, "Using Software Reliability Growth Models in Practice," IEEE Software, vol. 24, no. 6, pp. 82-88, 2007.
[Auer2006] M. Auer, A. Trendowicz, B. Graser, E. Haunschmid, and S. Biffl, "Optimal Project Feature Weights in Analogy-Based Cost Estimation: Improvement and Limitations," IEEE Transactions on Software Engineering, vol. 32, no. 2, pp. 83-92, 2006.
[Basili1984] V. R. Basili and B. T. Perricone, "Software Errors and Complexity: An Empirical Investigation," Communications of the ACM, vol. 27, no. 1, pp. 42-52, 1984.
[Becerra2009] R. L. Becerra, R. Sagarna, and X. Yao, "An Evaluation of Differential Evolution in Software Test Data Generation," IEEE Congress on Evolutionary Computation An Evaluation of Differential Evolution in Software Test Data Generation, pp. 2850-2857, Trondheim, Norway, 2009.
[Benediktsson2003] O. Benediktsson, D. Dalcher, K. Reed, and M. Woodman, "COCOMO-Based Effort Estimation for Iterative and Incremental Software Development," Software Quality Journal, vol. 11, no. 4, pp. 265-281, 2003.
[Boehm1981] B. Boehm, Software Engineering Economics, Prentice Hall, 1981.
[Boehm1995] B. Boehm, B. Clark, E. Horowitz, and C. Westland, "Cost Models for Future Software Life Cycle Processes: COCOMO 2.0," Annals of Software Engineering, vol. 1, no. 1, pp. 57-94, 1995.
[Briand2000] L. C. Briand, T. Langley, and I. Wieczorek, "A Replicated Assessment and Comparison of Common Software Cost Modeling Techniques," Proceedings of the 22nd International Conference on Software Engineering (ICSE 2000), pp. 377-386, Limerick, Ireland, 2000.
[Brocklehurst1990] S. Brocklehurst, P. Y. Chan, B. Littlewood, and J. Snell, "Recalibrating Software Reliability Models," IEEE Transactions on Software Engineering, vol. 16, no. 4, pp. 458-470, 1990.
[Bullen2003] P. S. Bullen, Handbook of means and their inequalities, 2nd edition, Kluwer Academic Publishers, 2003.
[Carnes1997] P. Carnes, "Software Reliability in Weapon Systems," Proceedings of the 8th International Symposium on Software Reliability Engineering (ISSRE 1997), pp. 114-115, Albuquerque, NM, USA, 1997.
[Chang2009] Y. C. Chang and C. T. Liu, "A Generalized JM Model with Applications to Imperfect Debugging in Software Reliability," Applied Mathematical Modelling, vol. 33, no. 9, pp. 3578-3588, 2009.
[Chen2006] C. C. Chen, C. T. Lin, H. H. Huang, S. W. Huang, and C. Y. Huang, "CARATS: A Computer-Aided Reliability Assessment Tool for Software Based on Object-Oriented Design," Proceedings of IEEE Region 10 Conference (TENCON 2006), pp. 1-4, Hong Kong, China, 2006.
[Chen2001a] M. C. Chen, H. P. Wu, and H. J. Shyur, "Analyzing Software Reliability Growth Model with Imperfect-Debugging and Change-Point by Genetic Algorithms," Proceedings of the 29th International Conference on Computers and Industrial Engineering (ICC&IE 2001), pp. 520-526, Montreal, Canada, 2001a.
[Chen2001b] M. H. Chen, M. R. Lyu, and W. E. Wong, "Effect of Code Coverage on Software Reliability Measurement," IEEE Transactions on Reliability, vol. 50, no. 2, pp. 165-170, 2001b.
[Chen2005] Z. Chen, T. Menzies, D. Port, and B. Boehm, "Finding the Right Data for Software Cost Modeling," IEEE Software, vol. 22, no. 6, pp. 38-46, 2005.
[Cheung1980] R. C. Cheung, "A User-Oriented Software Reliability Model," IEEE Transactions on Software Engineering, vol. SE-6, no. 2, pp. 118-125, 1980.
[Chiu2008] K. C. Chiu, Y. S. Huang, and T. Z. Lee, "A Study of Software Reliability Growth from the Perspective of Learning Effects," Reliability Engineering and System Safety, vol. 93, no. 10, pp. 1410-1421, 2008.
[Chiu2007] N. H. Chiu and S. J. Huang, "The Adjusted Analogy-Based Software Effort Estimation Based on Similarity Distances," Journal of Systems and Software, vol. 80, no. 4, pp. 628-640, 2007.
[Clarke2003] J. Clarke, J. J. Dolado, M. Harman, R. Hierons, B. Jones, M. Lumkin, B. Mitchell, S. Mancoridis, K. Rees, M. Roper, and M. Shepperd, "Reformulating Software Engineering as a Search Problem," IEE Proceedings - Software, vol. 150, no. 3, pp. 161-175, 2003.
[Conte1986] S. D. Conte, H. E. Dunsmore, and V. Y. Shen, Software Engineering Metrics and Models, Benjamin Cummings Publishing Company, 1986.
[Costa2010] E. O. Costa, A. Pozo, and S. R. Vergilio, "A Genetic Programming Approach for Software Reliability Modeling," IEEE Transactions on Reliability, vol. 59, no. 1, pp. 222-230, 2010.
[Dai2003] Y. S. Dai, M. Xie, K. L. Poh, and B. Yang, "Optimal Testing-Resource Allocation with Genetic Algorithm for Modular Software Systems," Journal of Systems and Software, vol. 66, no. 1, pp. 47-55, 2003.
[Deb2009] K. Deb, S. Gupta, D. Daum, J. Branke, A. K. Mall, and D. Padmanabhan, "Reliability-Based Optimization Using Evolutionary Algorithms," IEEE Transactions on Evolutionary Computation, vol. 13, no. 5, pp. 1054-1074, 2009.
[Deng1982] J. L. Deng, "Control Problems of Grey Systems," Systems and Control Letters, vol. 1, no. 5, pp. 288-294, 1982.
[Deng1989] J. L. Deng, "Introduction to Grey System Theory," The Journal of Grey System, vol. 1, no. 1, pp. 1-24, 1989.
[Deng2000] J. L. Deng, Theory and Approach of Grey System, Taipei Cau Lih Inc., 2000.
[Dengiz1997] B. Dengiz, F. Altiparmak, and A. E. Smith, "Local Search Genetic Algorithm for Optimal Design of Reliable Networks," IEEE Transactions on Evolutionary Computation, vol. 1, no. 3, pp. 179-188, 1997.
[Desharnais1989] J. M. Desharnais, Analyse statistique de la productivitie des projets informatique a partie de la technique des point des fonction, Masters Thesis, University of Montreal, Quebec, Canada, 1989.
[Dolado2001] J. J. Dolado, "On the Problem of the Software Cost Function," Information and Software Technology, vol. 43, no. 1, pp. 61-72, 2001.
[Ehrlich1990] W. K. Ehrlich, K. Lee, and R. H. Molisani, "Applying Reliability Measurements: A Case Study," IEEE Software, vol. 7, no. 2, pp. 56-64, 1990.
[Ejiogu2005] L. O. Ejiogu, Software Metrics: The Discipline of Software Quality, 1st edition, BookSurge Publishing, 2005.
[Fenton1998] N. E. Fenton and S. L. Pfleeger, Software Metrics: A Rigorous and Practical Approach, 2nd edition, PWS Publishing, 1998.
[Foss2003] T. Foss, E. Stensrud, B. Kitchenham, and I. Myrtveit, "A Simulation Study of the Model Evaluation Criterion MMRE," IEEE Transactions on Software Engineering, vol. 29, no. 11, pp. 985-995, 2003.
[Freedman1997] D. Freedman, R. Pisani, and R. Purves, Statistics, 3rd edition, W. W. Norton, 1997.
[Friedman1995] M. A. Friedman, P. Y. Tran, and P. L. Goddard, Reliability of Software Intensive Systems, Noyes Publications, 1995.
[Fries1977] M. J. Fries, Software Error Data Acquisition, Technical Report, Rome Air Development Center, 1977, RADC-TR-77-130.
[Goel1985] A. L. Goel, "Software Reliability Models: Assumptions, Limitations, and Applicability," IEEE Transactions on Software Engineering, vol. 11, no. 12, pp. 1411-1423, 1985.
[Gokhale2007] S. S. Gokhale, "Architecture-Based Software Reliability Analysis: Overview and Limitations," IEEE Transactions on Dependable and Secure Computing, vol. 4, no. 1, pp. 32-40, 2007.
[Gokhale2005] S. S. Gokhale and M. R. T. Lyu, "A Simulation Approach to Structure-Based Software Reliability Analysis," IEEE Transactions on Software Engineering, vol. 31, no. 8, pp. 643-656, 2005.
[Gokhale2002] S. S. Gokhale and K. S. Trivedi, "Reliability Prediction and Sensitivity Analysis Based on Software Architecture," Proceedings of the 13th International Symposium on Software Reliability Engineering (ISSRE 2002), pp. 64-75, Annapolis, MD, USA, 2002.
[Gokhale2004] S. S. Gokhale, W. E. Wong, J. R. Horgan, and K. S. Trivedi, "An Analytical Approach to Architecture-based Software Performance and Reliability Prediction," Performance Evaluation, vol. 58, no. 4, pp. 391-412, 2004.
[Gokhale1998] S. S. Gokhale, W. E. Wong, K. S. Trivedi, and J. R. Horgan, "An Analytical Approach to Architecture-Based Software Reliability Prediction," Proceedings of the 3rd International Computer Performance and Dependability Symposium (IPDS 1998), pp. 13-22, 1998.
[Goldberg1989] D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, 1989.
[Hamilton1978] P. A. Hamilton and J. D. Musa, "Measuring Reliability of Computation Center Software," Proceedings of the 3rd International Conference on Software Engineering (ICSE 1978), pp. 29-36, Atlanta, GA, USA, 1978.
[Harman2001] M. Harman and B. F. Jones, "Search-Based Software Engineering," Information and Software Technology, vol. 43, no. 14, pp. 833-839, 2001.
[Hindi2002] K. S. Hindi, H. Yang, and K. Fleszar, "An Evolutionary Algorithm for Resource-Constrained Project Scheduling," IEEE Transactions on Evolutionary Computation, vol. 6, no. 5, pp. 512-518, 2002.
[Hogg1995] R. V. Hogg and A. T. Craig, Introduction to Mathematical Statistics, 5th edition, Prentice Hall, 1995.
[Hsu2006] C. J. Hsu and C. Y. Huang, "Comparison and Assessment of Improved Grey Relation Analysis for Software Development Effort Estimation," Proceedings of the 3rd International Conference on Management of Innovation and Technology (ICMIT 2006), pp. 663-667, Singapore, 2006.
[Hsu2007] C. J. Hsu and C. Y. Huang, "Improving Effort Estimation Accuracy by Weighted Grey Relational Analysis During Software Development," Proceedings of the 14th Asia-Pacific Software Engineering Conference (APSEC 2007), pp. 534-541, Nagoya, Japan, 2007.
[Hsu2009] C. J. Hsu and C. Y. Huang, "Reliability Analysis Using Weighted Combinational Models for Web-based Software," Proceedings of the 18th International World Wide Web Conference (WWW 2009), pp. 1131-1132, Madrid, Spain, 2009.
[Hsu2010] C. J. Hsu and C. Y. Huang, "A Study on the Applicability of Modified Genetic Algorithms for the Parameter Estimation of Software Reliability Modeling," Proceedings of the 34th IEEE International Computer Software and Applications Conference (COMPSAC 2010), pp. 531-540, Seoul, South Korea, 2010.
[Huang2005] C. Y. Huang, "Cost-Reliability-Optimal Release Policy for Software Reliability Models Incorporating Improvements in Testing Efficiency," Journal of Systems and Software, vol. 77, no. 2, pp. 139-155, 2005.
[Huang2006a] C. Y. Huang and C. T. Lin, "Software Reliability Analysis by Considering Fault Dependency and Debugging Time Lag," IEEE Transactions on Reliability, vol. 55, no. 3, pp. 436-450, 2006a.
[Huang2010] C. Y. Huang and C. T. Lin, "Analysis of Software Reliability Modeling Considering Testing Compression Factor and Failure-to-Fault Relationship," IEEE Transactions on Computers, vol. 59, no. 2, pp. 283-288, 2010.
[Huang2003] C. Y. Huang, M. R. Lyu, and S. Y. Kuo, "A Unified Scheme of Some Nonhomogenous Poisson Process Models for Software Reliability Estimation," IEEE Transactions on Software Engineering, vol. 29, no. 3, pp. 261-269, 2003.
[Huang2006b] S. J. Huang and N. H. Chiu, "Optimization of Analogy Weights by Genetic Algorithm for Software Effort Estimation," Information and Software Technology, vol. 48, no. 11, pp. 1034-1045, 2006b.
[Huang2008] S. J. Huang, N. H. Chiu, and L. W. Chen, "Integration of the Grey Relational Analysis with Genetic Algorithm for Software Effort Estimation," European Journal of Operational Research, vol. 188, no. 3, pp. 898-909, 2008.
[ISBSG2006] ISBSG, www.isbsg.org.
[Jørgensen2003] M. Jørgensen, U. Indahl, and D. Sjøberg, "Software Effort Estimation by Analogy and “Regression Toward the Mean”," Journal of Systems and Software, vol. 68, no. 3, pp. 253-262, 2003.
[Jørgensen2007] M. Jørgensen and M. Shepperd, "A Systematic Review of Software Development Cost Estimation Studies," IEEE Transactions on Software Engineering,, vol. 33, no. 1, pp. 33-53, 2007.
[Jeffery2000] R. Jeffery, M. Ruhe, and I. Wieczorek, "A Comparative Study of Two Software Development Cost Modeling Techniques Using Multi-Organizational and Company-Specific Data," Information and Software Technology, vol. 42, no. 14, pp. 1009-1016, 2000.
[Jeffery2001] R. Jeffery, M. Ruhe, and I. Wieczorek, "Using Public Domain Metrics to Estimate Software Development Effort," Proceedings of the 7th International Symposium on Software Metrics (METRICS 2001), pp. 16-27, London, UK, 2001.
[Jeske2005] D. R. Jeske, Z. Xuemei, and L. Pham, "Adjusting Software Failure Rates That Are Estimated From Test Data," IEEE Transactions on Reliability, vol. 54, no. 1, pp. 107-114, 2005.
[Jiang2007] H. Y. Jiang, C. K. Chang, D. Zhu, and S. Cheng, "A Foundational Study on the Applicability of Genetic Algorithm to Software Engineering Problems," IEEE Congress on Evolutionary Computation (CEC 2007), pp. 2210-2219, Singapore, 2007.
[Johnson2005] V. E. Johnson, A. Moosman, and P. Cotter, "A Hierarchical Model for Estimating the Early Reliability of Complex Systems," IEEE Transactions on Reliability, vol. 54, no. 2, pp. 224-231, 2005.
[Jones1996] C. Jones, "Software Defect-Removal Efficiency," IEEE Computer, vol. 29, no. 4, pp. 94-95, 1996.
[Jones1991] W. D. Jones, "Reliability Models for Very Large Software Systems in Industry," Proceedings of the 2nd International Symposium on Software Reliability Engineering (ISSRE 1991), pp. 35-42, Austin, TX, USA, 1991.
[Jorgensen2008] P. C. Jorgensen, Software Testing: A Craftman's Approach, 3rd edition, Auerbach Publications, 2008.
[Kadoda2000] G. Kadoda, M. Cartwright, L. Chen, and M. J. Shepperd, Experiences Using Case-Based Reasoning to Predict Software Project Effort, Empirical Software Engineering Research Group at Bournemouth University, 2000, TR00-01.
[Kapur2008] P. K. Kapur, D. N. Goswami, A. Bardhan, and O. Singh, "Flexible Software Reliability Growth Model with Testing Effort Dependent Learning Process," Applied Mathematical Modelling, vol. 32, no. 7, pp. 1298-1307, 2008.
[Keller2008] G. Keller, Statistics for Management and Economics, 8th edition, South-Western College, 2008.
[Kemerer1987] C. F. Kemerer, "An Empirical Validation of Software Cost Estimation Models," Communications of the ACM, vol. 30, no. 5, pp. 416-429, 1987.
[Keung2007] J. W. Keung and B. Kitchenham, "Optimising Project Feature Weights for Analogy-Based Software Cost Estimation Using the Mantel Correlation," Proceedings of the 14th Asia-Pacific Software Engineering Conference (APSEC 2007), pp. 222-229, Nagoya, Japan, 2007.
[Khoshgoftaar1991] T. M. Khoshgoftaar and T. G. Woodcock, "Software Reliability Model Selection: a Case Study," Proceedings of the 2nd IEEE International Symposium on Software Reliability Engineering (ISSRE 1991), pp. 183-191, Austin, TX, USA, 1991.
[Khoshgoftaar2004] T. M. Khoshgoftaar, L. Yi, and S. N., "A Multiobjective Module-Order Model for Software Quality Enhancement," IEEE Transactions on Evolutionary Computation, vol. 8, no. 6, pp. 593-608, 2004.
[Kibria2007] B. M. G. Kibria and S. Nadarajah, "Reliability Modeling: Linear Combination and Ratio of Exponential and Rayleigh," IEEE Transactions on Reliability, vol. 56, no. 1, pp. 102-105, 2007.
[Korte2008] M. Korte and D. Port, "Confidence in Software Cost Estimation Results Based on MMRE and PRED," Proceedings of the 4th International Workshop on Predictor Models in Software Engineering (ICSE 2008), pp. 63-70, Leipzig, Germany, 2008.
[Krishnamurthy1997] S. Krishnamurthy and A. P. Mathur, "On the Estimation of Reliability of a Software System Using Reliabilities of Its Components," Proceedings of the 8th International Symposium on Software Reliability Engineering (ISSRE 1997), pp. 146-155, Albuquerque, NM, USA, 1997.
[Kubat1989] P. Kubat, "Assessing Reliability of Modular Software," Operation Research Letters, vol. 8, no. 1, pp. 35-41, 1989.
[Leung2002] H. K. N. Leung, "Estimating Maintenance Effort by Analogy," Empirical Software Engineering, vol. 7, no. 2, pp. 157-175, 2002.
[Li2006] J. Li and G. Ruhe, "A Comparative Study of Attribute Weighting Heuristics for Effort Estimation by Analogy," Proceedings of the 5th International Symposium on Empirical Software Engineering (ISESE 2006), pp. 66-74, Rio de Janeiro, Brazil, 2006.
[Li2007a] J. Li, G. Ruhe, A. Al-Emran, and M. M. Richter, "A Flexible Method for Software Effort Estimation by Analogy," Empirical Software Engineering, vol. 12, no. 1, pp. 65-106, 2007a.
[Li2007b] M. Li, Y. Yang, Q. Wang, and M. He, "COGOMO - An Extension of COCOMO II for China Government Contract Pricing," Proceedings of the 22th International Annual Forum on COCOMO and Systems/Software Cost Modeling (COSYSMO 2007), USC Campus, Los Angeles, CA, USA, 2007b.
[Li1996] N. Li and Y. K. Malaiya, "Fault Exposure Ratio Estimation and Applications," Proceedings of the 7th International Symposium on Software Reliability Engineering (ISSRE 1996), pp. 372-381, White Plains, NY, USA, 1996.
[Li2005] P. L. Li, J. Herbsleb, and M. Shaw, "Forecasting Field Defect Rates Using a Combined Time-Based and Metrics-Based Approach: A Case Study of OpenBSD," Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering (ISSRE 2005), pp. 193-202, Chicago, IL, USA, 2005.
[Li2010] X. Li, M. Xie, and S. H. Ng, "Sensitivity Analysis of Release Time of Software Reliability Models Incorporating Testing Effort with Multiple Change-Points," Applied Mathematical Modelling, vol. In Press, pp. doi:10.1016/j.apm.2010.1003.1000, 2010.
[Li2009a] Y. F. Li, M. Xie, and T. N. Goh, "A Study of Mutual Information Based Feature Selection for Case Based Reasoning in Software Cost Estimation," Expert Systems with Applications, vol. 36, no. 3, Part 2, pp. 5921-5931, 2009a.
[Li2009b] Y. F. Li, M. Xie, and T. N. Goh, "A Study of Project Selection and Feature Weighting for Analogy Based Software Cost Estimation," Journal of Systems and Software, vol. 82, no. 2, pp. 241-252, 2009b.
[Lin2008] C. T. Lin and C. Y. Huang, "Enhancing and Measuring the Predictive Capabilities of Testing-Effort Dependent Software Reliability Models," Journal of Systems and Software, vol. 81, no. 6, pp. 1025-1038, 2008.
[Littlewood1979] B. Littlewood, "Software Reliability Model for Modular Program Structure," IEEE Transactions on Reliability, vol. R-28, no. 3, pp. 241-246, 1979.
[Littlewood1973] B. Littlewood and J. L. Verall, "A Bayesian Reliability Growth Model for Computer Software," Applied Statistics, vol. 22, no. 3, pp. 332-346, 1973.
[Liu2008] Q. Liu, W. Z. Qin, R. Mintram, and M. Ross, "Evaluation of Preliminary Data Analysis Framework in Software Cost Estimation based on ISBSG R9 Data," Software Quality Journal, vol. 16, no. 3, pp. 411-458, 2008.
[Liu2006] S. Liu and Y. Lin, Grey Information: Theory and Practical Applications, 1st edition, Springer, 2006.
[Lo2006] J. H. Lo and C. Y. Huang, "An Integration of Fault Detection and Correction Processes in Software Reliability Analysis," Journal of Systems and Software, vol. 79, no. 9, pp. 1312-1323, 2006.
[Lo2005] J. H. Lo, C. Y. Huang, I. Y. Chen, S. Y. Kuo, and M. R. Lyu, "Reliability Assessment and Sensitivity Analysis of Software Reliability Growth Modeling Based on Software Module Structure," Journal of Systems and Software, vol. 76, no. 1, pp. 3-13, 2005.
[Lo2003] J. H. Lo, C. Y. Huang, S. Y. Kuo, and M. R. Lyu, "Sensitivity Analysis of Software Reliability for Component-Based Software Applications," Proceedings of the 27th International Computer Software and Applications Conference (COMPSAC 2003), pp. 500-505, Dallas, TX, USA, 2003.
[Lo2002] J. H. Lo, S. Y. Kuo, M. R. Lyu, and C. Y. Huang, "Optimal Resource Allocation and Reliability Analysis for Component-Based Software Applications," Proceedings of the 26th International Computer Software and Applications Conference (COMPSAC 2002), pp. 7-12, Oxford, England, 2002.
[Lu1993] M. Lu, S. Brocklehurst, and B. Littlewood, "Combination of Predictions Obtained from Different Software Reliability Growth Models," Journal of Computer and Software Engineering, vol. 1, no. 4, pp. 303-323, 1993.
[Lyu1996] M. R. Lyu, Handbook of Software Reliability Engineering, McGraw-Hill, 1996.
[Lyu1992] M. R. Lyu and A. Nikora, "Applying Reliability Models More Effectively," IEEE Software, vol. 9, no. 4, pp. 43-52, 1992.
[Malaiya2002] Y. K. Malaiya, M. N. Li, J. M. Bieman, and R. Karcich, "Software Reliability Growth with Test Coverage," IEEE Transactions on Reliability, vol. 51, no. 4, pp. 420-426, 2002.
[Malaiya1993] Y. K. Malaiya, A. von Mayrhauser, and P. K. Srimani, "An Examination of Fault Exposure Ratio," IEEE Transactions on Software Engineering, vol. 19, no. 11, pp. 1087-1094, 1993.
[Marir1994] F. Marir and I. Watson, "Case-Based Reasoning: A Categorized Bibliography," The Knowledge Engineering Review, vol. 9, no. 4, pp. 355-381, 1994.
[Mazzuchi1988] T. A. Mazzuchi and R. Soyer, "A Bayes Empirical-Bayes Model for Software Reliability," IEEE Transactions on Reliability, vol. 37, no. 2, pp. 248-254, 1988.
[McCall1977] J. McCall, P. Richards, and G. Walters, Factors in Software Quality, NTIS AD-A049-014-015-055, November, 1977.
[Mendes2005] E. Mendes, C. Lokan, R. Harrison, and C. Triggs, "A Replicated Comparison of Cross-Company and Within-Company Effort Estimation Models Using the ISBSG Database," Proceedings of the 11th International Symposium on Software Metrics (METRICS 2005), pp. 36-45, Como, Italy, 2005.
[Mendes2002a] E. Mendes, N. Mosley, and S. Counsell, "The Application of Case-Based Reasoning to Early Web Project Cost Estimation," Proceedings of the 26th International Computer Software and Applications Conference (COMPSAC 2002), pp. 393-398, Oxford, England, 2002a.
[Mendes2002b] E. Mendes, I. Watson, C. Triggs, N. Mosley, and S. Counsell, "A Comparison of Development Effort Estimation Techniques for Web Hypermedia Application," Proceedings of the 8th International Symposium on Software Metrics (METRICS 2002), pp. 131-140, Ottawa, Canada, 2002b.
[Minohara1995] T. Minohara and Y. Tohma, "Parameter Estimation of Hyper-Geometric Distribution Software Reliability Growth Model by Genetic Algorithms," Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering (ISSRE 1995), pp. 324-329, Toulouse, France, 1995.
[Misra1991] K. B. Misra and U. Sharma, "An Efficient Algorithm To Solve Integer-Programming Problems Arising In System-Reliability Design," IEEE Transactions on Reliability, vol. 40, no. 1, pp. 81-91, 1991.
[Mitchell1998] M. Mitchell, An Introduction to Genetic Algorithms, The MIT Press, 1998.
[Musa1975] J. D. Musa, "A Theory of Software Reliability and Its Application," IEEE Transactions on Software Engineering, vol. SE-1, no. 3, pp. 312-327, 1975.
[Musa1980] J. D. Musa, "The Measurement and Management of Software Reliability," Proceedings of the IEEE, vol. 68, no. 9, pp. 1131-1143, 1980.
[Musa1991] J. D. Musa, "Rationale for Fault Exposure Ratio K," ACM SIGSOFT Software Engineering Notes, vol. 16, no. 3, pp. 79, 1991.
[Musa1993] J. D. Musa, "Operational Profiles in Software-Reliability Engineering," IEEE Software, vol. 10, no. 2, pp. 14-32, 1993.
[Musa2004] J. D. Musa, Software Reliability Engineering: More Reliable Software, Faster and Cheaper, 2nd edition, Authorhouse, 2004.
[Musa1987] J. D. Musa, A. Iannino, and K. Okumoto, Software Reliability: Measurement, Prediction, Application, McGraw-Hill, 1987.
[Myers2004] G. J. Myers, The Art of Software Testing, 2nd edition, John Wiley and Sons, 2004.
[Nelson1978] E. Nelson, "Estimating Software Reliability from Test Data," Microelectronics and Reliability, vol. 17, no. 1, pp. 67-73, 1978.
[Ohba1984] M. Ohba, "Software Reliability Analysis Models," IBM Journal of Research and Development, vol. 28, no. 4, pp. 428-443, 1984.
[Ohba1989] M. Ohba and X. M. Chou, "Does Imperfect Debugging Affect Software Reliability Growth?," Proceedings of the 11th IEEE International Conference on Software Engineering (ICSE 1989), pp. 237-244, Pittsburgh, PA, USA, 1989.
[Pasquini1996] A. Pasquini, A. N. Crespo, and P. Matrella, "Sensitivity of Reliability-Growth Models to Operational Profile Errors vs Testing Accuracy," IEEE Transactions on Reliability, vol. 45, no. 4, pp. 531-540, 1996.
[Pham2000] H. Pham, Software Reliability, Springer, 2000.
[Pietrantuono2010] R. Pietrantuono, S. Russo, and K. S. Trivedi, "Software Reliability and Testing Time Allocation: An Architecture-Based Approach," IEEE Transactions on Software Engineering, vol. 36, no. 3, pp. 323-337, 2010.
[Popic2005] P. Popic, D. Desovski, W. Abdelmoez, and B. Cukic, "Error Propagation in the Reliability Analysis of Component Based Systems," Proceedings of the16th IEEE International Symposium on Software Reliability Engineering (ISSRE 2005), pp. 53-62, Chicago, IL, USA, 2005.
[Port2008] D. Port and M. Korte, "Comparative Studies of the Model Evaluation Criterions MMRE and PRED in Software Cost Estimation Research," Proceedings of the 2nd ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2008), pp. 51-60, Kaiserslautern, Germany, 2008.
[Pressman2009] R. S. Pressman, Software Engineering: A Practitioner's Approach, 7th edition, McGraw-Hill, 2009.
[Saglietti2009] F. Saglietti, F. Pinte, and S. Söhnlein, "Integration and Reliability Testing for Component-Based Software Systems," Proceedings of the 35th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2009), pp. 368-374, 2009.
[Samson1997] B. Samson, D. Ellison, and P. Dugard, "Software Cost Estimation Using An Albus perceptron (CMAC)," Information and Software Technology, vol. 39, no. 1, pp. 55-60, 1997.
[Schach1993] S. R. Schach, Software Engineering, 2nd edition, Richard D. Irwin, Inc. and Aksen Associates, Inc., 1993.
[Schneidewind2009] N. Schneidewind, "Integrating Testing with Reliability," Software Testing, Verification and Reliability, vol. 19, no. 3, pp. 175-198, 2009.
[Schneidewind1992a] N. F. Schneidewind and T. W. Keller, "Application of Reliability Models to the Space Shuttle," IEEE Software, vol. 9, no. 4, pp. 28-33, 1992a.
[Schneidewind1992b] N. F. Schneidewind and T. W. Keller, "Applying Reliability Models to the Space Shuttle," IEEE Software, vol. 9, no. 4, pp. 28-33, 1992b.
[Shepperd1997] M. Shepperd and C. Schofield, "Estimating Software Project Effort Using Analogies," IEEE Transactions on Software Engineering, vol. 23, no. 11, pp. 736-743, 1997.
[Shooman1976] M. L. Shooman, "Structural Models for Software Reliability Prediction," Proceedings of the 2nd International Conference on Software Engineering (ICSE 1976), pp. 268-280, San Francisco, California, USA, 1976.
[Shyur2003] H. J. Shyur, "A Stochastic Software Reliability Model with Imperfect-Debugging and Change-Point," Journal of Systems and Software, vol. 66, no. 2, pp. 135-141, 2003.
[Smith2001] R. K. Smith, J. E. Hale, and A. S. Parrish, "An Empirical Study Using Task Assignment Patterns to Improve the Accuracy of Software Effort Estimation," IEEE Transactions on Software Engineering, vol. 27, no. 3, pp. 264-271, 2001.
[Soltoggio2005] A. Soltoggio, "An Enhanced GA to Improve the Search Process Reliability in Tuning of Control Systems," Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation (GECCO 2005), pp. 2165-2172, Washington DC, USA, 2005.
[Song2005] Q. Song, M. Shepperd, and C. Mair, "Using Grey Relational Analysis to Predict Software Effort with Small Data Sets," Proceedings of the 11th International Symposium on Software Metrics (METRICS 2005), Como, Italy, 2005.
[SourceForge2008] SourceForge, http://sourceforge.net, Last Access Date: 2009 Dec. 11.
[Srinivasan1995] K. Srinivasan and D. Fisher, "Machine Learning Approaches to Estimating Software Development Effort," IEEE Transactions on Software Engineering, vol. 21, no. 2, pp. 126-137, 1995.
[Steward2006] J. Steward, Essential Calculus, 1st edition, Brooks Cole, 2006.
[Su2007] Y. S. Su and C. Y. Huang, "Neural-Network-Based Approaches for Software Reliability Estimation Using Dynamic Weighted Combinational Models," Journal of Systems and Software, vol. 80, no. 4, pp. 606-615, 2007.
[Tamura2006] Y. Tamura and S. Yamada, "A Flexible Stochastic Differential Equation Model in Distributed Development Environment," European Journal of Operational Research, vol. 168, no. 1, pp. 143-152, 2006.
[Tian2004] J. Tian, S. Rudraraju, and Z. Li, "Evaluating Web Software Reliability Based on Workload and Failure Data Extracted from Server Logs," IEEE Transactions on Software Engineering, vol. 30, no. 11, pp. 754-769, 2004.
[Tohma1989] Y. Tohma, R. Jacoby, Y. Murata, and M. Yamamoto, "Hyper-Geometric Distribution Model to Estimate the Number of Residual Software Faults," Proceedings of the 13th IEEE Annual International Computer Software and Applications Conference (COMPSAC 1989), pp. 610-617, Orlando, FL, USA, 1989.
[Tseng2009] L. Y. Tseng and S. C. Chen, "Two-Phase Genetic Local Search Algorithm for the Multimode Resource-Constrained Project Scheduling Problem," IEEE Transactions on Evolutionary Computation, vol. 13, no. 4, pp. 848-857, 2009.
[Walkerden1999] F. Walkerden and R. Jeffery, "An Empirical Study of Analogy-Based Software Effort Estimation," Empirical Software Engineering, vol. 4, no. 2, pp. 135-158, 1999.
[Wang2006] W. L. Wang, D. Pan, and M. H. Chen, "Architecture-Based Software Reliability Modeling," Journal of Systems and Software, vol. 79, no. 1, pp. 132-146, 2006.
[Wang1999] W. L. Wang, Y. Wu, and M. H. Chen, "An Architecture-Based Software Reliability Model," Proceedings of the 5th Pacific Rim International Symposium on Dependable Computing (PRDC 1999), pp. 143-150, Hong Kong, China, 1999.
[Wang2008] Z. Wang, K. Tang, and X. Yao, "A Multi-Objective Approach to Testing Resource Allocation in Modular Software Systems," IEEE Congress on Evolutionary Computation A Multi-Objective Approach to Testing Resource Allocation in Modular Software Systems, pp. 1148-1153, Hong Kong, China, 2008.
[Weiss1981] D. M. Weiss, Evaluating Software Development by Analysis of Change Data, Computer Science Technical Report, University of Maryland, 1981, TR-1120.
[Wen2006] K. L. Wen, S. K. Changchien, C. K. Yeh, C. W. Wang, and H. S. Lin, Apply Matlab in Grey System Theory, Taipei Chwa Inc., 2006.
[Wood1996] A. Wood, "Predicting Software Reliability," IEEE Computer, vol. 29, no. 11, pp. 69-77, 1996.
[Wu1993] K. Wu and Y. K. Malaiya, "The Effect of Correlated Faults on Software Reliability," Proceedings of the 4th International Symposium on Software Reliability Engineering (ISSRE 1993), pp. 80-89, Denver, CO, USA, 1993.
[Wu2007] Y. P. Wu, Q. P. Hu, M. Xie, and S. H. Ng, "Modeling and Analysis of Software Fault Detection and Correction Process by Considering Time Dependency," IEEE Transactions on Reliability, vol. 56, no. 4, pp. 629-642, 2007.
[Xie1991] M. Xie, Software Reliability Modeling, World Scientific Publishing, 1991.
[Xie1998] M. Xie and G. Y. Hong, "A Study of the Sensitivity of Software Release Time," Journal of Systems and Software, vol. 44, no. 2, pp. 163-168, 1998.
[Xie2007] M. Xie, Q. P. Hu, Y. P. Wu, and S. H. Ng, "A Study of the Modeling and Analysis of Software Fault-Detection and Fault-Correction Processes," Quality and Reliability Engineering International, vol. 23, no. 4, pp. 459-470, 2007.
[Yacoub2004] S. Yacoub, B. Cukic, and H. H. Ammar, "A Scenario-Based Reliability Analysis Approach for Component-Based Software," IEEE Transactions on Reliability, vol. 53, no. 4, pp. 465-480, 2004.
[Yacoub1999] S. M. Yacoub, B. Cukic, and H. H. Ammar, "Scenario-Based Reliability Analysis of Component-Based Software," Proceedings of the 10th International Symposium on Software Reliability Engineering (ISSRE 1999), pp. 22-31, 1999.
[Yang1996] K. Z. Yang, An Infinite Server Queueing Model for Software Readiness Assessment and Related Performance Measures, PhD dissertation, Department of Electrical Engineering and Computer Sciencein, Syracuse University, NY, USA, 1996.
[Zhang2001] X. Zhang, M. Y. Shin, and H. Pham, "Exploratory Analysis of Environmental Factors for Enhancing the Software Reliability Assessment," Journal of Systems and Software, vol. 57, no. 1, pp. 73-78, 2001.
[Zheng2010] Z. Zheng and M. R. Lyu, "An Adaptive QoS-Aware Fault Tolerance Strategy for Web Services " Empirical Software Engineering, vol. 15, no. 4, pp. 323-345, 2010.