Four Problematic Methods in Reliability Analysis

Some basic methods used in reliability analysis are problematic because they produce incorrect and overoptimistic predictions. Initially gratifying forecasts are often invalidated by testing and operational experience. The problematic methods in reliability analysis include estimating the system failure rate as the sum of component failure rates, assuming that reliability growth continues indefinitely during testing, overestimating the benefits of redundancy, and using the fault tolerance count instead of a detailed reliability analysis. Reliability analysis can produce more optimism than accuracy. This bug may now be a feature. The optimistic bias inevitable in project planning should be corrected by realistic reliability analysis that reflects relevant experience. That the repeated poor performance of reliability analysis is found to be surprising suggests willful blindness. Rigorous methods and impartial critical review are necessary to improve reliability analysis.