Reliability and Maintainability

This course provides an overview of Model-Based Systems Engineering and its implementation at NASA as Model-Based Mission Assurance (MBMA). Further information about MBMA is provided in two courses which are available from the NASA Engineering and Safety Center Academy: 

Model-Centric Engineering, Part 1 —Introduction to Model-Based Systems Engineering

Model-Centric Engineering, Part 2 —Introduction to System Modeling

Participants who successfully complete this course will be awarded Continuous Education Units.

Course: SMA-HQ-WBT-105

Length: 1.00 hour

Audience: This course is intended for all Safety and Mission Assurance personnel.

“Introduction to RAM Planning for Programs and Projects” is a beginner-level 12-hour course that will provide a general overview of the value associated with implementing the Reliability, Availability and Maintainability disciplines on a system, based on the systems engineering life cycle. This course will focus on the business aspects and monetary value associated with designing failure modes out of a system, the merits of alternative maintainability approaches, improving the operational availability of a system, as well as the costs associated with accepting certain types of risk. The student will learn why it is cost-effective to invest early in the life cycle to ensure long-term cost savings and mission success and will perform. Implementing RAM early in the program’s life cycle can save as much as 10 times or more when compared to failures in the later phases. When a failure mode is designed out while the system is still on paper, as opposed to physically manufactured, it costs much less to complete. Also, there is savings in maintenance, spares, logistics and the cost of mission success. There are many cost implications when it comes to loss of mission, mission degradation or even tolerating minor issues and each of these will be addressed in this course.

Course Number: SMA-RM-WBT-241

Length: 12.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course focuses on the application of methodologies for design and its improvement through sensitivity and gap analyses. Reliability, Availability and Maintainability (RAM) modeling can simulate the configuration, operation, failure, repair and maintenance of system(s) for various phases such as pre-launch, launch, ascent, orbit, cruise, landing on lunar/Mars and descent. The objective is to teach various modeling techniques and demonstrate how they are used.

In deterministic models, a good decision is judged by the outcome alone. However, in probabilistic models, the decision-maker is concerned not only with the outcome value but also with the amount of risk each decision carries. Probabilistic modeling is largely based on application of statistics for probability assessment of uncontrollable events, as well as risk assessment of your decision. The probabilistic models are used for protection against adverse uncertainty in decision-making. Key topics include

• Fault Tree Analysis, Reliability Block Diagram (RBD) and simulation modeling
• Standard classical analyses and equivalent Bayesian
• RBDs, fault trees, math models and simulation models
• Using a simulation to drive system design and ultimately positively affect probability of mission success
• Optimization techniques and tools (e.g. Arena, Titan, Probabilistic Design and Analysis Framework tool)
• Markov analysis methods
• Application examples, case studies

Course Number: SMA-RM-WBT-431

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

This 16-hour course is an introduction to Reliability, Availability and Maintainability (RAM) modeling. The course will introduce several of the most common RAM modeling techniques. Since most users will employ software for these purposes, the focus will not be on mathematical derivations. The focus will be on modeling tool selection, application, and understanding the benefits and drawbacks of the most popular tools. Practical application is the emphasis.

Course Number: SMA-RM-WBT-331

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course provides an overview of reliability growth analysis models and their application for data captured from developmental (reliability growth) testing and also from fielded systems. Topics include reliability growth tracking and projection models and calculating optimum overhaul times and other metrics for systems. Key topics include

• Reliability growth management and [lanning
• Developing a planned growth curve
• Estimating the initial reliability, maximum reliability or growth potential
• Assigning reliability growth fix effectiveness factor in planning stage
• Reliability growth analysis, implementation and strategy management
• Army Materiel Systems Analysis Activity reliability growth model
• Reliability growth confidence interval, goodness-of-fit test, fix effectiveness factor, growth rate
• Evaluating the reliability using operational test data or field data

Course Number: SMA-RM-EXTI-471

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

Testing for Reliability, Availability and Maintainability (RAM) performance is critical to ensuring a design will meet requirements. Testing can be conducted using a variety of methods and to demonstrate specific outcomes. This course focuses on the testing and demonstration techniques of system R&M using advanced techniques to verify the requirements. It also includes design and development of tests and its application. This course will provide real-life NASA examples of effective test regimens that have ensured success of NASA programs. Key topics include

• Terms and definitions
• Requirements for test and understanding requirements
• Test plans and planning
• Different types of test to verify RAM performance
• Accelerated test methods
• Closing the loop — feeding back test results to the engineering process
• Test analyze fix
• Design of experiments
• Test plan examples
• Data collection methodologies
• Test plan development exercise
• Test data analysis exercise

Course Number: SMA-RM-WBT-441

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

This eight-hour course covers reliability test and evaluation approaches. The course is ideal for persons with newly assigned responsibilities in the Reliability and Maintainability area, as well as managers who want to increase their awareness of the proper application of various reliability test approaches.

Course Number: SMA-RM-WBT-341

Length: 8.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course consists of a course from Defense Acquisition University (DAU) — Logistics 103 (LOG103). The DAU course provides a conceptual and non-quantitative overview of Reliability, Availability and Maintainability (RAM) and its activities throughout the acquisition life cycle. It presents basic principles and processes of the RAM engineering disciplines, along with how these apply to and impact acquisition and logistics. Each lesson within the course provides examples, progress reviews and a graded exam. There is also a comprehensive exam upon course completion.

Course Number: SMA-RM-EXTW-211

Length: 24.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course covers the concepts, principles and methods of physics of failure. It includes physical laws pertaining to how things work and how things fail; failure analysis over a period of time; trends in failure characteristics, design rules, component selection, testing, and screening; and physics-of-failure approach to reliability.

Physics of failure is an engineering-based approach to reliability that uses modeling and simulation to eliminate failures early in the design by addressing root-cause failure mechanisms. The physics-of-failure approach proactively incorporates reliability into the design process by establishing a scientific basis for evaluating new materials, structures and electronics technologies. Physics of failure encourages innovative, cost-effective design through the use of realistic reliability assessment. Key topics include

• Physics-of-failure approaches
• Stress analysis approaches
• Step-screening approaches
• Accelerated life testing
• Testing and screening
• Combined thermal cycling, vibration and humidity
• Probability-of-failure approach for process verification
• Non-destructive screening
• Drop test
• Accelerated wear-out screening

Course Number: SMA-RM-WBT-451

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

Application of proper parts and materials is the key to successful operation of space or ground systems. Among many considerations when designing a system, reliability and availability of its parts are the foundational element of the overall performance of a system. Choosing the proper materials for a given set of environment (thermal cycles, Electromagnetic Interference (EMI), off gassing, corrosion resistance, etc.) can be the difference between mission success and failure. Understanding how Electrical, Electronic, Electromechanical (EEE) and mechanical parts are chosen and applied in a system in what situation will be the final objective.

This course covers the requirements for parts (EEE and mechanical) and materials for use in space projects. The parts and material control program shall support the required mission life and environment. A design methodology that considers parts and materials is explained so that component reliability can be described. Parts and materials shall be selected and controlled based on performance, environmental criticality for safety and mission success, and lifetime requirements. This promotes Safety and Mission Assurance processes that eliminate parts failure in the advanced phases of the life cycle. Some of the key topics are

• Commercial Off-The-Shelf Parts
• Derating methods and principles
• EMI/radiation concerns
• Counterfeit part issues
• Radiation hardness
• Storage and age control
• Risk evaluation 

Course Number: SMA-RM-WBT-411

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course provides an overview of the importance of applying Reliability and Maintainability (R&M) to NASA programs and projects. Additionally, this course establishes the importance of R&M for system, personnel safety and mission success. This courses addresses R&M competencies, R&M elements, planning, requirements development and allocation, application to design, analysis tools and techniques, test and integration, and successful NASA applications.

Course Number: SMA-RM-WBT-100

Length: 1.50 hours

Audience: This course is intended for Safety and Mission Assurance personnel and anyone interested in learning more about this topic.

This 16-hour course explains some of the tools and techniques that can be used early in the design phase to analyze and enhance the maintainability and supportability of a system or equipment. The course begins with an overview of Maintainability Analysis and Supportability Analysis and what they encompass. Modules 2 and 3 identify some common characteristics of maintainability, both qualitative and quantitative. Module 4 explains some common methods of Maintainability Analysis. Module 5 describes how maintainability is tested at different stages of system development. Module 6 explains how to analyze maintenance tasks, and Module 7 explains some common methods of analyzing the supportability of a system.

Course Number: SMA-RM-WBT-351

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course serves as an introduction to human performance and Human Reliability Analysis (HRA) including the methods used in modeling of human errors and various methods of estimating their probabilities. This course is designed to teach introductory level skills in HRA and includes a broad introduction to HRA and its applications. A discussion of HRA strengths, limitations and results is also included.

Specific topics are HRA process, HRA standards, interface between HRA and probabilistic risk assessment (PRA), human error probability estimates, error taxonomies, performance shaping factors, human performance measurement, HRA good practices, task analysis, task dependency, error recovery, uncertainty estimates, safety culture, effects of automation, human performance data, and "HRA-informed" understanding of noteworthy events.

The participants are expected to have prior knowledge in basic statistics, probability and the processes that lead to human failures. Nevertheless, some refresher topics will be briefly reviewed.

Course Number: SMA-RM-WBT-481

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course will provide training in Failure Modes and Effects Analysis (FMEA)/Critical Items List (CIL). The course will identify program requirements for FMEA/CILs, evaluate FMEA and CIL reports, assign criticalities, identify critical items, and be able to participate in the FMEA/CIL approval process.

Course Number: SMA-RM-WBT-361

Length: 12.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course consists of a set of courses from REPERTOIRE, an online reliability engineering training curriculum available through Quanterion Solutions Incorporated. These online interactive reliability engineering training courses are based on the American Society for Quality body of knowledge for the Certified Reliability Engineer’s exam. To meet Safety and Mission Assurance Technical Excellence Program completion requirements for this course, you are required to complete selected lessons (sections) from seven REPERTOIRE courses.

Course Number: SMA-RM-EXTW-221

Length: 28.00 hours

Audience: This course is intended for engineers and engineering project managers.

This 28-hour course explains some of the tools and techniques that can be used to design maintainability into a program or project to enhance the maintainability of a system or equipment. The course begins with an overview of maintainability. Module 2 discusses the impact of maintainability on operations and cost. Modules 3 and 4 discuss managing for maintainability and setting maintainability requirements. Module 5 identifies specific maintainability considerations for a program or project. Module 6 explains the importance of testability and diagnostics. Module 7 describes the design tools used for maintainability. Module 8 discusses the methods used in Maintainability Analysis. Module 9 describes the reasons maintainability testing is performed and basic methods of maintainability testing. Module 10 explains the importance of maintainability data collection and analysis.

Course Number: SMA-RM-WBT-231

Length: 28.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course focuses on the application of data collection, methods and analysis. It discusses data pedigree and underlying assumptions that need to be considered when collecting and using data for analysis and decision-making. It covers various data types and sources such as discrete, continuous, attribute, vendors, field, commercial, surrogate systems and so on. Data analysis includes advanced parametric and non-parametric methods such as Bayesian, Weibull, Markov and Uncertainty Analysis (UA). Key topics include

• Advanced techniques (logistic regression, multi-variate correlation)
• Parametric analysis
• Weibull (or mixed-Weibull) estimation methods
• Gamma and other distributions
• Extreme value distributions
• Uncertainty versus confidence and its implications
• Comparing (and/or integrating) design options under uncertainty
• Dealing with knowledge correlations
• Bayesian estimation methods
• Simulation techniques
• Computer tools for estimation methods
• Data trending and analysis
• Expert elicitation
• Data aggregation (consistent methodology to qualify and use as an input to a reliability model (and beyond))
• Case studies, exercises, work-through examples

Course Number: SMA-RM-WBT-421

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.

The eight-hour course focuses on the collection and analysis of reliability data to make informed decisions. Topics covered include beginner-to-advanced topics in the collection and analysis of reliability data, including

• Understanding of variation
• Probability concepts
• Rules of probability
• Probability distributions
• Discrete distributions
• Continuous distributions
• Statistical confidence
• Statistical hypothesis testing
• Non-parametric inferential methods
• Goodness of fit
• Series of events (point processes)
• Computer software for statistics
• Reliability data collection and analysis
• Methods of modeling systems for reliability analysis
• Mathematical techniques used to analyze and solve reliability problems
• Probabilistic life models for components with both time-independent and time-dependent loads
• Data analysis, parametric and nonparametric estimation of basic time-to-failure distributions
• Data analysis for systems
• Repairable systems modeling

Course Number: SMA-RM-WBT-321

Length: 8.00 hours

Audience: This course is intended for engineers and engineering project managers.

This course presents concepts, principles, methods and tools to improve experiment design.

A strategically planned and executed experiment gives a great deal of information about the effect on a response variable due to one or more factors. This course covers basics of Design of Experiment, steps for designing and conducting effective experiments, and statistical and graphical tests for significance. It teaches how to set up, conduct and analyze factorial-designed experiments.

Course Number: SMA-RM-EXTI-461

Length: 16.00 hours

Audience: This course is intended for engineers and engineering project managers.