
Digital twins help teams compare proposed fixes during the DMAIC Improve phase before changing the production line. A validated model can estimate how different settings affect quality, throughput, and cycle time. Those estimates support solution selection and physical testing; they do not guarantee results.
Key Takeaways
Five principles guide the use of digital twins for Improve-phase testing.
- Test candidate fixes before changing production.
- Validate the model against measured process data.
- Use DOE to compare settings and interactions.
- Include uncertainty in every decision.
- Confirm the selected fix with physical trials.
How Digital Twins Support the DMAIC Improve Phase

DMAIC stands for Define, Measure, Analyze, Improve, and Control. Improve uses findings from earlier phases to develop, test, and implement solutions. A digital twin adds a way to screen those solutions before scheduling physical trials. NIST describes manufacturing digital twins as synchronized virtual models that support diagnosis, prediction, and optimization.
Data may come from sensors, operating records, or periodic measurements. Update frequency should match the decision and the speed of process change. An offline simulation can compare settings without applying them to production equipment.
Poor assumptions can still lead to costly decisions. Define the twin's intended use and limits before relying on its predictions.
The Simulation Workflow: From Baseline to Implementation

The following workflow connects model development, experimental design, and physical confirmation. Document assumptions and acceptance criteria before comparing solutions.
1. Build the Baseline Model
Define the process boundary, operating conditions, and decision the model must support. Use relevant process history, cycle times, equipment behavior, and defect records. Check measurement quality and include constraints such as capacity, maintenance, and product mix.
2. Verify and Validate the Model
Check that the model's logic and calculations work as intended. Compare predictions with independent measured data across relevant operating conditions. Set acceptable errors for each response before assessing the results.
A predicted defect rate of 4.2% versus an observed 4.1% does not establish validity by itself. Sample size, measurement error, process variation, and performance across conditions also matter. NIST's credibility framework calls for verification, validation, and uncertainty quantification throughout a twin's life cycle.
3. Select Factors and Response Measures
Select controllable inputs such as temperature, feed rate, pressure, or operator sequence. Define realistic ranges and separate controllable factors from noise variables. Choose measurable responses tied to customer requirements, such as defect rate, yield, or dimensional accuracy.
Include throughput and cycle time when they support the project objective. Specify the target and tradeoffs for each response. These definitions make scenario comparisons consistent.
4. Compare What-If Scenarios
Run candidate settings against the same baseline conditions. Compare expected performance, resource needs, and constraint violations. Parallel runs may speed analysis, but capacity depends on the software and computing resources.
5. Apply Design of Experiments
Use DOE to select informative combinations of factors instead of relying on informal trial and error. Choose a design that can estimate the effects and interactions relevant to the decision. Response surface methods can help locate promising settings within the modeled region.
These settings are estimates, and a fitted surface does not establish a global optimum. NIST's process optimization guidance explains that fitted responses are local approximations. For stochastic simulations, plan replications to estimate variability; identical deterministic runs provide no new sampling information.
6. Assess Uncertainty and Risk
A digital twin does not automatically produce credible probability distributions or confidence intervals. Those outputs require appropriate statistical models, input distributions, and uncertainty analysis. Evaluate sensitivity to uncertain inputs and test plausible stress conditions.
Separate process variation from uncertainty caused by limited data or model error. More simulation runs cannot correct a biased model. Present predicted benefits alongside assumptions, uncertainty bounds, and failure modes.
7. Confirm the Fix and Implement
Use the simulation to select a candidate and plan a controlled physical confirmation trial. Historical validation alone cannot prove performance at new settings. Define acceptance criteria, responsibilities, and a rollback plan before implementation. NIST recommends confirmation runs to check experimental predictions at the selected settings.
After implementation, compare actual results with predictions and update the Control plan. Investigate differences and recalibrate the twin when process behavior changes.
What Simulation and Physical Pilots Each Contribute
Simulation and physical trials provide complementary evidence. The comparison below shows their uses and limits without assuming fixed run counts or guaranteed savings.
| Approach | Evidence Provided | Main Limitation |
|---|---|---|
| Physical pilot | Measured performance under actual trial conditions | Requires production resources and appropriate risk controls |
| Digital twin simulation | Predicted outcomes for modeled scenarios | Depends on model validity and input assumptions |
| DOE within a twin | Structured comparisons of factor effects and interactions | Findings require model checks and physical confirmation |
For approval, present the baseline, candidate settings, predicted improvement, uncertainty, and planned confirmation tests. Include implementation costs and operating constraints. This gives stakeholders evidence for selecting the next trial.
A Documented Manufacturing Simulation Example
An AWS technical example uses a Level 4 twin for roll-to-roll manufacturing. It models bearing degradation and forecasts material tension with uncertainty bounds. The scenario helps illustrate decisions about maintenance timing and product quality.
The example uses synthetic degradation and notes that physical sensor measurements were unavailable for its historical observations. It demonstrates a modeling approach, rather than a controlled DMAIC study proving a percentage reduction in pilots. In an Improve project, the same reasoning can help compare a proposed fix with continued operation.
Tools and Training for Simulation Skills

Air Academy Associates offers resources for practicing simulation, model building, and experimental design. These skills support digital twin projects, but deployment also requires suitable software, data integration, and validation.
SimWare Pro
SimWare Pro is a process and product simulator for learning and practicing Six Sigma tools. Its product description lists control charts, histograms, capability analysis, experimental designs, and data export. That supports its use as a training aid; it does not establish live sensor integration for production digital twins.
Model Building and DOE Courses
The following courses address different parts of analytical model development. Their published outlines describe statistical skills, rather than dedicated digital twin deployment training.
- Advanced Model Building Short Course covers Quantum XL design sheets, expected value analysis, robust design, and combining models.
- Modeling Designs Short Course covers factorial, fractional factorial, central composite, Box-Behnken, and D-optimal designs.
- Operational Design of Experiments Course covers experimental planning, analysis, screening, modeling, and validation.
Conclusion
Digital twins can help Improve teams screen fixes and design more focused physical trials. Reliable decisions depend on validated models, explicit uncertainty, and confirmation under actual operating conditions. Air Academy Associates offers DOE training for teams building experimental planning and analysis skills.
FAQs
These answers address common decisions when using a digital twin during Improve.
What Is the Difference Between a Digital Twin and a Simulation?
A simulation uses a model to explore behavior under specified conditions. A digital twin maintains a data connection with a particular physical system. Simulation can be one of its capabilities.
Can a Digital Twin Replace a Physical Pilot?
Simulation can narrow the options and help define a smaller physical trial. Model results alone do not prove that a changed process will perform as predicted. Confirmation testing should reflect the process risks and applicable requirements.
Does a Digital Twin Need Real-Time Sensor Data?
A twin needs synchronization appropriate to its purpose, but updates need not always be continuous. Sensors, operating records, and periodic measurements can supply relevant data.
How Does DOE Help During the Improve Phase?
DOE organizes factor combinations so teams can estimate effects and interactions efficiently. Applied inside a validated model, it helps compare candidate settings before physical confirmation.
What Should Teams Monitor After Implementation?
Track the selected quality and performance measures against the approved baseline and targets. Compare actual results with predictions and investigate differences. Update the model and Control plan as the process changes.
