2024 JMP Discovery Summit - Advanced Decision SHL Rev3
2024 JMP Discovery Summit - Advanced Decision SHL Rev3
2024 JMP Discovery Summit - Advanced Decision SHL Rev3
1
Semiconductor Wafer Fab Process Flow
Oxidation
Wafer Acceptance
Test
Di
(Class Probe)
el
De ric ect ith
ol h y
p t
o p @ Individual
io osi Ph gra
n t o Device Level
300+ process
steps,
~ 9 weeks of
l
Meta it cycle time Etchi
s
Depo ng
ion
Cl e
@ Circuit Level for
n
tio
an
every die
Im Ion
nta
ing
pla
2
Case Study – BIN#6 Issue at Unit Probe for Part-A
3
Decisions To Make
There were 150 Part-A wafers from 6 lots at EOL Class Probe. Need to
determine how many wafers were at high risk of Unit Probe BIN#6 scrap.
I need a predictive
Determine whether to restart new materials from the beginning of line or escalate
priority of materials inlinemodel to help
accordingly with line down risk for
to minimize
customers.
risk assessment!
Identify the key class probe parameters responsible for BIN#6 fallout, and
thus recommend inline process tweak for better process window.
4
The 1st Step of Building Predictive Model
Define Responses and Predictors
• Predictors: wafer median of Class Probe parameters; total 173 continuous factors
− There are auto-correlations among the 173 factors
• Responses: Bin#6 fallout at Unit Probe test
− Total 2096 rows of data
− Continuous: normalized BIN#6 fallout on each wafer
− Categorical: classified as good or bad wafer based on the 90%-tile of normalized BIN#6 distribution (0.187)
Bad:
209
Good:
1887
5
Flow of Data Mining and Predictive Modeling
Model Screening
Data Extraction, Cleanup and Compare (4) Modeling Types
Identify key parameters from
Define Response & Predictors Construct Predictive Model
173
• Classification
Unit Probe
Good vs Bad
Response Decision Trees
• Categorical
6
Training vs. Validation Dataset
• Current Class Probe and Unit Probe data for completed lots will be randomly
assigned to a training dataset (~75%) and to a validation dataset (~25%) for
both categorical and continuous response analysis.
8
JMP Demo
Classification - Bootstrap Forest
Analyze Predictive Modeling Bootstrap Forest
9
JMP Demo
Regression – Stepwise Fit Linear Regression
Analyze Fit Model
10
JMP Demo
Regression – Bootstrap Forest
Analyze Predictive Modeling Bootstrap Forest
11
JMP Demo
R-square Comparison of the 4 Predictive Models
• Classification model: Bootstrap Forest model outperform the Tree Decision model
and will be used for Good vs Bad BIN#6 Classification for the 150 wafers at EOL Class
Probe.
− It predicted total 47 wafers to be BAD (higher than 0.187 of normalized BIN#6 fallout).
• Regression model: Bootstrap Forest model outperform the Stepwise linear regression
model and will be used for normalized BIN#6 fallout prediction.
− Based on the estimated values, NONE of the 47 wafers would result in scrap.
12
Decision Making
The estimated BIN#6 loss of these 150 wafers was not high enough to
warrant starting a new Part A material for backup
• Therefore, team notified Planning to prioritize Part-A materials inline to meet the die quantity
for on-time customer delivery.
13
Test Dataset for Model Accuracy Follow-up
• When all 6 lots completed unit probe,
the measured normalized BIN#6 fallout
was averaged at 0.162, with 2 lots
higher than 0.187 (at risk criteria).
• A model that handles autocorrelation without requiring much data manipulation or computer
memory constraints.
Yes
Tree Partition Yes Ok Excellent Yes
(but didn’t use)
Yes
Linear Regression No Yes Good Good
(but didn’t use)
15
Acknowledgement
• The author would like to thank Akira Abe (NXP 6-Sigma Master Black Belt), Mehul Shroff
(NXP 6-Sigma Black Belt) and Eric Sallquist (Device Staff Manager) for their guidance
when writing this presentation for external audiences.
• The author would like to thank Douglas Montgomery (Regents’ Professor of Industrial
Engineering and Statistics, Arizona State University) and Cheryl L. Jennings (Associate
Teaching Professor | Industrial Engineering and Engineering Management Programs) for their
technical feedbacks.
16
17