ATTRIBUTE MSA - LONG METHOD
MSA - manual / Ford / DC / GM - 3rd version
Part A - 1 A - 2 A - 3 B - 1 B - 2 B - 3 C - 1 C - 2 C - 3 Ref. Ref. value Code P
1 P P P P P P P P P P + NEG 9 0
2 P P P P P P P P P P + 9 0
3 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
4 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
5 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
6 P P NEG P P NEG P NEG NEG P x 5 0
7 P P P P P P P NEG P P x 8 0
8 P P P P P P P P P P + 9 0
9 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
10 P P P P P P P P P P + 9 0
11 P P P P P P P P P P + 9 0
12 NEG NEG NEG NEG NEG NEG NEG P NEG NEG x 0 8
13 P P P P P P P P P P + 9 0
14 P P NEG P P P P NEG NEG P x 6 0
15 P P P P P P P P P P + 9 0
16 P P P P P P P P P P + 9 0
17 P P P P P P P P P P + 9 0
18 P P P P P P P P P P + 9 0
19 P P P P P P P P P P + 9 0
20 P P P P P P P P P P + 9 0
21 P P NEG P NEG P NEG P NEG P x 5 0
22 NEG NEG P NEG P NEG P P NEG NEG x 0 5
23 P P P P P P P P P P + 9 0
24 P P P P P P P P P P + 9 0
25 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
26 NEG P NEG NEG NEG NEG NEG NEG P NEG x 0 7
27 P P P P P P P P P P + 9 0
28 P P P P P P P P P P + 9 0
29 P P P P P P P P P P + 9 0
30 NEG NEG NEG NEG NEG P NEG NEG NEG NEG x 0 8
31 P P P P P P P P P P + 9 0
32 P P P P P P P P P P + 9 0
33 P P P P P P P P P P + 9 0
34 NEG NEG P NEG NEG P NEG P P NEG x 0 5
35 P P P P P P P P P P + 9 0
36 P P NEG P P P P NEG P P x 7 0
37 NEG NEG NEG NEG NEG P NEG NEG NEG NEG - 0 8
38 P P P P P P P P P P + 9 0
39 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
40 P P P P P P P P P P + 9 0
41 P P P P P P P P P P + 9 0
42 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
43 P NEG P P P P P P NEG P x 7 0
44 P P P P P P P P P P + 9 0
45 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
46 P P P P P P P P P P + 9 0
47 P P P P P P P P P P + 9 0
48 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
49 P P P P P P P P P P + 9 0
50 NEG NEG NEG NEG NEG NEG NEG NEG NEG NEG - 0 9
Ref.
P = 34 34 32 34 34 36 34 33 32 34 + = OK 28 10
NEG = 16 16 18 16 16 14 16 17 18 16 - = Not OK
Total Total x = Marginal
KAPPA between operators
A=N & B=P 0 2 5 7 A=N & B=N 16 14 13 43
A=P & B=N 0 2 1 3 A=P & B=P 34 32 31 97
B=N & C=P 1 3 1 5 B=N & C=N 15 13 13 41
B=P & C=N 1 4 5 10 B=P & C=P 33 30 31 94
A=N & C=P 1 4 2 7 A=N & C=N 15 12 16 43
A=P & C=N 1 5 2 8 A=P & C=P 33 29 30 92
P = Positive outcome by operator
NEG = Negative outcome by operator
KAPPA between operators & REF value
A=N/Ref=P 5 B=N/Ref=P 2 C=N/Ref=P 9 = false alarm 29
A=N/Ref=N 45 B=N/Ref=N 44 C=N/Ref=N 42 = correct negative decision
A=P/Ref=P 97 B=P/Ref=P 100 C=P/Ref=P 93 = correct positive decision
A=P/Ref=N 3 B=P/Ref=N 4 C=P/Ref=N 6 = missed bad parts
16 48 = number of bad parts x 3 observations
34 102 = number of good parts x 3 observations
Operator
100%
match
Good 100% missed Mixed Operator
100%
match
Bad Operator
100%
match
Good & Bad
A 29 0 8 A 13 A 42
B 32 0 6 B 12 B 44
C 28 0 10 C 12 C 40
Reprinted from the Measurement Systems Analysis (MSA) Manual with permission of
DaimlerChrysler, Ford and GM Supplier Quality Requirements Task Force.
ATTRIBUTE MSA
Cross - Tab method Values < indicate poor agreement between appraisers
Kappa between operators Values > indicate good to excellent agreement ( max = 1 )
A to B crosstabulation
B Kappa A - B
0 1 Total Kappa = Po - Pe
A 0 Count 43 7 50 Po 1 - Pe
Expected count Pe
1 Count 3 97 100
Expected count
Total Count 46 104 150
Expected count
B to C crosstabulation
C Kappa B - C
0 1 Total
B 0 Count 41 5 46 Po
Expected count Pe
1 Count 10 94 104
Expected count
Total Count 51 99 150
Expected count
A to C crosstabulation
C Kappa A - C
0 1 Total
A 0 Count 43 7 50 Po
Expected count Pe
1 Count 8 92 100
Expected count
Total Count 51 99 150
Expected count
Cross - Tab method Values < indicate poor agreement between appraisers
Kappa between operators & ref value Values > indicate good to excellent agreement ( max = 1 )
A to REF crosstabulation
REF Kappa A - REF
0 1 Total
A 0 Count 45 5 50 Po
Expected Pe
1 Count 3 97 100
Expected
Total Count 48 102 150
Expected
B to REF crosstabulation
REF Kappa B - REF
0 1 Total
B 0 Count 44 2 46 Po
Expected Pe
1 Count 4 100 104
Expected
Total Count 48 102 150
Expected
C to REF crosstabulation
REF Kappa C - REF
0 1 Total
C 0 Count 42 9 51 Po
Expected Pe
1 Count 6 93 99
Expected
Total Count 48 102 150
Expected
ATTRIBUTIVE EFFECTIVENESS CALCULATION
% Appraiser % Score vs attribute
Source A B C A B C
Total inspected 50 50 50 50 50 50
# Matched 42 44 40 42 45 40
False negative ( appraiser biased toward rejection ) 0 0 0
False positive ( appraiser biased toward acceptance ) 0 0 0
Mixed 8 6 10
95% UCI 93 95 90 93 97 90
Calculated score 84 88 80 84 90 80
95% LCI 71 76 66 71 78 66
System % Effective Score System % Effective score vs reference
Total inspected 50 50
# in agreement 38 38
95% UCI MSA manual = 89 MSA manual = 89
Calculated score 76 76
95% LCI 62 62
UCI and LCI calculations :
n = Total inspected
x = # Matched
alfa =
UCI =BETAINV(1-(alfa/2); x+1; n-x)
LCI =BETAINV(alfa/2; x; n-x+1)
ATTRIBUTIVE MSA
Appraise
r
Number
Good
correct
Number
bad
correct
Number
correct
Number
false
alarm
Number
missed
Number
total
A 97 45 142 5 3 150
B 100 44 144 2 4 150
C 93 42 135 9 6 150
Appraise
r
Effectiveness Pfalse alarm Pmissed
A
B
C
Decision on
Measurement system
Effective-
ness
False
alarm
rate
Miss
rate
Acceptable for the appraiser > 90 % < 5 % < 2 %
Marginally acceptable for the
appraiser - may need
improvement
> 80
-
< 90 %
> 5
-
< 10 %
> 2
-
< 5 %
Unacceptable for the
appraiser - needs
improvement
< 80 % > 10 % > 5 %
SIGNAL DETECTION - to define the width of region II area
and from this the measurement system Gauge R & R
REF Value Code REF Value Code
- + + = positive assessment by everyone
- + - = negative assessment by everyone
- + x = mixed assessment
- +
- +
- + Last one negative by everyone
x +
x +
x +
x +
x +
x +
+ + First one positive by everyone
+ +
+ + Last one positive by everyone
+ x
+ x
+ x
+ x
+ x
+ - First one negative by everyone
+ -
+ -
+ -
+ -
dLSL= - =#######
dUSL= - =#######
d= = STDDEV*5,15
Tol = (Not in MSA manual)
% GRR = (100%)*(d/5,15)/(Tol/6)
% GRR =
% (d / tol)
