B
A 0 1 Total
0 Count 13 Count 1 14
Exp Count 1.307 Exp Count 12.693 14
1 Count 1 Count 135 136
Exp Count 12.693 Exp Count 123.307 136 PO 0.986666667
Total Count 14 Count 136 150 PE 0.83076
Exp Count 14 Exp Count 136 150
C
B 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14
1 Count 1 Count 135 136 PO 0.993333333
Exp Count 13.6 Exp Count 122.4 136 PE 0.825333333
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
C
A 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14 PO = 0.993333333
1 Count 1 Count 135 136 PE 0.825333333
Exp Count 13.6 Exp Count 122.4 136
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Measurement of Agreement Between Appraisers (kappa value)
kappa = P0 - Pe
1 - Pe
kappa A B C
A 0.921217 0.96165
B 0.96165
C
Acceptance Criteria:
1. Kappa value more than 0.75 indicates good agreement between appraisers.
2. Kappa value less than 0.40 indicates poor agreement between appraisers.
Po= Sum of proportion of observed counts.
Pe= Sum of proportion of expected counts.
Cross Tabulation between appraisers & ref value
A & Ref Crosstabulation
Ref
A 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14 PO 0.993333333
1 Count 1 Count 135 136 PE 0.825333333
Exp Count 13.6 Exp Count 122.4 136
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Ref
B 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14 PO 0.993333333
1 Count 1 Count 135 136 PE 0.825333333
Exp Count 13.6 Exp Count 122.4 136
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Ref
C 0 1 Total
0 Count 15 Count 0 15
Exp Count 1.5 Exp Count 13.5 15 PO 1
1 Count 0 Count 135 135 PE 0.82
Exp Count 13.5 Exp Count 121.5 135
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Measurement of Agreement Between Appraisers & Reference Value
kappa = P0 - Pe
1 - Pe
A B C
kappa 0.9618 0.9618 1
Acceptance Criteria:
1. Kappa value more than 0.75 indicates good agreement between appraisers.
2. Kappa value less than 0.40 indicates poor agreement between appraisers.
Calculation
1. Effectiveness = number of correct decisions / Total opportunity for decision
2. Miss Rate = number of times bad part is accepted / Total opportunity for decision
3. False Alarm = number of times good part is rejected / Total opportunity for decision
Acceptance Criteria:
Decision Effectiveness Miss Rate False Alarm
"Acceptable for the
appraiser" > 90% < 2% < 5%
"Marginally acceptable
for the appraiser
- may need improvement" > 80% < 5% < 10%
"Unacceptable for the
appraiser -
needs improvement" < 80% > 5% > 10%
Study Conclusion:
Decision Effectiveness Miss Rate False Alarm
A 99.30% 0.70% 0%
B 99.30% 0.70% 0%
C 100% 0% 0%
最新回复
痴情浪子 (2008-8-24 13:38:00)
vera2001xu (2008-8-24 13:50:22)
gqandkll (2008-8-25 09:34:56)
# A1 A2 A3 B1 B2 B3 C1 C2 C3 Ref Value
1 1 1 1 1 1 1 1 1 1 1
2 1 1 1 1 1 1 1 1 1 1
3 1 1 1 1 1 1 1 1 1 1
4 1 1 1 1 1 1 1 1 1 1
5 1 1 1 1 1 1 1 1 1 1
6 1 1 1 1 1 1 1 1 1 1
7 1 1 1 1 1 1 1 1 1 1
8 1 1 1 1 1 1 1 1 1 1
9 0 0 0 0 1 0 0 0 0 0
10 1 1 1 1 1 1 1 1 1 1
11 1 1 1 1 1 1 1 1 1 1
12 1 1 1 1 1 1 1 1 1 1
13 1 1 1 1 1 1 1 1 1 1
14 1 1 1 1 1 1 1 1 1 1
15 1 1 1 1 1 1 1 1 1 1
16 1 1 1 1 1 1 1 1 1 1
17 1 0 0 0 0 0 0 0 0 0
18 1 1 1 1 1 1 1 1 1 1
19 1 1 1 1 1 1 1 1 1 1
20 1 1 1 1 1 1 1 1 1 1
21 1 1 1 1 1 1 1 1 1 1
22 1 1 1 1 1 1 1 1 1 1
23 1 1 1 1 1 1 1 1 1 1
24 1 1 1 1 1 1 1 1 1 1
25 1 1 1 1 1 1 1 1 1 1
26 1 1 1 1 1 1 1 1 1 1
27 0 0 0 0 0 0 0 0 0 0
28 1 1 1 1 1 1 1 1 1 1
29 1 1 1 1 1 1 1 1 1 1
30 1 1 1 1 1 1 1 1 1 1
31 1 1 1 1 1 1 1 1 1 1
32 1 1 1 1 1 1 1 1 1 1
33 0 0 0 0 0 0 0 0 0 0
34 1 1 1 1 1 1 1 1 1 1
35 1 1 1 1 1 1 1 1 1 1
36 1 1 1 1 1 1 1 1 1 1
37 1 1 1 1 1 1 1 1 1 1
38 1 1 1 1 1 1 1 1 1 1
39 1 1 1 1 1 1 1 1 1 1
40 1 1 1 1 1 1 1 1 1 1
41 1 1 1 1 1 1 1 1 1 1
42 1 1 1 1 1 1 1 1 1 1
43 1 1 1 1 1 1 1 1 1 1
44 1 1 1 1 1 1 1 1 1 1
45 0 0 0 0 0 0 0 0 0 0
46 1 1 1 1 1 1 1 1 1 1
47 1 1 1 1 1 1 1 1 1 1
48 1 1 1 1 1 1 1 1 1 1
49 1 1 1 1 1 1 1 1 1 1
50 1 1 1 1 1 1 1 1 1 1
Cross Tabulation between appraisers
A & B Crosstabulation
B
A 0 1 Total
0 Count 13 Count 1 14
Exp Count 1.307 Exp Count 12.693 14
1 Count 1 Count 135 136
Exp Count 12.693 Exp Count 123.307 136 PO 0.986666667
Total Count 14 Count 136 150 PE 0.83076
Exp Count 14 Exp Count 136 150
C
B 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14
1 Count 1 Count 135 136 PO 0.993333333
Exp Count 13.6 Exp Count 122.4 136 PE 0.825333333
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
C
A 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14 PO = 0.993333333
1 Count 1 Count 135 136 PE 0.825333333
Exp Count 13.6 Exp Count 122.4 136
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Measurement of Agreement Between Appraisers (kappa value)
kappa = P0 - Pe
1 - Pe
kappa A B C
A 0.921217 0.96165
B 0.96165
C
Acceptance Criteria:
1. Kappa value more than 0.75 indicates good agreement between appraisers.
2. Kappa value less than 0.40 indicates poor agreement between appraisers.
Po= Sum of proportion of observed counts.
Pe= Sum of proportion of expected counts.
Cross Tabulation between appraisers & ref value
A & Ref Crosstabulation
Ref
A 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14 PO 0.993333333
1 Count 1 Count 135 136 PE 0.825333333
Exp Count 13.6 Exp Count 122.4 136
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Ref
B 0 1 Total
0 Count 14 Count 0 14
Exp Count 1.4 Exp Count 12.6 14 PO 0.993333333
1 Count 1 Count 135 136 PE 0.825333333
Exp Count 13.6 Exp Count 122.4 136
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Ref
C 0 1 Total
0 Count 15 Count 0 15
Exp Count 1.5 Exp Count 13.5 15 PO 1
1 Count 0 Count 135 135 PE 0.82
Exp Count 13.5 Exp Count 121.5 135
Total Count 15 Count 135 150
Exp Count 15 Exp Count 135 150
Measurement of Agreement Between Appraisers & Reference Value
kappa = P0 - Pe
1 - Pe
A B C
kappa 0.9618 0.9618 1
Acceptance Criteria:
1. Kappa value more than 0.75 indicates good agreement between appraisers.
2. Kappa value less than 0.40 indicates poor agreement between appraisers.
Calculation
1. Effectiveness = number of correct decisions / Total opportunity for decision
2. Miss Rate = number of times bad part is accepted / Total opportunity for decision
3. False Alarm = number of times good part is rejected / Total opportunity for decision
Acceptance Criteria:
Decision Effectiveness Miss Rate False Alarm
"Acceptable for the
appraiser" > 90% < 2% < 5%
"Marginally acceptable
for the appraiser
- may need improvement" > 80% < 5% < 10%
"Unacceptable for the
appraiser -
needs improvement" < 80% > 5% > 10%
Study Conclusion:
Decision Effectiveness Miss Rate False Alarm
A 99.30% 0.70% 0%
B 99.30% 0.70% 0%
C 100% 0% 0%
PREPARED BY APPROVED BY
zhzhsh81 (2008-8-25 09:44:29)
做一个小样法，再进行kappa分析。应该就能过关了。
haidong326 (2008-8-25 10:06:07)
fuguoding (2008-8-26 19:34:49)
请各位朋友继续给予指点，非常感谢。
renshanlu (2008-8-26 20:30:37)
xxyang (2008-8-26 21:22:24)