Pilot workload and technical effectiveness have been considered to be essential criteria when evaluating aircraft operability with subjective rating techniques. However, validation studies of the mission operability assessment technique found considerably higher levels of interrater reliability for pilots' ratings of workload than for technical effectiveness. The finding was replicated across aircraft, pilots, tasks, and with different forms of the rating scales. These results suggest that the implicit assumption that interrater reliability will be high and essentially identical for both pilot workload and technical effectiveness ratings may be invalid. This finding has implications for how one defines and subsequently measures aircraft operability with subjective rating techniques.
An empirical study comparing pilots' interrater reliability ratings for workload and effectiveness
Eine empirische Studie zum Vergleich der Pilotenzuverlaessigkeit bezueglich Arbeitsanforderung und Effektivitaet
IEEE Transactions on Systems, Man and Cybernetics ; 18 , 6 ; 978-981
1988
4 Seiten, 14 Quellen
Aufsatz (Zeitschrift)
Englisch
Interrater Reliability of Manual Pavement Distress Evaluations
British Library Online Contents | 2010
|Interrater Reliability of Manual Pavement Distress Evaluations
Online Contents | 2010
|Evaluation of interrater reliability for posture observations in a field study
Tema Archiv | 1999
|