|
|
|
Title: COHEN'S WEIGHTED KAPPA STATISTIC IN QUALITY CONTROL-QUALITY ASSURANCE PROCEDURES: APPLICATION TO NETWORK-LEVEL CONTRACT PAVEMENT SURFACE CONDITION SURVEYS IN BRITISH COLUMBIA, CANADA
Accession Number: 00968516
Record Type: Component
Record URL: Availability: Transportation Research Board Business Office 500 Fifth Street, NW Find a library where document is available Abstract: Like many provincial and municipal agencies, the British Columbia Ministry of Transportation (BCMoT) contracts out the collection of pavement surface condition data. Because BCMoT is committed to contracts with multiple private contractors, quality assurance (QA) plays a critical role in ensuring that the data are collected accurately and repeatably from year to year. Comprehensive QA testing procedures for surface distress data have been developed and implemented since the data collection has been based on visual ratings with event boards. Control sites that are manually surveyed are used to evaluate whether the contractor is correctly applying the BCMoT pavement surface distress rating system. To date, the QA testing has been based on a composite-index-based criterion for assessing the level of agreement and supplemented with the detailed severity and density rating data. However, the use of a composite index presents some limitations related to the model formulation and weightings assigned to particular distress types. Although the detailed ratings are useful as a diagnostic tool to pinpoint discrepancies, in the disaggregated format, they are not conducive as acceptance criteria for QA testing. Not widely used in the field of engineering, Cohen's weighted kappa statistic has been applied since the 1960s in other areas to assess the level of agreement beyond chance among raters. The statistic was therefore identified as a possible solution for improving the ministry's QA surface distress testing process by providing an overall measure of the level of agreement between the detailed manual benchmark survey and the contractor severity and density ratings. The application is described of Cohen's weighted kappa statistic for visual surface distress survey QA testing using the BCMoT survey and testing procedures as a case study.
Supplemental Notes: This paper appears in Transportation Research Record No. 1860, Pavement Assessment, Monitoring, and Evaluation 2003.
Language: English
Corporate Authors: Transportation Research Board 500 Fifth Street, NW Authors: Landers, SBekheet, WFalls, L CPagination: p. 103-108
Publication Date: 2003
Serial: ISBN: 0309085977
Features: References
(5)
; Tables
(6)
TRT Terms: Identifier Terms: Uncontrolled Terms: Geographic Terms: Subject Areas: Design; Highways; Pavements; I22: Design of Pavements, Railways and Guideways; I23: Properties of Road Surfaces
Files: TRIS, TRB, ATRI
Created Date: Jan 8 2004 12:00AM
More Articles from this Serial Issue:
|
