|
...using both predictive and postdictive criterion-related validation designs. The value and importance of constructive replication (Hendrick, 1990; Kelly, Chase, & Tucker, 1979), defined as "research that tests the same hypothesized relationships among the same theoretical constructs as a given earlier study but varies the 'operationalization' of those constructs" (Eden, 2002, p. 842), resides in its ability to strengthen confidence in and enhance the credibility of generalizations when the hypothesized relationships are confirmed using different methods. Along these lines, one of the critical goals of this study was to compare the extent to which predictive and postdictive designs yield similar (or different) criterion-related validities.
There is a reasonably large body of research examining the predictive validity of individual differences in motor vehicle crash involvement (for reviews see Arthur, Barrett, & Alexander, 1991; Elander, West, & French, 1993; Guastello, 1993), and in this research self-report accounts of crash involvement have been the most commonly used criterion (Ball & Owsley, 1991). However, although several reasons may explain the prevalence of self-reports (Elander et al., 1993), questions about their veracity and accuracy have been raised (see Elander et al., 1993; Harano, Peck, & McBride, 1975; Loftus, 1993). Consequently, archival data have been considered as an alternative to self-reports.
Self-Report and Archival Data
For several reasons, self-report measures of crash involvement are the most commonly used criterion measures. For instance, they are relatively easy to collect and enable researchers to sample all crash types. However, self-report measures have been criticized for being inherently susceptible to cognitive and communicative biases, such as selective memory and question comprehension (Elander et al., 1993; Harano et al., 1975; Loftus, 1995; Schwarz, 1999). In contrast, archival records of crash involvement--which are usually obtained from state law enforcement agencies and insurance companies--are assumed to be free of the biases associated with self-report measures. However, this type of data carries its own set of disadvantages. For example, it is generally more difficult to obtain. Another major disadvantage of archival driving records is that they are often incomplete because (a) police selectively report crash involvement, (b) moving violation tickets are removed from drivers' records in exchange for driving course credit, (c) the parties involved sometimes choose not to report the crash, or (d) interstate information exchange of data on crashes and moving violations is incomplete (Bums & Wilde, 1995; McGuire, 1973; Smith, 1976).
Given the important trade-offs between using either archival or self-report data in motor vehicle crash research, few studies have investigated the convergence between these two sources of criterion data. A handful of studies have collected crash data via both self-reports and state records (e.g., Dalziel & Job, 1997; Hilakivi et al., 1989; Marottoli, Cooney, & Tinetti, 1997; Owsley, Ball, Sloane, Roenker, & Bruni, 1991), and some have included performance on a driving simulator (e.g., Szlyk, Alexander, Severing, & Fishman, 1992; Szlyk, Fishman, Severing, Alexander, & Viana, 1993; Szlyk, Seiple, & Viana, 1995). However, most of these studies have used very restricted and specialized samples (e.g., older adults or participants with specialized medical conditions, such as retinitis pigmentosa and juvenile macular dystrophies). In addition, the convergence between the criterion sources has typically not been assessed because it was not the primary focus of the study. McGuire (1975), McGwin, Owsley, and Ball (1998), and Smith (1976) are three examples of studies that specifically investigated the convergence issue.
In addition to assessing the convergence between archival and self-report data, McGuire (1973) investigated the presence of systematic bias in official driving records. Archival driving data were obtained from the Mississippi Highway Patrol, and self-report data were obtained by telephone interviews. McGuire's (1973) results indicated that crash and citation data were grossly underreported in the official records. Even more important, however, there were systematic sex, race, age, and occupation biases.
McGwin et al. (1998) investigated crash information source as a potential explanation for the inconsistencies observed in the extant literature on medical and functional risk factors for older drivers. McGwin et al. (1998) concluded that there was a moderate level of agreement between self-report and state-recorded crash involvement. However, there were significant differences between crash-involved drivers identified via state records and self-report with respect to factors such as age, race, amount of driving, and vision impairment.
Finally, in a test of Zylman's (1972) claim that research studies based on archival data may yield spurious results, Smith (1976) investigated whether or not the exclusive use of official driver records is appropriate. In addition to reviewing official records obtained from the Road Traffic Authority (Western Australia), he interviewed participants to obtain self-report data. His results indicated that participants self-reported more crashes and driving-related convictions than were present in the official records. In addition, relationships between crashes and specified driver characteristics were significant only when archival data were combined with self-reports, leading him to conclude that his "study provides empirical support for Zylman's (1972) assertion that when used for research purposes, official driver records may yield spurious results" (Smith, 1976, p. 210).
In summary, the preceding studies suggest generally low levels of convergence between self-report and archival data, with the frequency of the former being higher than the latter. Nevertheless, although they provide some preliminary insight about the convergence (or lack thereof) between archival and self-report crash data, certain limitations of these...
NOTE: All illustrations and photos
have been removed from this article.
More articles from Human Factors
Blind and sighted pedestrians' judgments of gaps in traffic at roundab..., June 22, 2005
Cognitive anchoring on self-generated decisions reduces operator relia..., June 22, 2005
An evaluation of a "time tunnel" display format for the pres..., June 22, 2005
The efficacy of naps as a fatigue countermeasure: a meta-analytic inte..., June 22, 2005
Effects of visual flow display of flight maneuvers on perceived spatia..., June 22, 2005
Looking for additional articles?
Search our database of over 3 million articles.
Looking for more in-depth information on this industry?
Search our complete database of Industry & Market reports by text, subject, publication
name or publication date.
About Goliath
Whether you're looking for sales prospects, competitive information, company
analysis or best practices in managing your organization,
Goliath can help you meet your business needs.
Our extensive business information databases empower business
professionals with both the breadth and depth of credible,
authoritative information they need to support their business
goals. Whether it be strategic planning, sales prospecting,
company research or defining management best practices -
Goliath is your leading source for accurate information.
|
