Home | Industry Information | Business News | Browse by Publication | M | Measurement and Evaluation in Counseling and Development

Estimation of internal consistency reliability when test parts vary in effective length. (Methods, Plainly Speaking).(Gilmer-Feldt coefficient)

Publication: Measurement and Evaluation in Counseling and Development
Publication Date: 01-APR-03
Format: Online - approximately 2284 words
Delivery: Immediate Online Access

Article Excerpt
Evaluating a test's reliability often requires dividing it into 3 or more unequal parts, which causes violation of the tau equivalence assumption of Cronbach's alpha. This article presents a criterion for abandoning alpha and an approach for computing a more appropriate estimate of the (J. S....

View more below

Read this article now - Try Goliath Business News - FREE!   
You can view this article PLUS...

  • Over 5 million business articles
  • Hundreds of the most trusted magazines, newswires, and journals (see list)
  • Premium business information that is timely and relevant
  • Unlimited Access

Now for a Limited Time, try Goliath Business News - Free for 7 Days!
Tell Me More   Terms and Conditions

Purchase this article for $4.95

Already a subscriber? Log in to view full article

...reliability, Gilmer-Feldt coefficient Gilmer & L. S. Feldi, 1983).

If circumstances force a researcher to estimate reliability by the internal consistency approach, it is sometimes impossible to divide the instrument into parts of equal length. For example, suppose a test is composed of scores summed over four trials of a particular task. The trials become the "parts" of the total score, and trial scores may become more variable or less variable from the first to the last trial. If a panel of three or more judges constitutes the source of measurement data, the variances of the ratings of individual judges may vary significantly. The heterogeneity of the variances strongly suggests that the judges function as shorter or longer parts of the overall measurement of each subject.

The classical theory of measurement represents the observed score, [X.sub.ij], of subject I on part j of a test as

[X.sub.ij] = [T.sub.i] + [E.sub.ij']

where [T.sub.i] is the unchanging true score of subject i and [E.sub.ij] is the error of measurement of subject i on part j. Cronbach's alpha assumes that the variance of [T.sub.i] (over subjects) does not change from one test part to another, whereas the variance of [E.su.ij] may vary from part to part. Such measures are called tau equivalent by Lord and Novick (1968). If the variance of both [T.sub.i] and [E.sub.ij] vary from part to part (the true score would then be symbolized [T.sub.ij]), the parts are termed congeneric by Joreskog (1971). Angoff (1953) and Feldt (1975) described congeneric tests or part-tests as differing in effective or functional length. For example, in an essay test of three items, Essay 1 may contribute 20% to the total test true score, Essay 2 may contribute 30%, and Essay 3 may contribute 50%. These would constitute...

NOTE: All illustrations and photos have been removed from this article.



More articles from Measurement and Evaluation in Counseling and Development
Performing multivariate group comparisons following a statistically si..., April 01, 2003
Single-case time series with Bayesian analysis: a practitioner's guide..., April 01, 2003

Looking for additional articles?
Search our database of over 3 million articles.

Looking for more in-depth information on this industry?
Search our complete database of Industry & Market reports by text, subject, publication name or publication date.

About Goliath
Whether you're looking for sales prospects, competitive information, company analysis or best practices in managing your organization, Goliath can help you meet your business needs.

Our extensive business information databases empower business professionals with both the breadth and depth of credible, authoritative information they need to support their business goals. Whether it be strategic planning, sales prospecting, company research or defining management best practices - Goliath is your leading source for accurate information.