Interrater reliability and discriminant validity of the deductive reasoning test

Yael Goverover, Jim Hinojosa

Research output: Contribution to journalArticle

Abstract

OBJECTIVE. The purpose of this study was to determine the interrater reliability and discriminant validity of Toglia's Deductive Reasoning test for individuals with brain injuries. METHOD. Forty-two individuals with brain injuries and 51 participants without disabilities ranging in age from 18 to 84 years were given the Deductive Reasoning test three consecutive times. A between groups repeated measure design was used to examine differences between the two groups in performance of the Deductive Reasoning test across the three trials. RESULTS. An interclass correlation coefficient (ICC) was statistically significant, indicating good interrater reliability for participants without disabilities. A repeated measures analysis of variance (ANOVA) comparing performance across trials and between groups revealed a significant group main effect, F(1,91) = 52.68, p < .001, thus, participants with brain injuries performed significantly lower on the test than participants without disabilities. This analysis also revealed a significant increase in all participants' scores across trials, F(1.63, 148.67) = 35.094, p < .001. CONCLUSION. Findings confirm acceptable interrater reliability of the Deductive Reasoning test. Further, comparison of the performance of the two groups supports the discriminant validity of the Deductive Reasoning test for individuals with brain injuries. Thus, the Deductive Reasoning test was found to be an appropriate, valid, and reliable assessment tool for occupational therapists to assess deductive reasoning skills in individuals with brain injuries. Additional research is needed to continue to investigate the psychometric value of the Deductive Reasoning test so that clinicians and researchers can use it appropriately.

Original languageEnglish (US)
Pages (from-to)104-108
Number of pages5
JournalAmerican Journal of Occupational Therapy
Volume58
Issue number1
StatePublished - Jan 2004

Fingerprint

Reproducibility of Results
Brain Injuries
Psychometrics
Analysis of Variance
Research Personnel
Research

Keywords

  • Brain injury
  • Executive functions
  • Toglia's Category Assessment
  • traumatic brain injury
  • deductive reasoning

ASJC Scopus subject areas

  • Rehabilitation
  • Health Professions(all)

Cite this

Interrater reliability and discriminant validity of the deductive reasoning test. / Goverover, Yael; Hinojosa, Jim.

In: American Journal of Occupational Therapy, Vol. 58, No. 1, 01.2004, p. 104-108.

Research output: Contribution to journalArticle

@article{8bd846e3c2d7434890bcd2665ccd82ae,
title = "Interrater reliability and discriminant validity of the deductive reasoning test",
abstract = "OBJECTIVE. The purpose of this study was to determine the interrater reliability and discriminant validity of Toglia's Deductive Reasoning test for individuals with brain injuries. METHOD. Forty-two individuals with brain injuries and 51 participants without disabilities ranging in age from 18 to 84 years were given the Deductive Reasoning test three consecutive times. A between groups repeated measure design was used to examine differences between the two groups in performance of the Deductive Reasoning test across the three trials. RESULTS. An interclass correlation coefficient (ICC) was statistically significant, indicating good interrater reliability for participants without disabilities. A repeated measures analysis of variance (ANOVA) comparing performance across trials and between groups revealed a significant group main effect, F(1,91) = 52.68, p < .001, thus, participants with brain injuries performed significantly lower on the test than participants without disabilities. This analysis also revealed a significant increase in all participants' scores across trials, F(1.63, 148.67) = 35.094, p < .001. CONCLUSION. Findings confirm acceptable interrater reliability of the Deductive Reasoning test. Further, comparison of the performance of the two groups supports the discriminant validity of the Deductive Reasoning test for individuals with brain injuries. Thus, the Deductive Reasoning test was found to be an appropriate, valid, and reliable assessment tool for occupational therapists to assess deductive reasoning skills in individuals with brain injuries. Additional research is needed to continue to investigate the psychometric value of the Deductive Reasoning test so that clinicians and researchers can use it appropriately.",
keywords = "Brain injury, Executive functions, Toglia's Category Assessment, traumatic brain injury, deductive reasoning",
author = "Yael Goverover and Jim Hinojosa",
year = "2004",
month = "1",
language = "English (US)",
volume = "58",
pages = "104--108",
journal = "American Journal of Occupational Therapy",
issn = "0272-9490",
publisher = "American Occupational Therapy Association, Inc",
number = "1",

}

TY - JOUR

T1 - Interrater reliability and discriminant validity of the deductive reasoning test

AU - Goverover, Yael

AU - Hinojosa, Jim

PY - 2004/1

Y1 - 2004/1

N2 - OBJECTIVE. The purpose of this study was to determine the interrater reliability and discriminant validity of Toglia's Deductive Reasoning test for individuals with brain injuries. METHOD. Forty-two individuals with brain injuries and 51 participants without disabilities ranging in age from 18 to 84 years were given the Deductive Reasoning test three consecutive times. A between groups repeated measure design was used to examine differences between the two groups in performance of the Deductive Reasoning test across the three trials. RESULTS. An interclass correlation coefficient (ICC) was statistically significant, indicating good interrater reliability for participants without disabilities. A repeated measures analysis of variance (ANOVA) comparing performance across trials and between groups revealed a significant group main effect, F(1,91) = 52.68, p < .001, thus, participants with brain injuries performed significantly lower on the test than participants without disabilities. This analysis also revealed a significant increase in all participants' scores across trials, F(1.63, 148.67) = 35.094, p < .001. CONCLUSION. Findings confirm acceptable interrater reliability of the Deductive Reasoning test. Further, comparison of the performance of the two groups supports the discriminant validity of the Deductive Reasoning test for individuals with brain injuries. Thus, the Deductive Reasoning test was found to be an appropriate, valid, and reliable assessment tool for occupational therapists to assess deductive reasoning skills in individuals with brain injuries. Additional research is needed to continue to investigate the psychometric value of the Deductive Reasoning test so that clinicians and researchers can use it appropriately.

AB - OBJECTIVE. The purpose of this study was to determine the interrater reliability and discriminant validity of Toglia's Deductive Reasoning test for individuals with brain injuries. METHOD. Forty-two individuals with brain injuries and 51 participants without disabilities ranging in age from 18 to 84 years were given the Deductive Reasoning test three consecutive times. A between groups repeated measure design was used to examine differences between the two groups in performance of the Deductive Reasoning test across the three trials. RESULTS. An interclass correlation coefficient (ICC) was statistically significant, indicating good interrater reliability for participants without disabilities. A repeated measures analysis of variance (ANOVA) comparing performance across trials and between groups revealed a significant group main effect, F(1,91) = 52.68, p < .001, thus, participants with brain injuries performed significantly lower on the test than participants without disabilities. This analysis also revealed a significant increase in all participants' scores across trials, F(1.63, 148.67) = 35.094, p < .001. CONCLUSION. Findings confirm acceptable interrater reliability of the Deductive Reasoning test. Further, comparison of the performance of the two groups supports the discriminant validity of the Deductive Reasoning test for individuals with brain injuries. Thus, the Deductive Reasoning test was found to be an appropriate, valid, and reliable assessment tool for occupational therapists to assess deductive reasoning skills in individuals with brain injuries. Additional research is needed to continue to investigate the psychometric value of the Deductive Reasoning test so that clinicians and researchers can use it appropriately.

KW - Brain injury

KW - Executive functions

KW - Toglia's Category Assessment

KW - traumatic brain injury

KW - deductive reasoning

UR - http://www.scopus.com/inward/record.url?scp=2142763899&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=2142763899&partnerID=8YFLogxK

M3 - Article

VL - 58

SP - 104

EP - 108

JO - American Journal of Occupational Therapy

JF - American Journal of Occupational Therapy

SN - 0272-9490

IS - 1

ER -