Applying generalizability theory methods to assess continuity and change on the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS)

Ligia M. Chavez, Pedro Garcia, Nyrma Ortiz, Patrick Shrout

Research output: Contribution to journalArticle

Abstract

Purpose: The Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) is designed to measure quality of life in clinical samples of Latino adolescents aged 12–18 years. Initial findings support its reliability, validity and conceptual model for use of its three domains (emotional regulation, self-concept and social context). Our current study tests the usefulness of the AQOL-MHS for tracking changes in HRQOL during the course of service use. Methods: Three waves of data were collected from 59 participants who were recruited from mental health clinics, where waves were spaced 4 months apart. Participants were receiving services at baseline assessment and were tracked for follow-up appointments regardless of treatment status. We analyze conventional reliability statistics for individual differences (e.g., Cronbach’s alpha and test–retest correlations), and to estimate the reliability of change, we carried out a variance decomposition analysis. Results: The psychometric analyses from Chavez et al. (Qual Life Res 23(4):1327–1335, 2014) were replicated with comparable results. A generalizability theory (GT) analysis revealed that the AQOL-MHS domains can measure change reliably. The reliability estimates varied from .65 to .78. Although there was reliable change at the individual level, on the average the AQOL-MHS means improved only slightly over time. Conclusions: The reliability of change for all three scales in the AQOL-MHS was acceptable, but consistently lower than the Cronbach’s alpha values for each wave. Future work will use this approach to adapt our current measure to provide a better reliability of within-person change and thus broaden its applicability for prospective use.

Original languageEnglish (US)
Pages (from-to)1-6
Number of pages6
JournalQuality of Life Research
DOIs
StateAccepted/In press - Jun 25 2016

Fingerprint

Mental Health
Quality of Life
Hispanic Americans
Psychometrics
Self Concept
Reproducibility of Results
Individuality
Analysis of Variance
Appointments and Schedules
Therapeutics

Keywords

  • Adolescents
  • Generalizability theory
  • Mental health
  • Quality of life

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Applying generalizability theory methods to assess continuity and change on the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS). / Chavez, Ligia M.; Garcia, Pedro; Ortiz, Nyrma; Shrout, Patrick.

In: Quality of Life Research, 25.06.2016, p. 1-6.

Research output: Contribution to journalArticle

@article{3451889b9d964519809ec5b602edd0f9,
title = "Applying generalizability theory methods to assess continuity and change on the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS)",
abstract = "Purpose: The Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) is designed to measure quality of life in clinical samples of Latino adolescents aged 12–18 years. Initial findings support its reliability, validity and conceptual model for use of its three domains (emotional regulation, self-concept and social context). Our current study tests the usefulness of the AQOL-MHS for tracking changes in HRQOL during the course of service use. Methods: Three waves of data were collected from 59 participants who were recruited from mental health clinics, where waves were spaced 4 months apart. Participants were receiving services at baseline assessment and were tracked for follow-up appointments regardless of treatment status. We analyze conventional reliability statistics for individual differences (e.g., Cronbach’s alpha and test–retest correlations), and to estimate the reliability of change, we carried out a variance decomposition analysis. Results: The psychometric analyses from Chavez et al. (Qual Life Res 23(4):1327–1335, 2014) were replicated with comparable results. A generalizability theory (GT) analysis revealed that the AQOL-MHS domains can measure change reliably. The reliability estimates varied from .65 to .78. Although there was reliable change at the individual level, on the average the AQOL-MHS means improved only slightly over time. Conclusions: The reliability of change for all three scales in the AQOL-MHS was acceptable, but consistently lower than the Cronbach’s alpha values for each wave. Future work will use this approach to adapt our current measure to provide a better reliability of within-person change and thus broaden its applicability for prospective use.",
keywords = "Adolescents, Generalizability theory, Mental health, Quality of life",
author = "Chavez, {Ligia M.} and Pedro Garcia and Nyrma Ortiz and Patrick Shrout",
year = "2016",
month = "6",
day = "25",
doi = "10.1007/s11136-016-1344-0",
language = "English (US)",
pages = "1--6",
journal = "Quality of Life Research",
issn = "0962-9343",
publisher = "Springer Netherlands",

}

TY - JOUR

T1 - Applying generalizability theory methods to assess continuity and change on the Adolescent Quality of Life-Mental Health Scale (AQOL-MHS)

AU - Chavez, Ligia M.

AU - Garcia, Pedro

AU - Ortiz, Nyrma

AU - Shrout, Patrick

PY - 2016/6/25

Y1 - 2016/6/25

N2 - Purpose: The Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) is designed to measure quality of life in clinical samples of Latino adolescents aged 12–18 years. Initial findings support its reliability, validity and conceptual model for use of its three domains (emotional regulation, self-concept and social context). Our current study tests the usefulness of the AQOL-MHS for tracking changes in HRQOL during the course of service use. Methods: Three waves of data were collected from 59 participants who were recruited from mental health clinics, where waves were spaced 4 months apart. Participants were receiving services at baseline assessment and were tracked for follow-up appointments regardless of treatment status. We analyze conventional reliability statistics for individual differences (e.g., Cronbach’s alpha and test–retest correlations), and to estimate the reliability of change, we carried out a variance decomposition analysis. Results: The psychometric analyses from Chavez et al. (Qual Life Res 23(4):1327–1335, 2014) were replicated with comparable results. A generalizability theory (GT) analysis revealed that the AQOL-MHS domains can measure change reliably. The reliability estimates varied from .65 to .78. Although there was reliable change at the individual level, on the average the AQOL-MHS means improved only slightly over time. Conclusions: The reliability of change for all three scales in the AQOL-MHS was acceptable, but consistently lower than the Cronbach’s alpha values for each wave. Future work will use this approach to adapt our current measure to provide a better reliability of within-person change and thus broaden its applicability for prospective use.

AB - Purpose: The Adolescent Quality of Life-Mental Health Scale (AQOL-MHS) is designed to measure quality of life in clinical samples of Latino adolescents aged 12–18 years. Initial findings support its reliability, validity and conceptual model for use of its three domains (emotional regulation, self-concept and social context). Our current study tests the usefulness of the AQOL-MHS for tracking changes in HRQOL during the course of service use. Methods: Three waves of data were collected from 59 participants who were recruited from mental health clinics, where waves were spaced 4 months apart. Participants were receiving services at baseline assessment and were tracked for follow-up appointments regardless of treatment status. We analyze conventional reliability statistics for individual differences (e.g., Cronbach’s alpha and test–retest correlations), and to estimate the reliability of change, we carried out a variance decomposition analysis. Results: The psychometric analyses from Chavez et al. (Qual Life Res 23(4):1327–1335, 2014) were replicated with comparable results. A generalizability theory (GT) analysis revealed that the AQOL-MHS domains can measure change reliably. The reliability estimates varied from .65 to .78. Although there was reliable change at the individual level, on the average the AQOL-MHS means improved only slightly over time. Conclusions: The reliability of change for all three scales in the AQOL-MHS was acceptable, but consistently lower than the Cronbach’s alpha values for each wave. Future work will use this approach to adapt our current measure to provide a better reliability of within-person change and thus broaden its applicability for prospective use.

KW - Adolescents

KW - Generalizability theory

KW - Mental health

KW - Quality of life

UR - http://www.scopus.com/inward/record.url?scp=84976325858&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84976325858&partnerID=8YFLogxK

U2 - 10.1007/s11136-016-1344-0

DO - 10.1007/s11136-016-1344-0

M3 - Article

C2 - 27344319

AN - SCOPUS:84976325858

SP - 1

EP - 6

JO - Quality of Life Research

JF - Quality of Life Research

SN - 0962-9343

ER -