Evaluating online learning communities

Fengfeng Ke, Christopher Hoadley

Research output: Contribution to journalArticle

Abstract

This article reviews recent evaluation studies of online learning communities to provide a systematic understanding of how such communities are evaluated. Forty-two representative studies were selected and categorized into a newly developed taxonomy of online learning community evaluations. This taxonomy is divided into four components: evaluation purpose, evaluation approach, measures for evaluation, and evaluation techniques. The findings suggest that it is inappropriate to conceptualize evaluation of such communities as a one-size-fits-all, generalizable measure of "good" or "bad." Instead, we recommend a comprehensive, on-going, diagnostic approach to measuring clusters of indicators, or syndromes, of a particular OLC and examining the causal relation assumed by the evaluators between what is measured and the success of OLC as an imputed outcome.

Original languageEnglish (US)
Pages (from-to)487-510
Number of pages24
JournalEducational Technology Research and Development
Volume57
Issue number4
DOIs
StatePublished - 2009

Fingerprint

evaluation
learning
community
taxonomy
diagnostic

Keywords

  • Evaluation
  • Literature review
  • Online learning communities
  • Sensitivity analysis

ASJC Scopus subject areas

  • Education

Cite this

Evaluating online learning communities. / Ke, Fengfeng; Hoadley, Christopher.

In: Educational Technology Research and Development, Vol. 57, No. 4, 2009, p. 487-510.

Research output: Contribution to journalArticle

@article{030069eadf3f4576b511bda6c6e6568e,
title = "Evaluating online learning communities",
abstract = "This article reviews recent evaluation studies of online learning communities to provide a systematic understanding of how such communities are evaluated. Forty-two representative studies were selected and categorized into a newly developed taxonomy of online learning community evaluations. This taxonomy is divided into four components: evaluation purpose, evaluation approach, measures for evaluation, and evaluation techniques. The findings suggest that it is inappropriate to conceptualize evaluation of such communities as a one-size-fits-all, generalizable measure of {"}good{"} or {"}bad.{"} Instead, we recommend a comprehensive, on-going, diagnostic approach to measuring clusters of indicators, or syndromes, of a particular OLC and examining the causal relation assumed by the evaluators between what is measured and the success of OLC as an imputed outcome.",
keywords = "Evaluation, Literature review, Online learning communities, Sensitivity analysis",
author = "Fengfeng Ke and Christopher Hoadley",
year = "2009",
doi = "10.1007/s11423-009-9120-2",
language = "English (US)",
volume = "57",
pages = "487--510",
journal = "Educational Technology Research and Development",
issn = "1042-1629",
publisher = "Springer Boston",
number = "4",

}

TY - JOUR

T1 - Evaluating online learning communities

AU - Ke, Fengfeng

AU - Hoadley, Christopher

PY - 2009

Y1 - 2009

N2 - This article reviews recent evaluation studies of online learning communities to provide a systematic understanding of how such communities are evaluated. Forty-two representative studies were selected and categorized into a newly developed taxonomy of online learning community evaluations. This taxonomy is divided into four components: evaluation purpose, evaluation approach, measures for evaluation, and evaluation techniques. The findings suggest that it is inappropriate to conceptualize evaluation of such communities as a one-size-fits-all, generalizable measure of "good" or "bad." Instead, we recommend a comprehensive, on-going, diagnostic approach to measuring clusters of indicators, or syndromes, of a particular OLC and examining the causal relation assumed by the evaluators between what is measured and the success of OLC as an imputed outcome.

AB - This article reviews recent evaluation studies of online learning communities to provide a systematic understanding of how such communities are evaluated. Forty-two representative studies were selected and categorized into a newly developed taxonomy of online learning community evaluations. This taxonomy is divided into four components: evaluation purpose, evaluation approach, measures for evaluation, and evaluation techniques. The findings suggest that it is inappropriate to conceptualize evaluation of such communities as a one-size-fits-all, generalizable measure of "good" or "bad." Instead, we recommend a comprehensive, on-going, diagnostic approach to measuring clusters of indicators, or syndromes, of a particular OLC and examining the causal relation assumed by the evaluators between what is measured and the success of OLC as an imputed outcome.

KW - Evaluation

KW - Literature review

KW - Online learning communities

KW - Sensitivity analysis

UR - http://www.scopus.com/inward/record.url?scp=70350004970&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350004970&partnerID=8YFLogxK

U2 - 10.1007/s11423-009-9120-2

DO - 10.1007/s11423-009-9120-2

M3 - Article

VL - 57

SP - 487

EP - 510

JO - Educational Technology Research and Development

JF - Educational Technology Research and Development

SN - 1042-1629

IS - 4

ER -