Relevance ranking metrics for learning objects

Xavier Ochoa, Erik Duval

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Technologies that solve the scarce availability of learning objects have created the opposite problem: abundance of choice. The solution to that problem is relevance ranking. Unfortunately current techniques used to rank learning objects are not able to present the user with a meaningful ordering of the result list. This work interpret the Information Retrieval concept of Relevance in the context of learning object search and use that interpretation to propose a set of metrics to estimate the Topical, Personal and Situational relevance. These metrics are calculated mainly from usage and contextual information. An exploratory evaluation of the metrics shows that even the simplest ones provide statistically significant improvement in the ranking order over the most common algorithmic relevance metric.

Original languageEnglish (US)
Title of host publicationCreating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings
Pages262-276
Number of pages15
StatePublished - Dec 1 2007
Event2nd European Conference on Technology Enhanced Learning, EC-TEL 2007 - Crete, Greece
Duration: Sep 1 2007Sep 1 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4753 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other2nd European Conference on Technology Enhanced Learning, EC-TEL 2007
CountryGreece
CityCrete
Period9/1/079/1/07

Fingerprint

Learning Objects
Information retrieval
Ranking
Availability
Metric
Information Retrieval
Relevance
Evaluation
Estimate

Keywords

  • Learning objects
  • Personal relevance
  • Relevance ranking
  • Situational relevance
  • Topical relevance

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Ochoa, X., & Duval, E. (2007). Relevance ranking metrics for learning objects. In Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings (pp. 262-276). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4753 LNCS).

Relevance ranking metrics for learning objects. / Ochoa, Xavier; Duval, Erik.

Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings. 2007. p. 262-276 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4753 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ochoa, X & Duval, E 2007, Relevance ranking metrics for learning objects. in Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4753 LNCS, pp. 262-276, 2nd European Conference on Technology Enhanced Learning, EC-TEL 2007, Crete, Greece, 9/1/07.
Ochoa X, Duval E. Relevance ranking metrics for learning objects. In Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings. 2007. p. 262-276. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Ochoa, Xavier ; Duval, Erik. / Relevance ranking metrics for learning objects. Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings. 2007. pp. 262-276 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{2207503bd4ae441bbf9ef76ab0c51271,
title = "Relevance ranking metrics for learning objects",
abstract = "Technologies that solve the scarce availability of learning objects have created the opposite problem: abundance of choice. The solution to that problem is relevance ranking. Unfortunately current techniques used to rank learning objects are not able to present the user with a meaningful ordering of the result list. This work interpret the Information Retrieval concept of Relevance in the context of learning object search and use that interpretation to propose a set of metrics to estimate the Topical, Personal and Situational relevance. These metrics are calculated mainly from usage and contextual information. An exploratory evaluation of the metrics shows that even the simplest ones provide statistically significant improvement in the ranking order over the most common algorithmic relevance metric.",
keywords = "Learning objects, Personal relevance, Relevance ranking, Situational relevance, Topical relevance",
author = "Xavier Ochoa and Erik Duval",
year = "2007",
month = "12",
day = "1",
language = "English (US)",
isbn = "9783540751946",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "262--276",
booktitle = "Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings",

}

TY - GEN

T1 - Relevance ranking metrics for learning objects

AU - Ochoa, Xavier

AU - Duval, Erik

PY - 2007/12/1

Y1 - 2007/12/1

N2 - Technologies that solve the scarce availability of learning objects have created the opposite problem: abundance of choice. The solution to that problem is relevance ranking. Unfortunately current techniques used to rank learning objects are not able to present the user with a meaningful ordering of the result list. This work interpret the Information Retrieval concept of Relevance in the context of learning object search and use that interpretation to propose a set of metrics to estimate the Topical, Personal and Situational relevance. These metrics are calculated mainly from usage and contextual information. An exploratory evaluation of the metrics shows that even the simplest ones provide statistically significant improvement in the ranking order over the most common algorithmic relevance metric.

AB - Technologies that solve the scarce availability of learning objects have created the opposite problem: abundance of choice. The solution to that problem is relevance ranking. Unfortunately current techniques used to rank learning objects are not able to present the user with a meaningful ordering of the result list. This work interpret the Information Retrieval concept of Relevance in the context of learning object search and use that interpretation to propose a set of metrics to estimate the Topical, Personal and Situational relevance. These metrics are calculated mainly from usage and contextual information. An exploratory evaluation of the metrics shows that even the simplest ones provide statistically significant improvement in the ranking order over the most common algorithmic relevance metric.

KW - Learning objects

KW - Personal relevance

KW - Relevance ranking

KW - Situational relevance

KW - Topical relevance

UR - http://www.scopus.com/inward/record.url?scp=38349087619&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38349087619&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9783540751946

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 262

EP - 276

BT - Creating New Learning Experiences on a Global Scale - Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Proceedings

ER -