Personalizing web search results by reading level

Kevyn Collins-Thompson, Paul N. Bennett, Ryen W. White, Sebastian De La Chica, David Sontag

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Traditionally, search engines have ignored the reading difficulty of documents and the reading proficiency of users in computing a document ranking. This is one reason why Web search engines do a poor job of serving an important segment of the population: children. While there are many important problems in interface design, content filtering, and results presentation related to addressing children's search needs, perhaps the most fundamental challenge is simply that of providing relevant results at the right level of reading difficulty. At the opposite end of the proficiency spectrum, it may also be valuable for technical users to find more advanced material or to filter out material at lower levels of difficulty, such as tutorials and introductory texts. We show how reading level can provide a valuable new relevance signal for both general and personalized Web search. We describe models and algorithms to address the three key problems in improving relevance for search using reading difficulty: estimating user proficiency, estimating result difficulty, and re-ranking based on the difference between user and result reading level profiles. We evaluate our methods on a large volume of Web query traffic and provide a large-scale log analysis that highlights the importance of finding results at an appropriate reading level for the user.

Original languageEnglish (US)
Title of host publicationCIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management
Pages403-412
Number of pages10
DOIs
StatePublished - 2011
Event20th ACM Conference on Information and Knowledge Management, CIKM'11 - Glasgow, United Kingdom
Duration: Oct 24 2011Oct 28 2011

Other

Other20th ACM Conference on Information and Knowledge Management, CIKM'11
CountryUnited Kingdom
CityGlasgow
Period10/24/1110/28/11

Fingerprint

Web search
Search engine
Tutorial
Reranking
World Wide Web
Query
Ranking
Filter
Interface design

Keywords

  • personalization
  • re-ranking
  • reading difficulty

ASJC Scopus subject areas

  • Business, Management and Accounting(all)
  • Decision Sciences(all)

Cite this

Collins-Thompson, K., Bennett, P. N., White, R. W., De La Chica, S., & Sontag, D. (2011). Personalizing web search results by reading level. In CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management (pp. 403-412) https://doi.org/10.1145/2063576.2063639

Personalizing web search results by reading level. / Collins-Thompson, Kevyn; Bennett, Paul N.; White, Ryen W.; De La Chica, Sebastian; Sontag, David.

CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management. 2011. p. 403-412.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Collins-Thompson, K, Bennett, PN, White, RW, De La Chica, S & Sontag, D 2011, Personalizing web search results by reading level. in CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management. pp. 403-412, 20th ACM Conference on Information and Knowledge Management, CIKM'11, Glasgow, United Kingdom, 10/24/11. https://doi.org/10.1145/2063576.2063639
Collins-Thompson K, Bennett PN, White RW, De La Chica S, Sontag D. Personalizing web search results by reading level. In CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management. 2011. p. 403-412 https://doi.org/10.1145/2063576.2063639
Collins-Thompson, Kevyn ; Bennett, Paul N. ; White, Ryen W. ; De La Chica, Sebastian ; Sontag, David. / Personalizing web search results by reading level. CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management. 2011. pp. 403-412
@inproceedings{b662119f971a40de8a1a08118170801c,
title = "Personalizing web search results by reading level",
abstract = "Traditionally, search engines have ignored the reading difficulty of documents and the reading proficiency of users in computing a document ranking. This is one reason why Web search engines do a poor job of serving an important segment of the population: children. While there are many important problems in interface design, content filtering, and results presentation related to addressing children's search needs, perhaps the most fundamental challenge is simply that of providing relevant results at the right level of reading difficulty. At the opposite end of the proficiency spectrum, it may also be valuable for technical users to find more advanced material or to filter out material at lower levels of difficulty, such as tutorials and introductory texts. We show how reading level can provide a valuable new relevance signal for both general and personalized Web search. We describe models and algorithms to address the three key problems in improving relevance for search using reading difficulty: estimating user proficiency, estimating result difficulty, and re-ranking based on the difference between user and result reading level profiles. We evaluate our methods on a large volume of Web query traffic and provide a large-scale log analysis that highlights the importance of finding results at an appropriate reading level for the user.",
keywords = "personalization, re-ranking, reading difficulty",
author = "Kevyn Collins-Thompson and Bennett, {Paul N.} and White, {Ryen W.} and {De La Chica}, Sebastian and David Sontag",
year = "2011",
doi = "10.1145/2063576.2063639",
language = "English (US)",
isbn = "9781450307178",
pages = "403--412",
booktitle = "CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management",

}

TY - GEN

T1 - Personalizing web search results by reading level

AU - Collins-Thompson, Kevyn

AU - Bennett, Paul N.

AU - White, Ryen W.

AU - De La Chica, Sebastian

AU - Sontag, David

PY - 2011

Y1 - 2011

N2 - Traditionally, search engines have ignored the reading difficulty of documents and the reading proficiency of users in computing a document ranking. This is one reason why Web search engines do a poor job of serving an important segment of the population: children. While there are many important problems in interface design, content filtering, and results presentation related to addressing children's search needs, perhaps the most fundamental challenge is simply that of providing relevant results at the right level of reading difficulty. At the opposite end of the proficiency spectrum, it may also be valuable for technical users to find more advanced material or to filter out material at lower levels of difficulty, such as tutorials and introductory texts. We show how reading level can provide a valuable new relevance signal for both general and personalized Web search. We describe models and algorithms to address the three key problems in improving relevance for search using reading difficulty: estimating user proficiency, estimating result difficulty, and re-ranking based on the difference between user and result reading level profiles. We evaluate our methods on a large volume of Web query traffic and provide a large-scale log analysis that highlights the importance of finding results at an appropriate reading level for the user.

AB - Traditionally, search engines have ignored the reading difficulty of documents and the reading proficiency of users in computing a document ranking. This is one reason why Web search engines do a poor job of serving an important segment of the population: children. While there are many important problems in interface design, content filtering, and results presentation related to addressing children's search needs, perhaps the most fundamental challenge is simply that of providing relevant results at the right level of reading difficulty. At the opposite end of the proficiency spectrum, it may also be valuable for technical users to find more advanced material or to filter out material at lower levels of difficulty, such as tutorials and introductory texts. We show how reading level can provide a valuable new relevance signal for both general and personalized Web search. We describe models and algorithms to address the three key problems in improving relevance for search using reading difficulty: estimating user proficiency, estimating result difficulty, and re-ranking based on the difference between user and result reading level profiles. We evaluate our methods on a large volume of Web query traffic and provide a large-scale log analysis that highlights the importance of finding results at an appropriate reading level for the user.

KW - personalization

KW - re-ranking

KW - reading difficulty

UR - http://www.scopus.com/inward/record.url?scp=83055181765&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=83055181765&partnerID=8YFLogxK

U2 - 10.1145/2063576.2063639

DO - 10.1145/2063576.2063639

M3 - Conference contribution

SN - 9781450307178

SP - 403

EP - 412

BT - CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management

ER -