Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk

Rocío Calvo, Shaun K. Kane, Amy Hurst

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Crowd work web sites such as Amazon Mechanical Turk enable individuals to work from home, which may be useful for people with disabilities. However, the web sites for finding and performing crowd work tasks must be accessible if people with disabilities are to use them. We performed a heuristic analysis of one crowd work site, Amazon's Mechanical Turk, using the Web Content Accessibility Guidelines 2.0. This paper presents the accessibility problems identified in our analysis and offers suggestions for making crowd work platforms more accessible.

Original languageEnglish (US)
Title of host publicationASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility
PublisherAssociation for Computing Machinery, Inc
Pages257-258
Number of pages2
ISBN (Electronic)9781450327206
DOIs
StatePublished - Oct 20 2014
Event16th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2014 - Rochester, United States
Duration: Oct 20 2014Oct 22 2014

Publication series

NameASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility

Conference

Conference16th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2014
CountryUnited States
CityRochester
Period10/20/1410/22/14

Fingerprint

Websites

Keywords

  • Accessibility
  • Crowdsourcing
  • Evaluation
  • Mechanical turk

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Human-Computer Interaction
  • Software
  • Hardware and Architecture

Cite this

Calvo, R., Kane, S. K., & Hurst, A. (2014). Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk. In ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 257-258). (ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility). Association for Computing Machinery, Inc. https://doi.org/10.1145/2661334.2661401

Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk. / Calvo, Rocío; Kane, Shaun K.; Hurst, Amy.

ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 2014. p. 257-258 (ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Calvo, R, Kane, SK & Hurst, A 2014, Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk. in ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility. ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility, Association for Computing Machinery, Inc, pp. 257-258, 16th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2014, Rochester, United States, 10/20/14. https://doi.org/10.1145/2661334.2661401
Calvo R, Kane SK, Hurst A. Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk. In ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc. 2014. p. 257-258. (ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility). https://doi.org/10.1145/2661334.2661401
Calvo, Rocío ; Kane, Shaun K. ; Hurst, Amy. / Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk. ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 2014. pp. 257-258 (ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility).
@inproceedings{782b856a8eaf418dbca21ecbb960f193,
title = "Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk",
abstract = "Crowd work web sites such as Amazon Mechanical Turk enable individuals to work from home, which may be useful for people with disabilities. However, the web sites for finding and performing crowd work tasks must be accessible if people with disabilities are to use them. We performed a heuristic analysis of one crowd work site, Amazon's Mechanical Turk, using the Web Content Accessibility Guidelines 2.0. This paper presents the accessibility problems identified in our analysis and offers suggestions for making crowd work platforms more accessible.",
keywords = "Accessibility, Crowdsourcing, Evaluation, Mechanical turk",
author = "Roc{\'i}o Calvo and Kane, {Shaun K.} and Amy Hurst",
year = "2014",
month = "10",
day = "20",
doi = "10.1145/2661334.2661401",
language = "English (US)",
series = "ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility",
publisher = "Association for Computing Machinery, Inc",
pages = "257--258",
booktitle = "ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility",

}

TY - GEN

T1 - Evaluating the accessibility of crowdsourcing tasks on Amazon's mechanical turk

AU - Calvo, Rocío

AU - Kane, Shaun K.

AU - Hurst, Amy

PY - 2014/10/20

Y1 - 2014/10/20

N2 - Crowd work web sites such as Amazon Mechanical Turk enable individuals to work from home, which may be useful for people with disabilities. However, the web sites for finding and performing crowd work tasks must be accessible if people with disabilities are to use them. We performed a heuristic analysis of one crowd work site, Amazon's Mechanical Turk, using the Web Content Accessibility Guidelines 2.0. This paper presents the accessibility problems identified in our analysis and offers suggestions for making crowd work platforms more accessible.

AB - Crowd work web sites such as Amazon Mechanical Turk enable individuals to work from home, which may be useful for people with disabilities. However, the web sites for finding and performing crowd work tasks must be accessible if people with disabilities are to use them. We performed a heuristic analysis of one crowd work site, Amazon's Mechanical Turk, using the Web Content Accessibility Guidelines 2.0. This paper presents the accessibility problems identified in our analysis and offers suggestions for making crowd work platforms more accessible.

KW - Accessibility

KW - Crowdsourcing

KW - Evaluation

KW - Mechanical turk

UR - http://www.scopus.com/inward/record.url?scp=84911457894&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911457894&partnerID=8YFLogxK

U2 - 10.1145/2661334.2661401

DO - 10.1145/2661334.2661401

M3 - Conference contribution

T3 - ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility

SP - 257

EP - 258

BT - ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility

PB - Association for Computing Machinery, Inc

ER -