Bias in Computer Systems

Batya Friedman, Helen Nissenbaum

Research output: Contribution to journalArticle

Abstract

From an analysis of actual cases, three categories of bias in computer systems have been developed: preexisting, technical, and emergent. Preexisting bias has its roots in social institutions, practices, and attitudes. Technical bias arises from technical constraints or considerations. Emergent bias arises in a context of use. Although others have pointed to bias in particular computer systems and have noted the general problem, we know of no comparable work that examines this phenomenon comprehensively and which offers a framework for understanding and remedying it. We conclude by suggesting that freedom from bias should be counted among the select set of criteria - including reliability, accuracy, and efficiency -according to which the quality of systems in use in society should be judged.

Original languageEnglish (US)
Pages (from-to)330-347
Number of pages18
JournalACM Transactions on Information Systems
Volume14
Issue number3
StatePublished - Jul 1996

Fingerprint

Computer systems

Keywords

  • Bias
  • Computer ethics
  • Computers and society
  • D.2.0 [Software]: Software Engineering
  • Design
  • Design methods
  • Ethics
  • H.1.2 [Information Systems]: User/Machine Systems
  • Human Factors
  • Human values
  • K.4.0 [Computers and Society]: General
  • Standards

ASJC Scopus subject areas

  • Information Systems

Cite this

Friedman, B., & Nissenbaum, H. (1996). Bias in Computer Systems. ACM Transactions on Information Systems, 14(3), 330-347.

Bias in Computer Systems. / Friedman, Batya; Nissenbaum, Helen.

In: ACM Transactions on Information Systems, Vol. 14, No. 3, 07.1996, p. 330-347.

Research output: Contribution to journalArticle

Friedman, B & Nissenbaum, H 1996, 'Bias in Computer Systems', ACM Transactions on Information Systems, vol. 14, no. 3, pp. 330-347.
Friedman B, Nissenbaum H. Bias in Computer Systems. ACM Transactions on Information Systems. 1996 Jul;14(3):330-347.
Friedman, Batya ; Nissenbaum, Helen. / Bias in Computer Systems. In: ACM Transactions on Information Systems. 1996 ; Vol. 14, No. 3. pp. 330-347.
@article{8ccf7c3bdbaa4ceaa609ee0835da8367,
title = "Bias in Computer Systems",
abstract = "From an analysis of actual cases, three categories of bias in computer systems have been developed: preexisting, technical, and emergent. Preexisting bias has its roots in social institutions, practices, and attitudes. Technical bias arises from technical constraints or considerations. Emergent bias arises in a context of use. Although others have pointed to bias in particular computer systems and have noted the general problem, we know of no comparable work that examines this phenomenon comprehensively and which offers a framework for understanding and remedying it. We conclude by suggesting that freedom from bias should be counted among the select set of criteria - including reliability, accuracy, and efficiency -according to which the quality of systems in use in society should be judged.",
keywords = "Bias, Computer ethics, Computers and society, D.2.0 [Software]: Software Engineering, Design, Design methods, Ethics, H.1.2 [Information Systems]: User/Machine Systems, Human Factors, Human values, K.4.0 [Computers and Society]: General, Standards",
author = "Batya Friedman and Helen Nissenbaum",
year = "1996",
month = "7",
language = "English (US)",
volume = "14",
pages = "330--347",
journal = "ACM Transactions on Information Systems",
issn = "1046-8188",
publisher = "Association for Computing Machinery (ACM)",
number = "3",

}

TY - JOUR

T1 - Bias in Computer Systems

AU - Friedman, Batya

AU - Nissenbaum, Helen

PY - 1996/7

Y1 - 1996/7

N2 - From an analysis of actual cases, three categories of bias in computer systems have been developed: preexisting, technical, and emergent. Preexisting bias has its roots in social institutions, practices, and attitudes. Technical bias arises from technical constraints or considerations. Emergent bias arises in a context of use. Although others have pointed to bias in particular computer systems and have noted the general problem, we know of no comparable work that examines this phenomenon comprehensively and which offers a framework for understanding and remedying it. We conclude by suggesting that freedom from bias should be counted among the select set of criteria - including reliability, accuracy, and efficiency -according to which the quality of systems in use in society should be judged.

AB - From an analysis of actual cases, three categories of bias in computer systems have been developed: preexisting, technical, and emergent. Preexisting bias has its roots in social institutions, practices, and attitudes. Technical bias arises from technical constraints or considerations. Emergent bias arises in a context of use. Although others have pointed to bias in particular computer systems and have noted the general problem, we know of no comparable work that examines this phenomenon comprehensively and which offers a framework for understanding and remedying it. We conclude by suggesting that freedom from bias should be counted among the select set of criteria - including reliability, accuracy, and efficiency -according to which the quality of systems in use in society should be judged.

KW - Bias

KW - Computer ethics

KW - Computers and society

KW - D.2.0 [Software]: Software Engineering

KW - Design

KW - Design methods

KW - Ethics

KW - H.1.2 [Information Systems]: User/Machine Systems

KW - Human Factors

KW - Human values

KW - K.4.0 [Computers and Society]: General

KW - Standards

UR - http://www.scopus.com/inward/record.url?scp=0030196306&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0030196306&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0030196306

VL - 14

SP - 330

EP - 347

JO - ACM Transactions on Information Systems

JF - ACM Transactions on Information Systems

SN - 1046-8188

IS - 3

ER -