Globally-Aware Multiple Instance Classifier for Breast Cancer Screening

Yiqiu Shen, Nan Wu, Jason Phang, Jungkyu Park, Gene Kim, Linda Moy, Kyunghyun Cho, Krzysztof J. Geras

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep learning models designed for visual classification tasks on natural images have become prevalent in medical image analysis. However, medical images differ from typical natural images in many ways, such as significantly higher resolutions and smaller regions of interest. Moreover, both the global structure and local details play important roles in medical image analysis tasks. To address these unique properties of medical images, we propose a neural network that is able to classify breast cancer lesions utilizing information from both a global saliency map and multiple local patches. The proposed model outperforms the ResNet-based baseline and achieves radiologist-level performance in the interpretation of screening mammography. Although our model is trained only with image-level labels, it is able to generate pixel-level saliency maps that provide localization of possible malignant findings.

Original languageEnglish (US)
Title of host publicationMachine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings
EditorsHeung-Il Suk, Mingxia Liu, Chunfeng Lian, Pingkun Yan
PublisherSpringer
Pages18-26
Number of pages9
ISBN (Print)9783030326913
DOIs
StatePublished - Jan 1 2019
Event10th International Workshop on Machine Learning in Medical Imaging, MLMI 2019 held in conjunction with the 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019 - Shenzhen, China
Duration: Oct 13 2019Oct 13 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11861 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Workshop on Machine Learning in Medical Imaging, MLMI 2019 held in conjunction with the 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019
CountryChina
CityShenzhen
Period10/13/1910/13/19

Fingerprint

Breast Cancer
Medical Image Analysis
Saliency Map
Screening
Classifiers
Classifier
Medical Image
Image analysis
Mammography
Region of Interest
Patch
Labels
Baseline
High Resolution
Pixel
Pixels
Classify
Model
Neural Networks
Neural networks

Keywords

  • Breast cancer screening
  • Deep learning
  • High-resolution image classification
  • Neural networks
  • Weakly supervised localization

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Shen, Y., Wu, N., Phang, J., Park, J., Kim, G., Moy, L., ... Geras, K. J. (2019). Globally-Aware Multiple Instance Classifier for Breast Cancer Screening. In H-I. Suk, M. Liu, C. Lian, & P. Yan (Eds.), Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings (pp. 18-26). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11861 LNCS). Springer . https://doi.org/10.1007/978-3-030-32692-0_3

Globally-Aware Multiple Instance Classifier for Breast Cancer Screening. / Shen, Yiqiu; Wu, Nan; Phang, Jason; Park, Jungkyu; Kim, Gene; Moy, Linda; Cho, Kyunghyun; Geras, Krzysztof J.

Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings. ed. / Heung-Il Suk; Mingxia Liu; Chunfeng Lian; Pingkun Yan. Springer , 2019. p. 18-26 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11861 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shen, Y, Wu, N, Phang, J, Park, J, Kim, G, Moy, L, Cho, K & Geras, KJ 2019, Globally-Aware Multiple Instance Classifier for Breast Cancer Screening. in H-I Suk, M Liu, C Lian & P Yan (eds), Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11861 LNCS, Springer , pp. 18-26, 10th International Workshop on Machine Learning in Medical Imaging, MLMI 2019 held in conjunction with the 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019, Shenzhen, China, 10/13/19. https://doi.org/10.1007/978-3-030-32692-0_3
Shen Y, Wu N, Phang J, Park J, Kim G, Moy L et al. Globally-Aware Multiple Instance Classifier for Breast Cancer Screening. In Suk H-I, Liu M, Lian C, Yan P, editors, Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings. Springer . 2019. p. 18-26. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-32692-0_3
Shen, Yiqiu ; Wu, Nan ; Phang, Jason ; Park, Jungkyu ; Kim, Gene ; Moy, Linda ; Cho, Kyunghyun ; Geras, Krzysztof J. / Globally-Aware Multiple Instance Classifier for Breast Cancer Screening. Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings. editor / Heung-Il Suk ; Mingxia Liu ; Chunfeng Lian ; Pingkun Yan. Springer , 2019. pp. 18-26 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{a8c9cf203e5e462bb20dcc83b60af730,
title = "Globally-Aware Multiple Instance Classifier for Breast Cancer Screening",
abstract = "Deep learning models designed for visual classification tasks on natural images have become prevalent in medical image analysis. However, medical images differ from typical natural images in many ways, such as significantly higher resolutions and smaller regions of interest. Moreover, both the global structure and local details play important roles in medical image analysis tasks. To address these unique properties of medical images, we propose a neural network that is able to classify breast cancer lesions utilizing information from both a global saliency map and multiple local patches. The proposed model outperforms the ResNet-based baseline and achieves radiologist-level performance in the interpretation of screening mammography. Although our model is trained only with image-level labels, it is able to generate pixel-level saliency maps that provide localization of possible malignant findings.",
keywords = "Breast cancer screening, Deep learning, High-resolution image classification, Neural networks, Weakly supervised localization",
author = "Yiqiu Shen and Nan Wu and Jason Phang and Jungkyu Park and Gene Kim and Linda Moy and Kyunghyun Cho and Geras, {Krzysztof J.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-32692-0_3",
language = "English (US)",
isbn = "9783030326913",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer",
pages = "18--26",
editor = "Heung-Il Suk and Mingxia Liu and Chunfeng Lian and Pingkun Yan",
booktitle = "Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings",

}

TY - GEN

T1 - Globally-Aware Multiple Instance Classifier for Breast Cancer Screening

AU - Shen, Yiqiu

AU - Wu, Nan

AU - Phang, Jason

AU - Park, Jungkyu

AU - Kim, Gene

AU - Moy, Linda

AU - Cho, Kyunghyun

AU - Geras, Krzysztof J.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Deep learning models designed for visual classification tasks on natural images have become prevalent in medical image analysis. However, medical images differ from typical natural images in many ways, such as significantly higher resolutions and smaller regions of interest. Moreover, both the global structure and local details play important roles in medical image analysis tasks. To address these unique properties of medical images, we propose a neural network that is able to classify breast cancer lesions utilizing information from both a global saliency map and multiple local patches. The proposed model outperforms the ResNet-based baseline and achieves radiologist-level performance in the interpretation of screening mammography. Although our model is trained only with image-level labels, it is able to generate pixel-level saliency maps that provide localization of possible malignant findings.

AB - Deep learning models designed for visual classification tasks on natural images have become prevalent in medical image analysis. However, medical images differ from typical natural images in many ways, such as significantly higher resolutions and smaller regions of interest. Moreover, both the global structure and local details play important roles in medical image analysis tasks. To address these unique properties of medical images, we propose a neural network that is able to classify breast cancer lesions utilizing information from both a global saliency map and multiple local patches. The proposed model outperforms the ResNet-based baseline and achieves radiologist-level performance in the interpretation of screening mammography. Although our model is trained only with image-level labels, it is able to generate pixel-level saliency maps that provide localization of possible malignant findings.

KW - Breast cancer screening

KW - Deep learning

KW - High-resolution image classification

KW - Neural networks

KW - Weakly supervised localization

UR - http://www.scopus.com/inward/record.url?scp=85075700901&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85075700901&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-32692-0_3

DO - 10.1007/978-3-030-32692-0_3

M3 - Conference contribution

AN - SCOPUS:85075700901

SN - 9783030326913

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 18

EP - 26

BT - Machine Learning in Medical Imaging - 10th International Workshop, MLMI 2019, Held in Conjunction with MICCAI 2019, Proceedings

A2 - Suk, Heung-Il

A2 - Liu, Mingxia

A2 - Lian, Chunfeng

A2 - Yan, Pingkun

PB - Springer

ER -