Intelligent acquisition and learning of fluorescence microscope data models

Charles Jackson, Robert F. Murphy, Jelena Kovacevic

Research output: Contribution to journalArticle

Abstract

We propose a mathematical framework and algorithms both to build accurate models of fluorescence microscope time series, as well as to design intelligent acquisition systems based on these models. Model building allows the information contained in the 2-D and 3-D time series to be presented in a more useful and concise form than the raw image data. This is particularly relevant as the trend in biology tends more and more towards high-throughput applications, and the resulting increase in the amount of acquired image data makes visual inspection impractical. The intelligent acquisition system uses an active learning approach to choose the acquisition regions that let us build our model most efficiently, resulting in a shorter acquisition time, as well as a reduction of the amount of photobleaching and phototoxicity incurred during acquisition. We validate our methodology by modeling object motion within a cell. For intelligent acquisition, we propose a set of algorithms to evaluate the information contained in a given acquisition region, as well as the costs associated with acquiring this region in terms of the resulting photobleaching and phototoxicity and the amount of time taken for acquisition. We use these algorithms to determine an acquisition strategy: where and when to acquire, as well as when to stop acquiring. Results, both on synthetic as well as real data, demonstrate accurate model building and large efficiency gains during acquisition.

Original languageEnglish (US)
Pages (from-to)2071-2084
Number of pages14
JournalIEEE Transactions on Image Processing
Volume18
Issue number9
DOIs
StatePublished - Sep 3 2009

Fingerprint

Data structures
Microscopes
Fluorescence
Photobleaching
Time series
Inspection
Throughput
Costs

Keywords

  • Active learning
  • Fluorescence microscopy
  • Image modeling
  • Intelligent acquisition
  • Particle filter

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this

Intelligent acquisition and learning of fluorescence microscope data models. / Jackson, Charles; Murphy, Robert F.; Kovacevic, Jelena.

In: IEEE Transactions on Image Processing, Vol. 18, No. 9, 03.09.2009, p. 2071-2084.

Research output: Contribution to journalArticle

@article{ac371694a2b94a7095b87bcee2034a83,
title = "Intelligent acquisition and learning of fluorescence microscope data models",
abstract = "We propose a mathematical framework and algorithms both to build accurate models of fluorescence microscope time series, as well as to design intelligent acquisition systems based on these models. Model building allows the information contained in the 2-D and 3-D time series to be presented in a more useful and concise form than the raw image data. This is particularly relevant as the trend in biology tends more and more towards high-throughput applications, and the resulting increase in the amount of acquired image data makes visual inspection impractical. The intelligent acquisition system uses an active learning approach to choose the acquisition regions that let us build our model most efficiently, resulting in a shorter acquisition time, as well as a reduction of the amount of photobleaching and phototoxicity incurred during acquisition. We validate our methodology by modeling object motion within a cell. For intelligent acquisition, we propose a set of algorithms to evaluate the information contained in a given acquisition region, as well as the costs associated with acquiring this region in terms of the resulting photobleaching and phototoxicity and the amount of time taken for acquisition. We use these algorithms to determine an acquisition strategy: where and when to acquire, as well as when to stop acquiring. Results, both on synthetic as well as real data, demonstrate accurate model building and large efficiency gains during acquisition.",
keywords = "Active learning, Fluorescence microscopy, Image modeling, Intelligent acquisition, Particle filter",
author = "Charles Jackson and Murphy, {Robert F.} and Jelena Kovacevic",
year = "2009",
month = "9",
day = "3",
doi = "10.1109/TIP.2009.2024580",
language = "English (US)",
volume = "18",
pages = "2071--2084",
journal = "IEEE Transactions on Image Processing",
issn = "1057-7149",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "9",

}

TY - JOUR

T1 - Intelligent acquisition and learning of fluorescence microscope data models

AU - Jackson, Charles

AU - Murphy, Robert F.

AU - Kovacevic, Jelena

PY - 2009/9/3

Y1 - 2009/9/3

N2 - We propose a mathematical framework and algorithms both to build accurate models of fluorescence microscope time series, as well as to design intelligent acquisition systems based on these models. Model building allows the information contained in the 2-D and 3-D time series to be presented in a more useful and concise form than the raw image data. This is particularly relevant as the trend in biology tends more and more towards high-throughput applications, and the resulting increase in the amount of acquired image data makes visual inspection impractical. The intelligent acquisition system uses an active learning approach to choose the acquisition regions that let us build our model most efficiently, resulting in a shorter acquisition time, as well as a reduction of the amount of photobleaching and phototoxicity incurred during acquisition. We validate our methodology by modeling object motion within a cell. For intelligent acquisition, we propose a set of algorithms to evaluate the information contained in a given acquisition region, as well as the costs associated with acquiring this region in terms of the resulting photobleaching and phototoxicity and the amount of time taken for acquisition. We use these algorithms to determine an acquisition strategy: where and when to acquire, as well as when to stop acquiring. Results, both on synthetic as well as real data, demonstrate accurate model building and large efficiency gains during acquisition.

AB - We propose a mathematical framework and algorithms both to build accurate models of fluorescence microscope time series, as well as to design intelligent acquisition systems based on these models. Model building allows the information contained in the 2-D and 3-D time series to be presented in a more useful and concise form than the raw image data. This is particularly relevant as the trend in biology tends more and more towards high-throughput applications, and the resulting increase in the amount of acquired image data makes visual inspection impractical. The intelligent acquisition system uses an active learning approach to choose the acquisition regions that let us build our model most efficiently, resulting in a shorter acquisition time, as well as a reduction of the amount of photobleaching and phototoxicity incurred during acquisition. We validate our methodology by modeling object motion within a cell. For intelligent acquisition, we propose a set of algorithms to evaluate the information contained in a given acquisition region, as well as the costs associated with acquiring this region in terms of the resulting photobleaching and phototoxicity and the amount of time taken for acquisition. We use these algorithms to determine an acquisition strategy: where and when to acquire, as well as when to stop acquiring. Results, both on synthetic as well as real data, demonstrate accurate model building and large efficiency gains during acquisition.

KW - Active learning

KW - Fluorescence microscopy

KW - Image modeling

KW - Intelligent acquisition

KW - Particle filter

UR - http://www.scopus.com/inward/record.url?scp=69349090795&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=69349090795&partnerID=8YFLogxK

U2 - 10.1109/TIP.2009.2024580

DO - 10.1109/TIP.2009.2024580

M3 - Article

C2 - 19502128

AN - SCOPUS:69349090795

VL - 18

SP - 2071

EP - 2084

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

SN - 1057-7149

IS - 9

ER -