Automation of network-based scientific workflows

M. A. Vouk, I. Altintas, R. Barreto, John Blondin, Z. Cheng, T. Critchlow, Ayla Khan, S. Klasky, J. Ligon, B. Ludaescher, P. A. Mouallem, S. Parker, N. Podhorszki, A. Shoshani, C. Silva

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Comprehensive, end-to-end, data and workflow management solutions are needed to handle the increasing complexity of processes and data volumes associated with modern distributed scientific problem solving, such as ultrascale simulations and high-throughput experiments. The key to the solution is an integrated network-based framework that is functional, dependable, faulttolerant, and supports data and process provenance. Such a framework needs to make development and use of application workflows dramatically easier so that scientists' efforts can shift away from data management and utility software development to scientific research and discovery. An integrated view of these activities is provided by the notion of scientific workflows - a series of structured activities and computations that arise in scientific problem-solving. An information technology framework that supports scientific workflows is the Ptolemy II based environment called Kepler. This paper discusses the issues associated with practical automation of scientific processes and workflows and illustrates this with workflows developed using the Kepler framework and tools.

Original languageEnglish (US)
Title of host publicationGrid-Based Problem Solving Environments
Subtitle of host publicationIFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software
EditorsPatrick W. Gaffney, James C.T. Pool
Pages35-61
Number of pages27
DOIs
StatePublished - Dec 3 2007

Publication series

NameIFIP International Federation for Information Processing
Volume239
ISSN (Print)1571-5736

    Fingerprint

ASJC Scopus subject areas

  • Information Systems and Management

Cite this

Vouk, M. A., Altintas, I., Barreto, R., Blondin, J., Cheng, Z., Critchlow, T., Khan, A., Klasky, S., Ligon, J., Ludaescher, B., Mouallem, P. A., Parker, S., Podhorszki, N., Shoshani, A., & Silva, C. (2007). Automation of network-based scientific workflows. In P. W. Gaffney, & J. C. T. Pool (Eds.), Grid-Based Problem Solving Environments: IFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software (pp. 35-61). (IFIP International Federation for Information Processing; Vol. 239). https://doi.org/10.1007/978-0-387-73659-4_3