Tracking and analyzing the evolution of provenance from scripts

João Felipe Pimentel, Juliana Freire, Vanessa Braganholo, Leonardo Murta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Script languages are powerful tools for scientists. Scientists use them to process data, invoke programs, and link program outputs/inputs. During the life cycle of scientific experiments, scientists compose scripts, execute them, and perform analysis on the results. Depending on the results, they modify their script to get more data to confirm the original hypothesis or to test a new hypothesis, evolving the experiment. While some tools capture provenance from the execution of scripts, most approaches focus on a single execution, leaving out the possibility to analyze the provenance evolution of the experiment as a whole. This work enables tracking and analyzing the provenance evolution gathered from scripts. Tracking the provenance evolution also helps to reconstruct the environment of previous executions for reproduction. Provenance evolution analysis allows comparison of executions to understand what has changed and supports the decision of which execution provides better results.

Original languageEnglish (US)
Title of host publicationProvenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings
PublisherSpringer Verlag
Pages16-28
Number of pages13
Volume9672
ISBN (Print)9783319405926
DOIs
StatePublished - 2016
Event6th International Provenance and Annotation Workshop, IPAW 2016 - McLean, United States
Duration: Jun 7 2016Jun 8 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9672
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other6th International Provenance and Annotation Workshop, IPAW 2016
CountryUnited States
CityMcLean
Period6/7/166/8/16

Fingerprint

Provenance
Input output programs
Experiments
Life cycle
Experiment
Life Cycle
Output

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Pimentel, J. F., Freire, J., Braganholo, V., & Murta, L. (2016). Tracking and analyzing the evolution of provenance from scripts. In Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings (Vol. 9672, pp. 16-28). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9672). Springer Verlag. https://doi.org/10.1007/978-3-319-40593-3_2

Tracking and analyzing the evolution of provenance from scripts. / Pimentel, João Felipe; Freire, Juliana; Braganholo, Vanessa; Murta, Leonardo.

Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. Vol. 9672 Springer Verlag, 2016. p. 16-28 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9672).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Pimentel, JF, Freire, J, Braganholo, V & Murta, L 2016, Tracking and analyzing the evolution of provenance from scripts. in Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. vol. 9672, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9672, Springer Verlag, pp. 16-28, 6th International Provenance and Annotation Workshop, IPAW 2016, McLean, United States, 6/7/16. https://doi.org/10.1007/978-3-319-40593-3_2
Pimentel JF, Freire J, Braganholo V, Murta L. Tracking and analyzing the evolution of provenance from scripts. In Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. Vol. 9672. Springer Verlag. 2016. p. 16-28. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-40593-3_2
Pimentel, João Felipe ; Freire, Juliana ; Braganholo, Vanessa ; Murta, Leonardo. / Tracking and analyzing the evolution of provenance from scripts. Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. Vol. 9672 Springer Verlag, 2016. pp. 16-28 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{3d134a3d1e4d49cbbea891c2b55bb0f0,
title = "Tracking and analyzing the evolution of provenance from scripts",
abstract = "Script languages are powerful tools for scientists. Scientists use them to process data, invoke programs, and link program outputs/inputs. During the life cycle of scientific experiments, scientists compose scripts, execute them, and perform analysis on the results. Depending on the results, they modify their script to get more data to confirm the original hypothesis or to test a new hypothesis, evolving the experiment. While some tools capture provenance from the execution of scripts, most approaches focus on a single execution, leaving out the possibility to analyze the provenance evolution of the experiment as a whole. This work enables tracking and analyzing the provenance evolution gathered from scripts. Tracking the provenance evolution also helps to reconstruct the environment of previous executions for reproduction. Provenance evolution analysis allows comparison of executions to understand what has changed and supports the decision of which execution provides better results.",
author = "Pimentel, {Jo{\~a}o Felipe} and Juliana Freire and Vanessa Braganholo and Leonardo Murta",
year = "2016",
doi = "10.1007/978-3-319-40593-3_2",
language = "English (US)",
isbn = "9783319405926",
volume = "9672",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "16--28",
booktitle = "Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings",
address = "Germany",

}

TY - GEN

T1 - Tracking and analyzing the evolution of provenance from scripts

AU - Pimentel, João Felipe

AU - Freire, Juliana

AU - Braganholo, Vanessa

AU - Murta, Leonardo

PY - 2016

Y1 - 2016

N2 - Script languages are powerful tools for scientists. Scientists use them to process data, invoke programs, and link program outputs/inputs. During the life cycle of scientific experiments, scientists compose scripts, execute them, and perform analysis on the results. Depending on the results, they modify their script to get more data to confirm the original hypothesis or to test a new hypothesis, evolving the experiment. While some tools capture provenance from the execution of scripts, most approaches focus on a single execution, leaving out the possibility to analyze the provenance evolution of the experiment as a whole. This work enables tracking and analyzing the provenance evolution gathered from scripts. Tracking the provenance evolution also helps to reconstruct the environment of previous executions for reproduction. Provenance evolution analysis allows comparison of executions to understand what has changed and supports the decision of which execution provides better results.

AB - Script languages are powerful tools for scientists. Scientists use them to process data, invoke programs, and link program outputs/inputs. During the life cycle of scientific experiments, scientists compose scripts, execute them, and perform analysis on the results. Depending on the results, they modify their script to get more data to confirm the original hypothesis or to test a new hypothesis, evolving the experiment. While some tools capture provenance from the execution of scripts, most approaches focus on a single execution, leaving out the possibility to analyze the provenance evolution of the experiment as a whole. This work enables tracking and analyzing the provenance evolution gathered from scripts. Tracking the provenance evolution also helps to reconstruct the environment of previous executions for reproduction. Provenance evolution analysis allows comparison of executions to understand what has changed and supports the decision of which execution provides better results.

UR - http://www.scopus.com/inward/record.url?scp=84976628159&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84976628159&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-40593-3_2

DO - 10.1007/978-3-319-40593-3_2

M3 - Conference contribution

AN - SCOPUS:84976628159

SN - 9783319405926

VL - 9672

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 16

EP - 28

BT - Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings

PB - Springer Verlag

ER -