Contextual linking between workflow provenance and system performance logs

Open Access
Authors
Publication date 2019
Book title IEEE 15th International Conference on eScience
Book subtitle proceedings : 24-27 September 2019, San Diego, California
ISBN
  • 9781728124520
ISBN (electronic)
  • 9781728124513
Event 15th IEEE International Conference on eScience, eScience 2019
Pages (from-to) 634-635
Number of pages 2
Publisher Los Alamitos, California: IEEE Computer Society
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
  • Faculty of Science (FNWI)
Abstract

When executing scientific workflows, anomalies of the workflow behavior are often caused by different issues such as resource failures at the underlying infrastructure. The provenance information collected by workflow management systems only captures the transformation of data at the workflow level. Analyzing provenance information and apposite system metrics requires expertise and manual effort. Moreover, it is often timeconsuming to aggregate this information and correlate events occurring at different levels of the infrastructure. In this paper, we propose an architecture to automate the integration among workflow provenance information and performance information from the infrastructure level. Our architecture enables workflow developers or domain scientists to effectively browse workflow execution information together with the system metrics, and analyze contextual information for possible anomalies.

Document type Conference contribution
Language English
Published at https://doi.org/10.1109/eScience.2019.00093
Published at https://zenodo.org/record/3462820
Other links http://www.proceedings.com/53619.html https://www.scopus.com/pages/publications/85083195949
Downloads
Permalink to this page
Back