Characterizing and profiling scientific workflows

G Juve, A Chervenak, E Deelman, S Bharathi… - Future generation …, 2013 - Elsevier
Future generation computer systems, 2013Elsevier
Researchers working on the planning, scheduling, and execution of scientific workflows
need access to a wide variety of scientific workflows to evaluate the performance of their
implementations. This paper provides a characterization of workflows from six diverse
scientific applications, including astronomy, bioinformatics, earthquake science, and
gravitational-wave physics. The characterization is based on novel workflow profiling tools
that provide detailed information about the various computational tasks that are present in …
Researchers working on the planning, scheduling, and execution of scientific workflows need access to a wide variety of scientific workflows to evaluate the performance of their implementations. This paper provides a characterization of workflows from six diverse scientific applications, including astronomy, bioinformatics, earthquake science, and gravitational-wave physics. The characterization is based on novel workflow profiling tools that provide detailed information about the various computational tasks that are present in the workflow. This information includes I/O, memory and computational characteristics. Although the workflows are diverse, there is evidence that each workflow has a job type that consumes the most amount of runtime. The study also uncovered inefficiency in a workflow component implementation, where the component was re-reading the same data multiple times.
Elsevier
Showing the best result for this search. See all results