Skip to Main content Skip to Navigation
Conference papers

Enabling Reproducible Analysis of Complex Workflows on the Edge-to-Cloud Continuum

Daniel Rosendo 1, 2 Alexandru Costan 3, 2 Gabriel Antoniu 2 Patrick Valduriez 1 
1 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
2 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA-D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : Distributed digital infrastructures for computation and analytics are now evolving towards an interconnected ecosystem allowing complex applications to be executed from IoT Edge devices to the HPC Cloud (aka the Computing Continuum, the Digital Continuum, or the Transcontinuum). Understanding end-to-end performance in such a complex continuum is challenging. This breaks down to reconciling many, typically contradicting application requirements and constraints with low-level infrastructure design choices. One important challenge is to accurately reproduce relevant behaviors of a given application workflow and representative settings of the physical infrastructure underlying this complex continuum. We introduce a rigorous methodology for such a process and validate it through E2Clab. It is the first platform to support the complete experimental cycle across the Computing Continuum: deployment, analysis, optimization. Preliminary results with real-life use cases show that E2Clab allows one to understand and improve performance, by correlating it to the parameter settings, the resource usage and the specifics of the underlying infrastructure.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03332524
Contributor : Daniel Rosendo Connect in order to contact the contributor
Submitted on : Thursday, September 2, 2021 - 6:57:35 PM
Last modification on : Thursday, May 5, 2022 - 10:11:31 AM
Long-term archiving on: : Friday, December 3, 2021 - 9:07:39 PM

Files

main.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03332524, version 1

Citation

Daniel Rosendo, Alexandru Costan, Gabriel Antoniu, Patrick Valduriez. Enabling Reproducible Analysis of Complex Workflows on the Edge-to-Cloud Continuum. BDA 2021 - 37e Conférence sur la Gestion de Données - Principes, Technologies et Applications, Philippe Rigaux, Oct 2021, Paris, France. ⟨hal-03332524⟩

Share

Metrics

Record views

73

Files downloads

38