Experimenting with application-based benchmarks on different cloud providers via a multi-cloud execution and modeling framework

Research Projects
Organizational Units
Journal Issue
Abstract
Cloud services are emerging today as an innovative IT provisioning model, offering benefits over the traditional approach of provisioning infrastructure. However, the occurrence of multi-tenancy, virtualization and resource sharing issues raise certain difficulties in providing performance estimation during application design or deployment time. In order to assess the performance of cloud services and compare cloud offerings, cloud benchmarks are required. The aim of this paper is to present a mechanism and a benchmarking process for measuring the performance of various cloud service delivery models, while describing this information in a machine understandable format. The suggested framework is responsible for organizing the execution and may support multiple cloud providers. In our work context, benchmarking measurement results are demonstrated from three large commercial cloud providers, Amazon EC2, Microsoft Azure and Flexiant in order to assist with provisioning decisions for cloud users. Furthermore, we present approaches for measuring service performance with the usage of specialized metrics for ranking the services according to a weighted combination of cost, performance and workload.
Description
Publisher Copyright: © Springer International Publishing Switzerland 2015.
Citation
Evangelinou , A , Galante , N A , Kousiouris , G , Giammatteo , G , Kevani , E , Stampoltas , C , Menychtas , A , Kopaneli , A , Balraj , K R , Kyriazis , D , Varvarigou , T , Stuer , P , Arrieta , L O E , Velez , G M E & Bergmayr , A 2015 , Experimenting with application-based benchmarks on different cloud providers via a multi-cloud execution and modeling framework . in M Helfert , F Desprez , D Ferguson , F Leymann & V M Muñoz (eds) , Cloud Computing and Services Sciences - International Conference in Cloud Computing and Services Sciences, CLOSER 2014, Revised Selected Papers . Communications in Computer and Information Science , vol. 512 , Springer Verlag , pp. 213-227 , International Conference in Cloud Computing and Services Sciences, CLOSER 2014 , Barcelona , Spain , 3/04/14 . https://doi.org/10.1007/978-3-319-25414-2_14
conference