Insights from the Open Database Performance Ranking
FinOps – Think Data to Get Back Control Of Your Mainframe Costs
November 21, 2022
Ensuring the Mainframe is an Integral Part of Your Enterprise Observability Strategy
November 21, 2022
Understanding the performance of different databases is crucial for building efficient data-intensive applications.
Benchmarking possible databases is a valid option for enabling such comparison, yet, it is a major challenge due to heterogeneity on the resource, database and workload level.
To enable an on-demand comparison of cloud-hosted databases we present a database performance ranking as an open dataset that enables the performance and cost comparison in a multi cloud database and workload context.
In our talk we are discussing the challenges for carrying out transparent, reproducible and comparable benchmarking case studies for cloud-hosted database systems. In particular, we discuss impact factors on the cloud resource and database level that need to be considered for fair comparisons.
Based on our open database performance ranking, we demonstrate what kind of data is required to enable transparent, reproducible and comparable benchmarking results and also discuss the insights from large-scale benchmarking studies of cloud-hosted database systems.
This enables the audience to take away the following lessons-learned:
– what is required to enable transparent and pitfalls in running large-scale benchmarking studies in the cloud
– performance insights of different database systems
– performance insights of different cloud providers
– performance/cost comparisons of databases operated on IaaS vs. DBaaS
– performance insight for database systems under different workloads
Presented by
Daniel Seybold, Co-Founder & CTO at benchANT
Daniel Seybold started his career as PhD student in the area of cloud computing with a focus on distributed databases in the cloud. Further interests cover cloud orchestration, model-driven engineering, and performance evaluations of distributed systems. After completing his PhD on the topic “An automation-based approach for reproducible evaluations of distributed DBMS on elastic infrastructures”, Daniel co-founded the Benchmarking-as-a-Service platform benchANT, where he is responsible for the product development.
Symposium on Software Performance 2021 | Automated Benchmarking of Cloud-hosted DBMS with benchANT | 50 attendees (physical) | ? attendees (virtual)
ACM/USENIX MIDDLEWARE | Benchmarking-as-a-service for cloud-hosted DBMS |
Data Insights Day @ CrateDB | Finding Your Way in the Cloudy Database Jungle | 80 attendees (physical) + 30 (virtual)
ICPE 2022 | Tutorial – Automated Benchmarking of cloud-hosted DBMS with benchANT | 10 attendees (virtual)
PerconaLive 2022 | Towards an Open Database Performance Ranking | 60 attendees (physical) + x (virtual)
DevTalks.ro 2022 | Towards an Open Database Performance Ranking | ? attendees (virtual)
https://crate.io/resources/videos/finding-your-way-in-the-cloudy-database-jungle
IMPACT 2023 Proceeding Session Video:
To view the proceeding session video you must have a CMG Membership. Sign up today!
For existing members sign in here.
