Wrapping Up: Jepsen Test Results for YugaByte DB 1.2 Webinar
Kyle did a great deep-dive into his testing approach, research methodology and what he found when applied to YugaByte DB. If you are looking for an unvarnished and honest assessment of YugaByte DB’s consistency and transactional claims, this video is a must watch!
To recap, YugaByte DB 1.2 was Jepsen certified last month. You can read the official report here, plus YugaByte DB’s take on the process and the results here. A DIY version of the Jepsen test suite has been integrated into our CD/CI pipeline since 2018.
Questions and Answers
Here’s a few of the questions that came up in the Q&A portion of the webinar:
What’s your heuristic for assessing Jepsen tests that database vendors come up with internally? What is the most common spot that internal teams miss, maybe because they know it too well?
* * *
When a database is CP (Consistent and Partition Tolerant) and makes no claims in regards to availability, how do you detect that a cluster stopped working to the extent that it should fail the test?
* * *
Do you stay strictly blackbox in your testing, that is, only reason about high-level invariance or will you sometimes extend Jepsen to peek at metrics or end points that the databases exposes and assert on them?
* * *
When do you expect users to be able to try out the new generators implementation?
Want the answers? Check out the playback!