The Distributed SQL Blog

Thoughts on distributed databases, open source, and cloud native

YugabyteDB CDC: Using JDBC Sink Connector with Kafka

It’s been a while since YugabyteDB came out with Change Data Capture (CDC) using Debezium, an open source distributed platform. You can just fire it up as a plugin for Kafka connect and then it will start publishing all the changes in your database to a Kafka topic. 

The Debezium Connector for YugabyteDB CDC is our addition to the list of Debezium connectors.

Read More

Streaming Changes From YugabyteDB to Downstream Databases

In this blog post, we will stream data to downstream databases leveraging YugabyteDB’s Change Data Capture (CDC) feature introduced in YugabyteDB 2.13. This will publish the changes to Kafka and then stream those changes to databases like MySQL, PostgreSQL, and Elasticsearch.

YugabyteDB CDC Downstream Databases Topology

The diagram below represents how data will flow from YugabyteDB to Kafka and then further to the sink databases. 

Read More

Securing YugabyteDB: Part 2 – Client-to-Server Encryption in Transit

In the first post in this series, we covered how to secure YugabyteDB’s internal RPC protocol using the TLS encryption protocol, also referred to as server-to-server encryption in transit. In this post, we secure the communication between SQL clients and the PostgresQL query interface of YugabyteDB, also called client-to-server encryption in transit. 

YugabyteDB—a 100% open source,

Read More

Performing Flexible IO Testing in YugabyteDB

ybio is a PL/pgSQL based load generator for PostgreSQL and YSQL. This YugabyteDB-specific IO testing toolkit performs flexible IO testing to specific parts of the YugabyteDB infrastructure with no client installation. And because this toolkit is PL/pgSQL-based, it can also work on native PostgreSQL.

ybio is strongly inspired by Kevin Closson’s SLOB and pgio.

Read More

Database Connection Management: Exploring Pools and Performance

There are many secrets to creating a high-performing database application. One such secret is proper database connection management. However, this secret is not specific to YugabyteDB or PostgreSQL, but applies to any database.

In this post, we examine database connection management through the lens of YugabyteDB. We explore pools and performance, and run tests to measure the results.

Read More

YugabyteDB and Apache Superset: Explore and Visualize Open Source Data

Enterprises today collect and store vast amounts of data. However, realizing business value from this data requires modern data exploration and visualization tools.

Apache Superset is a widely popular, open source data exploration and visualization platform used and supported by enterprises such as Airbnb, Lyft, and Nielsen. More specifically, Superset enables users to quickly and easily explore and visualize large amounts of data stored in YugabyteDB.

Read More

PostgreSQL Timestamps and Timezones: How to Navigate the Interval Minefield

This is the second of a two part blog post series about the date-time data types that PostgreSQL, and therefore YSQL, support. The first part dealt with the basic business of representing moments (when things happen). The relevant data types here are time, date, and timestamp—where the latter has a without time zone and a with time zone variant.

Read More

PostgreSQL Timestamps and Timezones: What You Need to Know—and What You Don’t

Anecdotal reports indicate that some PostgreSQL programmers are daunted by the date and time data types, and by how operations that use values of these data types might be affected by the session’s timezone setting. Even experienced developers struggle when they first embark on a critical project that relies on this functionality. YugabyteDB’s YSQL subsystem gives the application developer the same experience as PostgreSQL.

Read More

YugabyteDB Integrates with Arctype SQL Client

PostgreSQL has eaten the world. And so Yugabyte set out to build the most Postgres-compatible, scalable, and resilient database. YugabyteDB is not only wire compatible with PostgreSQL, it is code compatible by reusing the upper half of PostgreSQL. Thanks to this compatibility, YugabyteDB can connect to the vast majority of database tools that integrate with Postgres.

In a previous blog post,

Read More

YugabyteDB Savepoints: Checkpointing Work in Distributed Transactions

Yugabyte brings best-in-class performance, scalability, and availability to YugabyteDB, a fully PostgreSQL-compatible SQL database. Because YugabyteDB’s architecture uses PostgreSQL at the SQL layer, we get a long-tail of PostgreSQL compatibility for free. But implementing savepoints requires deeper integration into YugabyteDB’s distributed persistence and transaction layers. 

In this blog post, we’ll discuss why you should care about savepoints.

Read More