Scale Out PostgreSQL

Best Practices for Deploying Confluent Kafka, Spring Boot & Distributed SQL Based Streaming Apps on Kubernetes

June 12, 2019

Distributed SQL How To Kafka Kubernetes Spring

Best Practices for Deploying Confluent Kafka, Spring Boot & Distributed SQL Based Streaming Apps on Kubernetes

In our previous post “Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL”, we highlighted how Confluent Kafka, KSQL, Spring Boot and YugabyteDB can be integrated to develop an application responsible for managing Internet-of-Things (IoT) sensor data. In this post, we will review the challenges and best practices associated with deploying such a stateful streaming application on Kubernetes.

Challenges of Streaming Apps

Streaming apps are inherently stateful in nature given the large volume of data managed and that too continuously.

…

June 4, 2019

By Sid Choudhury

Community News Distributed SQL YugabyteDB

YugabyteDB Engineering Update – June 4, 2019

We are pleased to announce that YugabyteDB 1.2.10 is live! You can read the release notes of this and previous versions here. This release is shipping with foreign key support plus 16 new features, enhancements and bug fixes. Here’s a few highlights from the 1.2.10 release:

YSQL Updates

What’s YSQL? It’s YugabyteDB’s PostgreSQL-compatible, distributed SQL API.

Basic support for FOREIGN KEY constraints is now available!

…

Spring Data REST Services Powered By Distributed SQL – A Hands-on Lab

May 30, 2019

By Sid Choudhury

Distributed SQL How To Pivotal Container Service (PKS)Spring

Spring Data REST Services Powered By Distributed SQL – A Hands-on Lab

The Spring application development framework is arguably the most popular framework among Java developers. However, given its extensive breadth and depth, it can be difficult to learn for new users. As the name suggests, Spring Boot makes it easy to `boot up` with the Spring framework. It shortens development time by taking an opinionated view of the framework and the associated third-party libraries. Annotation configuration and default codes are two examples of such a view.

…

How to Handle Runaway Queries in a Distributed SQL Database

May 28, 2019

By Rahul Desirazu

Distributed SQL How It Works

How to Handle Runaway Queries in a Distributed SQL Database

Runaway queries are queries that scan through a large set of data. Such queries consume vast amounts of I/O and CPU resources of the database in the background, even if the results appear as harmless timeouts to the end user or the client application. How do runaway queries get executed in the first place, anyway? Everyone who uses databases has at some point or another entered SELECT * from some_large_table, only to realize they forgot to add a LIMIT n clause.

…

Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL

May 23, 2019

By Sid Choudhury

Distributed SQL How To Kafka Spring

Develop IoT Apps with Confluent Kafka, KSQL, Spring Boot & Distributed SQL

In our previous post “5 Reasons Why Apache Kafka Needs a Distributed SQL Database”, we highlighted why Kafka-based data services need a distributed SQL database like YugabyteDB as their highly scalable, long-term persistent data store. In this post, we show how Confluent Kafka, KSQL, Spring Boot and YugabyteDB can be integrated to develop an application for managing Internet-of-Things (IoT) sensor data.

The Scenario – IoT-Enabled Fleet Management

A trucking company wants to track its fleet of IoT-enabled vehicles that are delivering shipments across the country.

…

5 Reasons Why Apache Kafka Needs a Distributed SQL Database

May 21, 2019

By Sid Choudhury

Distributed SQL How It Works Kafka

5 Reasons Why Apache Kafka Needs a Distributed SQL Database

Modern enterprise applications must be super-elastic, adaptable, and running 24/7. However, traditional request-driven architectures entail a tight coupling of applications. For example, App 1 asks for some information from App 2 and waits. App 2 then sends the requested information to App 1. This sort of app-to-app coupling hinders development agility and blocks rapid scaling.

In event-driven architectures, applications publish events to a message broker asynchronously. They trust the broker to route the message to the right application,

…

Achieving Fast Failovers After Network Partitions in a Distributed SQL Database

May 15, 2019

By Timur Yusupov

Distributed SQL Google Spanner How It Works Jepsen Tests

Achieving Fast Failovers After Network Partitions in a Distributed SQL Database

In February of this year, Kyle Kingsbury of Jepsen.io was conducting formal testing of YugabyteDB for correctness under extreme and unorthodox conditions. Obviously, simulating all manner of network partitions is part of his testing methodology. As a result, during his testing he spotted the fact that although nodes would reliably come back after a failure, the recovery itself was taking roughly 25 seconds to occur. We certainly didn’t like the sound of that!

…

YugabyteDB 2.0: A Distributed SQL Roadmap

May 13, 2019

By Sid Choudhury

Community News Company News Distributed SQL

YugabyteDB 2.0: A Distributed SQL Roadmap

The YugabyteDB community is eagerly looking forward to v2.0, the next major release expected in Summer 2019. Needless to say, we are very excited about the depth and breadth of features in this release. Here’s an overview of the various areas we expect the new release to cover.

Distributed SQL

YSQL is YugabyteDB’s PostgreSQL wire-compatible distributed SQL API. Thanks to our design decision to use the existing PostgreSQL query layer as a starting point,

…

6 Technical Challenges Developing a Distributed SQL Database

April 26, 2019

By Karthik Ranganathan

Amazon Aurora Distributed SQL Google Spanner How It Works Jepsen Tests

6 Technical Challenges Developing a Distributed SQL Database

You can join the discussion on HackerNews here.

We crossed the three year mark of developing the YugabyteDB database in February of 2019. It has been a thrilling journey thus far, but not without its fair share of technical challenges. There were times when we had to go back to the drawing board and even sift through academic research to find a better solution than what we had at hand.

…

Distributed PostgreSQL on a Google Spanner Architecture – Query Layer

March 18, 2019

By Karthik Ranganathan

Distributed SQL Google Spanner How It Works PostgreSQL YugabyteDB

Distributed PostgreSQL on a Google Spanner Architecture – Query Layer

Our previous post dived into the details of the storage layer of YugabyteDB called DocDB, a distributed document store inspired by Google Spanner. This post focuses on Yugabyte SQL (YSQL), a distributed, highly resilient, PostgreSQL-compatible SQL API layer powered by DocDB. A follow-up post will highlight the challenges faced and lessons learned when engineering such a database.

YSQL, Distributed PostgreSQL Made Real

Yugabyte SQL (YSQL) is a distributed and highly resilient SQL layer,

…

Scale Out PostgreSQL

Challenges of Streaming Apps

YSQL Updates

The Scenario – IoT-Enabled Fleet Management

Distributed SQL

YSQL, Distributed PostgreSQL Made Real

Explore Distributed SQL and YugabyteDB in Depth