The Distributed SQL Blog

Thoughts on distributed databases, open source, and cloud native

YugaByte Database Engineering Update – Nov 27, 2018

Founder & CTO

Lots has happened since our last engineering update about 3 months ago. Below are some of the highlights.

PostgreSQL API Updates & PostgresConf Silicon Valley Wrap-Up

We have made a lot of progress on YSQL, the PostgreSQL compatible distributed SQL API for YugaByte DB! You can also read about YSQL architecture which covers how distributed SQL is implemented in YugaByte DB.

We were at the first ever PostgresConf Silicon Valley in October 2018. We had a talk about architecting distributed data for GDPR compliance, where we go into the requirements imposed by GDPR, making sure app architecture continues to ensure regulatory compliance and the impact it has on the modern data tier. We also had a 3 hour hands-on workshop on getting started with the PostgreSQL-compatible YSQL on YugaByte DB by running metabase, an open-source business intelligence tool while exploring scale out and fault tolerance features.

Recent Meetups and Conferences

We were at a number of conferences and meetups over the past few months, below are some select few with the highlights.

Nov 1 – SF Bay Cloud Native Open Infra Meetup

In this meetup, we explained what Kubernetes StatefulSets are and 5 key points that developers and operations engineers should be aware of when working with them. We also demonstrated how to run a complete E-Commerce application powered by YugaByte DB, when all services are deployed in Kubernetes.

Nov 7 – Bay Area Kafka Meetup

In this talk at the Kafka meetup, we went over the key architectural patterns involved in the context of a sample IoT Fleet Management application built on Kafka, KSQL, YugaByte DB and Spring Boot.

Nov 15 – Silicon Valley Kubernetes and Cloud Native Meetup

Due to popular demand, we presented the Kubernetes StatefulSets talk at this meetup as well.

Nov 26-30 – AWS re:Invent

If you are planning on being in Las Vegas for the AWS show, drop by our booth to schedule a technical briefing on how YugaByte DB can help you lower your AWS infrastructure costs and reduce operational complexity, all at the same time.

YugaByte will have a booth at AWS reInvent and Kubecon, be sure to stop by and say hello!

We are also presenting at a number of meetups, check out the YugaByte events calendar.

We are Hiring!

YugaByte is growing fast and we’d like you to help us keep the momentum going! Check out our currently open positions:

Our team consists of domain experts from leading software companies such as Facebook, Oracle, Nutanix, Google and LinkedIn. We have come a long way in a short time but we cannot rest on our past accomplishments. We need your ideas and skills to make us better at every function that is necessary to create the next great software company. All while having tons of fun and blazing new trails!

Release and Roadmap Updates

We released YugaByte DB 1.1 with a ton of great features.

  • Distributed multi-shard/multi-table ACID transactions!
  • Global & consistent secondary indexes
  • UNIQUE constraint on secondary indexes
  • Native JSON data type
  • Public/private IP bindings for multi/hybrid cloud or multi-region deployments
  • User authentication
  • Redis-compatibility features added to our YEDIS API:
    • “Read from followers” for tunable read consistency
    • Support for multiple databases or namespaces
    • Support for MONITOR, EXPIRE, TTL

Read more about some of these features such as support for secondary indexes, the JSON data type and public IPs to simplify multi-cloud and hybrid-cloud database deployments.

YugaByte DB 1.1 also boasts a big performance boost! The graph below compares the performance of the latest Apache Cassandra with YugaByte DB 0.9 and 1.1 using the YCSB benchmark!

Look out for our upcoming release which will feature native Kubernetes support for YSQL (PostgreSQL-compatible API in YugaByte DB)!

Documentation, Blogs, Tutorials and Videos

We have been busy writing a lot of high quality blog posts, here are a few of them:

We have produced a number of technical videos as well, below is a list – enjoy!

On the documentation front, be sure to explore some of the core YSQL features.

Enhancements, Bug Fixes & Technical Questions

Security in YugaByte DB

We have just completed adding role based access control (RBAC) for the YCQL API! Securing who can access data in a database is extremely important. This is often done by created roles/users to authenticate who can connect to a database and granting them the appropriate access privileges to ensure they can access just the data they need. YugaByte DB automatically enforces authentication and authorization while allowing operators to add nodes to a cluster and tolerate failures. Most of our users running or planning to run YugaByte DB for their business critical data require this feature.

Serialization for YSQL

A great question asked by ddorian was about how the serialization format of data types in the PostgreSQL-compatible YSQL in YugaByte DB. In order to quickly enable the vast majority of PostgreSQL types, we are starting with reusing PostgreSQL’s in-memory serialization. This allows YugaByte DB to quickly enable data types such as N-dimensional arrays, JSONB and other complex types PostgreSQL has. However, for data types that are allowed in the primary key, YugaByte DB has a serialization, because the binary representation needs to be byte sortable. For collection types such as arrays, maps and JSONB the plan is to start using PostgreSQL’s serialization, and later map them onto the hierarchical document structure of DocDB to allow efficient updates of keys within the map in a backward-compatible way.

Since ddorian has had a number of great suggestions and answers to questions by other users to help YugaByte DB along, we are sending him a hoodie!

What’s Next?

  • Using YugaByte at your company? Tell us about it and we’ll send you a hoodie!
  • Get started with YugaByte DB on the cloud or container of your choice.
  • Contact us to learn more about licensing, pricing or to schedule a technical overview.
  • Compare YugaByte DB to databases like Redis, Cassandra, MongoDB and Cosmos DB and DynamoDB.

Related Posts

Founder & CTO