Streaming SQL is the latest hot technology that takes a fundamentally familiar topic and adds modern techniques. SQL is ubiquitous and probably will continue to be for a long time, so if you start with that foundation and add modern streaming functionality, you get a technology that is ideal for querying real-time data streams. The widespread familiarity of SQL will help with adopting it in new environments and new use cases.
However, there are many aspects of streaming SQL that are challenging to grasp, including continuous queries, late arrival of events and different types of windowing. The trick is to not only leverage these new functionalities but also to present them to end users in a logical and meaningful way. We will explain various aspects of streaming SQL by showing visual representations of the different semantics provided.
In this talk, we will use KSQL to illustrate various examples. Attendees will get a better understanding on:
- Defining various aggregation window types and their behavior
- How to understand time scales and granularity
- The ability to replay results for testing and for creating new outputs