�ݺ�ߣshows by User: MatthiasJSax

�ݺ�ߣshows by User: MatthiasJSax / http://www.slideshare.net/images/logo.gif �ݺ�ߣshows by User: MatthiasJSax / Sun, 29 Apr 2018 13:41:19 GMT �ݺ�ߣShare feed for �ݺ�ߣshows by User: MatthiasJSax KSQL---Streaming SQL for Apache Kafka /slideshow/ksqlstreaming-sql-for-apache-kafka/95414085 meetup-germany-april-2018-180429134119
This talk is about KSQL, an open source streaming SQL engine for Apache Kafka. KSQL aims to make stream processing available to everybody without the need to write Java or Scala code. Streaming SQL makes it easy to get started with a wide-range of stream processing applications such as real-time ETL, sessionization, monitoring and alerting, or fraud detection. We will give a general introduction to KSQL covering its SQL dialect, core concepts, and architecture including some technical deep-dives how it works under the hood.]]>
This talk is about KSQL, an open source streaming SQL engine for Apache Kafka. KSQL aims to make stream processing available to everybody without the need to write Java or Scala code. Streaming SQL makes it easy to get started with a wide-range of stream processing applications such as real-time ETL, sessionization, monitoring and alerting, or fraud detection. We will give a general introduction to KSQL covering its SQL dialect, core concepts, and architecture including some technical deep-dives how it works under the hood.]]> Sun, 29 Apr 2018 13:41:19 GMT /slideshow/ksqlstreaming-sql-for-apache-kafka/95414085 MatthiasJSax@slideshare.net(MatthiasJSax) KSQL---Streaming SQL for Apache Kafka MatthiasJSax This talk is about KSQL, an open source streaming SQL engine for Apache Kafka. KSQL aims to make stream processing available to everybody without the need to write Java or Scala code. Streaming SQL makes it easy to get started with a wide-range of stream processing applications such as real-time ETL, sessionization, monitoring and alerting, or fraud detection. We will give a general introduction to KSQL covering its SQL dialect, core concepts, and architecture including some technical deep-dives how it works under the hood. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/meetup-germany-april-2018-180429134119-thumbnail.jpg?width=120&height=120&fit=bounds" /> This talk is about KSQL, an open source streaming SQL engine for Apache Kafka. KSQL aims to make stream processing available to everybody without the need to write Java or Scala code. Streaming SQL makes it easy to get started with a wide-range of stream processing applications such as real-time ETL, sessionization, monitoring and alerting, or fraud detection. We will give a general introduction to KSQL covering its SQL dialect, core concepts, and architecture including some technical deep-dives how it works under the hood.

KSQL---Streaming SQL for Apache Kafka from Matthias J. Sax

]]> 2295 10 https://cdn.slidesharecdn.com/ss_thumbnails/meetup-germany-april-2018-180429134119-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Building Stream Processing Applications with Apache Kafka's Exactly-Once Processing Guarantees /slideshow/building-stream-processing-applications-with-apache-kafkas-exactlyonce-processing-guarantees/80069245 big-data-apps-meetup-2017-170922203442
This talk was given at the "Big Data Applications" Meetup group (https://www.meetup.com/BigDataApps/). Abstract: Kafka 0.11 added a new feature called "exactly-once guarantees". In this talk, we will explain what "exactly-once" means in the context of Kafka and data stream processing and how it effects application development. The talk will go into some details about exactly-once namely the new idempotent producer and transactions and how both can be exploited to simplify application code: for example, you don't need to have complex deduplication code in your input path, as you can rely on Kafka to deduplicate messages when data is produces by an upstream application. Transactions can be used to write multiple messages into different topics and/or partitions and commit all writes in an atomic manner (or abort all writes so none will be read by a downstream consumer in read-committed mode). Thus, transactions allow for applications with strong consistency guarantees, like in the financial sector (e.g., either send a withdrawal and deposit message to transfer money or none of them). Finally, we talk about Kafka's Streams API that makes exactly-once stream processing as simple as it can get.]]>
This talk was given at the "Big Data Applications" Meetup group (https://www.meetup.com/BigDataApps/). Abstract: Kafka 0.11 added a new feature called "exactly-once guarantees". In this talk, we will explain what "exactly-once" means in the context of Kafka and data stream processing and how it effects application development. The talk will go into some details about exactly-once namely the new idempotent producer and transactions and how both can be exploited to simplify application code: for example, you don't need to have complex deduplication code in your input path, as you can rely on Kafka to deduplicate messages when data is produces by an upstream application. Transactions can be used to write multiple messages into different topics and/or partitions and commit all writes in an atomic manner (or abort all writes so none will be read by a downstream consumer in read-committed mode). Thus, transactions allow for applications with strong consistency guarantees, like in the financial sector (e.g., either send a withdrawal and deposit message to transfer money or none of them). Finally, we talk about Kafka's Streams API that makes exactly-once stream processing as simple as it can get.]]> Fri, 22 Sep 2017 20:34:42 GMT /slideshow/building-stream-processing-applications-with-apache-kafkas-exactlyonce-processing-guarantees/80069245 MatthiasJSax@slideshare.net(MatthiasJSax) Building Stream Processing Applications with Apache Kafka's Exactly-Once Processing Guarantees MatthiasJSax This talk was given at the "Big Data Applications" Meetup group (https://www.meetup.com/BigDataApps/). Abstract: Kafka 0.11 added a new feature called "exactly-once guarantees". In this talk, we will explain what "exactly-once" means in the context of Kafka and data stream processing and how it effects application development. The talk will go into some details about exactly-once namely the new idempotent producer and transactions and how both can be exploited to simplify application code: for example, you don't need to have complex deduplication code in your input path, as you can rely on Kafka to deduplicate messages when data is produces by an upstream application. Transactions can be used to write multiple messages into different topics and/or partitions and commit all writes in an atomic manner (or abort all writes so none will be read by a downstream consumer in read-committed mode). Thus, transactions allow for applications with strong consistency guarantees, like in the financial sector (e.g., either send a withdrawal and deposit message to transfer money or none of them). Finally, we talk about Kafka's Streams API that makes exactly-once stream processing as simple as it can get. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/big-data-apps-meetup-2017-170922203442-thumbnail.jpg?width=120&height=120&fit=bounds" /> This talk was given at the "Big Data Applications" Meetup group (https://www.meetup.com/BigDataApps/). Abstract: Kafka 0.11 added a new feature called "exactly-once guarantees". In this talk, we will explain what "exactly-once" means in the context of Kafka and data stream processing and how it effects application development. The talk will go into some details about exactly-once namely the new idempotent producer and transactions and how both can be exploited to simplify application code: for example, you don't need to have complex deduplication code in your input path, as you can rely on Kafka to deduplicate messages when data is produces by an upstream application. Transactions can be used to write multiple messages into different topics and/or partitions and commit all writes in an atomic manner (or abort all writes so none will be read by a downstream consumer in read-committed mode). Thus, transactions allow for applications with strong consistency guarantees, like in the financial sector (e.g., either send a withdrawal and deposit message to transfer money or none of them). Finally, we talk about Kafka's Streams API that makes exactly-once stream processing as simple as it can get.

Building Stream Processing Applications with Apache Kafka's Exactly-Once Processing Guarantees from Matthias J. Sax

]]> 575 2 https://cdn.slidesharecdn.com/ss_thumbnails/big-data-apps-meetup-2017-170922203442-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Stream Application Development with Apache Kafka /MatthiasJSax/stream-application-development-with-apache-kafka meetup-apache-kafka11-10-16smytesf-161120035943
Talk at "Apache Kafka Bay Area" Meetup as Smyte, San Francisco, CA on 11/10/16. https://www.meetup.com/http-kafka-apache-org/events/234812858/]]>
Talk at "Apache Kafka Bay Area" Meetup as Smyte, San Francisco, CA on 11/10/16. https://www.meetup.com/http-kafka-apache-org/events/234812858/]]> Sun, 20 Nov 2016 03:59:43 GMT /MatthiasJSax/stream-application-development-with-apache-kafka MatthiasJSax@slideshare.net(MatthiasJSax) Stream Application Development with Apache Kafka MatthiasJSax Talk at "Apache Kafka Bay Area" Meetup as Smyte, San Francisco, CA on 11/10/16. https://www.meetup.com/http-kafka-apache-org/events/234812858/ <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/meetup-apache-kafka11-10-16smytesf-161120035943-thumbnail.jpg?width=120&height=120&fit=bounds" /> Talk at "Apache Kafka Bay Area" Meetup as Smyte, San Francisco, CA on 11/10/16. https://www.meetup.com/http-kafka-apache-org/events/234812858/

Stream Application Development with Apache Kafka from Matthias J. Sax

]]> 1976 4 https://cdn.slidesharecdn.com/ss_thumbnails/meetup-apache-kafka11-10-16smytesf-161120035943-thumbnail.jpg?width=120&height=120&fit=bounds presentation 000000 http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Feeding a Squirrel in Time---Windows in Flink /slideshow/feeding-a-squirrel-in-timewindows-in-flink/55057974 meetupmunich-151112213837-lva1-app6891
Apache Flink Meetup Munich (November 2015). ]]>
Apache Flink Meetup Munich (November 2015). ]]> Thu, 12 Nov 2015 21:38:37 GMT /slideshow/feeding-a-squirrel-in-timewindows-in-flink/55057974 MatthiasJSax@slideshare.net(MatthiasJSax) Feeding a Squirrel in Time---Windows in Flink MatthiasJSax Apache Flink Meetup Munich (November 2015). <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/meetupmunich-151112213837-lva1-app6891-thumbnail.jpg?width=120&height=120&fit=bounds" /> Apache Flink Meetup Munich (November 2015).

Feeding a Squirrel in Time---Windows in Flink from Matthias J. Sax

]]> 760 5 https://cdn.slidesharecdn.com/ss_thumbnails/meetupmunich-151112213837-lva1-app6891-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 A Tale of Squirrels and Storms /slideshow/a-tale-of-squirrels-and-storms/54332398 flink-forward-151024130323-lva1-app6891
Describes some differences and similarities of Apache Flink and Apache Storm. Gives a introduction into Flink's compatibility layer that allows to run Storm topologies in Flink and to embed spouts and bolts in Flink streaming programs.]]>
Describes some differences and similarities of Apache Flink and Apache Storm. Gives a introduction into Flink's compatibility layer that allows to run Storm topologies in Flink and to embed spouts and bolts in Flink streaming programs.]]> Sat, 24 Oct 2015 13:03:23 GMT /slideshow/a-tale-of-squirrels-and-storms/54332398 MatthiasJSax@slideshare.net(MatthiasJSax) A Tale of Squirrels and Storms MatthiasJSax Describes some differences and similarities of Apache Flink and Apache Storm. Gives a introduction into Flink's compatibility layer that allows to run Storm topologies in Flink and to embed spouts and bolts in Flink streaming programs. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/flink-forward-151024130323-lva1-app6891-thumbnail.jpg?width=120&height=120&fit=bounds" /> Describes some differences and similarities of Apache Flink and Apache Storm. Gives a introduction into Flink's compatibility layer that allows to run Storm topologies in Flink and to embed spouts and bolts in Flink streaming programs.

A Tale of Squirrels and Storms from Matthias J. Sax

]]> 241 5 https://cdn.slidesharecdn.com/ss_thumbnails/flink-forward-151024130323-lva1-app6891-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 https://cdn.slidesharecdn.com/profile-photo-MatthiasJSax-48x48.jpg?cb=1573840930 https://www.linkedin.com/in/mjsax https://cdn.slidesharecdn.com/ss_thumbnails/meetup-germany-april-2018-180429134119-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/ksqlstreaming-sql-for-apache-kafka/95414085 KSQL---Streaming SQL f... https://cdn.slidesharecdn.com/ss_thumbnails/big-data-apps-meetup-2017-170922203442-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/building-stream-processing-applications-with-apache-kafkas-exactlyonce-processing-guarantees/80069245 Building Stream Proces... https://cdn.slidesharecdn.com/ss_thumbnails/meetup-apache-kafka11-10-16smytesf-161120035943-thumbnail.jpg?width=320&height=320&fit=bounds MatthiasJSax/stream-application-development-with-apache-kafka Stream Application Dev...