Scribd
Upload
20 views

Spark (Structured) Streaming vs. Kafka Streams

The document compares Spark Structured Streaming and Kafka Streams for real-time stream processing. Spark Structured Streaming is an extension of the Spark SQL engine that allows streaming data processing, while Kafka Streams is a client library for building applications and microservices that process and analyze data stored in Kafka clusters. The document outlines key differences in characteristics like programming model, fault tolerance, latency, and integration with other systems.

Uploaded by

Phú Đình
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
20 views

Spark (Structured) Streaming vs. Kafka Streams

The document compares Spark Structured Streaming and Kafka Streams for real-time stream processing. Spark Structured Streaming is an extension of the Spark SQL engine that allows streaming data processing, while Kafka Streams is a client library for building applications and microservices that process and analyze data stored in Kafka clusters. The document outlines key differences in characteristics like programming model, fault tolerance, latency, and integration with other systems.

Uploaded by

Phú Đình
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 41

Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.

net/slideshow/embed_code/key/bTx7SmAUSjujd0

1 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

2 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

3 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

4 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

5 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

6 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

7 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

8 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

9 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

10 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

11 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

12 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

13 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

14 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

15 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

16 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

17 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

18 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

19 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

20 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

21 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

22 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

23 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

24 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

25 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

26 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

27 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

28 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

29 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

30 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

31 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

32 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

33 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

34 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

35 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

36 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

37 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

38 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

39 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

40 of 41 31/05/2022, 15:19
Spark (Structured) Streaming vs. Kafka Streams https://www.slideshare.net/slideshow/embed_code/key/bTx7SmAUSjujd0

31 of 41

31 of 41

41 of 41 31/05/2022, 15:19

You might also like