Scribd
Upload
35 views1 page

Kafka Architecture

A Kafka cluster ingests real-time data from data sources through Kafka topics. The topics are organized by medical categories like stroke, vitals, and cardiology. Broker 1 handles one partition of the topics. Consumer groups ingest data from the topics for real-time alerts or batch storage and processing in MongoDB collections. Consumer group 1 handles real-time actions and consumer group 2 performs analytics, reporting, and diagnosis on the offline data.

Uploaded by

Khouloud Ch
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
35 views1 page

Kafka Architecture

A Kafka cluster ingests real-time data from data sources through Kafka topics. The topics are organized by medical categories like stroke, vitals, and cardiology. Broker 1 handles one partition of the topics. Consumer groups ingest data from the topics for real-time alerts or batch storage and processing in MongoDB collections. Consumer group 1 handles real-time actions and consumer group 2 performs analytics, reporting, and diagnosis on the offline data.

Uploaded by

Khouloud Ch
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 1

Kafka Cluster

Data Gateway/ Real-Time Data Consumer Groups


Kafka Topics
Source Data Collect Ingestion

Broker(1): Kafka Consumer Group


(One partition) Message 1:
*Emergency- Real-Time
streaming
Docs action
Kafka (Consumer
Topic1 : stroke Group 1 ) *Nurses Team
Gateway.Py Topic2 : vitals Topic 1 and 2
test.csv Topic3 : cardiology with ALERTS
*Collect
*Classification Topic4: diabete
*Topic Creation Topic5 : dyslipidemia Consumer Group
Topic6 : research Batch / Data Storage:
2:
MongoDB *Analytics
*Emergency
Offline Data *Reporting
ingestion Docs
Zookeeper (Consumers *Nurses Team *Diagnosis
Group 1&2 ) *Cardiologist *Batch
Database : ihealth
*Endocrinologist processing
Collections:
*stroke/*vitals/ *Lipidologist
MongoDB Kafka c *cardiology/ *Research Team
onnector *diabetes
*dyslipidemia/
*research

You might also like