Skip to content

Akshit-Zatakia/go-stream-pipeline

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Go Stream Pipeline

To understand the workflow and whole code please refer my blog: Dynamically Updating Streaming Rules in Golang

How to run this application:

  • Clone the repository

    git clone github.com/Akshit-Zatakia
  • Up the docker containers for kafka and redpanda-ui (it will be useful for topics management)

    docker compose up -d
  • Add the below rule in rules-topic:
    Operation values are : sum,minus,multiply,divide
    keynames are: json keys which needs to be processed

    {
      "operation": "sum",
      "keynames": ["price", "tax"]
    }
  • Run our streampipeline application:

    make run
  • For testing use benchmark module which will generate the messages:

    cd benchmark
    go run main.go

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published