Skip to content

cloudymoma/pubsub-dataflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Google Cloud Pubsub & Dataflow

TL;DR

Pipelines

  • Pubsub data producer, 1 message per second
  • Pubsub data consumer, 10s sliding window, for every 1s log a sample message per window + count number of messages per window

For load tests, use this data producer to dump messages to Pubsub

Quickstart

Simply change parameters defined in this makefile, for example, project id, pubsub topic name, pubsub subscription name etc.

then make df will launch the dataflow job, or make up will update the current running job

DAG

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published