Code

Batch job processing#470

Code

Closed

benjie wants to merge 20 commits intomaingraphile/worker:mainfrom batched-get-jobsgraphile/worker:batched-get-jobsCopy head branch name to clipboard

+516-121

Commits

Commits on Jun 6, 2024

• Hoist getJob to workerPool

  benjie

  committed
  fa50044

  Copy full SHA for fa50044

• Switch to using poolId rather than workerId for locking/unlocking jobs

  benjie

  committed
  57eb29d

  Copy full SHA for 57eb29d

• Fix test

  benjie

  committed
  a771d63

  Copy full SHA for a771d63

• Add release notes

  benjie

  committed
  5877677

  Copy full SHA for 5877677

• Update docs and tests to refer to pool rather than worker for locked_at

  benjie

  committed
  6d7a9a2

  Copy full SHA for 6d7a9a2

• Switch failJobs to using poolId too

  benjie

  committed
  f481a42

  Copy full SHA for f481a42

• Start work on batch fetching jobs

  benjie

  committed
  88de944

  Copy full SHA for 88de944

• Batched job fetching with watermark

  benjie

  committed
  454aed5

  Copy full SHA for 454aed5

• Fix getJob call to reflect changes in #469

  benjie

  committed
  ec38935

  Copy full SHA for ec38935

• Hoist completeJob and failJob

  benjie

  committed
  2b60028

  Copy full SHA for 2b60028

• Refactor failJob/completeJob in preparation for batching

  benjie

  committed
  2695b50

  Copy full SHA for 2695b50

• Stub batch function

  benjie

  committed
  63bbceb

  Copy full SHA for 63bbceb

• Implement batching function

  benjie

  committed
  daa110e

  Copy full SHA for daa110e

• Lint fix

  benjie

  committed
  454d220

  Copy full SHA for 454d220

• Tweak graceful/forceful shutdown handover

  benjie

  committed
  1e818db

  Copy full SHA for 1e818db

• Evaluate envvar just once up top

  benjie

  committed
  22e8b19

  Copy full SHA for 22e8b19

• Release batches before releasing worker pool

  benjie

  committed
  9d9207e

  Copy full SHA for 9d9207e

• Tweak perfTest for more logging

  benjie

  committed
  bf103b9

  Copy full SHA for bf103b9

• Fairer startup time calc

  benjie

  committed
  8fb0174

  Copy full SHA for 8fb0174

• Refactor

  benjie

  committed
  f46ec8d

  Copy full SHA for f46ec8d