Skip to content

CommittablePartitionedSourceBenchmark failed #416

New issue
New issue
Open
Open
CommittablePartitionedSourceBenchmark failed#416
@Arkatufus

Description

@Arkatufus
Arkatufus
opened on May 6, 2025

Version Information
Version of Akka.Persistence.MongoDb? dev branch

Describe the bug
CommittablePartitionedSourceBenchmark failed and we need to figure out if it is the benchmark code failing or if it is our commitable code that is failing.

Setting up Kafka benchmark...
[Setup] Benchmark run ID: 546afb67f576451dba09a1f731fb3763
[Setup] Topic name will be: benchmark-topic-546afb67f576451dba09a1f731fb3763
[Setup] Successfully created topic: benchmark-topic-546afb67f576451dba09a1f731fb3763
Kafka benchmark setup complete.
[INFO][05/06/2025 15:16:40.535Z][Thread 0001][ActorSystem(kafka-benchmark)] Populating data for Topic: benchmark-topic-546afb67f576451dba09a1f731fb3763 [100000 messages]
[INFO][05/06/2025 15:16:55.550Z][Thread 0005][ActorSystem(kafka-benchmark)] Test messages populated.
[Iteration] Using topic: benchmark-topic-546afb67f576451dba09a1f731fb3763 with group: benchmark-group-546afb67f576451dba09a1f731fb3763-543e3a3c25f142ab9343ad3e68fd0ed7
[INFO][05/06/2025 15:16:55.578Z][Thread 0008][SourceShape`1([] [out])(akka://kafka-benchmark/user/StreamSupervisor-0)] Starting
[INFO][05/06/2025 15:16:55.580Z][Thread 0001][ActorSystem(kafka-benchmark)] Starting consumer stream...
[INFO][05/06/2025 15:16:55.587Z][Thread 0001][ActorSystem(kafka-benchmark)] Consumer stream started.
[INFO][05/06/2025 15:16:58.665Z][Thread 0008][SourceShape`1([] [out])(akka://kafka-benchmark/user/StreamSupervisor-0)] 0 Starting SubSource for partition benchmark-topic-546afb67f576451dba09a1f731fb3763 [[0]]
[INFO][05/06/2025 15:16:58.665Z][Thread 0009][SourceShape`1([] [out])(akka://kafka-benchmark/user/StreamSupervisor-0)] 0 Starting SubSource for partition benchmark-topic-546afb67f576451dba09a1f731fb3763 [[1]]
[INFO][05/06/2025 15:16:58.665Z][Thread 0005][SourceShape`1([] [out])(akka://kafka-benchmark/user/StreamSupervisor-0)] 0 Starting SubSource for partition benchmark-topic-546afb67f576451dba09a1f731fb3763 [[2]]
[INFO][05/06/2025 15:16:58.666Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: Prestart
[INFO][05/06/2025 15:16:58.666Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: Prestart
[INFO][05/06/2025 15:16:58.666Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: Prestart
[INFO][05/06/2025 15:16:58.861Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 999, total: 1000
[INFO][05/06/2025 15:16:58.999Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 1999, total: 2000
[INFO][05/06/2025 15:16:59.123Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 2999, total: 3000
[INFO][05/06/2025 15:16:59.263Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 3999, total: 4000
[INFO][05/06/2025 15:16:59.388Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 4999, total: 5000
[INFO][05/06/2025 15:16:59.510Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 5999, total: 6000
[INFO][05/06/2025 15:16:59.636Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 6999, total: 7000
[INFO][05/06/2025 15:16:59.760Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 7999, total: 8000
[INFO][05/06/2025 15:16:59.884Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 8999, total: 9000
[INFO][05/06/2025 15:17:00.008Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 9999, total: 10000
[INFO][05/06/2025 15:17:00.133Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 10999, total: 11000
[INFO][05/06/2025 15:17:00.259Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 11999, total: 12000
[INFO][05/06/2025 15:17:00.383Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 12999, total: 13000
[INFO][05/06/2025 15:17:00.507Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 13999, total: 14000
[INFO][05/06/2025 15:17:00.632Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 14999, total: 15000
[INFO][05/06/2025 15:17:00.772Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 15999, total: 16000
[INFO][05/06/2025 15:17:00.893Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 16999, total: 17000
[INFO][05/06/2025 15:17:01.016Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 17999, total: 18000
[INFO][05/06/2025 15:17:01.141Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 18999, total: 19000
[INFO][05/06/2025 15:17:01.265Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 19999, total: 20000
[INFO][05/06/2025 15:17:01.390Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 20999, total: 21000
[INFO][05/06/2025 15:17:01.513Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 21999, total: 22000
[INFO][05/06/2025 15:17:01.636Z][Thread 0008][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 22999, total: 23000
[INFO][05/06/2025 15:17:01.760Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 23999, total: 24000
[INFO][05/06/2025 15:17:01.882Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 24999, total: 25000
[INFO][05/06/2025 15:17:02.020Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 25999, total: 26000
[INFO][05/06/2025 15:17:02.144Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 26999, total: 27000
[INFO][05/06/2025 15:17:02.271Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 27999, total: 28000
[INFO][05/06/2025 15:17:02.411Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 28999, total: 29000
[INFO][05/06/2025 15:17:02.535Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 29999, total: 30000
[INFO][05/06/2025 15:17:02.660Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 30999, total: 31000
[INFO][05/06/2025 15:17:02.785Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 31999, total: 32000
[INFO][05/06/2025 15:17:02.906Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 32999, total: 33000
[INFO][05/06/2025 15:17:03.028Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 33999, total: 34000
[INFO][05/06/2025 15:17:03.154Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 34999, total: 35000
[INFO][05/06/2025 15:17:03.277Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 35999, total: 36000
[INFO][05/06/2025 15:17:03.401Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:2, last: 36999, total: 37000
[INFO][05/06/2025 15:17:03.588Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 999, total: 1000
[INFO][05/06/2025 15:17:03.711Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 1999, total: 2000
[INFO][05/06/2025 15:17:03.835Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 2999, total: 3000
[INFO][05/06/2025 15:17:03.960Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 3999, total: 4000
[INFO][05/06/2025 15:17:04.084Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 4999, total: 5000
[INFO][05/06/2025 15:17:04.209Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 5999, total: 6000
[INFO][05/06/2025 15:17:04.333Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 6999, total: 7000
[INFO][05/06/2025 15:17:04.457Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 7999, total: 8000
[INFO][05/06/2025 15:17:04.580Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 8999, total: 9000
[INFO][05/06/2025 15:17:04.704Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 9999, total: 10000
[INFO][05/06/2025 15:17:04.828Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 10999, total: 11000
[INFO][05/06/2025 15:17:04.952Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 11999, total: 12000
[INFO][05/06/2025 15:17:05.077Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 12999, total: 13000
[INFO][05/06/2025 15:17:05.201Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 13999, total: 14000
[INFO][05/06/2025 15:17:05.340Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 14999, total: 15000
[INFO][05/06/2025 15:17:05.463Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 15999, total: 16000
[INFO][05/06/2025 15:17:05.585Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 16999, total: 17000
[INFO][05/06/2025 15:17:05.708Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 17999, total: 18000
[INFO][05/06/2025 15:17:05.833Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 18999, total: 19000
[INFO][05/06/2025 15:17:05.956Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 19999, total: 20000
[INFO][05/06/2025 15:17:06.079Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 20999, total: 21000
[INFO][05/06/2025 15:17:06.202Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 21999, total: 22000
[INFO][05/06/2025 15:17:06.326Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 22999, total: 23000
[INFO][05/06/2025 15:17:06.449Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 23999, total: 24000
[INFO][05/06/2025 15:17:06.574Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 24999, total: 25000
[INFO][05/06/2025 15:17:06.698Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 25999, total: 26000
[INFO][05/06/2025 15:17:06.822Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:1, last: 26999, total: 27000
[INFO][05/06/2025 15:17:06.948Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 999, total: 1000
[INFO][05/06/2025 15:17:07.071Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 1999, total: 2000
[INFO][05/06/2025 15:17:07.197Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 2999, total: 3000
[INFO][05/06/2025 15:17:07.320Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 3999, total: 4000
[INFO][05/06/2025 15:17:07.444Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 4999, total: 5000
[INFO][05/06/2025 15:17:07.571Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 5999, total: 6000
[INFO][05/06/2025 15:17:07.694Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 6999, total: 7000
[INFO][05/06/2025 15:17:07.817Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 7999, total: 8000
[INFO][05/06/2025 15:17:07.939Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 8999, total: 9000
[INFO][05/06/2025 15:17:08.062Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 9999, total: 10000
[INFO][05/06/2025 15:17:08.186Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 10999, total: 11000
[INFO][05/06/2025 15:17:08.309Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 11999, total: 12000
[INFO][05/06/2025 15:17:08.432Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 12999, total: 13000
[INFO][05/06/2025 15:17:08.556Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 13999, total: 14000
[INFO][05/06/2025 15:17:08.693Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 14999, total: 15000
[INFO][05/06/2025 15:17:08.818Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 15999, total: 16000
[INFO][05/06/2025 15:17:08.940Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 16999, total: 17000
[INFO][05/06/2025 15:17:09.062Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 17999, total: 18000
[INFO][05/06/2025 15:17:09.187Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 18999, total: 19000
[INFO][05/06/2025 15:17:09.313Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 19999, total: 20000
[INFO][05/06/2025 15:17:09.437Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 20999, total: 21000
[INFO][05/06/2025 15:17:09.561Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 21999, total: 22000
[INFO][05/06/2025 15:17:09.686Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 22999, total: 23000
[INFO][05/06/2025 15:17:09.809Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 23999, total: 24000
[INFO][05/06/2025 15:17:09.933Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 24999, total: 25000
[INFO][05/06/2025 15:17:10.058Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 25999, total: 26000
[INFO][05/06/2025 15:17:10.179Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 26999, total: 27000
[INFO][05/06/2025 15:17:10.305Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 27999, total: 28000
[INFO][05/06/2025 15:17:10.428Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 28999, total: 29000
[INFO][05/06/2025 15:17:10.553Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 29999, total: 30000
[INFO][05/06/2025 15:17:10.691Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 30999, total: 31000
[INFO][05/06/2025 15:17:10.815Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 31999, total: 32000
[INFO][05/06/2025 15:17:10.955Z][Thread 0005][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 32999, total: 33000
[INFO][05/06/2025 15:17:11.079Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 33999, total: 34000
[INFO][05/06/2025 15:17:11.221Z][Thread 0011][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: batch size, partition:0, last: 34999, total: 35000
[INFO][05/06/2025 15:17:13.418Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: interval, partition:2, last: 37215, total: 37216
[INFO][05/06/2025 15:17:16.837Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: interval, partition:1, last: 27167, total: 27168
[INFO][05/06/2025 15:17:21.239Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: interval, partition:0, last: 35615, total: 35616
[INFO][05/06/2025 15:17:23.428Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: No active batch
[INFO][05/06/2025 15:17:26.856Z][Thread 0009][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: No active batch
[INFO][05/06/2025 15:17:31.260Z][Thread 0006][Akka.Streams.Kafka.Stages.Consumers.CommitCollectorStage+CommitCollectorStageLogic(akka://kafka-benchmark/user/StreamSupervisor-0)] ScheduleCommit: No active batch

The total commits that went through ScheduleCommit is exactly 100,000 commits, but then the benchmark get stuck in a "no active batch" loop.

To Reproduce
Run the benchmark.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions