-
Notifications
You must be signed in to change notification settings - Fork 30
Open
Labels
enhancementNew feature or requestNew feature or request
Description
In move/buffered operations we currently use target-chunk-time to set the read-chunk-size. This is an MVCC read, so it doesn't provide the same benefit as in unbuffered where it yields locks. It does still yield read-views (which helps HLL), so it's not completely without purpose.
Writes are fanned out to 1000 rows/1MiB at a time, in write-threads. The default write threads is 2, which is low. Typically in production we will fan out to 32+ threads.
The bottlenecks shift from unbuffered operations:
- We don't have contention on locks
- Where we do have contention is the shared redo log.
So we should find a way to measure and yield based on that. Thus, my suggestion is a throttler based on observed commit latency.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request