Skip to content

Conversation

etonlels
Copy link
Contributor

@etonlels etonlels commented Oct 3, 2025

This change allows users to set a default batch_concurrency value in their
project configuration that will be applied to incremental models.

  • Added batch_concurrency field to ModelDefaultsConfig
  • Updated create_model_kind() to apply batch_concurrency default to models
    inheriting from _IncrementalBy when not explicitly set
  • Skips applying default for subclasses with hardcoded batch_concurrency
    (e.g., IncrementalByUniqueKeyKind which has batch_concurrency: Literal[1])
  • Added comprehensive tests covering default behavior and edge cases

🤖 Generated with Claude Code

@etonlels etonlels force-pushed the batch-concurrency-model-defaults branch 2 times, most recently from 2efd868 to 6aff870 Compare October 3, 2025 20:17
@etonlels etonlels changed the title Add batch_concurrency to ModelDefaultsConfig feat: add batch_concurrency to ModelDefaultsConfig Oct 3, 2025
This change allows users to set a default `batch_concurrency` value in their
project configuration that will be applied to incremental models.

- Added `batch_concurrency` field to `ModelDefaultsConfig`
- Updated `create_model_kind()` to apply `batch_concurrency` default to models
  inheriting from `_IncrementalBy` when not explicitly set
- Skips applying default for subclasses with hardcoded `batch_concurrency`
  (e.g., `IncrementalByUniqueKeyKind` which has `batch_concurrency: Literal[1]`)
- Added comprehensive tests covering default behavior and edge cases

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>
@etonlels etonlels force-pushed the batch-concurrency-model-defaults branch from 6aff870 to fff244a Compare October 3, 2025 20:42
@etonlels etonlels changed the title feat: add batch_concurrency to ModelDefaultsConfig feat: add batch_concurrency to ModelDefaultsConfig Oct 3, 2025
@etonlels etonlels marked this pull request as ready for review October 3, 2025 20:44
@erindru
Copy link
Collaborator

erindru commented Oct 5, 2025

Does it make sense to add batch_concurrency without also adding batch_size?

@etonlels
Copy link
Contributor Author

etonlels commented Oct 6, 2025

Does it make sense to add batch_concurrency without also adding batch_size?

My team just cares about batch_concurrency at this time, but I'm happy to add other fields as part of this. If you give me the complete list I can add them.

@erindru
Copy link
Collaborator

erindru commented Oct 6, 2025

It's just batch_size because batch_size and batch_concurrency are related and work together

@izeigerman izeigerman merged commit db1faeb into TobikoData:main Oct 7, 2025
21 of 22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants