Repository navigation

Add `_merge_and_standardize_kwargs` to image and video processors - #50706

Draft

hmellor wants to merge 10 commits into

huggingface:mainfrom

hmellor:merge-and-standardize-kwargs

Draft

Add `_merge_and_standardize_kwargs` to image and video processors#50706
hmellor wants to merge 10 commits into
huggingface:mainfrom
hmellor:merge-and-standardize-kwargs

Commits on Nov 12, 2026
- Add `_get_num_multimodal_tokens` to more processors
  
  hmellor
  and
  claude
  committed
  a85d6a4
- Add `_get_num_multimodal_tokens` to Granite Speech
  
  hmellor
  and
  claude
  committed
  fad3530
Commits on Nov 13, 2026
- Drop `_get_num_multimodal_tokens` from audio-only processors
  
  hmellor
  and
  claude
  committed
  0a73f13
- Count embedding tokens for Llama4 and Ovis2 without `image_token_ids` overrides
  
  hmellor
  and
  claude
  committed
  9312d00
- Use dict literals in Llama4/Ovis2 token count tests
  
  hmellor
  and
  claude
  committed
  f25beba
- Run the image token count test on both image processor backends
  
  hmellor
  and
  claude
  committed
  79b1dfb
- Note GOT-OCR2 `num_image_tokens` fallback goes with the v5.29.0 deprecation
  
  hmellor
  and
  claude
  committed
  7b1eb3c
- Add `_merge_and_standardize_kwargs` to image and video processors
  
  hmellor
  and
  claude
  committed
  e17c02e
- Count embedding tokens from replacements in the token count tests
  
  hmellor
  and
  claude
  committed
  c657874
- Merge branch 'processors-num-mm-tokens' into merge-and-standardize-kwargs
  
  hmellor
  and
  claude
  committed
  e35511e