-
Notifications
You must be signed in to change notification settings - Fork 888
Pull requests: huggingface/tokenizers
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Update __init__.pyi: fix 525: SyntaxWarning: invalid escape sequence '\w'
#1764
opened Apr 18, 2025 by
wyattscarpenter
Loading…
Bump http-proxy-middleware from 2.0.6 to 2.0.9 in /tokenizers/examples/unstable_wasm/www
dependencies
Pull requests that update a dependency file
javascript
Pull requests that update Javascript code
#1762
opened Apr 16, 2025 by
dependabot
bot
Loading…
Implement
from_bytes and read_bytes Methods in WordPiece Tokenizer for WebAssembly Compatibility
#1758
opened Mar 31, 2025 by
sondalex
Loading…
Pre-tokenizers that support multi-word/non-whitespace BPE in single pass
#1753
opened Mar 22, 2025 by
mjbommar
Loading…
Update dependency versions to fix NoGIL Python package install
#1750
opened Mar 17, 2025 by
vinayakdsci
Loading…
Fix data path in test_continuing_prefix_trainer_mismatch
#1747
opened Mar 13, 2025 by
GaetanLepage
Loading…
Use ApiBuilder::from_env() in from_pretrained function
#1737
opened Feb 19, 2025 by
BenLocal
Loading…
Add FxHash and ShortStringOptimization.
#1733
opened Feb 10, 2025 by
MeetThePatel
Loading…
3 of 4 tasks
[WIP] free speed/mem optimizations with ahash, dary_heap, and compact_str
#1618
opened Aug 21, 2024 by
mjbommar
Loading…
[Feature] support Assign token to update the content of a token
Stale
#1570
opened Jul 12, 2024 by
ArthurZucker
•
Draft
1 task
ProTip!
Filter pull requests by the default branch with base:main.