Skip to content

feat: improve text_normalize in english.py #54

Open
Ishita-190 wants to merge 1 commit intomofa-org:mainfrom
Ishita-190:next
Open

feat: improve text_normalize in english.py #54
Ishita-190 wants to merge 1 commit intomofa-org:mainfrom
Ishita-190:next

Conversation

@Ishita-190
Copy link
Copy Markdown
Contributor

Fixes: #53

Changes Made

  • Replaced minimal punctuation mapping with extended support for smart quotes, dashes, ellipsis, and CJK punctuation.
  • Added uppercase and digit handling for normalize_numbers.
  • Stripped accents consistently using Unicode normalization.
  • Expanded abbreviations (i.e. to that is, e.g. to for example) with word-boundary and case-insensitive matching.
  • Handled consecutive punctuation safely to avoid reference leaks.
  • Normalized whitespace and ensured terminal punctuation for TTS stability.

All the changes are working properly

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

enhancement: improve english text normalization in english.py

1 participant