Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

epic: improve model encoding compression 💾 #12293

Draft
wants to merge 60 commits into
base: master
Choose a base branch
from
Draft

epic: improve model encoding compression 💾 #12293

wants to merge 60 commits into from
+1,425 −604

Commits on Jul 2, 2024

  1. feat(common/models/templates): initial trie node compression/decompre… 

    …ssion

Aims for a UCS-2 encoded string and does not shy away from unpaired surrogates in the encoding.
    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ef5a6f2 View commit details
    Browse the repository at this point in the history

  2. fix(common/models/templates): early test-fixture did not use sentinel… 

    … code

When a leaf node exists at the same Trie location as an internal node, it should be a child of that internal node using SENTINEL_CODE_UNIT
(\ufdd0).  The fixture was using null/undefined instead!
    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    84a36bc View commit details
    Browse the repository at this point in the history

  3. feat(common/models/templates): basic full-trie compression test

    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    af2b7ac View commit details
    Browse the repository at this point in the history

  4. fix(common/models/templates): model-compiler error correction for com… 

    …pressor
    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    be66dff View commit details
    Browse the repository at this point in the history

  5. chore(common/models/templates): doc on probable error location

    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    56fd030 View commit details
    Browse the repository at this point in the history

  6. change(common/models/templates): encoded-num range-offset experiment

    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    c0febba View commit details
    Browse the repository at this point in the history

  7. chore(common/models/templates): reverts offset but leaves its infrast… 

    …ructure
    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    94900c5 View commit details
    Browse the repository at this point in the history

  8. docs(common/models/templates): minor notes on noted editor complaints… 

    … for compressed-Trie code
    @jahorton
    jahorton committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    467efd4 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. refactor(common/models): split trie-model implementation into separat… 

    …e components
    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    7644d38 View commit details
    Browse the repository at this point in the history

  2. refactor(developer/compilers): prepare for trie-compiler split

    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    c16ae27 View commit details
    Browse the repository at this point in the history

  3. refactor(common/models): move primary trie-compilation code into comm… 

    …on/models/templates

We'll likely want to dynamically build a Trie to represent user-specific entries made available by the active OS.  We'll then blend _that_ with the 'static' distributed model.
    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    54bdf73 View commit details
    Browse the repository at this point in the history

  4. refactor(common/models): refactor migrated trie-construction code for… 

    … improved encapsulation
    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    7684353 View commit details
    Browse the repository at this point in the history

  5. change(common/models): clean up trie construction code, add unit tests

    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    f7d2d63 View commit details
    Browse the repository at this point in the history

  6. fix(developer): add 'build' dependency link to models/templates

    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    32a31bc View commit details
    Browse the repository at this point in the history

  7. chore(common/models): Merge branch 'refactor/common/models/trie-const… 

    …ruction' into refactor/common/models/trie-construction-cntd
    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    996b2ae View commit details
    Browse the repository at this point in the history

  8. chore(common/models): Merge branch 'refactor/common/models/trie-const… 

    …ruction-cntd' into change/common/models/trie-construction-cleanup
    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    ec8bdee View commit details
    Browse the repository at this point in the history

  9. fix(common/models): relocates sortNode to avoid cyclic imports

    @jahorton
    jahorton committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    3b56336 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. chore(common/models/templates): Merge branch 'change/common/models/tr… 

    …ie-construction-cleanup' into feat/common/models/templates/trie-compression-start
    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    6e97ed2 View commit details
    Browse the repository at this point in the history

  2. chore(web): update for new base branch

    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    58a0f21 View commit details
    Browse the repository at this point in the history

  3. chore(web): update for new base branch

    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    d1b5d8c View commit details
    Browse the repository at this point in the history

  4. change(common/models): recompute entry keys via keying func

    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    5c5c0b1 View commit details
    Browse the repository at this point in the history

  5. change(common/models): sets leaves to auto-decompress entries

    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    5933d21 View commit details
    Browse the repository at this point in the history

  6. change(common/models): adjust unit tests to work with alternate encod… 

    …ing bases
    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    6427196 View commit details
    Browse the repository at this point in the history

  7. chore(common/models/templates): Merge with remote changes to branch

    @jahorton
    jahorton committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    7057300 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. chore(common/models): clean up comments + keying-func typing

    @jahorton
    jahorton committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    6b7feb5 View commit details
    Browse the repository at this point in the history

  2. feat(common/models): add TrieBuilder.compress(), unit tests reliant u… 

    …pon it
    @jahorton
    jahorton committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    b8bf1dd View commit details
    Browse the repository at this point in the history

  3. feat(common/models): integrates trie decompression methods into worke… 

    …r's Trie, TrieModel
    @jahorton
    jahorton committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    374d9e4 View commit details
    Browse the repository at this point in the history

  4. feat(developer): output new TrieModel format when compiling

    @jahorton
    jahorton committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    65d45e0 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. docs(common/models): improves a comment

    @jahorton
    jahorton committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    ee5877c View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. chore(common/models/templates): Merge branch 'master' into feat/commo… 

    …n/models/templates/trie-compression-start
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    3da9285 View commit details
    Browse the repository at this point in the history

  2. chore(common/models): pulls in comment tweaks from later reviews on e… 

    …pic/user-dict
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    f53dfde View commit details
    Browse the repository at this point in the history

  3. refactor(common/models): split trie-model implementation into separat… 

    …e components
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    2db1d4e View commit details
    Browse the repository at this point in the history

  4. refactor(developer/compilers): prepare for trie-compiler split

    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    c7c534a View commit details
    Browse the repository at this point in the history

  5. refactor(common/models): move primary trie-compilation code into comm… 

    …on/models/templates

We'll likely want to dynamically build a Trie to represent user-specific entries made available by the active OS.  We'll then blend _that_ with the 'static' distributed model.
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    c21b864 View commit details
    Browse the repository at this point in the history

  6. fix(developer): add 'build' dependency link to models/templates

    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    2db0302 View commit details
    Browse the repository at this point in the history

  7. chore: establish user-dict epic

    @mcdurdin @jahorton
    mcdurdin authored and jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    8789d72 View commit details
    Browse the repository at this point in the history

  8. chore(common/models): Apply suggestions from code review 

    Co-authored-by: Marc Durdin <[email protected]>
    @jahorton @mcdurdin
    jahorton and mcdurdin committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    3cea701 View commit details
    Browse the repository at this point in the history

  9. fix(developer): sets models-templates as package.json dependency

    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    b884e15 View commit details
    Browse the repository at this point in the history

  10. chore(common): update package-lock.json

    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    b53c325 View commit details
    Browse the repository at this point in the history

  11. refactor(common/models): refactor migrated trie-construction code for… 

    … improved encapsulation
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    d286b3f View commit details
    Browse the repository at this point in the history

  12. change(common/models): clean up trie construction code, add unit tests

    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    57146e1 View commit details
    Browse the repository at this point in the history

  13. fix(common/models): relocates sortNode to avoid cyclic imports

    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    a8a665f View commit details
    Browse the repository at this point in the history

  14. chore(common/models/templates): Merge branch 'chore/models/seed-epic-… 

    …model-encoding' into feat/common/models/templates/trie-compression-start-check
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    7991b2b View commit details
    Browse the repository at this point in the history

  15. chore(common/models/templates): Merge branch 'feat/common/models/temp… 

    …lates/trie-compression-start' into feat/common/models/templates/integrate-trie-compression
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    1140207 View commit details
    Browse the repository at this point in the history

  16. chore(developer): Merge branch 'feat/common/models/templates/integrat… 

    …e-trie-compression' into feat/developer/compress-compiled-tries
    @jahorton
    jahorton committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    7d61428 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. chore(common/models): minor polish per review

    @jahorton
    jahorton committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    2a6c6c5 View commit details
    Browse the repository at this point in the history

  2. chore(common/models): drops a local temp-alias

    @jahorton
    jahorton committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    6517a3c View commit details
    Browse the repository at this point in the history

  3. chore(developer): Apply suggestions from code review 

    Co-authored-by: Marc Durdin <[email protected]>
    @jahorton @mcdurdin
    jahorton and mcdurdin committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    83c696b View commit details
    Browse the repository at this point in the history

  4. chore(common/models): remove shorthand aliases

    @jahorton
    jahorton committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    bfa7ab1 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Merge pull request #12268 from keymanapp/chore/models/seed-epic-model… 

    …-encoding

chore(models/templates): seed epic/model-encoding with cherry-pick from epic/user-dict 💾
    @jahorton
    jahorton committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    745172c View commit details
    Browse the repository at this point in the history

  2. chore(common/models): Apply suggestions from code review 

    Co-authored-by: Eberhard Beilharz <[email protected]>
    @jahorton @ermshiperete
    jahorton and ermshiperete committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    b351cd1 View commit details
    Browse the repository at this point in the history

  3. chore(common/models): addresses a number of PR comments

    @jahorton
    jahorton committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    2e92a7f View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge pull request #11088 from keymanapp/feat/common/models/templates… 

    …/trie-compression-start

feat(common/models): add Trie string-encoding + decoding methods 💾
    @jahorton
    jahorton committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    2093ef9 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #12128 from keymanapp/feat/common/models/templates… 

    …/integrate-trie-compression

feat(common/models): integrate new trie decoding methods into predictive-text engine 💾
    @jahorton
    jahorton committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    0bc464e View commit details
    Browse the repository at this point in the history

  3. Merge pull request #12129 from keymanapp/feat/developer/compress-comp… 

    …iled-tries

feat(developer): output new TrieModel format when compiling 💾
    @jahorton
    jahorton committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    636a3ee View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Merge pull request #12320 from keymanapp/chore/merge-master-into-mode… 

    …l-encoding

chore: merge master into model-encoding
    @mcdurdin
    mcdurdin committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    53992ee View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. chore: Merge branch 'epic/model-encoding' into chore/merge-master-int… 

    …o-model-encoding
    @mcdurdin
    mcdurdin committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    93f8daa View commit details
    Browse the repository at this point in the history

  2. chore: dependencies

    @mcdurdin
    mcdurdin committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    22007a1 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. chore(developer): models-templates is required not just for test

    @mcdurdin
    mcdurdin committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    6240254 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Merge pull request #12414 from keymanapp/chore/merge-master-into-mode… 

    …l-encoding

chore: merge master into model-encoding 💾
    @mcdurdin
    mcdurdin committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    c5d4195 View commit details
    Browse the repository at this point in the history