Add the generalized Pratt parsing example #277

chengluyu · 2025-02-12T00:45:12Z

No description provided.

LPTK

Looks like the test outputs are not up to date.

hkmc2/shared/src/main/scala/hkmc2/syntax/Parser.scala

hkmc2/shared/src/test/mlscript-compile/apps/Parser.mls

hkmc2/shared/src/test/mlscript/backlog/UCS.mls

Co-authored-by: Lionel Parreaux <[email protected]>

hkmc2/shared/src/test/mlscript/apps/ParserTest.mls

hkmc2/shared/src/test/mlscript-compile/apps/Lexer.mls

Co-authored-by: Lionel Parreaux <[email protected]>

hkmc2/shared/src/test/mlscript-compile/TreeTracer.mls

hkmc2/shared/src/test/mlscript/decls/Prelude.mls

LPTK · 2025-02-28T00:21:14Z

hkmc2/shared/src/test/mlscript-compile/apps/parsing/Rules.mls

  Choice.Ref of
    "type"
    (lhs, compose) => compose(lhs)
    None
    None
    typeInfixRule
-


LPTK · 2025-03-04T07:03:15Z

hkmc2/shared/src/test/mlscript/HkScratch.mls

Did you forget to clean HkScratch?

LPTK · 2025-03-04T07:04:16Z

hkmc2/shared/src/test/mlscript/backlog/UCS.mls

+        None
+    else
+      console.warn("expect the definition to be a tuple but found " + tree)
+      None


What's wrong with this one? There's no error report in the test case.

LPTK · 2025-03-04T07:04:30Z

hkmc2/shared/src/test/mlscript/backlog/UCS.mls

+        None
+    else
+      console.warn("expect the definition to be a tuple but found " + tree)
+      None


Suggested change

None

None

// ——— ——— ———

chengluyu and others added 9 commits February 12, 2025 05:10

Implement the lexer

e330f06

WIP Add the parser

63a77b2

WIP

0ab1110

Support Unicode escapes in string literals

04a770e

Refactor TreeTracer and move functions to libraries

a58aeb7

Selectively open Token from Lexer

361b265

A bunch of improvements to the parser

d7d6cdd

Add magic constants and use them in traces

79e6dfa

Move the parser to the library

685b5b2

LPTK reviewed Feb 12, 2025

View reviewed changes

chengluyu and others added 9 commits February 12, 2025 17:20

Use separator comments

0ca0927

Co-authored-by: Lionel Parreaux <[email protected]>

Improve an error message

70b3951

Co-authored-by: Lionel Parreaux <[email protected]>

Clean up and add new tests

2505a78

Amend error message changes

9b77505

Amend changes caused by merging match arms

bfb8766

Support parsing empty tuples

60fe72d

Support rec modifier

685baaa

Support empty sequences

a5fb56c

Support identifiers ending with primes

c7d8996

LPTK reviewed Feb 12, 2025

View reviewed changes

hkmc2/shared/src/test/mlscript/apps/ParserTest.mls Show resolved Hide resolved

LPTK reviewed Feb 12, 2025

View reviewed changes

hkmc2/shared/src/test/mlscript/apps/ParserTest.mls Outdated Show resolved Hide resolved

LPTK reviewed Feb 12, 2025

View reviewed changes

hkmc2/shared/src/test/mlscript-compile/apps/Lexer.mls Outdated Show resolved Hide resolved

chengluyu and others added 3 commits February 12, 2025 22:09

Support multiple let bindings using and

b40fd37

Group set

f65a889

Co-authored-by: Lionel Parreaux <[email protected]>

Merge branch 'hkmc2' into generalized-pratt-parsing

64fb5c2

LPTK reviewed Feb 13, 2025

View reviewed changes

hkmc2/shared/src/test/mlscript-compile/TreeTracer.mls Outdated Show resolved Hide resolved

LPTK reviewed Feb 13, 2025

View reviewed changes

hkmc2/shared/src/test/mlscript/decls/Prelude.mls Outdated Show resolved Hide resolved

chengluyu added 3 commits February 17, 2025 18:13

Ensure the token stream is drained after parse

80114b8

Fix a :todo in the test

73899fb

Render parse rules

44a883e

LPTK force-pushed the generalized-pratt-parsing branch from b429216 to b770910 Compare February 27, 2025 10:16

chengluyu added 12 commits February 27, 2025 18:58

Reduce the use of funs in rule definitions

c9735e5

Reduce the number of strings in rules

87641ff

Declutter parse rules and support siding rules

0e96c49

Remove an outdated compiled JS file

0d201f7

Remove yeetSpaces and filter out Spaces

1a8886f

Fix selection and array access

48f6649

Add typevar and ident kinds and use them in typdefs

0668c88

Fix operator ==

d8d21e3

Add the ident category

fb19a2d

Add a doc comment explaining Choice.Siding

775ec33

Add two examples from Caml Light code base

6846eb5

Support directives

d51873c

LPTK reviewed Feb 28, 2025

View reviewed changes

chengluyu added 13 commits February 28, 2025 12:42

Prepare the web demo

176e65e

Remove TypeKeywords and use Keywords instead

28ddc26

Remove one TODO outerPrec and innerPrec (1/4)

2ed9bbe

Remove one TODO outerPrec and innerPrec (2/4)

89a5630

Remove one TODO outerPrec and innerPrec (3/4)

025245a

Remove one TODO outerPrec and innerPrec (4/4)

8825593

Minor cleanup

e5ec103

Display errors in the web demo

f211d10

Add the web demo builder

82d7f00

Make the diagram visible at the first glance

7db46dd

Support extensible syntax

b1b1e0c

Display extended syntax

c7ac72a

Web demo of extensible syntax

c29135a

LPTK reviewed Mar 4, 2025

View reviewed changes

hkmc2/shared/src/test/mlscript/HkScratch.mls Outdated

Copy link

Contributor

LPTK Mar 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did you forget to clean HkScratch?

LPTK reviewed Mar 4, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add the generalized Pratt parsing example #277

Add the generalized Pratt parsing example #277

chengluyu commented Feb 12, 2025

LPTK left a comment

LPTK Feb 28, 2025

LPTK Mar 4, 2025

LPTK Mar 4, 2025

LPTK Mar 4, 2025

-      None
+      None
+// ——— ——— ———

Add the generalized Pratt parsing example #277

Are you sure you want to change the base?

Add the generalized Pratt parsing example #277

Conversation

chengluyu commented Feb 12, 2025

LPTK left a comment

Choose a reason for hiding this comment

LPTK Feb 28, 2025

Choose a reason for hiding this comment

LPTK Mar 4, 2025

Choose a reason for hiding this comment

LPTK Mar 4, 2025

Choose a reason for hiding this comment

LPTK Mar 4, 2025

Choose a reason for hiding this comment