SIP-031 stateful property tests #6321
Conversation
|
To run the outside-in stateful testing with Clarinet and fast-check: cd contrib/core-contract-tests
npx vitest tests/sip-031/sip-031.stateful.prop.test.ts
|
|
Quick guide on how to run the Rendezvous Clarity property tests and invariants: cd contrib/core-contract-tests
npm i
# To run property tests:
npx rv . sip-031 test
# To run invariant tests:
npx rv . sip-031 invariantTo increase the number of runs of a testing routine (100 by default), you can use: npx rv . sip-031 test --runs=1000On failure (shouldn't be the case at this point), a seed is reported at the end of the run. You can use that seed to reproduce the exact same sequence of events: npx rv . sip-031 test --seed=<REPRO_SEED>Sample output: 
|
|
@BowTiedRadone I pushed a 1-line change for the pox-4 tests - the |
|
@hstove thanks! I'm looking into the remaining failing tests. |
moodmosaic
force-pushed
the
sip31-prop-tests
branch
3 times, most recently
from
f223d26 to
2e3e92f
Compare
github-project-automation
bot
moved this from Status: In Review
to Status: 💻 In Progress
in Stacks Core Eng
moodmosaic
force-pushed
the
sip31-prop-tests
branch
from
2e3e92f to
6a2c90d
Compare
Added `sip-031.stateful.prop.test.ts`, with initial command set: Claim, ClaimErr, Mint, MintInitial, MineBlocks, UpdateRecipient, UpdateRecipientErr. Tests use fast-check's `modelRun` to verify sip-031.clar against a tracked model. Based on: - https://github.com/stacks-network/stacks-core/tree/a5587d13c51829f49a7645d9484469e5ca891e29/contrib/boot-contracts-stateful-prop-tests/tests/pox-4 - https://blog.nikosbaxevanis.com/2022/03/15/clarity-clarity-model-based-testing-primer/ - https://github.com/moodmosaic/counter-invariant-tests/tree/99c9987c446c74feb1acf970993214c7b2350b53/tests/counter !!! NOT A COMPLETE TEST SUITE !!!
Maybe there's a better way via clarigen, but not known at time of writing.
The constants were affected by the addition of wallet_10 for testing SIP-031.
moodmosaic
force-pushed
the
sip31-prop-tests
branch
from
6a2c90d to
225d25b
Compare
63f180e
github-project-automation
bot
moved this from Status: 💻 In Progress
to Status: ✅ Done
in Stacks Core Eng
Codecov Report✅ All modified and coverable lines are covered by tests. ❌ Your project status has failed because the head coverage (55.95%) is below the target coverage (80.00%). You can increase the head coverage or adjust the target coverage.
Additional details and impacted files@@ Coverage Diff @@
## develop #6321 +/- ##
============================================
- Coverage 80.79% 55.95% -24.85%
============================================
Files 541 541
Lines 347771 347771
============================================
- Hits 280993 194598 -86395
- Misses 66778 153173 +86395 see 421 files with indirect coverage changes Continue to review full report in Codecov by Sentry.
🚀 New features to boost your workflow:
|
|
This pull request has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
5 participants
Ideally, these tests would live in
boot-contracts-stateful-prop-tests, butsip-031.test.ts(example-based tests) was placed incontrib/core-contract-tests, so this follows that pattern to avoid unnecessary git noise.Details on how to run the two test suites — outside-in stateful testing with Clarinet and fast-check, and inside-out with Rendezvous — will follow shortly.