fix(tests): optimize json_infra fixture reads

[gurukamath]

What was wrong?

Running the json_infra does a lot of I?O that can potentially be avoided.

Related to Issue #

How was it fixed?

Optimise file reads from disk using some caching techniques and queueing the test fixtures in a better order.

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 86.07%. Comparing base (9563a51) to head (6115b7b).
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@             Coverage Diff              @@
##           forks/osaka    #1730   +/-   ##
============================================
  Coverage        86.07%   86.07%           
============================================
  Files              743      743           
  Lines            44078    44078           
  Branches          3894     3894           
============================================
  Hits             37938    37938           
  Misses            5659     5659           
  Partials           481      481           

Flag	Coverage Δ
unittests	86.07% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[SamWilsn]

@marioevz used --dist=loadfile in #1666, would that make sense here?

[gurukamath]

@marioevz used --dist=loadfile in #1666, would that make sense here?

I have implemented --dist=loadgroup by defining all the tests in a particular json fixture file as part of the same xdist group. That allows each file to be read exactly once and makes the LRU caching technique maximally useful. Just waiting to see what the CI runtime from this is

[gurukamath]

@marioevz used --dist=loadfile in #1666, would that make sense here?

Next, I will try out some of the ideas from that PR and see what works best

[SamWilsn]

I have implemented --dist=loadgroup by defining all the tests in a particular json fixture file as part of the same xdist group.

I saw! Was wondering if loadfile would save you having to manually create those groups.

[gurukamath]

I saw! Was wondering if loadfile would save you having to manually create those groups.

Ah. I see. From what I understand --dist=loadfile groups the tests by the python test file (.py file) and has no way of distinguishing the different json fixtures (unless we explicitly tell it). This is why I decided to explicitly define the groups and run the --dist=loadgroup which should achieve the intended effect.