feat!: Use borrow_array instead of value_array for array lowering

[tatiana-s]

Closes #1072

BREAKING CHANGE: (guppy-internals) Arrays are now lowered to borrow_arrays instead of value_arrays so elements do no longer need to be wrapped in options during lowering.

Requires a tket2 release with Quantinuum/tket2#975 for the execution tests to pass Requires a hugr-llvm release for the lowering + hugr with copy discard handler + tket2 with adjustments + hugr-qis compiler with adjustments

[acl-cqc]

Looks Good enough To Merge into main but must not release until #1306 is fixed.

[hugrbot]

This PR contains breaking changes to the public Python API.

Breaking changes summary

guppylang-internals/src/guppylang_internals/compiler/expr_compiler.py:0: ARRAY_COMPREHENSION_INIT:
Public object was removed

guppylang-internals/src/guppylang_internals/compiler/expr_compiler.py:0: array_comprehension_init_func:
Public object was removed

guppylang-internals/src/guppylang_internals/compiler/expr_compiler.py:0: array_unwrap_elem:
Public object was removed

guppylang-internals/src/guppylang_internals/compiler/expr_compiler.py:0: array_wrap_elem:
Public object was removed

guppylang-internals/src/guppylang_internals/compiler/core.py:653: AFFINE_EXTENSION_TYS:
Attribute value was changed:
Old: [qualified_name(ARRAY_EXTENSION.get_type('array'))]
New: [qualified_name(ARRAY_EXTENSION.get_type('array')), qualified_name(BORROW_ARRAY_EXTENSION.get_type('borrow_array'))]

guppylang-internals/src/guppylang_internals/definition/parameter.py:0: TypeVarDef.must_be_copyable:
Public object was removed

guppylang-internals/src/guppylang_internals/definition/parameter.py:0: TypeVarDef.must_be_droppable:
Public object was removed

guppylang-internals/src/guppylang_internals/definition/parameter.py:0: TypeVarDef.__init__(must_be_copyable):
Parameter was removed

guppylang-internals/src/guppylang_internals/definition/parameter.py:0: TypeVarDef.__init__(must_be_droppable):
Parameter was removed

guppylang-internals/src/guppylang_internals/definition/parameter.py:0: TypeVarDef.__init__(copyable):
Parameter was added as required

guppylang-internals/src/guppylang_internals/definition/parameter.py:0: TypeVarDef.__init__(droppable):
Parameter was added as required

[github-actions]

Bencher Report

Branch	ts/borrow-arrays
Testbed	Linux

Click to view all benchmark results

Benchmark	Latency	Benchmark Result microseconds (µs) (Result Δ%)	Upper Boundary microseconds (µs) (Limit %)
tests/benchmarks/test_big_array.py::test_big_array_check	📈 view plot 🚷 view threshold	662,023.73 µs (-13.74%) Baseline: 767,437.81 µs	805,809.70 µs (82.16%)
tests/benchmarks/test_big_array.py::test_big_array_compile	📈 view plot 🚷 view threshold	1,536,932.32 µs (-51.61%) Baseline: 3,176,070.64 µs	3,334,874.17 µs (46.09%)
tests/benchmarks/test_big_array.py::test_big_array_executable	📈 view plot 🚷 view threshold	7,254,392.88 µs (-20.69%) Baseline: 9,146,336.34 µs	9,603,653.15 µs (75.54%)
tests/benchmarks/test_ctrl_flow.py::test_many_ctrl_flow_check	📈 view plot 🚷 view threshold	47,103.69 µs (-31.81%) Baseline: 69,078.00 µs	72,531.90 µs (64.94%)
tests/benchmarks/test_ctrl_flow.py::test_many_ctrl_flow_compile	📈 view plot 🚷 view threshold	83,618.05 µs (-15.26%) Baseline: 98,676.50 µs	103,610.33 µs (80.70%)
tests/benchmarks/test_ctrl_flow.py::test_many_ctrl_flow_executable	📈 view plot 🚷 view threshold	581,379.01 µs (-26.20%) Baseline: 787,784.60 µs	827,173.83 µs (70.28%)
tests/benchmarks/test_prelude.py::test_import_guppy	📈 view plot 🚷 view threshold	24.23 µs (-9.05%) Baseline: 26.64 µs	27.97 µs (86.62%)

🐰 View full continuous benchmarking report in Bencher

[github-actions]

Bencher Report

Branch	ts/borrow-arrays
Testbed	Linux

🚨 2 Alerts

Benchmark	Measure Units	View	Benchmark Result (Result Δ%)	Upper Boundary (Limit %)
tests/benchmarks/test_big_array.py::test_big_array_compile	hugr_nodes nodes x 1e3	📈 plot 🚷 threshold 🚨 alert (🔔)	6.59 x 1e3 (+33.89%) Baseline: 4.92 x 1e3	4.97 x 1e3 (132.56%)
tests/benchmarks/test_big_array.py::test_big_array_compile	hugr_bytes bytes x 1e3	📈 plot 🚷 threshold 🚨 alert (🔔)	135.90 x 1e3 (+5.14%) Baseline: 129.26 x 1e3	130.55 x 1e3 (104.10%)

Click to view all benchmark results

Benchmark	hugr_bytes	Benchmark Result bytes x 1e3 (Result Δ%)	Upper Boundary bytes x 1e3 (Limit %)	hugr_nodes	Benchmark Result nodes (Result Δ%)	Upper Boundary nodes (Limit %)
tests/benchmarks/test_big_array.py::test_big_array_compile	📈 view plot 🚷 view threshold 🚨 view alert (🔔)	135.90 x 1e3 (+5.14%) Baseline: 129.26 x 1e3	130.55 x 1e3 (104.10%)	📈 view plot 🚷 view threshold 🚨 view alert (🔔)	6,590.00 (+33.89%) Baseline: 4,922.06	4,971.28 (132.56%)
tests/benchmarks/test_ctrl_flow.py::test_many_ctrl_flow_compile	📈 view plot 🚷 view threshold	19.77 x 1e3 (-9.85%) Baseline: 21.92 x 1e3	22.14 x 1e3 (89.26%)	📈 view plot 🚷 view threshold	606.00 (-12.24%) Baseline: 690.51	697.42 (86.89%)

🐰 View full continuous benchmarking report in Bencher

[codecov-commenter]

Codecov Report

❌ Patch coverage is 95.91837% with 4 lines in your changes missing coverage. Please review.
✅ Project coverage is 93.44%. Comparing base (6990d85) to head (c1c0808).

Files with missing lines	Patch %	Lines
...rnals/src/guppylang_internals/definition/custom.py	87.50%	2 Missing ⚠️
.../src/guppylang_internals/compiler/expr_compiler.py	90.90%	1 Missing ⚠️
guppylang/src/guppylang/std/array.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1166      +/-   ##
==========================================
- Coverage   93.50%   93.44%   -0.06%     
==========================================
  Files         123      123              
  Lines       11522    11432      -90     
==========================================
- Hits        10774    10683      -91     
- Misses        748      749       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.