support equality/positional deletes in vectorized arrow reader

[callum-ryan]

Feature Request / Improvement

when using VectorizedTableScanIterable / ArrowReader there is no support for deletes, be it equality or positional. The IcebergGenerics functionality to read with deletes "feels" far too slow, it would be beneficial to have a vectorized implementation without Spark that supports these kind of reads.

Using the DeleteFilter is easy enough to translate from ColumnarBatch to an iterable of Record (with the appropriate records removed), but I am not sure this is the most efficient way of handling deletes.

Query engine

Other

Willingness to contribute

• I can contribute this improvement/feature independently
• I would be willing to contribute this improvement/feature with guidance from the Iceberg community
• I cannot contribute this improvement/feature at this time