You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Trying to use CometScanExec with Spark 3.5.2 results in a runtime exception.
Steps to reproduce
Class not found error at runtime, but can also be replicated by trying to compile Comet with Spark 3.5.2:
[ERROR] /Users/abinford/projects/arrow-datafusion-comet/spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala:144: value OP_ID_TAG is not a member of object org.apache.spark.sql.catalyst.plans.QueryPlan
Expected behavior
Compilation and runtime succeed
Additional context
This is due to apache/spark@88582e1 which removed OP_ID_TAG and uses a different mechanism to track operator IDs.
The text was updated successfully, but these errors were encountered:
Describe the bug
Trying to use
CometScanExec
with Spark 3.5.2 results in a runtime exception.Steps to reproduce
Class not found error at runtime, but can also be replicated by trying to compile Comet with Spark 3.5.2:
Expected behavior
Compilation and runtime succeed
Additional context
This is due to apache/spark@88582e1 which removed
OP_ID_TAG
and uses a different mechanism to track operator IDs.The text was updated successfully, but these errors were encountered: