Search results

[SPARK-53064][CORE] Rewrite MDC LogKey in Java

CONNECT

CORE

DSTREAM

GRAPHX

KUBERNETES

ML

MLLIB

PYTHON

R

SQL

STRUCTURED STREAMING

WEB UI

YARN

Status: Open (in progress).

apache/sparknumber 51775

#51775 In apache/spark;

· pan3793 opened on Aug 1, 2025

[SPARK-53063][CORE] Remove inner references of deprecated APIs in FileCommitProtocol

CORE

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51772

#51772 In apache/spark;

· yaooqinn opened on Aug 1, 2025

[SPARK-53062][CORE] Support <code>deleteQuietly</code> in <code>SparkFileUtils</code> and <code>JavaUtils</code>

BUILD

CORE

Status: Open (in progress).

apache/sparknumber 51771

#51771 In apache/spark;

· dongjoon-hyun opened on Aug 1, 2025

[SPARK-53022][TESTS] Add MemoryConsumerBenchmark

CORE

Status: Open (in progress).

apache/sparknumber 51728

#51728 In apache/spark;

· zhztheplayer opened on Jul 30, 2025

[SPARK-53019][SQL] Fix job attempt path conflicts in o.a.hadoop..FileOutputCommitter

CORE

SQL

Status: Draft (not ready).

apache/sparknumber 51724

#51724 In apache/spark;

· yaooqinn opened on Jul 30, 2025

[SPARK-53002] Show accurate memory usage statistics when bounded memory is enabled for RocksDB

CORE

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51709

#51709 In apache/spark;

· ericm-db opened on Jul 29, 2025

[SPARK-52980][PYTHON] Support Arrow Python UDTFs

BUILD

CONNECT

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51692

#51692 In apache/spark;

· allisonwang-db opened on Jul 28, 2025

[SPARK-52844][PYTHON][TESTS] Update black to 24.3.0

BUILD

CONNECT

CORE

DSTREAM

INFRA

ML

MLLIB

PANDAS API ON SPARK

PYTHON

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51687

#51687 In apache/spark;

· eschcam opened on Jul 28, 2025

[SPARK-52971] [PYTHON] Limit idle Python worker queue size

CORE

PYTHON

Status: Open (in progress).

apache/sparknumber 51684

#51684 In apache/spark;

· craiuconstantintiberiu opened on Jul 28, 2025

[SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51635

#51635 In apache/spark;

· benrobby opened on Jul 23, 2025

[SPARK-52923][CORE] Allow ShuffleManager to control push merge during shuffle registration

CORE

Status: Open (in progress).

apache/sparknumber 51629

#51629 In apache/spark;

· gaoyajun02 opened on Jul 23, 2025

[SPARK-52794][PYTHON] Performance improvement of arrow-optimized python UDTF with LocalDataToArrowConversion check

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51479

#51479 In apache/spark;

· asl3 opened on Jul 14, 2025