Skip to content

[SPARK-46094] Support Executor JVM Profiling #7477

[SPARK-46094] Support Executor JVM Profiling

[SPARK-46094] Support Executor JVM Profiling #7477

Triggered via push January 15, 2024 21:46
Status Success
Total duration 1h 28m 1s
Artifacts 21

build_main.yml

on: push
Run  /  Check changes
32s
Run / Check changes
Run  /  Base image build
52s
Run / Base image build
Run  /  Protobuf breaking change detection and Python CodeGen check
1m 3s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Run TPC-DS queries with SF=1
49m 16s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
27m 31s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
56m 48s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
20s
Run / Run Spark UI tests
Matrix: Run / build
Matrix: Run / java-other-versions
Run  /  Build modules: sparkr
27m 21s
Run / Build modules: sparkr
Run  /  Linters, licenses, dependencies and documentation generation
1h 0m
Run / Linters, licenses, dependencies and documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 warning
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-713f608d0f2de948-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-a2c7c38d0f2ec7f5-exec-1".
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$685/0x00007f660c5c2228@42d4a817 rejected from java.util.concurrent.ThreadPoolExecutor@2757aba6[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 309]
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$685/0x00007f660c5c2228@361d5956 rejected from java.util.concurrent.ThreadPoolExecutor@2757aba6[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 310]
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-b600828d0f3f9fca-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-609d3d8d0f4084f8-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-9d75778d0f44248d-exec-1".
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-6dec07d3eda947de99041ed5f6e057a1-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-6dec07d3eda947de99041ed5f6e057a1-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
test-results-api, catalyst, hive-thriftserver--17-hadoop3-hive2.3 Expired
2.83 MB
test-results-core, unsafe, kvstore, avro, utils, network-common, network-shuffle, repl, launcher, examples, sketch--17-hadoop3-hive2.3 Expired
2.62 MB
test-results-docker-integration--17-hadoop3-hive2.3 Expired
130 KB
test-results-hive-- other tests-17-hadoop3-hive2.3 Expired
926 KB
test-results-hive-- slow tests-17-hadoop3-hive2.3 Expired
862 KB
test-results-mllib-local, mllib, graphx--17-hadoop3-hive2.3 Expired
1.45 MB
test-results-pyspark-connect--17-hadoop3-hive2.3 Expired
457 KB
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect--17-hadoop3-hive2.3 Expired
1.11 MB
test-results-pyspark-pandas--17-hadoop3-hive2.3 Expired
1.64 MB
test-results-pyspark-pandas-connect-part0--17-hadoop3-hive2.3 Expired
1.07 MB
test-results-pyspark-pandas-connect-part1--17-hadoop3-hive2.3 Expired
987 KB
test-results-pyspark-pandas-connect-part2--17-hadoop3-hive2.3 Expired
534 KB
test-results-pyspark-pandas-connect-part3--17-hadoop3-hive2.3 Expired
548 KB
test-results-pyspark-pandas-slow--17-hadoop3-hive2.3 Expired
1.28 MB
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3 Expired
444 KB
test-results-sparkr--17-hadoop3-hive2.3 Expired
280 KB
test-results-sql-- extended tests-17-hadoop3-hive2.3 Expired
3.02 MB
test-results-sql-- other tests-17-hadoop3-hive2.3 Expired
4.37 MB
test-results-sql-- slow tests-17-hadoop3-hive2.3 Expired
2.82 MB
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, yarn, kubernetes, hadoop-cloud, spark-ganglia-lgpl, connect, protobuf--17-hadoop3-hive2.3 Expired
1.51 MB
test-results-tpcds--17-hadoop3-hive2.3 Expired
21.8 KB