Skip to content

Conversation

wking
Copy link
Member

@wking wking commented Aug 13, 2025

These will probably not pass without more work, but checking to see how far away we are.

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 13, 2025
@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 13, 2025
These will probably not pass without more work, but checking to see
how far away we are.
Copy link

openshift-trt bot commented Aug 14, 2025

Job Failure Risk Analysis for sha: fcebaa6

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-1of2 IncompleteTests
Tests for this run (15) are below the historical average (1580): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch 2 times, most recently from ae9e67d to b18aac0 Compare August 14, 2025 20:26
@openshift-ci openshift-ci bot removed the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 14, 2025
Avoid [1]:

  Error running oc --namespace=e2e-oc-adm-upgrade-recommend-393 --kubeconfig=/tmp/kubeconfig-1102618529 adm upgrade recommend --version 4.21.0:
    StdOut>
    Failed to check for at least some preconditions: failed to get alerts from Thanos: no token is currently in use for this session
    Upstream update service: http://172.30.88.84:8000/graph
    ...

by creating a service account so we can use token-based access for the
alert-retrieval.

[1]: https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30113/pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2/1955777594481709056
Copy link

openshift-trt bot commented Aug 15, 2025

Job Failure Risk Analysis for sha: b18aac0

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-1of2 IncompleteTests
Tests for this run (25) are below the historical average (1742): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: b18aac0

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-gcp-ovn-techpreview-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: b18aac0

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 5, Pass: 0, Fail: 5, Flake: 0]

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 34ec4d1 to 2a74ae2 Compare August 15, 2025 04:59
Copy link

openshift-trt bot commented Aug 15, 2025

Job Failure Risk Analysis for sha: 2a74ae2

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-1of2 IncompleteTests
Tests for this run (15) are below the historical average (1735): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 2a74ae2 to 8924956 Compare August 15, 2025 18:44
Copy link

openshift-trt bot commented Aug 15, 2025

Job Failure Risk Analysis for sha: 8924956

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-vsphere-ovn IncompleteTests
Tests for this run (15) are below the historical average (3149): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-vsphere-ovn-upi IncompleteTests
Tests for this run (15) are below the historical average (3172): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch 2 times, most recently from 931699e to d7501ee Compare August 15, 2025 23:54
Copy link

openshift-trt bot commented Aug 16, 2025

Job Failure Risk Analysis for sha: d7501ee

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-disruptive Medium
[sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator
Potential external regression detected for High Risk Test analysis
---
[sig-cli][OCPFeatureGate:UpgradeStatus] oc amd upgrade status never fails
Potential external regression detected for High Risk Test analysis
---
[bz-Etcd] clusteroperator/etcd should not change condition/Available
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones Medium
[sig-instrumentation] Metrics should grab all metrics from kubelet /metrics/resource endpoint [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 93.13% of 2141 runs on release 4.20 [Overall] in the last week.

Open Bugs
e2e-aws-ovn-edge-zones is unstable
Kubelet metrics endpoint test regressed
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgrade IncompleteTests
pull-ci-openshift-origin-main-e2e-hypershift-conformance IncompleteTests
Tests for this run (19) are below the historical average (2886): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: d7501ee

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-gcp-ovn-techpreview-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: d7501ee

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 4, Pass: 0, Fail: 4, Flake: 0]

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch 2 times, most recently from 3d796c1 to 6f8ca39 Compare August 16, 2025 05:00
Copy link

openshift-trt bot commented Aug 16, 2025

Job Failure Risk Analysis for sha: 6f8ca39

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-azure IncompleteTests
Tests for this run (19) are below the historical average (3238): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-csi IncompleteTests
Tests for this run (19) are below the historical average (1627): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-hypershift-conformance IncompleteTests
Tests for this run (16) are below the historical average (2871): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn IncompleteTests
Tests for this run (14) are below the historical average (3232): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 6f8ca39 to 4cbd5fe Compare August 16, 2025 17:10
Copy link

openshift-trt bot commented Aug 16, 2025

Job Failure Risk Analysis for sha: 4cbd5fe

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-hypershift-conformance IncompleteTests
Tests for this run (19) are below the historical average (2841): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn IncompleteTests
Tests for this run (101) are below the historical average (3198): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 4cbd5fe

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-gcp-ovn-techpreview-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: 4cbd5fe

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 5, Pass: 0, Fail: 5, Flake: 0]

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 4cbd5fe to b9b2c30 Compare August 18, 2025 06:23
Copy link

openshift-trt bot commented Aug 18, 2025

Job Failure Risk Analysis for sha: b9b2c30

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-disruptive High
[bz-Monitoring] clusteroperator/monitoring should not change condition/Available
This test has passed 99.94% of 4943 runs on release 4.20 [Overall] in the last week.
---
[bz-Monitoring] clusteroperator/monitoring should not change condition/Degraded
This test has passed 99.92% of 4943 runs on release 4.20 [Overall] in the last week.
---
[sig-arch][Late] operators should not create watch channels very often
This test has passed 99.94% of 4669 runs on release 4.20 [Overall] in the last week.
pull-ci-openshift-origin-main-e2e-hypershift-conformance IncompleteTests
Tests for this run (19) are below the historical average (2775): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn IncompleteTests
Tests for this run (101) are below the historical average (3143): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: b9b2c30

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-gcp-ovn-techpreview-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: b9b2c30

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 5, Pass: 0, Fail: 5, Flake: 0]

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from b9b2c30 to ccb493b Compare August 19, 2025 22:59
Copy link

openshift-trt bot commented Aug 20, 2025

Job Failure Risk Analysis for sha: ccb493b

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-hypershift-conformance IncompleteTests
Tests for this run (16) are below the historical average (2771): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn IncompleteTests
Tests for this run (14) are below the historical average (2898): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from ccb493b to eefe2bb Compare August 20, 2025 02:39
Copy link

openshift-trt bot commented Aug 20, 2025

Job Failure Risk Analysis for sha: eefe2bb

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-agnostic-ovn-cmd IncompleteTests
Tests for this run (19) are below the historical average (1767): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-csi IncompleteTests
Tests for this run (18) are below the historical average (1869): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-disruptive IncompleteTests
Tests for this run (18) are below the historical average (1140): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn IncompleteTests
Tests for this run (18) are below the historical average (3177): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-cgroupsv2 IncompleteTests
Tests for this run (18) are below the historical average (3279): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zones IncompleteTests
Tests for this run (19) are below the historical average (3322): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-fips IncompleteTests
Tests for this run (19) are below the historical average (3296): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (18) are below the historical average (1811): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (16) are below the historical average (1810): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (16) are below the historical average (860): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-1of2 IncompleteTests
Tests for this run (18) are below the historical average (1946): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 IncompleteTests
Tests for this run (18) are below the historical average (1942): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node IncompleteTests
Tests for this run (18) are below the historical average (3066): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial IncompleteTests
Tests for this run (18) are below the historical average (1847): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgrade IncompleteTests
Tests for this run (19) are below the historical average (4136): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-upgrade IncompleteTests
Tests for this run (20) are below the historical average (1916): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-proxy IncompleteTests
Tests for this run (19) are below the historical average (3278): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-azure IncompleteTests
Tests for this run (19) are below the historical average (3220): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-csi IncompleteTests
Tests for this run (19) are below the historical average (1627): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-ovn IncompleteTests
Tests for this run (19) are below the historical average (2933): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Showing 20 of 40 jobs analysis

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from eefe2bb to 93f5c58 Compare August 21, 2025 03:45
@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch 3 times, most recently from 12c29c5 to 5c406e9 Compare August 26, 2025 00:29
Copy link

openshift-trt bot commented Aug 26, 2025

Job Failure Risk Analysis for sha: 5c406e9

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-disruptive IncompleteTests
Tests for this run (106) are below the historical average (1073): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (104) are below the historical average (2656): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack IncompleteTests
Tests for this run (25) are below the historical average (2702): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway IncompleteTests
Tests for this run (104) are below the historical average (2621): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (104) are below the historical average (2438): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-1of2 IncompleteTests
Tests for this run (104) are below the historical average (1554): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 IncompleteTests
Tests for this run (104) are below the historical average (1585): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-1of2 IncompleteTests
Tests for this run (104) are below the historical average (1559): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-2of2 IncompleteTests
Tests for this run (104) are below the historical average (1582): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia IncompleteTests
Tests for this run (104) are below the historical average (2476): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-openstack-ovn IncompleteTests
Tests for this run (21) are below the historical average (3164): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 5c406e9

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-gcp-ovn-techpreview-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: 5c406e9

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 3, Pass: 0, Fail: 3, Flake: 0]

@wking
Copy link
Member Author

wking commented Aug 27, 2025

openshift/oc#2083 should address the cert issue:

: [Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]	20s
...
      Failed to check for at least some preconditions: failed to get alerts from Thanos: unable to get /api/v1/alerts from URI in the openshift-monitoring/thanos-querier Route: thanos-querier-openshift-monitoring.apps.ci-op-3j3htwqv-173fd.XXXXXXXXXXXXXXXXXXXXXX->Get "https://thanos-querier-openshift-monitoring.apps.ci-op-3j3htwqv-173fd.XXXXXXXXXXXXXXXXXXXXXX/api/v1/alerts": tls: failed to verify certificate: x509: certificate signed by unknown authority

/test e2e-aws-ovn-serial-2of2

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 5c406e9 to 5d9d9db Compare August 27, 2025 07:31
Copy link

openshift-trt bot commented Aug 27, 2025

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 5d9d9db

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: 5d9d9db

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 4, Pass: 0, Fail: 4, Flake: 0]

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 5d9d9db to 88c9905 Compare August 27, 2025 16:05
Copy link

openshift-trt bot commented Aug 27, 2025

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 88c9905

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-serial High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-gcp-ovn-techpreview-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit
pull-ci-openshift-origin-main-e2e-metal-ipi-serial-ovn-ipv6-2of2 High - "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" is a new test that failed 1 time(s) against the current commit

New tests seen in this PR at sha: 88c9905

  • "[Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]" [Total: 5, Pass: 0, Fail: 5, Flake: 0]

@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch 3 times, most recently from 1483aa0 to 7c7a3fa Compare August 28, 2025 03:58
Avoid [1]:

  : [Serial][sig-cli] oc adm upgrade recommend When the update service has conditional recommendations runs successfully with an accepted conditional recommendation to the --version target [Suite:openshift/conformance/serial]	20s
  {  fail [github.com/openshift/origin/test/extended/cli/adm_upgrade/recommend.go:225]: Unexpected error:
    <*errors.errorString | 0xc008463cc0>:
    expected:
      Failed to check for at least some preconditions: failed to get alerts from Thanos: unable to get /api/v1/alerts from URI in the openshift-monitoring/thanos-querier Route: thanos-querier-openshift-monitoring.apps.ci-op-p9ttsvlv-173fd.XXXXXXXXXXXXXXXXXXXXXX->Get "https://thanos-querier-openshift-monitoring.apps.ci-op-p9ttsvlv-173fd.XXXXXXXXXXXXXXXXXXXXXX/api/v1/alerts": tls: failed to verify certificate: x509: certificate signed by unknown authority

by retrieving the default (self-signed) ingress certificate and
passing it to 'oc' via --certificate-authority and a temporary file.
The default ingress certificate knobs I'm using are documented in [2].
The router-certs-default fallback may not be documented, but is backed
by [3,4].

We need to keep trusting the Kube API server though, and while I'm not
clear on the mechanism it uses to pick its external API server
certificate, iterating over all the TLS secrets in the Kube API server
namespace and aggregating seems like it should pick up the one we
need.

[1]: https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/30113/pull-ci-openshift-origin-main-e2e-aws-ovn-serial-2of2/1956090254670696448
[2]: https://docs.redhat.com/en/documentation/openshift_container_platform/4.19/html/security_and_compliance/configuring-certificates#replacing-default-ingress_replacing-default-ingress
[3]: https://github.com/openshift/cluster-ingress-operator/blob/afb2160975399f4249d9d100641ce32a33c262f1/pkg/operator/controller/certificate/default_cert.go#L76-L83
[4]: https://github.com/openshift/cluster-ingress-operator/blob/afb2160975399f4249d9d100641ce32a33c262f1/pkg/operator/controller/names.go#L152-L159
[5]: https://kubernetes.io/docs/concepts/configuration/secret/#tls-secrets
@wking wking force-pushed the test-oc-adm-upgrade-recommend-with-precheck-and-accept branch from 7c7a3fa to 0c633d8 Compare August 28, 2025 08:15
Copy link
Contributor

openshift-ci bot commented Aug 28, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: wking

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 28, 2025
I think mentioning us using --accept makes for a more clear name, but
the generated annotation file has a different approver set, so I'm
deferring that until we have more time to loop those folks in.
Copy link
Contributor

openshift-ci bot commented Aug 28, 2025

@wking: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-metal-ipi-ovn-dualstack 0c633d8 link false /test e2e-metal-ipi-ovn-dualstack
ci/prow/e2e-metal-ipi-ovn-dualstack-local-gateway 0c633d8 link false /test e2e-metal-ipi-ovn-dualstack-local-gateway
ci/prow/e2e-aws-ovn-single-node 0c633d8 link false /test e2e-aws-ovn-single-node
ci/prow/e2e-gcp-ovn-upgrade 0c633d8 link true /test e2e-gcp-ovn-upgrade
ci/prow/e2e-aws-ovn-single-node-upgrade 0c633d8 link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-openstack-ovn 0c633d8 link false /test e2e-openstack-ovn
ci/prow/e2e-gcp-ovn 0c633d8 link true /test e2e-gcp-ovn
ci/prow/e2e-aws-ovn-kube-apiserver-rollout 0c633d8 link false /test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/e2e-aws-disruptive 0c633d8 link false /test e2e-aws-disruptive
ci/prow/e2e-gcp-ovn-techpreview-serial-1of2 0c633d8 link false /test e2e-gcp-ovn-techpreview-serial-1of2

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Copy link

openshift-trt bot commented Aug 28, 2025

Job Failure Risk Analysis for sha: 0c633d8

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-disruptive IncompleteTests
Tests for this run (30) are below the historical average (964): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@wking wking changed the title OTA-1559: test/extended/cli/adm_upgrade/recommend: Enable precheck and accept OCPBUGS-61062: test/extended/cli/adm_upgrade/recommend: Enable precheck and accept Aug 29, 2025
@openshift-ci-robot openshift-ci-robot added the jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. label Aug 29, 2025
@openshift-ci-robot
Copy link

@wking: This pull request references Jira Issue OCPBUGS-61062, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.20.0) matches configured target version for branch (4.20.0)
  • bug is in the state New, which is one of the valid states (NEW, ASSIGNED, POST)

No GitHub users were found matching the public email listed for the QA contact in Jira ([email protected]), skipping review request.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

These will probably not pass without more work, but checking to see how far away we are.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@wking wking changed the title OCPBUGS-61062: test/extended/cli/adm_upgrade/recommend: Enable precheck and accept OCPBUGS-61063: test/extended/cli/adm_upgrade/recommend: Enable precheck and accept Aug 29, 2025
@openshift-ci-robot openshift-ci-robot added jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. and removed jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. labels Aug 29, 2025
@openshift-ci-robot
Copy link

@wking: This pull request references Jira Issue OCPBUGS-61063, which is invalid:

  • expected the bug to target the "4.20.0" version, but no target version was set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

These will probably not pass without more work, but checking to see how far away we are.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@wking
Copy link
Member Author

wking commented Aug 29, 2025

/jira refresh

@openshift-ci-robot openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Aug 29, 2025
@openshift-ci-robot
Copy link

@wking: This pull request references Jira Issue OCPBUGS-61063, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.20.0) matches configured target version for branch (4.20.0)
  • bug is in the state New, which is one of the valid states (NEW, ASSIGNED, POST)

No GitHub users were found matching the public email listed for the QA contact in Jira ([email protected]), skipping review request.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants