Skip to content

TestLanguage/l2-failed-create-continue-on-error is flaky #1037

Description

@iwahbe
=== FAIL: . TestLanguage/l2-failed-create-continue-on-error (21.40s)
    language_test.go:264: l2_failed_create_continue_on_error.go:83: 
        	Error Trace:	/Users/runner/go/pkg/mod/github.com/pulumi/pulumi/pkg/v3@v3.245.0/testing/pulumi-test-language/tests/l2_failed_create_continue_on_error.go:83
        	            				/Users/runner/go/pkg/mod/github.com/pulumi/pulumi/pkg/v3@v3.245.0/testing/pulumi-test-language/runner/runner.go:1719
        	            				/Users/runner/go/pkg/mod/github.com/pulumi/pulumi/pkg/v3@v3.245.0/testing/pulumi-test-language/tests/types.go:183
        	Error:      	Not equal: 
        	            	expected: 2
        	            	actual  : 1
        	Messages:   	expected 2 Creates

         +  pulumi:pulumi:Stack l2-failed-create-continue-on-error-test creating (0s) 
         +  fail_on_create:index:Resource failing creating (0s) 
         +  fail_on_create:index:Resource failing creating (0s) error: failed create
         +  fail_on_create:index:Resource failing **creating failed** error: failed create
            simple:index:Resource dependent_on_output  error: simple:index:Resource resource 'dependent_on_output': property value value output<string>{} has a problem: missing value
         +  pulumi:pulumi:Stack l2-failed-create-continue-on-error-test created 
            simple:index:Resource dependent_on_output **failed** 1 error
        Diagnostics:
          fail_on_create:index:Resource (failing):
            error: failed create

          simple:index:Resource (dependent_on_output):
            error: simple:index:Resource resource 'dependent_on_output': property value value output<string>{} has a problem: missing value

        Resources:
            + 1 created
            2 errored

From https://github.com/pulumi/pulumi-dotnet/actions/runs/27408287455/job/81002817642 (conformance-tests (macos-latest, 8) on #1035, attempt 1; the re-run passed).

The test expects 2 Creates, but dependent_on_output failed with output<string>{} has a problem: missing value instead of being created after the continue-on-error create failure, so only 1 Create happened.

Metadata

Metadata

Assignees

No one assigned

    Labels

    impact/flaky-testA test that is unreliablekind/engineeringWork that is not visible to an external user

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions