BUG: network.PrivateZone returns output object that can not be deserialized [python]

[leonavevor]

What happened?

DESCRIPTION

All outputs returned from this network.PrivateZone are wrapped in Output[T] objects which are unfortunately unusable. this component needs to be reported

resources:ResourceGroup and others works perfectly as expected

REPRODUCE

pulumi version : v3.248.0

code:

    private_dns_zone = privatedns.PrivateZone(
        name,
        resource_group_name=resource_group_name,
        private_zone_name=zone_name,
        tags=tags,
        opts=child_opts,
    )

    # Register outputs
    self.object = private_dns_zone
    self.id: pulumi.Output[str] = private_dns_zone.id
    self.name: pulumi.Output[str] = private_dns_zone.name

    self.register_outputs(
        {
        "id": self.id,
        "name": self.name,
        "object": self.object
        }
    )

---

trying to get value:

    private_dns_zones_names: list[tuple[str, str]] \
        = [(zone.name.apply(lambda n:f"{n}"), zone.id.apply(lambda i:f"{i}")) for zone in private_dns_zones]

run:

    pulumi -C stacks/platform_shared_services preview -s dev --diff

ERROR 1

    Previewing update (dev)

    View Live: https://app.pulumi.com/leonavevor/shared_services/dev/previews/163afddf-36f4-4541-b7ea-be3b3574d2d5

    warning: Calling __str__ on an Output[T] is not supported.

    To get the value of an Output[T] as an Output[str] consider:
    1. o.apply(lambda v: f"prefix{v}suffix")

    See https://www.pulumi.com/docs/concepts/inputs-outputs for more details.
    private_dns_zone: Calling __str__ on an Output[T] is not supported.

    To get the value of an Output[T] as an Output[str] consider:
    1. o.apply(lambda v: f"prefix{v}suffix")

ERROR 2

when trying to create a lock for it using the id:

  azure-native:authorization:ManagementLockByScope  lock-Calling __str__ on an Output[T] is not supported.\n\nTo get the value of an Output[T] as an Output[str] consider:\n1. o.apply(lambda v: f"prefix{v}suffix")\n\nSee https://www.pulumi.com/docs/concepts/inputs-outputs for more details.\nThis function may throw in a future version of Pulumi

DESIRED OUTCOME

private_dns_zone.id.apply(lambda v:v) -> give me a string back not an unusable object

Example

private_dns_zone.id.apply(lambda v:v)

Output of pulumi about

give me a string back not an unusable object

Additional context

No response

Contributing

Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

[Zaid-Ajaj]

Hi there @leonavevor I am reading through the code and trying to understand it. The line here:

    private_dns_zones_names: list[tuple[str, str]] \
        = [(zone.name.apply(lambda n:f"{n}"), zone.id.apply(lambda i:f"{i}")) for zone in private_dns_zones]

How are you consuming this variable private_dns_zones_names? Because the type here not list[tuple[str, str]] it is actually list[tuple[Output[str], Output[str]]]. Using apply(...) doesn't return a string, it still returns an output.

Can you share the entire program for me to debug?

[leonavevor]

  `
  from __future__ import annotations
  
  import pulumi
  from pulumi_azure_native import dns, privatedns
  
  from utils import build_tags
  
  
  class PrivateDnsZoneComponent(pulumi.ComponentResource):
  
      def __init__(
          self,
          name: str,
          resource_group_name: pulumi.Input[str],
          zone_name: str,
          tags: dict[str, str] | None = None,
          *,
          opts: pulumi.ResourceOptions | None = None,
      ):
  
          super().__init__("azure:network:PrivateDnsZoneComponent", name, {}, opts)
  
          child_opts = pulumi.ResourceOptions(parent=self)
          if opts and opts.protect is not None:
              child_opts.protect = opts.protect
  
          tags = build_tags(extra_tags=tags)
  
          private_dns_zone = privatedns.PrivateZone(
              name,
              resource_group_name=resource_group_name,
              private_zone_name=zone_name,
              tags=tags,
              opts=child_opts,
          )
  
          # Register outputs
          self.object = private_dns_zone
          self.id: pulumi.Output[str] = private_dns_zone.id
          self.name: pulumi.Output[str] = private_dns_zone.name
  
          self.register_outputs({"id": self.id, "name": self.name, "object": self.object})
  `

[leonavevor]

then try accessing it:
zone.id.apply(lambda i:f"{i}")

[Zaid-Ajaj]

@leonavevor I am trying to repro with the following:

from __future__ import annotations

import pulumi
from pulumi_azure_native import resources, privatedns


class PrivateDnsZoneComponent(pulumi.ComponentResource):

    def __init__(
        self,
        name: str,
        resource_group_name: pulumi.Input[str],
        zone_name: str,
        tags: dict[str, str] | None = None,
        *,
        opts: pulumi.ResourceOptions | None = None,
    ):

        super().__init__("azure:network:PrivateDnsZoneComponent", name, {}, opts)

        child_opts = pulumi.ResourceOptions(parent=self)
        if opts and opts.protect is not None:
            child_opts.protect = opts.protect

        private_dns_zone = privatedns.PrivateZone(
            name,
            resource_group_name=resource_group_name,
            private_zone_name=zone_name,
            location="global",
            tags=tags or {},
            opts=child_opts,
        )

        # Register outputs
        self.object = private_dns_zone
        self.id: pulumi.Output[str] = private_dns_zone.id
        self.name: pulumi.Output[str] = private_dns_zone.name

        self.register_outputs({"id": self.id, "name": self.name, "object": self.object})


rg = resources.ResourceGroup("repro-4777-rg")

zone = PrivateDnsZoneComponent(
    "zone-a",
    resource_group_name=rg.name,
    zone_name="a.example.internal",
    opts=pulumi.ResourceOptions(),
)

pulumi.export("zone_id", zone.id)

this works just fine and the id is exported correctly:

zone_id: "/subscriptions/<--->/resourceGroups/repro-4777-rg3624c9f9/providers/Microsoft.Network/privateDnsZones/a.example.interna..."

I believe you are getting an error if you tried to do this:

private_dns_zones = [
    PrivateDnsZoneComponent(
        "zone-a",
        resource_group_name=rg.name,
        zone_name="a.example.internal",
        opts=pulumi.ResourceOptions(),
    ),
    PrivateDnsZoneComponent(
        "zone-b",
        resource_group_name=rg.name,
        zone_name="b.example.internal",
        opts=pulumi.ResourceOptions(),
    ),
]

private_dns_zones_names: list[tuple[str, str]] = [
    (zone.name.apply(lambda n: f"{n}"), zone.id.apply(lambda i: f"{i}")) for zone in private_dns_zones
]

How are you using private_dns_zones_names? It should actually be list[tuple[Output[str], Output[str]]]

[leonavevor]

This should be programmatically possible.

I using a component and stack approach where I reuse components in various stacks.

The problems comes up after the export, when I try to o access the values from the export it doesn't seem to work.

[leonavevor]

I sent should be programmatically possible.

I using a component and stack approach where I reuse components in various stacks. The problems comes up after the export, when I try to o access the values from the export it doesn't seem to work.

[leonavevor]

Please can you try to log it out to verify it really works?

[Zaid-Ajaj]

The problems comes up after the export, when I try to o access the values from the export it doesn't seem to work.

I think I will need your full program, reduced to the only parts that aren't working to debug this properly.

[leonavevor]

@Zaid-Ajaj, basically this is it, a component and a stack using the component.

try logging the id out an there you will realize what i mean.

print(f"zone id: {zone.id.apply(lambda n: n)}")
print(f"zone name: {zone.name.apply(lambda n: n)}")

[Zaid-Ajaj]

That's probably the problem: print(f"zone id: {zone.id.apply(lambda n: n)}") will not work because you are trying to evaluate zone.id (an asynchronous value) in a string which will try to stringyfy the the expression. In Pulumi you cannot log a value of type Output[str] in a str, you have to extract the underlying value and log it when it is available:

def log(value):
    print(f"zone id: {value}")

zone.id.apply(log)

The above will work during pulumi up but not during pulumi preview because in preview the value is unknown and doesn't call apply

BTW: zone.id.apply(lambda n: n) is exactly the same as zone.id