AWS MSK - Updates doesn't work with kafka-controller

[kkopuru]

Provisioning of AWS MSK using kafka-controller works fine but any updates to existing deployment doesn't work. Any updates like volume size, instance type etc are not getting rolled out.

Environment:

• AWS EKS: 1.29
• Kafka-controller: 1.0.1

[a-hilaly]

Indeed looks like there is a missing logic for volume size/instance type updates in https://github.com/aws-controllers-k8s/kafka-controller/blob/main/pkg/resource/cluster/hooks.go#L114-L155

[a-hilaly]

cc @michaelhtm @rushmash91

[michaelhtm]

Hey @kkopuru
Can you provide sample manifests that you're using? I can try replicating on my end

[kkopuru]

Hi @michaelhtm
Here is the manifest file

apiVersion: kafka.services.k8s.aws/v1alpha1
kind: Cluster
metadata:
  name: pd1-tst-msk
  namespace: tst
spec:
  brokerNodeGroupInfo:
    brokerAZDistribution: DEFAULT
    clientSubnets:
    - subnet-xxxx
    - subnet-xxxx
    - subnet-xxxx
    instanceType: kafka.m7g.large
    securityGroups:
    - sg-xxxx
    storageInfo:
      ebsStorageInfo:
        volumeSize: 20
  clientAuthentication:
    sasl:
      scram:
        enabled: false
  configurationInfo:
    arn: arn:aws:kafka:us-west-2:xxxx:configuration/pd1-tst-msk-conf/xxxxx
    revision: 1
  encryptionInfo:
    encryptionInTransit:
      clientBroker: PLAINTEXT
      inCluster: false
  enhancedMonitoring: DEFAULT
  kafkaVersion: 3.6.0
  name: pd1-tst-msk
  numberOfBrokerNodes: 3
  openMonitoring:
    prometheus:
      jmxExporter:
        enabledInBroker: true
      nodeExporter:
        enabledInBroker: true
  tags:
    ClusterType: integration
    Environment: Non Prod

[michaelhtm]

Hi @kkopuru, is this issue resolved for you?