Create new cluster level helm chart

[jgwerner]

Create a new helm chart that is to be used by all namespaces in the cluster. This would allow us to use a helm-chart for the Cluster to manage cluster level resources and a separate helm chart for namespace level resources.

• Datadog
• Load Balancer
• Prometheus
• ...

@abhex could you complete the list above?

[Abhi94N]

@jgwerner Potential sub-issues to this epic issue
I think we should separate these into sub-issues but overall the cluster helm chart named: illumidesk/ild-cluster should have the following

1. Datadog - include subchart
2. Load Balancer - integrate alb version 2.3.0 and allow option to use eksctl to create service account or the hard way using aws cli. Could potentially write a bash script or a helm pre job to create service account role arn which is then passed into service account manifest/resource
3. Prometheus - Bring in sub chart for deployments that cannot use datadog
4. Argo and Argo Events - bring in argo-events helm chart and create values.yaml that deploys nats and stan at the same time. Also add documentation to list existing workflows such as using argo list -n {namespace}
5. External DNS - integerate external dns and allow option to use eksctl to create service account or the hard way using aws cli. Could also be a pontential bash script or helm pre job
6. Cluster Auto Scaler - Bring in helm subchart

[jgwerner]

Thanks @Abhi94N - could you add these items to the checklist above and create new issues based on the checklist items? That would convert this issue into an epic and tie in the checklist items as sub issues.