feat(PVO11Y-4928): Implement Otel sidecar for Konflux UI

[martysp21]

KONFLUX-5285
This is an implementation of OTEL sidecar for Konflux UI Nginx proxy in order to collect all necessary HTTP traffic data and convert them into metrics. These metrics will be then used to create alert for inaccessibility.

The otel image will change before this PR is merged to the otel-collector-sp after it is updated

Changes:
nginx.conf

• added a new logformat that will be saved into access.log
• The new logformat is the same as the default ngingx format "combined", I redefined it for better readability and easier future maintenance
• access.log is located at /var/log/nginx/access.log and stores all the logs of in the combined_cusotm format

otel-collector-conf.yaml

• configuration for the otel collector
• takes logs from the access.log and parses them using regex
• the data are then transformed into metrics
• this is the main file to change how the output lookslike and will probably need most of the refinement

proxy.yaml

• added sidecar to proxy deployment
• sidecar uses the otel collector image
• mounts the nginx logs volume
• Added a new port in the Service configuration to allow access to the metrics port of the otel collector by the prometheus
• Added Service monitor to define scraping definition for Prometheus using UWM -- More at: https://github.com/redhat-appstudio/infra-deployments/tree/main/components/monitoring/prometheus

The changes can be also found at: https://docs.google.com/document/d/1RTvHJl90rvbVMxM6a8ag9dWTGTcTIow_zapaxCYEmzE/edit?tab=t.0

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[github-actions]

🤖 Gemini AI Assistant Available

Hi @martysp21! I'm here to help with your pull request. You can interact with me using the following commands:

Available Commands

• @gemini-cli /review - Request a comprehensive code review

  • Example: @gemini-cli /review Please focus on security and performance

• @gemini-cli <your question> - Ask me anything about the codebase

  • Example: @gemini-cli How can I improve this function?
  • Example: @gemini-cli What are the best practices for error handling here?

How to Use

1. Simply type one of the commands above in a comment on this PR
2. I'll analyze your code and provide detailed feedback
3. You can track my progress in the workflow logs

Permissions

Only OWNER, MEMBER, or COLLABORATOR users can trigger my responses. This ensures secure and appropriate usage.

---

This message was automatically added to help you get started with the Gemini AI assistant. Feel free to delete this comment if you don't need assistance.

[github-actions]

🤖 Hi @martysp21, I've received your request, and I'm working on it now! You can track my progress in the logs for more details.

[martysp21]

The tests run in the Draft of this PR do not seem to be related with the changes made by this PR.
Asking for advice from Konflux Ui when the PR will be opened.

[martysp21]

Reviewing possibility of changing the otel collector image to internal one.

[TominoFTW]

As stated in the tests, the container is still missing runAsUser label.

Error when running kustomize build for components/konflux-ui/staging/stone-stage-p01: Error: remove operation does not apply: doc is missing path: "/spec/template/spec/containers/1/securityContext/runAsUser": missing value
Error when running kustomize build for components/konflux-ui/staging/stone-stg-rh01: Error: remove operation does not apply: doc is missing path: "/spec/template/spec/containers/1/securityContext/runAsUser": missing value

[raks-tt]

This means, the command will be -> /usr/local/bin/otel-collector-sp --config /etc/otelcol-contrib/config.yaml.

Can we please test this @martysp21 locally.

[martysp21]

Changed and tested. Please double check that it is mounted correctly, because that part is different from local testing.

[raks-tt]

LGTM

[mftb]

/retest

[mftb]

/lgtm
/approve

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: martysp21, mftb, raks-tt

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• components/konflux-ui/OWNERS [mftb]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment