Encountering this kind of "Log file does not exist" very frequently in all running dags - please help

[setushah19]

*** Log file does not exist: /mnt/disks/logs/dag_id=from_labelbox/run_id=scheduled__2024-07-11T01:00:00+00:00/task_id=create_local_folders/attempt=2.log 
*** Fetching from: http://:8793/log/dag_id=from_labelbox/run_id=scheduled__2024-07-11T01:00:00+00:00/task_id=create_local_folders/attempt=2.log 
*** Failed to fetch log file from worker. Request URL is missing an 'http://' or 'https://' protocol.

Some of the approaches we have already tried to resolve it are:

• Recreated airflow
• changed log locations to various others directories
• Checked any related service accounts
• Removed recent dags to see if they are causing the issue
• Emptied log folder and recreated it
• Change config values in the airflow config file

[setushah19]

OR this

*** Log file does not exist: /home/airflow/logs/dag_id=to_labelbox/run_id=scheduled__2024-09-01T01:00:00+00:00/task_id=upload_conversations_to_GCS/attempt=2.log
*** Fetching from: http://cortex-airflow-main.us-east4.us.walmart.net:8793/log/dag_id=to_labelbox/run_id=scheduled__2024-09-01T01:00:00+00:00/task_id=upload_conversations_to_GCS/attempt=2.log
*** Failed to fetch log file from worker. Client error '404 NOT FOUND' for url 'http://cortex-airflow-main.us-east4.us.walmart.net:8793/log/dag_id=to_labelbox/run_id=scheduled__2024-09-01T01:00:00+00:00/task_id=upload_conversations_to_GCS/attempt=2.log'