[beats receivers] OTel manager failed: supervised collector exited with error: Error response from daemon: Sign in to continue using Docker Desktop #11171
Description
- Version: 9.2.1
- Operating System: MacOS(15.7.2)
The supervised collector fails to start on MacOS (or presumably any system relying on Docker Desktop) if you are not signed in to Docker Desktop and signing in is mandatory (as it is at Elastic).
Relevant parts of state.yaml, where only system/metrics-monitoring appears even though we are attempting to start all of the monitoring beats.
fleet_message: Connected
fleet_state: 2
log_level: info
message: 'OTel manager failed: supervised collector (pid: 8109) exited with error: exit status 1'
state: 4
# ...
components:
# This is the only monitoring beat with state reported in state.yaml
- id: system/metrics-monitoring
state:
component:
apmconfig: null
limits:
gomaxprocs: 0
source:
fields:
go_max_procs:
kind:
numbervalue: 0
component_idx: 0
features_idx: 0
message: 'Starting: spawned pid ''8140'''
pid: 0
state: 0
units:
input-system/metrics-monitoring-metrics-monitoring-endpoint_security:
message: 'Starting: spawned pid ''8140'''
state: 0
output-system/metrics-monitoring:
message: 'Starting: spawned pid ''8140'''
state: 0
version_info:
build_hash: ""
name: ""Relevant logs where the primary error is Exiting: error initializing processors: failed to start watcher: Error response from daemon: Sign in to continue using Docker Desktop. Membership in the [elastic] organization is required. Sign in enforced by your administrators (via registry.json)
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.813Z","message":"Output reload is enabled, the beat will restart as needed on change of output config","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.logger":"centralmgmt.V2-manager.centralmgmt","log.origin":{"file.line":203,"file.name":"management/managerV2.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/management.NewV2AgentManagerWithClient"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.813Z","message":"Set gc percentage to: 100","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.origin":{"file.line":897,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).configure"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-13T10:28:04.856Z","message":"error found during service initialization","log.origin.stack_trace":"go.opentelemetry.io/collector/service.New.func1\n\tgo.opentelemetry.io/collector/[email protected]/service.go:140\ngo.opentelemetry.io/collector/service.New\n\tgo.opentelemetry.io/collector/[email protected]/service.go:200\ngo.opentelemetry.io/collector/otelcol.(*Collector).setupConfigurationComponents\n\tgo.opentelemetry.io/collector/[email protected]/collector.go:195\ngo.opentelemetry.io/collector/otelcol.(*Collector).Run\n\tgo.opentelemetry.io/collector/[email protected]/collector.go:310\ngithub.com/elastic/elastic-agent/internal/pkg/otel.Run\n\tgithub.com/elastic/elastic-agent/internal/pkg/otel/run.go:41\ngithub.com/elastic/elastic-agent/internal/pkg/agent/cmd.RunCollector\n\tgithub.com/elastic/elastic-agent/internal/pkg/agent/cmd/otel.go:124\ngithub.com/elastic/elastic-agent/internal/pkg/agent/cmd.newOtelCommandWithArgs.func1\n\tgithub.com/elastic/elastic-agent/internal/pkg/agent/cmd/otel.go:58\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/[email protected]/command.go:1015\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/[email protected]/command.go:1148\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/[email protected]/command.go:1071\nmain.main\n\tgithub.com/elastic/elastic-agent/main.go:32\nruntime.main\n\truntime/proc.go:283","log.origin":{"file.line":140,"file.name":"[email protected]/service.go","function":"go.opentelemetry.io/collector/service.New.func1"},"resource":{"service.instance.id":"add8ab72-07f6-4ee0-91c0-cd69d26e0ab8","service.name":"/Library/Elastic/Agent/elastic-agent","service.version":"9.2.0"},"error":{"message":"failed to build pipelines: failed to create \"filebeatreceiver/_agent-component/filestream-monitoring\" receiver for data type \"logs\": error creating filebeatreceiver: error creating processors: error initializing processors: failed to start watcher: Error response from daemon: Sign in to continue using Docker Desktop. Membership in the [elastic] organization is required. Sign in enforced by your administrators (via registry.json)."},"ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.856Z","message":"Stats endpoint (/Library/Elastic/Agent/data/tmp/jTgjFSdPDnYoazUu541NazzsJSv6daDn.sock) finished: accept unix /Library/Elastic/Agent/data/tmp/jTgjFSdPDnYoazUu541NazzsJSv6daDn.sock: use of closed network connection","log.logger":"edot.api","log.origin":{"file.line":90,"file.name":"api/server.go","function":"github.com/elastic/elastic-agent-libs/api.(*Server).Start.func1"},"ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.856Z","message":"failed to build pipelines: failed to create \"filebeatreceiver/_agent-component/filestream-monitoring\" receiver for data type \"logs\": error creating filebeatreceiver: error creating processors: error initializing processors: failed to start watcher: Error response from daemon: Sign in to continue using Docker Desktop. Membership in the [elastic] organization is required. Sign in enforced by your administrators (via registry.json).","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-13T10:28:04.859Z","log.logger":"otel_manager","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/otel/manager.(*OTelManager).Run","file.name":"manager/manager.go","file.line":299},"message":"collector exited with error (will try to recover in 7.863083759s): supervised collector (pid: 87740) exited with error: exit status 1","log":{"source":"elastic-agent"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component filestream-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"filestream-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component beat/metrics-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"beat/metrics-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component http/metrics-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"http/metrics-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component prometheus/metrics-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"prometheus/metrics-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component filestream-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"filestream-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component beat/metrics-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"beat/metrics-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.859Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component http/metrics-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"http/metrics-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.860Z","log.origin":{"function":"github.com/elastic/elastic-agent/internal/pkg/agent/application/coordinator.logComponentStateChange","file.name":"coordinator/coordinator.go","file.line":980},"message":"Spawned new component prometheus/metrics-monitoring: ","log":{"source":"elastic-agent"},"component":{"id":"prometheus/metrics-monitoring","state":"STOPPED"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.882Z","message":"Output reload is enabled, the beat will restart as needed on change of output config","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-monitoring","type":"system/metrics"},"log":{"source":"system/metrics-monitoring"},"log.logger":"centralmgmt.V2-manager.centralmgmt","log.origin":{"file.line":203,"file.name":"management/managerV2.go","function":"github.com/elastic/beats/v7/x-pack/libbeat/management.NewV2AgentManagerWithClient"},"service.name":"metricbeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:04.882Z","message":"Set gc percentage to: 100","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-monitoring","type":"system/metrics"},"log":{"source":"system/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.origin":{"file.line":897,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).configure"},"ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2025-11-13T10:28:07.884Z","message":"add_cloud_metadata: hosting provider type not detected.","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-monitoring","type":"system/metrics"},"log":{"source":"system/metrics-monitoring"},"service.name":"metricbeat","ecs.version":"1.6.0","log.logger":"processors.add_cloud_metadata","log.origin":{"file.line":103,"file.name":"add_cloud_metadata/add_cloud_metadata.go","function":"github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).init.func1"},"ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-13T10:28:09.510Z","message":"Exiting: error initializing processors: failed to start watcher: Error response from daemon: Sign in to continue using Docker Desktop. Membership in the [elastic] organization is required. Sign in enforced by your administrators (via registry.json).","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"log-default","type":"log"},"log":{"source":"log-default"},"service.name":"filebeat","ecs.version":"1.6.0","log.origin":{"file.line":1363,"file.name":"instance/beat.go","function":"github.com/elastic/beats/v7/libbeat/cmd/instance.handleError"},"ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-13T10:28:09.512Z","message":"Exiting: error initializing processors: failed to start watcher: Error response from daemon: Sign in to continue using Docker Desktop. Membership in the [elastic] organization is required. Sign in enforced by your administrators (via registry.json).","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"log-default","type":"log"},"log":{"source":"log-default"},"ecs.version":"1.6.0"}