[Flaky Test]: TestOtelLogsIngestion – Expected 10000 logs, got &{0} #7222
Description
Failing test case
Error message
Expected 10000 logs, got &{0}
Build
TestOtelLogsIngestion
OS
Windows
Stacktrace and notes
=== FAIL: testing/integration TestOtelLogsIngestion (131.73s)
fetcher.go:93: Using existing artifact elastic-agent-9.0.0-SNAPSHOT-linux-x86_64.tar.gz
fixture.go:290: Extracting artifact elastic-agent-9.0.0-SNAPSHOT-linux-x86_64.tar.gz to /tmp/TestOtelLogsIngestion3955429767
fixture.go:308: Completed extraction of artifact elastic-agent-9.0.0-SNAPSHOT-linux-x86_64.tar.gz to /tmp/TestOtelLogsIngestion3955429767
fixture.go:965: All component specifications where removed
fixture.go:1006: Placed component specifications: fake
log.go:85: Starting in otel mode
log.go:85: 2025-03-05T18:42:24.653Z info [email protected]/service.go:186 Setting up own telemetry...
log.go:85: 2025-03-05T18:42:24.653Z info builders/builders.go:26 Development component. May change in the future. {"kind": "exporter", "data_type": "logs", "name": "debug"}
log.go:85: 2025-03-05T18:42:24.653Z warn [email protected]/config.go:367 dedot has been deprecated: in the future, dedotting will always be performed in ECS mode only {"kind": "exporter", "data_type": "logs", "name": "elasticsearch"}
log.go:85: 2025-03-05T18:42:24.655Z info [email protected]/service.go:252 Starting /tmp/TestOtelLogsIngestion3955429767/elastic-agent-9.0.0-SNAPSHOT-linux-x86_64/elastic-agent... {"Version": "9.0.0", "NumCPU": 8}
log.go:85: 2025-03-05T18:42:24.655Z info extensions/extensions.go:39 Starting extensions...
log.go:85: 2025-03-05T18:42:24.655Z info adapter/receiver.go:41 Starting stanza receiver {"kind": "receiver", "name": "filelog", "data_type": "logs"}
log.go:85: 2025-03-05T18:42:24.655Z warn fileconsumer/file.go:49 finding files {"kind": "receiver", "name": "filelog", "data_type": "logs", "component": "fileconsumer", "error": "no files match the configured criteria"}
log.go:85: 2025-03-05T18:42:24.655Z info [email protected]/service.go:275 Everything is ready. Begin running and processing data.
fixture.go:665: >> running binary with: [/tmp/TestOtelLogsIngestion3955429767/elastic-agent-9.0.0-SNAPSHOT-linux-x86_64/elastic-agent otel validate --config /tmp/TestOtelLogsIngestion114992297/001/otel-valid.yml --feature-gates foo.bar]
fixture.go:665: >> running binary with: [/tmp/TestOtelLogsIngestion3955429767/elastic-agent-9.0.0-SNAPSHOT-linux-x86_64/elastic-agent otel validate --config /tmp/TestOtelLogsIngestion114992297/001/otel-invalid.yml]
log.go:85: 2025-03-05T18:42:25.055Z info fileconsumer/file.go:265 Started watching file {"kind": "receiver", "name": "filelog", "data_type": "logs", "component": "fileconsumer", "path": "/tmp/TestOtelLogsIngestion114992297/001/input.log"}
log.go:85: 2025-03-05T18:42:25.060Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.062Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.063Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.064Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.066Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.067Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.069Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.071Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.072Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
log.go:85: 2025-03-05T18:42:25.073Z info Logs {"kind": "exporter", "data_type": "logs", "name": "debug", "resource logs": 1, "log records": 100}
otel_test.go:509:
Error Trace: /opt/buildkite-agent/builds/bk-agent-prod-gcp-1741199515198757084/elastic/elastic-agent/testing/integration/otel_test.go:509
/opt/buildkite-agent/.asdf/installs/golang/1.23.6/go/src/runtime/asm_amd64.s:1700
Error: Received unexpected error:
error in HTTP query: non-200 return code: 503, response: '[503 Service Unavailable] {
"error" : {
"root_cause" : [
{
"type" : "no_shard_available_action_exception",
"reason" : "[instance-0000000000][10.47.193.14:19929][indices:data/read/search[phase/query]]"
}
],
"type" : "search_phase_execution_exception",
"reason" : "all shards failed",
"phase" : "query",
"grouped" : true,
"failed_shards" : [
{
"shard" : 0,
"index" : ".ds-logs-generic-default-2025.03.05-000001",
"node" : "32G2H4bkSWS7j9WxL2w9Cw",
"reason" : {
"type" : "no_shard_available_action_exception",
"reason" : "[instance-0000000000][10.47.193.14:19929][indices:data/read/search[phase/query]]"
}
}
]
},
"status" : 503
}
'
Test: TestOtelLogsIngestion
otel_test.go:501:
Error Trace: /opt/buildkite-agent/builds/bk-agent-prod-gcp-1741199515198757084/elastic/elastic-agent/testing/integration/otel_test.go:501
Error: Condition never satisfied
Test: TestOtelLogsIngestion
Messages: Expected 10000 logs, got &{0}