Skip to content

Commit 80e6017

Browse files
authored
Merge branch 'master' into dd/fouad/llm-evals-investigate
2 parents aa49df7 + ecd5e9d commit 80e6017

63 files changed

Lines changed: 1007 additions & 528 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

hugo/config/_default/menus/main.en.yaml

Lines changed: 39 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -752,16 +752,11 @@ menu:
752752
identifier: otel-setup-ddot-migrate
753753
parent: otel-setup-ddot
754754
weight: 4013
755-
- name: Other Setup Options
756-
url: /opentelemetry/setup/
757-
identifier: otel-setup-other
758-
parent: otel_collect
759-
weight: 402
760755
- name: OpenTelemetry Collector
761756
url: /opentelemetry/setup/collector_exporter/
762757
identifier: otel-setup-collector-exporter
763-
parent: otel-setup-other
764-
weight: 4021
758+
parent: otel_collect
759+
weight: 402
765760
- name: Deploy
766761
url: /opentelemetry/setup/collector_exporter/deploy
767762
identifier: otel-setup-collector-exporter-deploy
@@ -790,13 +785,13 @@ menu:
790785
- name: OTLP Ingest in the Agent
791786
url: /opentelemetry/setup/otlp_ingest_in_the_agent
792787
identifier: otel-setup-otlp-ingest
793-
parent: otel-setup-other
794-
weight: 4022
788+
parent: otel_collect
789+
weight: 403
795790
- name: Direct OTLP Ingest
796791
url: /opentelemetry/setup/otlp_ingest
797792
identifier: otel-setup-intake-endpoint
798-
parent: otel-setup-other
799-
weight: 4023
793+
parent: otel_collect
794+
weight: 404
800795
- name: Logs Endpoint
801796
url: /opentelemetry/setup/otlp_ingest/logs
802797
parent: otel-setup-intake-endpoint
@@ -2714,16 +2709,21 @@ menu:
27142709
parent: incidents_settings
27152710
identifier: incidents_settings_property_fields
27162711
weight: 202
2712+
- name: Transition Forms
2713+
url: incident_response/incident_management/setup_and_configuration/transition_forms
2714+
parent: incidents_settings
2715+
identifier: incidents_settings_transition_forms
2716+
weight: 203
27172717
- name: Responder Types
27182718
url: incident_response/incident_management/setup_and_configuration/responder_types
27192719
parent: incidents_settings
27202720
identifier: incidents_settings_responder_types
2721-
weight: 203
2721+
weight: 204
27222722
- name: Automations
27232723
url: incident_response/incident_management/setup_and_configuration/automations
27242724
parent: incidents_settings
27252725
identifier: incidents_settings_automations
2726-
weight: 204
2726+
weight: 205
27272727
- name: Notification Rules
27282728
url: incident_response/incident_management/setup_and_configuration/notification_rules
27292729
parent: incidents_settings
@@ -7664,36 +7664,41 @@ menu:
76647664
parent: cloudprem_operate
76657665
identifier: cloudprem_operate_sizing
76667666
weight: 600
7667+
- name: Autoscaling
7668+
url: /byoc-logs/operate/autoscaling
7669+
parent: cloudprem_operate
7670+
identifier: cloudprem_operate_autoscaling
7671+
weight: 601
76677672
- name: Monitoring
76687673
url: /byoc-logs/operate/monitoring
76697674
parent: cloudprem_operate
76707675
identifier: cloudprem_operate_monitoring
7671-
weight: 601
7676+
weight: 602
76727677
- name: Search Logs
76737678
url: /byoc-logs/operate/search_logs
76747679
parent: cloudprem_operate
76757680
identifier: cloudprem_operate_search
7676-
weight: 602
7681+
weight: 603
76777682
- name: Production Best Practices
76787683
url: /byoc-logs/operate/best_practices
76797684
parent: cloudprem_operate
76807685
identifier: cloudprem_operate_best_practices
7681-
weight: 603
7686+
weight: 604
76827687
- name: Disk Buffer Durability
76837688
url: /byoc-logs/operate/disk_buffer_durability
76847689
parent: cloudprem_operate
76857690
identifier: cloudprem_operate_disk_buffer_durability
7686-
weight: 604
7691+
weight: 605
76877692
- name: Releases and Updates
76887693
url: /byoc-logs/operate/updates
76897694
parent: cloudprem_operate
76907695
identifier: cloudprem_operate_updates
7691-
weight: 605
7696+
weight: 606
76927697
- name: Troubleshooting
76937698
url: /byoc-logs/operate/troubleshooting
76947699
parent: cloudprem_operate
76957700
identifier: cloudprem_operate_troubleshooting
7696-
weight: 606
7701+
weight: 607
76977702
- name: Guides
76987703
url: /byoc-logs/guides/
76997704
parent: cloudprem
@@ -10052,26 +10057,31 @@ menu:
1005210057
parent: pa_charts
1005310058
identifier: pa_chart_basics
1005410059
weight: 101
10055-
- name: Pathways Diagram
10056-
url: product_analytics/charts/pathways
10057-
parent: pa_charts
10058-
identifier: pa_pathways
10059-
weight: 102
10060-
- name: Funnel Analysis
10060+
- name: Funnel
1006110061
url: product_analytics/charts/funnel_analysis
1006210062
parent: pa_charts
1006310063
identifier: pa_funnel_analysis
10064+
weight: 102
10065+
- name: Journey Paths
10066+
url: product_analytics/charts/journey_paths
10067+
parent: pa_charts
10068+
identifier: pa_journey_paths
1006410069
weight: 103
10065-
- name: Retention Analysis
10070+
- name: Pathways
10071+
url: product_analytics/charts/pathways
10072+
parent: pa_charts
10073+
identifier: pa_pathways
10074+
weight: 104
10075+
- name: Retention
1006610076
url: product_analytics/charts/retention_analysis
1006710077
parent: pa_charts
1006810078
identifier: pa_user_retention
10069-
weight: 104
10070-
- name: Analytics Explorer
10079+
weight: 105
10080+
- name: Analytics
1007110081
url: product_analytics/charts/analytics_explorer
1007210082
parent: pa_charts
1007310083
identifier: pa_analytics_explorer
10074-
weight: 105
10084+
weight: 106
1007510085
- name: Dashboards
1007610086
url: product_analytics/dashboards
1007710087
parent: product_analytics

hugo/config/_default/params.yaml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -288,6 +288,10 @@ core_product:
288288

289289
# Unsupported sites for each product
290290
unsupported_sites:
291+
cloudcraft_apm_overlay: [gov, gov2]
292+
code_locations: [gov, gov2]
293+
ownership_of_views: [gov, gov2]
294+
ai_credit_limits: [gov, gov2]
291295
amazon-security-lake: [gov, gov2]
292296
resource_catalog_policies: [gov, gov2]
293297
runtime_prioritization_engine: [gov, gov2]
@@ -382,6 +386,7 @@ unsupported_sites:
382386
linear_error_tracking: [gov,gov2]
383387
live_debugger: [gov,gov2]
384388
llm_observability: [gov,gov2]
389+
dd.llm_observability.dataset: [gov,gov2]
385390
mcp_server: [gov,gov2]
386391
mobile_app_testing: [gov,gov2]
387392
nebius-cloud: [gov,gov2]
@@ -428,3 +433,4 @@ unsupported_sites:
428433
workflow-automation: [gov,gov2]
429434
workflows: [gov,gov2]
430435
workload_security_active_protection: [gov,gov2]
436+
work_management_ai_site_support: [gov,gov2]

hugo/content/en/actions/forms/_index.md

Lines changed: 14 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,6 @@
11
---
22
title: Forms
33
description: Build forms to collect input, analyze responses, and trigger automations.
4-
disable_toc: false
54
further_reading:
65
- link: https://www.datadoghq.com/blog/datadog-forms
76
tag: Blog
@@ -78,6 +77,16 @@ To preview or share your form:
7877
1. Click {{< ui >}}Preview{{< /ui >}} to view the form as it appears to respondents.
7978
1. Click {{< ui >}}Share{{< /ui >}} to copy the form link or configure sharing options.
8079

80+
## Customize start and end pages
81+
82+
Forms can include a start page shown before the first question, and an end page shown after a respondent submits the form. Customize the title and message on both pages. By default, forms don't include a start page, and the end page shows a generic completion message.
83+
84+
To add or customize a start or end page:
85+
1. From the [Forms][2] page, click a form to open it in the editor.
86+
1. In the {{< ui >}}Pages{{< /ui >}} panel, click {{< ui >}}Start Page{{< /ui >}} or {{< ui >}}End Page{{< /ui >}}. If no start page exists, click the plus **+** icon to add one.
87+
1. Edit the title and message.
88+
1. Click {{< ui >}}Publish{{< /ui >}} or {{< ui >}}Publish Changes{{< /ui >}} to apply your changes.
89+
8190
## Form settings
8291

8392
From the [Forms][2] page, click a form to open it in the editor. In the editor header, click the gear <i class="icon-cog-2"></i> icon to access the following settings:
@@ -102,7 +111,9 @@ To configure sharing for a form:
102111
The following sharing options are available:
103112

104113
{{% collapse-content title="Share within Datadog" level="h3" expanded=false %}}
105-
Share the form with users in your Datadog organization.
114+
Share the form with users or teams in your Datadog organization.
115+
116+
Add individual users or teams as recipients. Enable {{< ui >}}Notify added teammates{{< /ui >}} to send a notification, and optionally add a custom message. Teams are notified in their configured Slack channel or by email; individual users are notified by email.
106117

107118
Under {{< ui >}}Add to Dashboard{{< /ui >}}, use the dropdown to add the form to an existing dashboard or create a dashboard.
108119

@@ -116,7 +127,7 @@ The following options are available:
116127

117128
- **Specific individuals**: Add recipients by individual email address. For example, `alice@example.com` and `bob@example.com`.
118129
- **Company domain**: Share with anyone in a specific email domain. For example, `*@yourcompany.com`.
119-
- **Shareable link**: Generate a link that anyone can use to access the form without a Datadog account.
130+
- **Anyone with a link**: Generate a link that anyone can use to access the form after verifying their email address.
120131
{{% /collapse-content %}}
121132

122133
To pause or remove external sharing, click {{< ui >}}Share{{< /ui >}}, then click {{< ui >}}Edit{{< /ui >}} and select {{< ui >}}Pause Sharing{{< /ui >}} or {{< ui >}}Delete Sharing{{< /ui >}}.

hugo/content/en/agent/guide/azure-private-link.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ You can configure Azure Private Link to expose a private IP address for each Dat
5151
5. After the Private DNS zone is created, select it from the list.
5252
6. In the panel that opens, select {{< ui >}}+ Record set{{< /ui >}}.
5353
7. In the {{< ui >}}Add record set{{< /ui >}} panel, configure the following:
54-
- For {{< ui >}}Name{{< /ui >}}, enter `*`.
54+
- For {{< ui >}}Name{{< /ui >}}, enter `@`.
5555
- For {{< ui >}}Type{{< /ui >}}, select {{< ui >}}A - Address record{{< /ui >}}.
5656
- For {{< ui >}}IP address{{< /ui >}}, enter the IP address you noted at the end of the previous section.
5757

hugo/content/en/api/v2/agent-observability/examples.json

Lines changed: 44 additions & 13 deletions
Large diffs are not rendered by default.

hugo/content/en/api/v2/application-security/examples.json

Lines changed: 6 additions & 6 deletions
Large diffs are not rendered by default.

hugo/content/en/api/v2/static-analysis/examples.json

Lines changed: 21 additions & 3 deletions
Large diffs are not rendered by default.

hugo/content/en/byoc-logs/introduction/network.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,8 @@ If your environment uses an HTTP proxy, BYOC Logs supports standard proxy config
3737

3838
Only **searcher** pods establish the reverse connection. Indexers, the control plane, the metastore, and the janitor do not initiate any connection to Datadog.
3939

40+
<div class="alert alert-warning">Keep at least one searcher pod running when using the reverse connection. If all searcher pods are unavailable or scaled to <code>0</code>, Datadog cannot route queries or index management requests through the reverse connection until a searcher pod starts and reconnects.</div>
41+
4042
## Public ingress (optional)
4143

4244
It is also possible to configure BYOC Logs to deploy a public ingress so Datadog can establish the connection in the other direction.

hugo/content/en/byoc-logs/operate/_index.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,11 @@ aliases:
77

88
## Overview
99

10-
Manage your BYOC (Bring Your Own Cloud) Logs deployment with guides on sizing, monitoring, and troubleshooting.
10+
Manage your BYOC (Bring Your Own Cloud) Logs deployment with guides on sizing, autoscaling, monitoring, and troubleshooting.
1111

1212
{{< whatsnext desc="Operate BYOC Logs:">}}
1313
{{< nextlink href="/byoc-logs/operate/sizing/" >}}Sizing Guide{{< /nextlink >}}
14+
{{< nextlink href="/byoc-logs/operate/autoscaling/" >}}Autoscale Indexers and Compactors{{< /nextlink >}}
1415
{{< nextlink href="/byoc-logs/operate/monitoring/" >}}Monitor BYOC Logs{{< /nextlink >}}
1516
{{< nextlink href="/byoc-logs/operate/search_logs/" >}}Search Logs{{< /nextlink >}}
1617
{{< nextlink href="/byoc-logs/operate/best_practices/" >}}Production Best Practices{{< /nextlink >}}
Lines changed: 121 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,121 @@
1+
---
2+
title: Autoscale Indexers and Compactors
3+
description: Configure Horizontal Pod Autoscalers for BYOC Logs indexer and compactor workloads.
4+
aliases:
5+
- /cloudprem/operate/autoscaling/
6+
further_reading:
7+
- link: "/byoc-logs/operate/sizing/"
8+
tag: "Documentation"
9+
text: "Cluster Sizing"
10+
- link: "/byoc-logs/operate/monitoring/"
11+
tag: "Documentation"
12+
text: "Monitor BYOC Logs"
13+
- link: "https://github.com/DataDog/helm-charts/blob/main/charts/cloudprem/values.yaml"
14+
tag: "Source"
15+
text: "CloudPrem Helm chart default values"
16+
---
17+
18+
## Overview
19+
20+
The `datadog/cloudprem` Helm chart creates Horizontal Pod Autoscalers (HPAs) for BYOC (Bring Your Own Cloud) Logs indexers and standalone compactors when you enable them. HPAs are disabled by default, and each component is configured independently.
21+
22+
## Before you begin
23+
24+
Before you enable autoscaling, you need:
25+
26+
- A BYOC Logs deployment installed with the `datadog/cloudprem` Helm chart.
27+
- Chart version `0.4.6` or later for standalone compactor autoscaling.
28+
- Kubernetes Metrics Server, or another metrics API implementation, installed in the cluster.
29+
- Enough node capacity for the maximum number of indexer and compactor pods.
30+
- CPU requests configured for autoscaled workloads.
31+
32+
CPU-based HPA calculations use the pod CPU request. Indexers get CPU requests from `indexer.podSize` or `indexer.resources.requests.cpu`. For standalone compactors, configure `compactor.resources.requests.cpu`.
33+
34+
## Enable indexer autoscaling
35+
36+
To enable the indexer HPA, set `indexer.autoscaling.enabled` to `true`:
37+
38+
```yaml
39+
indexer:
40+
autoscaling:
41+
enabled: true
42+
```
43+
44+
When you enable indexer autoscaling, the HPA controls the number of indexer pods and ignores `indexer.replicaCount`.
45+
46+
Default indexer HPA settings:
47+
48+
| Setting | Default | Description |
49+
|---|---:|---|
50+
| `indexer.autoscaling.minReplicas` | `2` | Minimum number of indexer pods |
51+
| `indexer.autoscaling.maxReplicas` | `10` | Maximum number of indexer pods |
52+
| CPU target | `70%` | Average CPU utilization target across indexer pods |
53+
54+
## Enable compactor autoscaling
55+
56+
To enable the compactor HPA, enable standalone compactors and set `compactor.autoscaling.enabled` to `true`:
57+
58+
```yaml
59+
enableStandaloneCompactors: true
60+
61+
compactor:
62+
autoscaling:
63+
enabled: true
64+
```
65+
66+
The chart creates the compactor HPA only when you set both `enableStandaloneCompactors` and `compactor.autoscaling.enabled` to `true`. When you enable compactor autoscaling, the HPA controls the number of compactor pods and ignores `compactor.replicaCount`.
67+
68+
Default compactor HPA settings:
69+
70+
| Setting | Default | Description |
71+
|---|---:|---|
72+
| `compactor.autoscaling.minReplicas` | `1` | Minimum number of compactor pods |
73+
| `compactor.autoscaling.maxReplicas` | `10` | Maximum number of compactor pods |
74+
| CPU target | `80%` | Average CPU utilization target across compactor pods |
75+
76+
## Override the defaults
77+
78+
Set `minReplicas` and `maxReplicas` alongside `enabled` to size the scaling range for your workload. Use the [Cluster Sizing][1] guide to pick a maximum that your node capacity supports:
79+
80+
```yaml
81+
indexer:
82+
autoscaling:
83+
enabled: true
84+
minReplicas: 4
85+
maxReplicas: 20
86+
```
87+
88+
## Apply the configuration
89+
90+
Add the autoscaling values to your BYOC Logs values file, then upgrade your release:
91+
92+
```shell
93+
helm upgrade <RELEASE_NAME> datadog/cloudprem \
94+
--namespace <NAMESPACE_NAME> \
95+
--values datadog-values.yaml
96+
```
97+
98+
## Verify the HPAs
99+
100+
List HPAs in the BYOC Logs namespace:
101+
102+
```shell
103+
kubectl get hpa -n <NAMESPACE_NAME>
104+
```
105+
106+
Describe an HPA to check metrics and recent scaling events:
107+
108+
```shell
109+
kubectl describe hpa <RELEASE_NAME>-indexer -n <NAMESPACE_NAME>
110+
kubectl describe hpa <RELEASE_NAME>-compactor -n <NAMESPACE_NAME>
111+
```
112+
113+
`<RELEASE_NAME>-indexer` and `<RELEASE_NAME>-compactor` are the default HPA names created by the chart. If you set `nameOverride` or `fullnameOverride`, use the resulting names instead.
114+
115+
If `kubectl get hpa` shows `<unknown>` in the `TARGETS` column, the HPA cannot read CPU metrics. Check that the metrics API is running and that the target pods have CPU requests.
116+
117+
## Further reading
118+
119+
{{< partial name="whats-next/whats-next.html" >}}
120+
121+
[1]: /byoc-logs/operate/sizing/

0 commit comments

Comments
 (0)