Restore redirects for 18 /docs URLs still 404ing after the IA restructure

[jkodroff]

Summary

A set of /docs URLs still return 404 following the information-architecture restructure. They are receiving steady, real traffic — from both humans and AI crawlers — and each one is a missing redirect rather than a page that should genuinely be gone.

All paths below were verified live on 2026-07-13 and confirmed still 404 (following redirects).

Data

Source: CloudFront access logs (CLICKSTREAM.FCT_FRONTEND_CDN_PAGEVIEWS), 1 May – 30 Jun 2026, HTTP_STATUS = 404.

• 404s = all requests to that path over the two months.
• Agent 404s = the subset from self-identified AI crawlers (ChatGPT/GPTBot, ClaudeBot, PerplexityBot, Googlebot-AI, Amazonbot, etc.). These matter disproportionately: a 404 teaches the crawler the URL is dead, so it can drop out of assistant answers entirely.

Path	404s	Agent 404s
/docs/deployments/deployments/using/	276	22
/docs/get-started/azure/create-project/	257	23
/docs/clouds/aws/cloudfx/	216	11
/docs/guides/adopting/	202	16
/docs/iac/concepts/options/retainondelete/	201	91
/docs/intro/console/	177	7
/docs/get-started/azure/begin/	169	22
/docs/iac/guides/continuous-delivery/add-support-for-cicd-systems/	164	17
/docs/reference/tutorials/	164	4
/docs/reference/component-tutorial/	147	6
/docs/get-started/aws/review-project/	143	23
/docs/pulumi-cloud/access-management/oidc/client/github/	140	26
/docs/insights/policy/pre-built-packs/	132	6
/docs/iac/support/troubleshooting/	129	31
/docs/get-started/kubernetes/modify-program/	129	19
/docs/iac/crossguard/core-concepts/	—	53
/docs/iac/concepts/stacks/stackreference/	—	29
/docs/iac/cli/commands/pulumi_cloud_api_describe/	—	26

The last three sit below the reporting cutoff for total volume but are notable for how heavily crawlers hit them; counts shown are June-only agent 404s.

Suggested fix

Add redirects (or restore the pages) for each path above. Most map cleanly onto an existing destination in the current IA — e.g. /docs/iac/concepts/options/retainondelete/ → the current retainOnDelete resource-option page, and the /docs/get-started/* paths → their equivalents under the current getting-started flow.

Notes / scope

• Already fixed, so not included: the entire /docs/iac/guides/building-extending/* cluster (packages, components, providers) plus organizing-projects-stacks, concepts/plugins, resources/options/aliases, and the pulumi_stack_init / pulumi_plugin_ls / pulumi_plugin_rm CLI pages. These 404'd in May–June but return 200 as of today, presumably resolved by the July provider-docs consolidation.
• Deliberately excluded as noise, not doc pages: legacy Java/.NET API-reference assets under /docs/reference/pkg/* (*-search-index.js/zip, fonts), /docs/robots.txt, /docs/info/refs (git clone probes), /docs/.env (vulnerability scanning), and malformed inbound links with a trailing ) from external sites' broken markdown.

Separately, /docs/robots.txt alone drew ~688 crawler 404s in June; a redirect or an explicit 410 would quiet that.