Skip to content

DOCS-1430 - Improve LLM agent discoverability via head tag#6381

Merged
kimsauce merged 9 commits intomainfrom
llm-agent-discoverability
May 8, 2026
Merged

DOCS-1430 - Improve LLM agent discoverability via head tag#6381
kimsauce merged 9 commits intomainfrom
llm-agent-discoverability

Conversation

@kimsauce
Copy link
Copy Markdown
Collaborator

@kimsauce kimsauce commented Mar 5, 2026

Purpose of this pull request

Improve LLM agent discoverability via a <link rel="llms-txt"> tag and enriched llms.txt.

Adds a <link rel="llms-txt"> tag to the HTML head for machine discovery, and rewrites llms.txt from 6 entry points to a curated index of ~40 pages organized by doc section.

Select the type of change

  • Minor Changes - Typos, formatting, slight revisions
  • Update Content - Revisions, updating sections
  • New Content - New features, sections, pages, tutorials
  • Site and Tools - .clabot, version updates, maintenance, dependencies, new packages for the site (Docusaurus, Gatsby, React, etc.)

Ticket (if applicable)

https://sumologic.atlassian.net/browse/DOCS-1430

…nriched llms.txt

Agents don't know our llms.txt exists unless we tell them on every page.
This adds a lightweight agent directive (blockquote before the h1) on all
doc pages pointing to llms.txt, a <link rel="help"> tag in the HTML head
for machine discovery, and rewrites llms.txt from 6 entry points to a
structured index of ~140 pages across all doc sections.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@kimsauce kimsauce self-assigned this Mar 5, 2026
@cla-bot cla-bot Bot added the cla-signed Contributor approved, listed in .clabot file label Mar 5, 2026
@kimsauce kimsauce changed the title Improve LLM agent discoverability: top-of-page directive, link tag, and enriched llms.txt DOCS-1430 - Improve LLM agent discoverability (LLMs.txt, etc.) Mar 25, 2026
kimsauce and others added 2 commits April 17, 2026 02:57
Changes after merging main:
- Change <link rel="help"> to <link rel="llms-txt"> for better semantic clarity
- Simplify llms.txt: reduce from 140 entries to ~30 high-value pages
- Remove redundant text and focus on essential navigation
- Update last modified date

Note: Removed src/theme/DocItem/Layout component (top-of-page directive) -
this approach was too intrusive for human readers.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Comment thread static/llms.txt Outdated
@kimsauce kimsauce marked this pull request as ready for review April 17, 2026 10:25
@kimsauce kimsauce changed the title DOCS-1430 - Improve LLM agent discoverability (LLMs.txt, etc.) DOCS-1430 - Improve LLM agent discoverability via head tag Apr 17, 2026
@kimsauce kimsauce added the doc:site tech Site/tool maintenance, dependencies, updates label Apr 17, 2026
@kimsauce kimsauce enabled auto-merge May 8, 2026 00:49
@kimsauce kimsauce added this pull request to the merge queue May 8, 2026
Merged via the queue into main with commit 6cac996 May 8, 2026
4 checks passed
@kimsauce kimsauce deleted the llm-agent-discoverability branch May 8, 2026 00:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed Contributor approved, listed in .clabot file doc:site tech Site/tool maintenance, dependencies, updates

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants