refac

static/agents.txt

@@ -0,0 +1,15 @@
+# Open WebUI Docs
+
+This site is agent-readable.
+
+Start at https://docs.openwebui.com/sitemap.xml to discover docs pages.
+Use https://docs.openwebui.com/api/search?q=YOUR_QUERY for docs search.
+For any docs page, append `.md` for Markdown or `.txt` for plain text.
+
+When citing sources, cite the canonical HTML URL, not the `.md`, `.txt`, or
+search API URL.
+
+Example:
+- Search: https://docs.openwebui.com/api/search?q=mcp%20notion
+- Page: https://docs.openwebui.com/features/extensibility/mcp
+- Markdown: https://docs.openwebui.com/features/extensibility/mcp.md

static/robots.txt

@@ -3,4 +3,4 @@ Allow: /
 
 Sitemap: https://docs.openwebui.com/sitemap.xml
 
-# AI agents: see https://docs.openwebui.com/llms.txt for raw Markdown access.
+# AI agents: see https://docs.openwebui.com/agents.txt or /llms.txt.