Microsoft Launches NLWeb To Enable Agentic Websites

Microsoft introduced NLWeb, an open project and protocol that makes websites conversational and discoverable to AI agents, according to Microsoft News (May 2025). Per Microsoft, every NLWeb instance can act as a Model Context Protocol (MCP) server, exposing site content and optional capabilities to agents via endpoints such as /ask and /mcp (Microsoft News; Itnext deep dive). NLWeb leverages common web formats including Schema.org, RSS, sitemaps, and site feeds and combines them with LLMs and tooling to produce grounded natural-language responses, Microsoft states. Cloudflare and community posts (Cloudflare blog; TechCommunity Microsoft Foundry) outline complementary practices for making sites agent-ready: open bot-friendly crawling, up-to-date sitemaps and feeds, and consistent structured data. Several community deep dives and vendor guides provide implementation details and examples for .NET, static sites, and e-commerce publishers (C-SharpCorner; Itnext; Cloudflare).
What happened
Microsoft introduced NLWeb as an open project and protocol to turn websites into conversational, agent-ready endpoints, per Microsoft News (May 2025). The Microsoft announcement describes NLWeb as a way to "make it simple to create a rich, natural language interface for websites using the model of their choice and their own data," and notes that each NLWeb instance can act as a Model Context Protocol (MCP) server to make content discoverable to agents (Microsoft News). Third-party writeups and technical deep dives document how NLWeb surfaces a /ask interface for natural-language queries and an optional /mcp interface for capability discovery and agent tooling (Itnext deep dive; C-SharpCorner).
Technical details
Per Microsoft and community documentation, NLWeb relies on existing on-site, semi-structured signals: Schema.org JSON-LD, RSS/Atom feeds, and sitemaps. The project combines those signals with LLM-based enrichment and retrieval to produce grounded answers that are intended to be consumable by both human chat UIs and automated agents (Microsoft News; Itnext). Vendor and infrastructure posts (Cloudflare) describe architecture patterns and integrations that have emerged in practice:
- •support for multiple model providers and vector databases, per Microsoft News
- •exposing /ask for query/response and optional /mcp for agent-to-tool discovery, per Itnext
- •using feeds, sitemaps, and open crawler rules to improve agent discovery, per Microsoft Foundry blog and Cloudflare
Industry context
Editorial analysis: Industry reporting frames NLWeb as part of a broader push to make the web machine-readable for autonomous agents rather than only human browsers. Observers note that the same building blocks used for SEO and structured data can be repurposed to support agent interactions, reducing the need for bespoke chat integrations across surfaces (Itnext; Microsoft Foundry; Cloudflare). Past patterns show that open, interoperable protocols catalyze ecosystem tools and vendor plugins, which can accelerate adoption among CMS, e-commerce platforms, and CDN providers.
Practical implications for implementers
Editorial analysis: For practitioners, NLWeb shifts emphasis from building separate chat layers to publishing reliable, structured, and discoverable site data that agents can call. In practice, teams will likely focus on maintaining accurate Schema.org markup, providing feeds and sitemaps, and exposing stable /ask endpoints that return structured results suitable for downstream retrieval. Cloudflare documentation also emphasizes operational controls such as bot allowlisting, rate limits, and policy-driven access to prevent unwanted scraping and manage cost when agents call LLMs.
What to watch
Editorial analysis: Observers will watch adoption signals: CMS and e-commerce plugins that implement NLWeb hooks, CDN and bot-management vendor support for identified agent crawlers, and how MCP interoperates across agent runtimes. Another key indicator will be community libraries and reference servers that implement /ask and /mcp patterns, and whether tooling emerges to validate grounding and provenance of agent responses. Finally, platform-level safeguards and access-control patterns will be important as sites open machine-readable interfaces to external agents (Cloudflare; Microsoft Foundry).
Scoring Rationale
NLWeb is a notable, developer-facing protocol from Microsoft that could materially change how sites expose content to AI agents. It is not a frontier-model release, but it meaningfully affects integration patterns and tooling for web and AI practitioners.
Practice interview problems based on real data
1,500+ SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems


