Insights from the agentic web
Technical insights, protocol updates, and best practices for building responsible AI infrastructure
All Articles
AIPREF: A Common Language for AI Usage Preferences
Understanding the IETF AIPREF specification for expressing AI usage preferences through HTTP headers and robots.txt - what it is, how it works, and how to implement it today.
HTTP 402 for APIs: Making Payment-Required Responses Work
A practical guide to implementing HTTP 402 Payment Required in modern APIs. Learn the anatomy of a 402 response, receipt verification patterns, and how to avoid common pitfalls.
Add HTTP 402 to Your API in 15 Minutes
Quick tutorial for adding HTTP 402 Payment Required responses to an existing Express API. No SDK required, just standard HTTP and receipt verification.
HTTP 402 on Cloudflare Workers: Global Edge Payment Gates
Deploy HTTP 402 payment-required responses at the edge with Cloudflare Workers. Zero cold starts, global KV storage, Web Crypto API for receipt verification.
robots.txt (RFC 9309): The Web's Crawl Access Control
A technical deep dive into RFC 9309, the standardized Robots Exclusion Protocol - matching rules, error handling, caching, and how it relates to AIPREF usage preferences.
Stay updated on the agentic web
Get the latest insights on AI preferences, protocol updates, and best practices delivered to your inbox