Google Is Testing New Bot Authorization Standard via @sejournal, @martinibuster

Original Article Summary
Google is testing a cryptographic protocol for verifying bot traffic that could make unwanted crawlers easier to identify. The post Google Is Testing New Bot Authorization Standard appeared first on Search Engine Journal.
Read full article at Search Engine Journalâ¨Our Analysis
Google's testing of a new cryptographic protocol for verifying bot traffic via a bot authorization standard marks a significant development in the company's efforts to help website owners manage unwanted crawlers. This means that website owners may soon have a more reliable way to distinguish between legitimate and malicious bot traffic, potentially reducing the impact of spam bots and crawlers on their sites. With Google's new protocol, website owners could gain more control over which bots are allowed to access their content, enabling them to optimize their sites for legitimate search engine crawlers while blocking unwanted traffic. To prepare for this potential change, website owners can take several steps: review their current bot traffic patterns to identify potential issues, update their llms.txt files to reflect any changes in bot permissions, and monitor Google's updates on the new protocol to ensure they are ready to implement it when it becomes widely available.
Related Topics
Track AI Bots on Your Website
See which AI crawlers like ChatGPT, Claude, and Gemini are visiting your site. Get real-time analytics and actionable insights.
Start Tracking Free â


