LLMS Central - The Robots.txt for AI
Industry News

UK small businesses are spending big on Anthropic — but OpenAI isn't far behind as expenditure on AI tools hits new high

TechRadar••1 min read
Share:
UK small businesses are spending big on Anthropic — but OpenAI isn't far behind as expenditure on AI tools hits new high

Original Article Summary

A surge in AI adoption has been identified among smaller UK firms, with Anthropic outgunning OpenAI among British SMEs.

Read full article at TechRadar

✨Our Analysis

Anthropic's surge in UK small business spending, outpacing OpenAI among British SMEs, highlights a rapid shift toward generative‑AI tools for everyday operations. For website owners, this means a noticeable uptick in automated traffic originating from Anthropic‑powered assistants (Claude, Claude‑2) and OpenAI’s ChatGPT integrations embedded in client sites, e‑commerce platforms, and SaaS dashboards. These bots often scrape product data, test forms, or generate content on‑the‑fly, which can inflate page‑view metrics, trigger false positives in security logs, and consume bandwidth. Moreover, the competitive spend race suggests that more firms will embed AI directly into their customer‑facing interfaces, increasing the diversity of bot signatures hitting your servers. **Actionable tips:** 1. **Update your llms.txt** to explicitly list Anthropic’s user‑agent patterns (e.g., `User‑Agent: ClaudeBot/*`) and OpenAI’s (`User‑Agent: OpenAI‑Bot/*`), assigning them a “crawl‑delay” that reflects your server capacity. 2. **Deploy real‑time bot detection** through llmscentral’s tracking dashboard, setting alerts for spikes in AI‑generated requests that exceed baseline thresholds. 3. **Implement rate‑limiting rules** for identified AI agents, throttling their access to high‑cost resources (API endpoints, image generation services) while allowing legitimate human traffic to flow unhindered.

Related Topics

OpenAIAnthropic

Track AI Bots on Your Website

See which AI crawlers like ChatGPT, Claude, and Gemini are visiting your site. Get real-time analytics and actionable insights.

Start Tracking Free →