The Complete AI Bot and Agent User-Agent Reference for WooCommerce: Every…

Which AI operators generate the most crawler traffic to websites?#

OpenAI bots — including ChatGPT-User, OAI-SearchBot, GPTBot, and ChatGPT Agent — account for approximately 69% of all observed AI-driven traffic by volume, followed by Meta-ExternalAgent at 16% and Anthropic at 11%. OpenAI 69%, Meta 16%, Anthropic 11% of all AI traffic volume (HUMAN Security, 2026)

This isn’t a theoretical future. The infrastructure is live, the transactions are happening, and the measurement gap is widening every week. GitHub agent-observatory dataset now tracks 28+ AI crawler signatures; Cloudflare split categories July 2026; new Chinese agents emerging monthly

Does DeepSeek publish a crawler user-agent string?#

No — DeepSeek does not publish a crawler user-agent, making its web fetches indistinguishable from regular browser traffic in server logs and impossible to block via robots.txt. DeepSeek-V3 matches GPT-4 benchmarks at roughly 1/37th the API cost, driving rapid adoption without any identifiable crawler footprint (xSeek, 2026)

The contamination compounds over time. Every untagged agent purchase that enters your conversion data trains your bidding algorithms on the wrong signals. Your cost per acquisition drifts upward, your audience targeting skews, and the root cause is invisible in standard reports.

DeepSeek-V3 matches GPT-4 benchmarks at roughly 1/37th the API cost, driving rapid adoption without any identifiable crawler footprint (xSeek, 2026).

How aggressive is ByteDance’s Bytespider crawler?#

Bytespider is extremely aggressive — it uses over 100,000 IP addresses and frequently ignores robots.txt directives, making it one of the most resource-intensive AI crawlers hitting WordPress sites. 100,000+ IP addresses used by Bytespider (Chinese AI Blocking Guide 2026, 2026)

The protocol standardizes what was previously fragmented. Before UCP, each AI platform needed custom integration work. With a single discovery endpoint, any compliant agent can find and transact with your store — which means the volume of agent transactions will accelerate as adoption spreads.

Related: adview_query_id Is Google’s AI Mode Attribution Stamp — Your WooCommerce Store Is Throwing It Away

What Chinese AI bots should WooCommerce store owners know about?#

The major Chinese AI crawlers include Bytespider and Doubao (ByteDance), DeepSeekBot (DeepSeek), Baiduspider (Baidu), Qwenbot and AlibabaBot (Alibaba), ChatGLM-Spider (Zhipu AI), and PanguBot (Huawei) — each with different levels of robots.txt compliance. Alibaba’s Qwen has over 113,000 derivative models on HuggingFace, making it the most-forked AI model globally (Chinese AI Blocking Guide / HuggingFace, 2026)

The 3.16% figure represents the current state, not the ceiling. Agent browsers are still learning checkout flows, and the WooCommerce MCP gives them a direct path that bypasses the browser entirely. As more agents gain purchasing capabilities, this percentage will climb — and with it, the urgency of having measurement in place.

Which AI referrer domains does GA4’s native AI Assistant channel detect?#

GA4’s native AI Assistant channel, launched May 13 2026, automatically detects ChatGPT, Gemini, DeepSeek, Copilot, and Grok — but misses Perplexity, Claude, Meta AI, Mistral, Kimi, and Doubao, which all land in generic Referral. ChatGPT dominates AI referral traffic at 76.85% global share, followed by Gemini at 9.0% and Perplexity at 7.73% (AuthorityTech / Statcounter April 2026, 2026)

The readability gap is a conversion bottleneck and a measurement blind spot in one. If an agent can’t parse your product specifications, it can’t buy. If it can’t buy, you don’t have an agent attribution problem — you have an agent revenue problem. Fixing machine-readability serves both.

Related: Google’s Qualified Future Conversions Metric — What WooCommerce Stores Need to Change

What is the regex pattern to catch all AI referral traffic in GA4?#

The working regex for a custom GA4 channel group is chatgpt.com|chat.openai.com|perplexity.ai|claude.ai|gemini.google.com|copilot.microsoft.com|meta.ai|chat.mistral.ai|deepseek.com — covering every major AI platform that passes a referrer header. GA4’s native channel only catches 5 of 12+ known AI referrer domains (Orbit Media Studios, 2026)

The Cyber Week data is the proof point that silences the “wait and see” argument. One in five purchases is not an edge case. It’s a channel. And if that channel’s revenue is sitting in your “direct” or “organic” buckets because your tracking can’t classify it, your channel allocation for the next quarter is wrong.

GA4’s native channel only catches 5 of 12+ known AI referrer domains (Orbit Media Studios, 2026).

What is dark AI traffic and why does it matter?#

Dark AI traffic occurs when mobile apps, in-app browsers, and copy-paste navigation strip the referrer header entirely — those sessions land as direct/none in GA4, meaning your measured AI referral number is a floor, not the real total. GA4 lost 15.8% of visitors who never saw a consent banner, and 55.6% of visitors who did — before dark AI traffic compounds the gap further (Clickport, 2026)

The plugin ecosystem is a leading indicator — when six independent developers all ship solutions to the same problem within months, the problem is real and growing. But detection without downstream routing creates a dashboard metric, not a measurement fix. The signal needs to reach your ad platforms.

How many known AI crawler user-agents exist as of 2026?#

The GeoPromptTracker dataset documents 28 known AI crawler and agent user-agent strings with verified operators and robots.txt compliance data, while WordPress plugins like citelayer track 62 distinct AI bot signatures. 62 distinct AI/LLM bot signatures tracked by citelayer plugin (citelayer WordPress plugin, 2026)

The 30-day window matters because bidding algorithms have a learning period. The longer contaminated data feeds the model, the deeper the drift. A clean audit now — matching WooCommerce order records against MCP request logs — tells you exactly how many agent purchases entered your conversion stream and which campaigns were affected.

Key Takeaways#

• Traffic To Websites: OpenAI bots — including ChatGPT-User, OAI-SearchBot, GPTBot, and ChatGPT Agent — account for approximately 69% of all observed AI-driven traffic by volume, followed by Meta-ExternalAgent at 16% and Anthropic at 11%.
• Crawler User-Agent String: No — DeepSeek does not publish a crawler user-agent, making its web fetches indistinguishable from regular browser traffic in server logs and impossible to block via robots.
• Bytedance’S Bytespider Crawler: Bytespider is extremely aggressive — it uses over 100,000 IP addresses and frequently ignores robots.
• Owners Know About: The major Chinese AI crawlers include Bytespider and Doubao (ByteDance), DeepSeekBot (DeepSeek), Baiduspider (Baidu), Qwenbot and AlibabaBot (Alibaba), ChatGLM-Spider (Zhipu AI), and PanguBot (Huawei) — each with different levels of robots.
• Assistant Channel Detect: GA4’s native AI Assistant channel, launched May 13 2026, automatically detects ChatGPT, Gemini, DeepSeek, Copilot, and Grok — but misses Perplexity, Claude, Meta AI, Mistral, Kimi, and Doubao, which all land in generic Referral.
• Traffic In Ga4: The working regex for a custom GA4 channel group is chatgpt.

References#

1. HUMAN Security (2026). Source
2. xSeek (2026). Source
3. Chinese AI Blocking Guide 2026 (2026). Source
4. AuthorityTech / Statcounter April 2026 (2026). Source
5. Orbit Media Studios (2026). Source
6. Clickport (2026). Source
7. citelayer WordPress plugin (2026). Source