Analytics: 47.4% Bot Traffic in 2025 Demands New Schemas

Listen to this article · 9 min listen

Key Takeaways

  • Implement robust bot detection mechanisms, such as those offered by Cloudflare Bot Management or Akamai Bot Manager, to accurately filter non-human traffic before it skews analytics data.
  • Design your analytics schema with a dedicated field for “session_type” (e.g., human, bot, AI_agent) to categorize traffic at the point of ingestion, enabling granular analysis.
  • Regularly audit your analytics data for anomalies, particularly spikes in conversion rates or unusual navigation patterns, as these often indicate undetected non-human sessions.
  • Utilize advanced segmentation in your analytics platform to isolate and analyze AI agent data separately, understanding its unique impact on your digital properties without conflating it with human behavior.
  • Establish clear internal definitions for what constitutes a “non-human session” within your organization, ensuring consistent data labeling and reporting across teams.

A staggering 47.4% of all internet traffic in 2025 was non-human, a figure that continues to climb, fundamentally altering how we perceive and measure digital engagement. This dramatic shift demands a rethinking of how we attribute non-human sessions within our analytics schema. Are your current metrics truly reflecting human user behavior, or are they a distorted echo of AI agents and bots?

Data Point 1: The Exploding Share of Non-Human Traffic

According to a recent report by Imperva, non-human traffic accounted for 47.4% of all internet traffic in 2025, a significant increase from previous years. This isn’t just about malicious bots anymore; it includes a growing category of beneficial AI agents. When I first started in analytics over a decade ago, we were primarily concerned with filtering out spam bots and scrapers. Now, we’re talking about sophisticated AI models interacting with our sites, sometimes indistinguishably from a human user. This percentage underscores a critical challenge: if nearly half of your “sessions” aren’t human, how can you make informed business decisions about user experience, conversion funnels, or content effectiveness? You simply can’t. Your entire understanding of customer journeys becomes fundamentally flawed. My professional interpretation is that any analytics system failing to accurately segment and identify these sessions is essentially operating with a half-blindfold on. We need to move beyond simple bot filters. We need an analytics schema that anticipates and categorizes these interactions, not just discards them. Ignoring this data means you’re building products and marketing campaigns based on phantom users.

Data Point 2: The Rise of “Good Bots” and AI Agents

While malicious bots remain a significant threat, a substantial portion of non-human traffic now comes from “good bots” and AI agents. A 2025 study by Barracuda Networks found that these beneficial bots, including search engine crawlers, monitoring services, and legitimate AI assistants, constitute over 20% of all bot traffic. This figure is particularly fascinating because these aren’t sessions you necessarily want to block. You want Googlebot to crawl your site. You want your monitoring services to ensure uptime. The challenge lies in distinguishing these from human users in a way that doesn’t skew your core engagement metrics. Here’s my take: many organizations still lump all non-human traffic into a single “bot” category, or worse, allow it to inflate their human session counts. This is a missed opportunity. Imagine being able to analyze how AI agents are interacting with your API documentation versus how human developers are. Or understanding the crawl patterns of various search engines in granular detail. This requires a nuanced approach to your analytics schema design, one that includes specific dimensions for different types of non-human entities. We need to differentiate between a search engine spider and a generative AI model scraping content for training data. They have distinct purposes and impact your site differently.

Data Point 3: The Impact on Conversion Rates and User Behavior Metrics

Undetected non-human sessions can dramatically inflate or deflate key performance indicators (KPIs), leading to erroneous business decisions. I had a client last year, a medium-sized e-commerce retailer, who saw an inexplicable 15% jump in their add-to-cart rate over a quarter. They were ecstatic, pouring more budget into the campaigns they thought were driving this. We dug in. Turns out, a poorly configured scraping bot from a competitor was repeatedly adding items to carts to test pricing dynamics. Once we filtered those sessions out, their actual human add-to-cart rate was flat, even slightly down. This kind of misattribution costs money and wastes resources. This example illustrates a fundamental truth: if your baseline data is contaminated, all subsequent analysis is compromised. Your bounce rate, time on site, pages per session, and especially conversion rates, become unreliable. My professional opinion is that a dedicated field for “session_source_type” (e.g., ‘human’, ‘bot_crawler’, ‘ai_agent_scraper’, ‘internal_tool’) is no longer optional; it’s essential for any enterprise-level analytics setup. This allows for immediate segmentation and filtering, providing a cleaner view of human behavior. Without it, you’re constantly chasing ghosts in your data.

Data Point 4: The Growing Need for AI Agent Data Analysis

As generative AI becomes more prevalent, understanding how AI agents interact with your digital properties is becoming a strategic imperative, not just a data hygiene exercise. Companies are increasingly deploying their own AI agents to gather competitive intelligence, monitor market trends, or even interact with customer service portals. Forrester Research predicted in late 2025 that by 2027, over 30% of customer service interactions would involve AI agents on at least one side of the conversation. This isn’t just about website visits; it’s about API calls, app interactions, and data exchanges. My interpretation: we need to stop thinking of all non-human traffic as “noise” to be eliminated. Some of it is valuable, providing insights into how the evolving digital ecosystem perceives and interacts with your brand. We should be designing our analytics schema to capture and analyze this AI agent data specifically. What kind of content are they accessing? How frequently? Are they hitting rate limits? This data can inform your API design, content strategy, and even your competitive intelligence efforts. Ignoring it means missing a crucial piece of the future digital landscape. We need dimensions like `ai_agent_id`, `agent_purpose`, and `agent_origin` to truly understand this emerging segment.

Where I Disagree with Conventional Wisdom

Many analytics professionals still advocate for simply filtering out all non-human traffic at the earliest possible stage, often at the server or CDN level. While essential for basic data hygiene, I strongly disagree with the notion that all non-human sessions should be entirely removed from your data warehouse or even your raw logs. My experience has shown that this approach, while simplifying dashboards, throws out valuable information. Consider this: if you filter out all AI agent traffic before it even hits your analytics platform, you lose the ability to understand how your content is being consumed by these agents. Are they finding the information they need? Are they encountering errors? This data is crucial for optimizing your site for AI readability, which is becoming as important as human readability for discoverability and information dissemination. We should be identifying and tagging these sessions, not just deleting them. The conventional wisdom prioritizes clean human data above all else, but in 2026, a comprehensive understanding includes the non-human element. We need to shift from a “filter and forget” mindset to a “categorize and analyze” approach. In a recent project, we implemented a system for a SaaS company where we specifically tracked interactions from known AI agents accessing their public API documentation. By attributing these non-human sessions with specific `agent_type` and `agent_name` dimensions in their Segment implementation, they discovered that a significant portion of their API calls came from a specific type of language model being used by a large enterprise client for internal automation. This insight allowed their product team to prioritize API enhancements that directly benefited this high-value client, something they would have completely missed if they had simply blocked all bot traffic. The future of digital analytics isn’t just about understanding humans; it’s about understanding the complex interplay between human and non-human entities. A robust analytics schema that can accurately attribute and segment non-human sessions and AI agent data is no longer a luxury, but a fundamental requirement for informed decision-making in the AI-driven era. Failure to adapt will leave businesses making decisions based on incomplete, and often misleading, data.

What exactly constitutes a “non-human session” in analytics?

A non-human session refers to any interaction with a digital property (website, app, API) that is not initiated by a human user. This includes a wide range of entities such as malicious bots (scrapers, spammers), legitimate crawlers (search engine bots like Googlebot), monitoring services, and increasingly, sophisticated AI agents performing various tasks like data collection, content generation, or automated interactions.

Why is it important to differentiate between different types of non-human sessions?

Differentiating non-human sessions is crucial because not all non-human traffic is undesirable. While malicious bots need to be filtered to protect data integrity and security, legitimate bots and AI agents can provide valuable insights. Understanding their behavior helps in optimizing for search engine visibility, monitoring system health, and analyzing how AI models interact with your content or services, which can inform product development and content strategy.

How can I design my analytics schema to effectively attribute non-human sessions?

Effective schema design involves adding specific dimensions to categorize sessions. Key fields might include session_type (e.g., ‘human’, ‘bot’, ‘ai_agent’), bot_category (e.g., ‘crawler’, ‘scraper’, ‘monitor’), and potentially ai_agent_id or ai_agent_purpose for more granular AI agent data. This allows for flexible segmentation and analysis, providing a clearer picture of both human and non-human interactions.

What tools or methods are best for identifying non-human traffic?

Identifying non-human traffic typically involves a multi-layered approach. This includes server-side log analysis, client-side bot detection (e.g., JavaScript-based fingerprinting), and specialized bot management solutions like Cloudflare Bot Management or Akamai Bot Manager. These tools use behavioral analysis, IP reputation, and request headers to distinguish between human and automated interactions.

What are the risks of ignoring non-human sessions in my analytics?

Ignoring non-human sessions leads to significantly skewed data and flawed business decisions. It can inflate user counts, distort engagement metrics like bounce rate and time on site, and falsely impact conversion rates. This can result in misallocated marketing budgets, inefficient product development, and a fundamental misunderstanding of your actual customer base and their digital journey.

John Weber

Principal Research Scientist, AI Attribution Ph.D., Computer Science, Carnegie Mellon University

John Weber is a leading Principal Research Scientist at Veridian AI Labs, specializing in the intricate field of AI agent attribution. With 15 years of experience, he focuses on developing robust methodologies for tracing the provenance and decision-making processes of autonomous systems. His work at the forefront of digital forensics has been instrumental in establishing industry standards for accountability in AI. Weber's groundbreaking paper, "The Algorithmic Fingerprint: A Framework for AI Attribution," published in the Journal of Autonomous Systems, is widely cited