{"id":74066,"date":"2025-07-07T07:00:00","date_gmt":"2025-07-07T14:00:00","guid":{"rendered":"https:\/\/dhblog.dream.press\/blog\/?p=74066"},"modified":"2025-10-01T08:52:42","modified_gmt":"2025-10-01T15:52:42","slug":"bot-traffic","status":"publish","type":"post","link":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/","title":{"rendered":"Bot Traffic Is on the Rise: Is Your Website Prepared?"},"content":{"rendered":"\n<p>For every human visiting your website, there are 3 bots.<\/p>\n\n\n\n<p>Surprised? We were too.<\/p>\n\n\n\n<p>But according to our internal data, we saw an average of 71.5% bot traffic since January 2025.<\/p>\n\n\n\n<p>AI crawlers from ChatGPT (9.16%), Claude (6.09%), and other LLMs show up regularly in our bot traffic data, while search engine bots like Googlebot represent just 7.57% of traffic.<\/p>\n\n\n\n<p>We can\u2019t just block them all because most bots are necessary. For instance, Googlebot helps your site show up in search, or ChatGPT bot cites your brand as a source in responses.<\/p>\n\n\n\n<p>But if you\u2019re seeing traffic spikes or spam entries in your contact forms, that\u2019s when you need to take action.<\/p>\n\n\n\n<h2 id=\"h-just-how-bad-has-the-bot-traffic-surge-become\" class=\"wp-block-heading\">Just How Bad Has the Bot Traffic Surge Become?<\/h2>\n\n\n\n<p>Here is a breakdown of the bot traffic we are seeing across our customer websites on the DreamHost network:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"1274\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x.webp\" alt=\"Bar chart showing top 10 bots by traffic on DreamHost\u2019s network, with WordPress bots, ChatGPT, and Amazonbot leading over the past 7 days.\" class=\"wp-image-74071 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-300x239.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-1024x815.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-768x612.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-1536x1223.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-600x478.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-1200x956.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-730x581.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-1460x1163.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-784x624.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-1568x1249.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/01-Most-Active-Bots-on-DreamHost_s-Network-Diagram_1x-877x698.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/1274;\" \/><\/figure>\n\n\n\n<p>The geographic patterns we observed are quite interesting, too.<\/p>\n\n\n\n<p><strong>Ireland leads bot traffic at 40.70% of daily visits<\/strong>, followed by Singapore at 13.04%. This geographic concentration is not just coincidence.<\/p>\n\n\n\n<p>Ireland hosts the European headquarters of almost every major US tech company \u2013 Google, Apple, Microsoft, Amazon, and Facebook \u2013 drawn by EU access, low corporate taxes, and an English-speaking workforce.<\/p>\n\n\n\n<p>Meanwhile, Singapore is the Asia-Pacific data center hub, with AWS, Microsoft Azure, and Google Cloud operating major facilities there to serve Asian markets with lower latency. When AI crawlers and cloud services scan websites, they&#8217;re often operating from server farms concentrated in these two strategic locations.<\/p>\n\n\n\n<p>Our findings are quite coherent with <a target=\"_blank\" href=\"https:\/\/www.imperva.com\/resources\/resource-library\/reports\/2025-bad-bot-report\/\">Imperva\u2019s Bad Bot Report 2025<\/a>, where 51% of all internet traffic now comes from automated sources, with 37% classified as malicious bots.<\/p>\n\n\n\n<p>The challenge lies in the gray area.<\/p>\n\n\n\n<p>Some AI training crawlers (like GPTBot) collect your content to train language models without providing direct traffic benefits back to your site.<\/p>\n\n\n\n<p>But whether these represent &#8220;good&#8221; or &#8220;bad&#8221; bots depends on how you feel about AI companies using your content for commercial purposes.<\/p>\n\n\n\n<h2 id=\"h2_good-bots-vs-bad-bots-whats-the-difference\" class=\"wp-block-heading\">Good Bots vs. Bad Bots: What\u2019s the Difference<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"1334\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x.webp\" alt=\"Donut chart showing 2023 web traffic breakdown: 49% human, 37% bad bot (up 5%), and 14% good bot (down 3.6%) year over year.\" class=\"wp-image-74072 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-300x250.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-1024x854.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-768x640.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-1536x1281.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-600x500.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-1200x1001.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-730x609.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-1460x1217.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-784x654.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-1568x1307.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/02-Bad-Bot-vs.-Good-Bots-vs.-Human_1x-877x731.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/1334;\" \/><\/figure>\n\n\n\n<p>Not all automated traffic deserves blocking. You need to know which bots help your business and which ones harm it before you take any action to manage bots on your website.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Good Bots That Benefit Your Site<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Search engine crawlers:<\/strong> For example, Googlebot and Bingbot index your content for search results.<\/li>\n\n\n\n<li><strong>Social media bots:<\/strong> Like FacebookExternalAgent generate link previews when users share your content.<\/li>\n\n\n\n<li><strong>Monitoring services:<\/strong> These check <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/pagespeed-insights-report\/\">your site&#8217;s uptime and performance<\/a>.<\/li>\n\n\n\n<li><strong>AI search crawlers:<\/strong> Like ChatGPT-User and Perplexity-User that cite your content when answering user queries.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Bad Bots That Drain Your Resources<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Content scrapers:<\/strong> These steal your articles, <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/how-to-write-product-descriptions\/\">product descriptions<\/a>, and images.<\/li>\n\n\n\n<li><strong>Form spam bots:<\/strong> They flood contact forms with junk submissions.<\/li>\n\n\n\n<li><strong>Price monitoring bots:<\/strong> From competitors tracking your pricing strategies.<\/li>\n\n\n\n<li><strong>Inventory hoarding bots:<\/strong> These add products to carts without purchasing.<\/li>\n\n\n\n<li><strong>Credential stuffing bots:<\/strong> They attempt to break into user accounts.<\/li>\n<\/ul>\n\n\n<div class=\"single__related-article\">\n\t<span>Related Article<\/span>\n\t<div class=\"single__related-article__wrap\">\n\t\t<div class=\"single__related-article__title\">\n\t\t\tHow To Stop Web Crawlers and Bots From Slowing Down Your Website\n\t\t<\/div>\n\t\t<a href=\"https:\/\/www-dev.dreamhost.com\/blog\/block-web-crawlers\/\" class=\"btn btn--sm btn--brand\" target=\"_blank\" rel=\"noopener\">\n\t\t\tRead More\n\t\t<\/a>\n\t<\/div>\n<\/div>\n\n\n<h2 id=\"h2_the-hidden-costs-hitting-your-small-business-site\" class=\"wp-block-heading\">The Hidden Costs Hitting Your Small Business Site<\/h2>\n\n\n\n<p>Irrespective of the type of bot, automated traffic impacts your website in three critical areas:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Hosting expenses<\/li>\n\n\n\n<li>Security risks<\/li>\n\n\n\n<li>Data accuracy<\/li>\n<\/ul>\n\n\n\n<p>Each bot visit consumes server resources just like a human visitor, but <em>without<\/em> any potential for conversions, engagement, or revenue.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">1. Your Infrastructure Costs Keep Climbing<\/h3>\n\n\n\n<p><strong>Every bot request uses your bandwidth, processing power, and storage.<\/strong><\/p>\n\n\n\n<p>If you have a content-heavy site or e-commerce platform, you are likely to see this hit your wallet fast.<\/p>\n\n\n\n<p>The Read the Docs project <a target=\"_blank\" href=\"https:\/\/arstechnica.com\/ai\/2025\/03\/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries\/\">reduced traffic by 75%<\/a> after blocking AI crawlers and went from serving 800GB to 200GB daily, saving $1,500 per month in bandwidth costs.<\/p>\n\n\n\n<p>If you\u2019re on a <a href=\"https:\/\/www.dreamhost.com\/hosting\/\" target=\"_blank\" rel=\"noreferrer noopener\">shared web hosting plan<\/a>, you won\u2019t see direct costs.<\/p>\n\n\n\n<p>Excessive bot traffic, however, can trigger your host to throttle site performance. More aggressive bot activity can push you toward requiring a <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/hosting\/vps\/\">VPS<\/a> or <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/hosting\/dedicated\/\">dedicated hosting solutions<\/a> earlier than you planned.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2. Security and Spam Problems Get Worse<\/h3>\n\n\n\n<p><strong>Malicious bots target your contact forms, login pages, and checkout processes.<\/strong><\/p>\n\n\n\n<p>They look for vulnerabilities, attempt <a target=\"_blank\" href=\"https:\/\/owasp.org\/www-community\/attacks\/Credential_stuffing\">credential stuffing attacks<\/a>, and also flood forms with junk submissions. Since most websites have just basic security, they become an attractive target.<\/p>\n\n\n\n<p>If your contact forms or blog comments have spam entries, I\u2019d suggest immediately <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/akismet-block-spam-wordpress\/\">installing Askimet<\/a> to see spam entries will go down. Remember, though, Askimet does not block bot traffic.<\/p>\n\n\n\n<p>You need to take steps to block bots yourself (more on that in a bit).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">3. Your Analytics Data Gets Contaminated<\/h3>\n\n\n\n<p><strong>Bot traffic messes up your website analytics.<\/strong><\/p>\n\n\n\n<p>When bots visit pages, they don&#8217;t engage with content, creating artificially high traffic numbers with zero <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/increase-website-conversion-rate\/\">conversion rates<\/a>.<\/p>\n\n\n\n<p>This contamination makes it almost impossible for you to measure real user behavior, optimize conversion funnels, or make data-driven marketing decisions.<\/p>\n\n\n\n<p>And even if Google Analytics lets you filter traffic to narrow down the analysis, it&#8217;s difficult to distinguish bot traffic from regular human visitors.<\/p>\n\n\n\n<div class=\"article-newsletter article-newsletter--gradient\">\n\n\n<h2>Get Content Delivered Straight to Your Inbox<\/h2><p>Subscribe now to receive all the latest updates, delivered directly to your inbox.<\/p><form class=\"nwsl-form\" id=\"newsletter_block_\" novalidate><div class=\"messages\"><\/div><div class=\"form-group\"><label for=\"input_newsletter_block_\"><input type=\"email\"name=\"email\"id=\"input_newsletter_block_\"placeholder=\"Enter your email address\"novalidatedisabled=\"disabled\"\/><\/label><button type=\"submit\"class=\"btn btn--brand\"disabled=\"disabled\"><span>Sign Me Up!<\/span><svg width=\"21\" height=\"14\" viewBox=\"0 0 21 14\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n<path d=\"M13.8523 0.42524L12.9323 1.34521C12.7095 1.56801 12.7132 1.9304 12.9404 2.14865L16.7241 5.7823H0.5625C0.251859 5.7823 0 6.03416 0 6.3448V7.6573C0 7.96794 0.251859 8.2198 0.5625 8.2198H16.7241L12.9405 11.8535C12.7132 12.0717 12.7095 12.4341 12.9323 12.6569L13.8523 13.5769C14.072 13.7965 14.4281 13.7965 14.6478 13.5769L20.8259 7.39879C21.0456 7.17913 21.0456 6.82298 20.8259 6.60327L14.6477 0.42524C14.4281 0.205584 14.0719 0.205584 13.8523 0.42524Z\" fill=\"white\"\/>\n<\/svg>\n<\/button><\/div><\/form><\/div>\n\n\n<h2 id=\"h2_where-to-look-for-bot-traffic-on-your-site\" class=\"wp-block-heading\">Where To Look for Bot Traffic on Your Site<\/h2>\n\n\n\n<p>There is currently no foolproof way to find all bot traffic since advanced bots are virtually indistinguishable from human visitors.<\/p>\n\n\n\n<p>But there are certain steps you can take to start monitoring.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">1. Start With DreamHost Panel\u2019s Traffic Dashboard<\/h3>\n\n\n\n<p>If you\u2019re hosting with DreamHost, you\u2019re already one step ahead. <a target=\"_blank\" href=\"https:\/\/help.dreamhost.com\/hc\/en-us\/articles\/33447779990292-Viewing-bots-on-the-traffic-panel-page\">The Traffic tab<\/a> in your DreamHost panel gives you a clear view of traffic activity, including bot behavior. You can monitor spikes, detect anomalies, and track how many bots may be impacting your site, all without needing a third-party tool.<\/p>\n\n\n\n<p>Our panel helps you:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Distinguish between human and bot traffic at a glance<\/li>\n\n\n\n<li>View traffic by IP, referrer, or user agent<\/li>\n\n\n\n<li>Spot patterns early so you can take action fast<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"1035\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x.webp\" alt=\"Traffic dashboard highlighting bot activity over 7 days, with traffic sources broken down by AI, search engine, and social bots.\" class=\"wp-image-74068 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-300x194.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-1024x662.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-768x497.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-1536x994.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-600x388.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-1200x776.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-730x472.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-1460x944.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-784x507.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-1568x1014.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/03-Start-With-DreamHost-Panels-Traffic-Dashboard_1x-877x567.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/1035;\" \/><\/figure>\n\n\n\n<p>This is especially helpful for users who prefer built-in tools over complicated dashboards. Bonus \u2013 No extra configuration is needed!<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2. Dig in With Google Analytics<\/h3>\n\n\n\n<p>Look at your <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/analytics-intelligence-ga4\/\">Google Analytics<\/a> dashboard for these telltale signs of heavy bot activity:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Traffic spikes with corresponding bounce rate increases<\/li>\n\n\n\n<li>High page views with zero time on page<\/li>\n\n\n\n<li>Unusual geographic traffic patterns (sudden traffic from countries where you don&#8217;t operate)<\/li>\n\n\n\n<li>Referrer spam from unfamiliar domains<\/li>\n<\/ul>\n\n\n\n<p>Go to <strong>Reports<\/strong> \u2192 <strong>Tech<\/strong> and use GA4\u2019s tech filtering to narrow down to user technology.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"914\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x.webp\" alt=\"screenshot of Google Analytics report\" class=\"wp-image-74069 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-300x171.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-1024x585.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-768x439.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-1536x877.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-600x343.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-1200x686.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-730x417.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-1460x834.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-784x448.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-1568x896.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/04-Start-With-Google-Analytics_1x-877x501.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/914;\" \/><\/figure>\n\n\n\n<p>Here, you can start filtering by browser and operating system, screen resolutions, device, app versions, etc. What you\u2019re looking for are uncommon browsers, strange operating systems, and uncommon screen resolutions like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>1024 x 768<\/li>\n\n\n\n<li>1366 x 768<\/li>\n\n\n\n<li>1600 x 864<\/li>\n\n\n\n<li>800 x 600<\/li>\n\n\n\n<li>1600 x 1200<\/li>\n\n\n\n<li>1024 x 667<\/li>\n\n\n\n<li>Not Specified<\/li>\n<\/ul>\n\n\n\n<p>This would cut some real visitors from your tracking, but you\u2019ll also see many fewer bot entries in the analytics data.<\/p>\n\n\n\n<p><strong>Note:<\/strong> Advanced bots can use normal resolutions and the latest device versions to disguise their activity. Those are extremely difficult to filter out for analysis unless you begin to screen visitors before they can view your website.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">3. Check Your Server Logs<\/h3>\n\n\n\n<p>If you have access to your hosting <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/control-panel\/\">control panel<\/a>, look at your server access logs for patterns that indicate automated traffic:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Rapid-fire requests from single IP addresses.<\/li>\n\n\n\n<li>Requests to non-existent pages (often bots probing for vulnerabilities).<\/li>\n\n\n\n<li>User agents identifying as known crawlers (both good and bad).<\/li>\n\n\n\n<li>Requests with no referrer information.<\/li>\n<\/ul>\n\n\n\n<p>Many hosting providers, including DreamHost, offer log analysis tools in their control panels. Look for unusual spikes in bandwidth usage that don&#8217;t correspond with marketing campaigns or content updates.<\/p>\n\n\n\n<p>Once you have a list of IP addresses that seem to be repeat offenders, you can start blocking the IP addresses either from your web server, like <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/nginx-vs-apache\/\">NGINX or Apache<\/a>, or from a CDN.<\/p>\n\n\n\n\n\n<div class=\"glossary-term\">\n\t<a\n\t\tclass=\"glossary-term__above-title\"\n\t\thref=\"\"\n\t\ttarget=\"_blank\"\n\t\trel=\"noopener noreferrer\"\n\t>\n\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 640 512\"><path d=\"M320 32c-8.1 0-16.1 1.4-23.7 4.1L15.8 137.4C6.3 140.9 0 149.9 0 160s6.3 19.1 15.8 22.6l57.9 20.9C57.3 229.3 48 259.8 48 291.9v28.1c0 28.4-10.8 57.7-22.3 80.8c-6.5 13-13.9 25.8-22.5 37.6C0 442.7-.9 448.3 .9 453.4s6 8.9 11.2 10.2l64 16c4.2 1.1 8.7 .3 12.4-2s6.3-6.1 7.1-10.4c8.6-42.8 4.3-81.2-2.1-108.7C90.3 344.3 86 329.8 80 316.5V291.9c0-30.2 10.2-58.7 27.9-81.5c12.9-15.5 29.6-28 49.2-35.7l157-61.7c8.2-3.2 17.5 .8 20.7 9s-.8 17.5-9 20.7l-157 61.7c-12.4 4.9-23.3 12.4-32.2 21.6l159.6 57.6c7.6 2.7 15.6 4.1 23.7 4.1s16.1-1.4 23.7-4.1L624.2 182.6c9.5-3.4 15.8-12.5 15.8-22.6s-6.3-19.1-15.8-22.6L343.7 36.1C336.1 33.4 328.1 32 320 32zM128 408c0 35.3 86 72 192 72s192-36.7 192-72L496.7 262.6 354.5 314c-11.1 4-22.8 6-34.5 6s-23.5-2-34.5-6L143.3 262.6 128 408z\"\/><\/svg>\n\t\t<span><\/span>\n\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 384 512\"><path d=\"M342.6 233.4c12.5 12.5 12.5 32.8 0 45.3l-192 192c-12.5 12.5-32.8 12.5-45.3 0s-12.5-32.8 0-45.3L274.7 256 105.4 86.6c-12.5-12.5-12.5-32.8 0-45.3s32.8-12.5 45.3 0l192 192z\"\/><\/svg>\n\t<\/a>\n    <h3>CDN<\/h3>\n    <p>CDN is an abbreviation for \u201cContent Delivery Network\u201d. It refers to a geographically-distributed network of web servers (and their data centers). The entities that make up a CDN collaborate to ensure speedy content delivery via the internet.<\/p>\n            <a\n            href=\"https:\/\/www.dreamhost.com\/glossary\/hosting\/cdn\/\"\n                        class=\"btn btn--white-outline btn--sm btn--round\"\n                                    target=\"_blank\"\n            rel=\"noopener noreferrer\"\n            >\n                            Read More                    <\/a>\n\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\">4. Use Third-Party Monitoring Tools<\/h3>\n\n\n\n<p>Sometimes, you can only identify so much traffic. Which is why there are free, third-party tools like Cloudflare Analytics (if you use their service) which provide bot traffic breakdowns.<\/p>\n\n\n\n<p>There are also other comprehensive apps like:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Wordfence:<\/strong> For WordPress sites; identifies malicious bot attempts<\/li>\n\n\n\n<li><strong>Sucuri:<\/strong> Offers website firewall services with bot detection<\/li>\n\n\n\n<li><strong>MonsterInsights:<\/strong> Provides enhanced Google Analytics reporting with bot filtering<\/li>\n<\/ul>\n\n\n\n<h2 id=\"h2_managing-and-blocking-bad-bots-without-hurting-the-good-ones\" class=\"wp-block-heading\">Managing and Blocking Bad Bots Without Hurting the Good Ones<\/h2>\n\n\n\n<p>I recommend going slow on blocking bot traffic because you could accidentally block real users as well. And you also need a balanced approach that blocks harmful automated traffic while preserving beneficial crawlers.<\/p>\n\n\n\n<p>Here&#8217;s how I would implement bot management without accidentally blocking search engines or legitimate services.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Set Up Your robots.txt File<\/h3>\n\n\n\n<p>Your <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/glossary\/seo\/robots-txt-file\/\">robots.txt file<\/a> serves as the first line of defense against unwanted crawlers.<\/p>\n\n\n\n<p>Create or update the file in your website&#8217;s root directory with specific instructions for different bot types:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># Block AI training crawlers\nUser-agent: GPTBot\nDisallow: \/\n\nUser-agent: anthropic-ai\nDisallow: \/\n\nUser-agent: Google-Extended\nDisallow: \/\n\n# Allow search engines\nUser-agent: Googlebot\nAllow: \/\n\nUser-agent: Bingbot\nAllow: \/\n\n# Allow AI search bots that cite sources\nUser-agent: ChatGPT-User\nAllow: \/\n\nUser-agent: PerplexityBot\nAllow: \/<\/code><\/pre>\n\n\n\n<p>If you don\u2019t have direct access to the robots.txt file and use WordPress, you could try using the <a target=\"_blank\" href=\"https:\/\/wordpress.org\/plugins\/wp-robots-txt\/\">WP Robots Txt<\/a> plugin that lets you edit the file from your WordPress dashboard.<\/p>\n\n\n\n<p>Keep in mind that robots.txt operates on an honor system. Well-behaved crawlers respect these directives, but malicious bots often ignore the file entirely.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Implement a Website Firewall<\/h3>\n\n\n\n<p>For more aggressive <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/secure-your-wordpress-website\/\">website security<\/a>, implement a <a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/web-application-firewall\/\">Web Application Firewall (WAF)<\/a> that can block bots at the server level.<\/p>\n\n\n\n<p>You also have a couple more options as a small business owner managing low-volume websites.<\/p>\n\n\n\n<p><strong>Cloudflare Free Plan:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Provides basic bot fighting capabilities<\/li>\n\n\n\n<li>Blocks obvious malicious traffic automatically<\/li>\n\n\n\n<li>Offers customizable firewall rules for specific threats<\/li>\n<\/ul>\n\n\n\n<p><strong>Wordfence (WordPress Users):<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Includes bot detection and blocking features<\/li>\n\n\n\n<li>Real-time threat intelligence updates<\/li>\n\n\n\n<li>Customizable rate limiting to prevent rapid-fire requests<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Server-Level Rate Limiting<\/h4>\n\n\n\n<p>Many hosting providers offer rate-limiting features that automatically slow down or block IP addresses making too many requests in short timeframes. You can configure these rate limiters to block IP addresses that browse too many pages in a very short span of time.<\/p>\n\n\n\n<p>For instance, a normal human would require a couple of seconds to look around on a page before clicking on different links. A bot would take milliseconds to do the same.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Plugin Solutions for WordPress Sites<\/h3>\n\n\n\n<p>If you&#8217;re running WordPress, you have additional options for bot management:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a target=\"_blank\" href=\"https:\/\/automattic.pxf.io\/daXbzW\"><strong>Akismet<\/strong><\/a><strong>:<\/strong> Automatically filters comment and form spam with 99.99% accuracy using advanced AI filtering. Essential for any WordPress site accepting user submissions.<\/li>\n\n\n\n<li><a target=\"_blank\" href=\"https:\/\/wpcerber.com\/\"><strong>WP Cerber Security<\/strong><\/a><strong>:<\/strong> Provides comprehensive bot protection, including login attempt limiting, IP blocking, and advanced bot detection algorithms.<\/li>\n\n\n\n<li><a target=\"_blank\" href=\"https:\/\/wordpress.org\/plugins\/all-in-one-wp-security-and-firewall\/\"><strong>All-In-One Security (AIOS)<\/strong><\/a><strong>:<\/strong> Offers firewall features and bot blocking capabilities suitable for small business websites.<\/li>\n<\/ul>\n\n\n\n<h2 id=\"h2_your-complete-bot-protection-implementation-path\" class=\"wp-block-heading\">Your Complete Bot Protection Implementation Path<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1600\" height=\"1187\" data-src=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x.webp\" alt=\"Four-stage timeline showing how bot protection improves over time, from quick fixes to advanced defenses.\" class=\"wp-image-74070 lazyload\" data-srcset=\"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x.webp 1600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-300x223.webp 300w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-1024x760.webp 1024w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-768x570.webp 768w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-1536x1140.webp 1536w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-600x445.webp 600w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-1200x890.webp 1200w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-730x542.webp 730w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-1460x1083.webp 1460w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-784x582.webp 784w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-1568x1163.webp 1568w, https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/05-Your-Bot-Protection-Journey_1x-877x651.webp 877w\" data-sizes=\"(max-width: 1600px) 100vw, 1600px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 1600px; --smush-placeholder-aspect-ratio: 1600\/1187;\" \/><\/figure>\n\n\n\n<p>I\u2019ve split this implementation plan so it fits within tight schedules and helps you go from zero protection to a working bot defense within a short time.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">20 Minutes: Quick Wins<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Update robots.txt file<\/li>\n\n\n\n<li>Enable basic security \u200b\u200bplugins&nbsp;<\/li>\n\n\n\n<li>Check Google Analytics for bot patterns<\/li>\n<\/ul>\n\n\n\n<p><strong>Start with your robots.txt file because it&#8217;s the easiest first step.<\/strong> Log into your website&#8217;s file manager (or use FTP) and create or update the robots.txt file in your root directory. Copy the robots.txt configuration from earlier in this article and paste it in.<\/p>\n\n\n\n<p><strong>If you&#8217;re running WordPress, install and activate the Wordfence security plugin right now.<\/strong> The free version includes basic bot protection and will start blocking obvious malicious traffic immediately.<\/p>\n\n\n\n<p><strong>Open Google Analytics to check your traffic sources for unusual patterns.<\/strong> Look for countries you don&#8217;t serve, sudden traffic spikes, or high bounce rates with zero session duration.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">24 Hours: Layer Your Defense<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Set up a free Cloudflare account<\/li>\n\n\n\n<li>Configure rate limiting<\/li>\n\n\n\n<li><a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/complete-guide-to-recaptcha\/\">Add CAPTCHA<\/a> to forms<\/li>\n\n\n\n<li>Enable comment moderation<\/li>\n<\/ul>\n\n\n\n<p><strong>Sign up for a <\/strong><a target=\"_blank\" href=\"https:\/\/www.cloudflare.com\/en-in\/plans\/free\/\"><strong>free Cloudflare account<\/strong><\/a><strong> and add your website.<\/strong> Cloudflare sits between your site and visitors, automatically blocking obvious bot traffic before it hits your server. Setup takes about 30 minutes and includes changing DNS settings, but Cloudflare walks you through each step.<\/p>\n\n\n\n<p><strong>Set rate limiting through your host to automatically<\/strong> <strong>slow down or block IP addresses making too many requests.<\/strong> Configure limits that allow normal browsing (a few seconds per page) but stop aggressive crawlers (multiple pages per second).<\/p>\n\n\n\n<p><strong>Add CAPTCHA to vulnerable forms using the reCAPTCHA plugin<\/strong> <strong>for WordPress or <\/strong><a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/captcha-alternative\/\"><strong>Cloudflare Turnstile<\/strong><\/a><strong>.<\/strong> Add invisible CAPTCHA to contact forms, comment sections, and user registration pages to stop automated submissions without annoying real users.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">One Week: Monitor and Optimize<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Analyze server logs<\/li>\n\n\n\n<li>Fine-tune firewall rules<\/li>\n\n\n\n<li>Set up monitoring alerts&nbsp;<\/li>\n\n\n\n<li>Block problem IP ranges<\/li>\n<\/ul>\n\n\n\n<p><strong>Analyze your server access logs to identify bot patterns specific to your site.<\/strong> Look for rapid-fire requests from single IP addresses, requests to non-existent pages, and suspicious user agent strings. Most hosting control panels include log analysis tools that make this easier.<\/p>\n\n\n\n<p><strong>Use this data to create custom firewall rules in Cloudflare or your security plugin.<\/strong> For example, if you notice bots from specific countries consistently causing problems, you can block entire geographic regions. Or if certain user agents keep hitting your site aggressively, block those specific strings.<\/p>\n\n\n\n<p><strong>Set up monitoring alerts so you know when bot traffic spikes happen.<\/strong> Tools like <a target=\"_blank\" href=\"https:\/\/uptimerobot.com\/\">UptimeRobot<\/a> or <a target=\"_blank\" href=\"https:\/\/tools.pingdom.com\/\">Pingdom<\/a> can alert you to unusual traffic patterns, slow loading times, or server resource spikes that might indicate a bot attack.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">One Month: Advanced Protection<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Implement behavioral analysis<\/li>\n\n\n\n<li>Deploy API rate limiting<\/li>\n\n\n\n<li>Set up CDN caching<\/li>\n\n\n\n<li>Create bot honeypots<\/li>\n<\/ul>\n\n\n\n<p><strong>Add behavioral analysis tools like DataDome or Imperva that detect bots by analyzing mouse movements, typing patterns, and page interaction timing.<\/strong> These catch sophisticated bots that mimic human behavior.<\/p>\n\n\n\n<p><strong>Use a CDN to <\/strong><a target=\"_blank\" href=\"https:\/\/www.dreamhost.com\/blog\/a-comprehensive-guide-to-website-caching\/\"><strong>cache static resources<\/strong><\/a><strong> aggressively.<\/strong> This way, bot traffic hits the cache, not your host, reducing the load from repeated requests.<\/p>\n\n\n\n<p><strong>One of my favorite techniques is creating bot honeypots.<\/strong> If you see a lot of form spam, add an extra hidden field to the form. Since bots look at the page HTML while filling forms, they will see this hidden field and add some data to it. You can safely delete all form entries that have any text in the hidden field because a human visitor cannot see it.<\/p>\n\n\n\n<h2 id=\"h2_the-future-of-bot-traffic-management\" class=\"wp-block-heading\">The Future of Bot Traffic Management<\/h2>\n\n\n\n<p>Bot traffic isn&#8217;t going away. With 71.5% of visits to our network coming from automated sources, robots now outnumber humans 3 to 1 on the internet.<\/p>\n\n\n\n<p>But while most website owners are still figuring out what\u2019s happening, you have everything you need to turn this bot chaos around for your business and even benefit from the good bots.<\/p>\n\n\n\n<p>So go forth and begin implementing bot management systems while your competition is still panicking about the fake traffic!<\/p>\n\n\n\n<div class=\"article-newsletter article-newsletter--gradient\">\n\n\n<h2>Get Content Delivered Straight to Your Inbox<\/h2><p>Subscribe now to receive all the latest updates, delivered directly to your inbox.<\/p><form class=\"nwsl-form\" id=\"newsletter_block_\" novalidate><div class=\"messages\"><\/div><div class=\"form-group\"><label for=\"input_newsletter_block_\"><input type=\"email\"name=\"email\"id=\"input_newsletter_block_\"placeholder=\"Enter your email address\"novalidatedisabled=\"disabled\"\/><\/label><button type=\"submit\"class=\"btn btn--brand\"disabled=\"disabled\"><span>Sign Me Up!<\/span><svg width=\"21\" height=\"14\" viewBox=\"0 0 21 14\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n<path d=\"M13.8523 0.42524L12.9323 1.34521C12.7095 1.56801 12.7132 1.9304 12.9404 2.14865L16.7241 5.7823H0.5625C0.251859 5.7823 0 6.03416 0 6.3448V7.6573C0 7.96794 0.251859 8.2198 0.5625 8.2198H16.7241L12.9405 11.8535C12.7132 12.0717 12.7095 12.4341 12.9323 12.6569L13.8523 13.5769C14.072 13.7965 14.4281 13.7965 14.6478 13.5769L20.8259 7.39879C21.0456 7.17913 21.0456 6.82298 20.8259 6.60327L14.6477 0.42524C14.4281 0.205584 14.0719 0.205584 13.8523 0.42524Z\" fill=\"white\"\/>\n<\/svg>\n<\/button><\/div><\/form><\/div>","protected":false},"excerpt":{"rendered":"<p>Bot traffic is rising, and it\u2019s hurting small business sites. If bots are hogging your bandwidth or flooding you with spam, here\u2019s how to stop them.<\/p>\n","protected":false},"author":1070,"featured_media":74067,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_yoast_wpseo_metadesc":"Bot traffic is rising, and it\u2019s hurting small business sites. If bots are hogging your bandwidth or flooding you with spam, here\u2019s how to stop them.","toc_headlines":"[[\"h-just-how-bad-has-the-bot-traffic-surge-become\",\"Just How Bad Has the Bot Traffic Surge Become?\"],[\"h2_good-bots-vs-bad-bots-whats-the-difference\",\"Good Bots vs. Bad Bots: What\u2019s the Difference\"],[\"h2_the-hidden-costs-hitting-your-small-business-site\",\"The Hidden Costs Hitting Your Small Business Site\"],[\"h2_where-to-look-for-bot-traffic-on-your-site\",\"Where To Look for Bot Traffic on Your Site\"],[\"h2_managing-and-blocking-bad-bots-without-hurting-the-good-ones\",\"Managing and Blocking Bad Bots Without Hurting the Good Ones\"],[\"h2_your-complete-bot-protection-implementation-path\",\"Your Complete Bot Protection Implementation Path\"],[\"h2_the-future-of-bot-traffic-management\",\"The Future of Bot Traffic Management\"]]","hide_toc":false,"footnotes":""},"categories":[10025],"tags":[],"class_list":["post-74066","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-talk"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.3 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Bot Traffic Is on the Rise, Prepare Your Website - DreamHost<\/title>\n<meta name=\"description\" content=\"Bot traffic is rising, and it\u2019s hurting small business sites. If bots are hogging your bandwidth or flooding you with spam, here\u2019s how to stop them.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Bot Traffic Is on the Rise. Is Your Website Prepared?\" \/>\n<meta property=\"og:description\" content=\"71.5% of web traffic is now bots. Learn how to manage AI crawlers, reduce hosting costs, and stop spam without losing SEO benefits.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/\" \/>\n<meta property=\"og:site_name\" content=\"DreamHost Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DreamHost\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-07T14:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-01T15:52:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/1220x628_OGIMAGE_Bot-Traffic-Is-on-the-Rise_-Is-Your-Website-Prepared__1x.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Josh Helmuth\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Bot Traffic Is on the Rise. Is Your Website Prepared?\" \/>\n<meta name=\"twitter:description\" content=\"71.5% of web traffic is now bots. Learn how to manage AI crawlers, reduce hosting costs, and stop spam without losing SEO benefits.\" \/>\n<meta name=\"twitter:creator\" content=\"@dreamhost\" \/>\n<meta name=\"twitter:site\" content=\"@dreamhost\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Josh Helmuth\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"12 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Bot Traffic Is on the Rise, Prepare Your Website - DreamHost","description":"Bot traffic is rising, and it\u2019s hurting small business sites. If bots are hogging your bandwidth or flooding you with spam, here\u2019s how to stop them.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/","og_locale":"en_US","og_type":"article","og_title":"Bot Traffic Is on the Rise. Is Your Website Prepared?","og_description":"71.5% of web traffic is now bots. Learn how to manage AI crawlers, reduce hosting costs, and stop spam without losing SEO benefits.","og_url":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/","og_site_name":"DreamHost Blog","article_publisher":"https:\/\/www.facebook.com\/DreamHost\/","article_published_time":"2025-07-07T14:00:00+00:00","article_modified_time":"2025-10-01T15:52:42+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/www.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/1220x628_OGIMAGE_Bot-Traffic-Is-on-the-Rise_-Is-Your-Website-Prepared__1x.webp","type":"image\/webp"}],"author":"Josh Helmuth","twitter_card":"summary_large_image","twitter_title":"Bot Traffic Is on the Rise. Is Your Website Prepared?","twitter_description":"71.5% of web traffic is now bots. Learn how to manage AI crawlers, reduce hosting costs, and stop spam without losing SEO benefits.","twitter_creator":"@dreamhost","twitter_site":"@dreamhost","twitter_misc":{"Written by":"Josh Helmuth","Est. reading time":"12 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#article","isPartOf":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/"},"author":{"name":"Josh Helmuth","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/person\/4f77e8cd1f8549bfdac38d224944f69b"},"headline":"Bot Traffic Is on the Rise: Is Your Website Prepared?","datePublished":"2025-07-07T14:00:00+00:00","dateModified":"2025-10-01T15:52:42+00:00","mainEntityOfPage":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/"},"wordCount":2344,"publisher":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#organization"},"image":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#primaryimage"},"thumbnailUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/1460x1095-BLOG-HERO-Bot-Traffic-Is-on-the-Rise_-Is-Your-Website-Prepared__1x.webp","articleSection":["Tech Talk"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/","url":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/","name":"Bot Traffic Is on the Rise, Prepare Your Website - DreamHost","isPartOf":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#primaryimage"},"image":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#primaryimage"},"thumbnailUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/1460x1095-BLOG-HERO-Bot-Traffic-Is-on-the-Rise_-Is-Your-Website-Prepared__1x.webp","datePublished":"2025-07-07T14:00:00+00:00","dateModified":"2025-10-01T15:52:42+00:00","description":"Bot traffic is rising, and it\u2019s hurting small business sites. If bots are hogging your bandwidth or flooding you with spam, here\u2019s how to stop them.","breadcrumb":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#primaryimage","url":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/1460x1095-BLOG-HERO-Bot-Traffic-Is-on-the-Rise_-Is-Your-Website-Prepared__1x.webp","contentUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2025\/07\/1460x1095-BLOG-HERO-Bot-Traffic-Is-on-the-Rise_-Is-Your-Website-Prepared__1x.webp","width":1460,"height":1095,"caption":"Bot Traffic Is on the Rise: Is Your Website Prepared?"},{"@type":"BreadcrumbList","@id":"https:\/\/www-dev.dreamhost.com\/blog\/bot-traffic\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/dhblog.dream.press\/blog\/"},{"@type":"ListItem","position":2,"name":"Bot Traffic Is on the Rise: Is Your Website Prepared?"}]},{"@type":"WebSite","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#website","url":"https:\/\/www-dev.dreamhost.com\/blog\/","name":"DreamHost Blog","description":"","publisher":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www-dev.dreamhost.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#organization","name":"DreamHost","url":"https:\/\/www-dev.dreamhost.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/dhblog.dream.press\/blog\/wp-content\/uploads\/2019\/01\/dh_logo-blue-2.png","contentUrl":"https:\/\/dhblog.dream.press\/blog\/wp-content\/uploads\/2019\/01\/dh_logo-blue-2.png","width":1200,"height":168,"caption":"DreamHost"},"image":{"@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DreamHost\/","https:\/\/x.com\/dreamhost","https:\/\/www.instagram.com\/dreamhost\/","https:\/\/www.linkedin.com\/company\/dreamhost\/","https:\/\/www.youtube.com\/user\/dreamhostusa"]},{"@type":"Person","@id":"https:\/\/www-dev.dreamhost.com\/blog\/#\/schema\/person\/4f77e8cd1f8549bfdac38d224944f69b","name":"Josh Helmuth","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2022\/10\/Screen-Shot-2022-10-21-at-9.12.32-AM-e1666372760846-100x100.png","url":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2022\/10\/Screen-Shot-2022-10-21-at-9.12.32-AM-e1666372760846-100x100.png","contentUrl":"https:\/\/www-dev.dreamhost.com\/blog\/wp-content\/uploads\/2022\/10\/Screen-Shot-2022-10-21-at-9.12.32-AM-e1666372760846-100x100.png","caption":"Josh Helmuth"},"description":"Josh is DreamHost's Customer Experience Lead, responsible for understanding and improving the overall experience for all customers. In his free time, he enjoys visiting the local brewery, watching a documentary, or checking out the latest tech.","url":"https:\/\/www-dev.dreamhost.com\/blog\/author\/josh-helmuth\/"}]}},"lang":"en","translations":{"en":74066,"es":74079,"uk":74944,"pt":74995,"de":75004,"ru":75015,"pl":75065,"fr":75095,"it":75137,"nl":75140},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts\/74066","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/users\/1070"}],"replies":[{"embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/comments?post=74066"}],"version-history":[{"count":7,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts\/74066\/revisions"}],"predecessor-version":[{"id":76129,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/posts\/74066\/revisions\/76129"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/media\/74067"}],"wp:attachment":[{"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/media?parent=74066"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/categories?post=74066"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www-dev.dreamhost.com\/blog\/wp-json\/wp\/v2\/tags?post=74066"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}