{"version":"1.0","provider_name":"DreamHost Blog","provider_url":"https:\/\/www-dev.dreamhost.com\/blog","author_name":"Ian Hernandez","author_url":"https:\/\/www-dev.dreamhost.com\/blog\/author\/ianh\/","title":"Stop Bad Bots, Keep Your Website Fast","type":"rich","width":600,"height":338,"html":"<blockquote class=\"wp-embedded-content\" data-secret=\"UdcfxFBzWT\"><a href=\"https:\/\/www-dev.dreamhost.com\/blog\/block-web-crawlers\/\">How To Stop Web Crawlers and Bots From Slowing Down Your Website<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/www-dev.dreamhost.com\/blog\/block-web-crawlers\/embed\/#?secret=UdcfxFBzWT\" width=\"600\" height=\"338\" title=\"&#8220;How To Stop Web Crawlers and Bots From Slowing Down Your Website&#8221; &#8212; DreamHost Blog\" data-secret=\"UdcfxFBzWT\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/* ]]> *\/\n<\/script>\n","thumbnail_url":"https:\/\/dhblog.dream.press\/blog\/wp-content\/uploads\/2025\/05\/1220x628_ogimage_how_to_stop_web_crawlers_and_bots_from_slowing_down_your_website.webp","thumbnail_width":1200,"thumbnail_height":628,"description":"Over 51% of your website traffic could be bots. That\u2019s more bots than humans. And they\u2019re draining your resources. Learn which bots and crawlers to block, which to keep, and how to protect your site\u2019s speed."}