GoDaddy Help

Why would I block specific Web pages and/or search engines?

You may want to block search engines or Web pages from crawling specific areas or pages of your website. Crawling is the process of an application scanning the Internet and indexing information to return in search query results. While you want many crawlers to access your site, here are a few reasons to consider blocking Web pages or search engines using Search Engine Visibility:

  • To avoid crawlers such as spam bots trying to collect your private information for spamming purposes.
  • To avoid traffic overload by spiders accessing your site at high speeds or bots that index your scripts.
  • To protect information that you want to remain private such as addresses or contact information, printer-friendly pages that contain duplicate content, testing or experimental pages, and advertisement links.

There is no textbook answer for when or why you should block Web pages or search engines, but it is important that you watch for problems and correct them as needed. For information on blocking techniques, see Selecting website pages .

Was dit artikel nuttig?
Hartelijk dank voor je feedback. Gebruik het supporttelefoonnummer of de bovenstaande chatoptie als je een vertegenwoordiger van de afdeling Klantenondersteuning wilt spreken.
Fijn dat we konden helpen! Kunnen we nog iets voor je doen?
Dat spijt ons. Vertel ons wat je verwarrend vond of waarom je probleem niet is opgelost via de geboden oplossing.