googlee

You can instruct Google  not to include content from your site or remove content that is currently  indexed in their search engine.

For instance to prevent robots from crawling your site, place a robots.txt file in your server root:

Open a text editor such as wordpad and copy and paste the following text:

User-agent: *

Disallow: /

Save the file as robots.txt and place it in your server root as such:

(http://yourserver.com/robots.txt)

  • To block a directory and everything in it, follow the directory name with a forward slash.
    Disallow: /junk-directory/
  • To block a page, list the page.
    Disallow: /private_file.html
  • To remove a specific image from Google image search, add the following:
    User-agent: Googlebot-Image
    Disallow: /images/dogs.jpg
  • To remove all images on your site from Google image search:
    User-agent: Googlebot-Image
    Disallow: /
  • To block files of a specific file type (for example, .gif), use the following:
    User-agent: Googlebot
    Disallow: /*.gif$

So you can therefore specify which part of your site you need preventing from indexing, To find out  more about content indexation go to  google Webmaster Guidelines.


This post is tagged

Leave a Reply





Configure Widgets

Categories

Configure Widgets

WordPress database error Got error 28 from storage engine for query SELECT t.*, tt.*, tr.object_id FROM wp_terms AS t INNER JOIN wp_term_taxonomy AS tt ON tt.term_id = t.term_id INNER JOIN wp_term_relationships AS tr ON tr.term_taxonomy_id = tt.term_taxonomy_id WHERE tt.taxonomy IN ('category', 'post_tag') AND tr.object_id IN (660) ORDER BY t.name ASC made by require, wp, WP->main, WP->query_posts, WP_Query->query, WP_Query->get_posts, update_post_caches, update_object_term_cache, wp_get_object_terms WordPress database error Got error 28 from storage engine for query SELECT t.*, tt.*, tr.object_id FROM wp_terms AS t INNER JOIN wp_term_taxonomy AS tt ON tt.term_id = t.term_id INNER JOIN wp_term_relationships AS tr ON tr.term_taxonomy_id = tt.term_taxonomy_id WHERE tt.taxonomy IN ('category', 'post_tag') AND tr.object_id IN (5) ORDER BY t.name ASC made by require, require_once, include, get_header, locate_template, load_template, require_once, wp_head, do_action, call_user_func_array, start_post_rel_link, get_boundary_post_rel_link, get_boundary_post, get_posts, WP_Query->query, WP_Query->get_posts, update_post_caches, update_object_term_cache, wp_get_object_terms WordPress database error Got error 28 from storage engine for query SELECT t.*, tt.* FROM wp_terms AS t INNER JOIN wp_term_taxonomy AS tt ON t.term_id = tt.term_id WHERE tt.taxonomy IN ('category') ORDER BY t.name ASC made by require, require_once, include, include, wp_list_categories, get_categories, get_terms