Top Menu

Tag Archives | slurps

How to Remove a Page already Indexed by Yahoo

In recent months, Yahoo has been crawling all unnecessary pages which spoil the ranking of the high priority pages in a website. Hence, Yahoo can be seen reporting a much larger amount of indexed pages than what is actually available. To avoid unnecessary indexing, please read the “Restricting Yahoo Bot using Robots.txt” article. To remove […]

Continue Reading 0

Restricting Yahoo Bot using Robots

Yahoo bot has been indexing more number of pages than Google bots. This is due to Yahoo indexing even the internal site search results pages. Some webmasters have reported that Yahoo bot crawls even their drop down menus and also displays their sitemap.xml in its results page which is ridiculous. Such indexing can deter your […]

Continue Reading 0

Slurps Hit Sites Repeatedly!

Some webmasters have noticed that Slurp (Yahoos Spider) is hitting their site for almost an hour with over 1000 requests, most of these referals from Overture Advertisements. However, its been reported that the PPCs are not being charged. However, rumours are that these might be some illicit IP addresses trying to gain income through PPCs. […]

Continue Reading 0