MSN Search Tells Why Pages Are Not Crawled Or Indexed
By Rich Ord
CEO, iEntry, Inc.
Article Date: 2004-11-19
Eytan Seidman, MSN Search Program Manager, commented in the MSN search blog on the question of why a site is not crawled and why a page may be crawled but not indexed.
Here is the key point he makes on why a site is not crawled:
"URL's with many (definitely more than 5) query parameters have a very low chance of ever being crawled. Another thing to consider is whether we can find your page. If we need to traverse through eight pages on your site before finding leaf pages that nobody but yourself points to, MSNBot might choose not to go that far. This is why many people recommend creating a site map and we would as well."
You can always try submitting your site. If your site is new the bot simply may not have found it.
If a site is crawled but not in their index he states:
"The reason that this is most likely happening is that we are detecting the page as spam when we analyze the page to build our index." Items such as, "dirty javascript redirects, stuffing alt text, white on white links, off topic links" are all considered spam by the MSN Searchbot.
For more details on what is considered spam go to the Site Owners Help area.
About the Author:
Rich Ord is the CEO of iEntry, Inc. which publishes over 200 websites and email newsletters. Rich also publishes his blog WebProBlog which focuses on internet business and marketing trends.
|
