iEntry 10th Anniversary RSS Contact


Updated Google Quality Rater Guidelines

By: Philipp Lenssen
2008-03-14

A newer version of what seems to be the guideline for Googles quality raters* has surfaced (I dont know when it surfaced, it may have been recently). Brian Ussery gave it a look already.

According to the document, which is dated April 2007 and at least looks legitimate, a quality rater has the job to first research and understand a specific search query " say -cell phones- ", to then look at the quality of a website returned for this query. The rater will then assign a rating to this specific query-page combo, and proceed to the next query-page task.

Back in 2005, SearchBistro.com already discovered information on Googles quality raters. Note besides quality raters, Google also has trusted testers, but those are different job roles " and the latter is unpaid, last thing I heard.

Quality raters use the evaluation system EWOQ, logging in with their approved Gmail account. (If I understand it right, this system is part of a larger Rater Hub homepage. Note none of the two previous links should work for you unless youre a rater, Im just including them for reference.) If you want to work in quality evaluation, a Google job page states, you need to have in-depth, up-to-date familiarity with English-speaking web culture and media, as well as a broad ranges of interests and strong web research skills.

The quality rating options for a specific URL are: vital, useful, relevant, not relevant, off-topic, didnt load, foreign language, and unratable. Also, a URL can be flagged as not spam, maybe spam, or spam, and malicious or pornography. We have reason to believe the feedback given by quality raters is then incorporated into the algorithms by Google engineers, or helps deciding with which fine-tuned variant of the algorithms to proceed. (Google once told people their results are completely objectively, completely automated and independent of the beliefs of people working at Google, but they since revised many occurrences of such wording on their help pages.)

As before, queries are grouped into the types navigational (when a user just wants to locate a specific webpage they have in mind, e.g. typing -ibm-), informational (when someone researches a topic to find out more about something, e.g. querying for -tsunami-), and transactional (when the user wants to buy something or download something or is looking for some other type of resource, as opposed to information, e.g. for a query like -download adobe reader-). These types are not mutually exclusive; Google lists the query -"ipod nano"- as an example of something which is navigational (going to the product page), informational (reading a review or info on the product page), as well as transactional (perhaps purchasing the product).

In the document, Google (if its by Google, though again, it looks authentic) also describes the different types of spam found online. In their list: pay-per-click pages, JavaScript redirects, parked domains, keyword stuffing, thin affiliates, 100% frame, hidden text/ hidden links, and sneaky redirects. Parked domains are an interesting item, as Google themselves makes AdSense bucks from their google.com/domainpark/ program... classic case of doublethink. Thin affiliates, Google explains, are pages merely existing to push the visitor to another page by another owner, making some commission spare change from this referral. A 100% frame page, on the other hand, simply wraps another page with its own invisible frameset, thus basically appearing to own the other sites content.

Comments

Tag:

Add to Del.icio.us | Digg | Reddit | Furl

Have a bookmark! -




About the Author:
Philipp Lenssen from Germany, author of Google Apps Hacks, shares his views & news on the search industry in the daily Google Blogoscoped.


Visit the SearchNewz Directory
Do you have a search site?
Submit it free to the internet's best search industry directory. » Click Here
Search Engines
Google, Yahoo, MSN...

Search Marketing
Marketing, Budget, Planning...

Pay Per Click
Bid, Price, Quality...
SEO Companies
Optimization, Manage, Company...

SEO Tools
Track, Search, Create...

Analytics
Statistics, Counter...
» Submit your site for FREE «

Latest News

Get Your Site Submitted for Free in the World's Largest B2B Directory!

Email Address:
* URL:
*
*Indicates Mandatory Field

Terms & Conditions



Titan Quest Forum Nintendo Wii Graphics Forum
Halo 3 Forum Mac Software

Privacy Policy Legal Sitemap Contact Us RSS Feeds Newsletter Archive SearchNewz.com Privacy Policy Legal Sitemap Contact Us RSS Feeds Newsletter Signup Subscribe to our feeds!