Google's Matt Cutts spills the beans on how the search team actually does Google evaluate algorithmic changes in a webmaster help video, which asks what metrics Google uses to evaluate whether one iteration of the ranking algorithm is delivering better quality results to users than another.
