File:Swap2and3 Search Test Analysis.pdf

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search
Go to page

Original file(1,275 × 1,650 pixels, file size: 1,006 KB, MIME type: application/pdf, 7 pages)



Add a one-line explanation of what this file represents


English: Wikimedia Technology’s Search Platform team ran an A/B test from April 7 to April 25, 2016 to see how much our users care about the position of the result vs the actual content of the result by swapping the second and third search results. We found that position 2 had a higher clickthrough rate than position 3 in both groups, but the clickthrough rate of the 3rd result was higher in the test group than in the control group. We also found that test group users were less likely to click on the 2nd result first than the control group and were more likely to click on the 3rd result first. Based on the results of this analysis, we think that both position and quality matter in user behavior, but with different weights. Further experiments are needed to figure out the quantitative relationship between user behavior and these two factors.
Source Own work
Author CXie (WMF)


I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

File history

Click on a date/time to view the file as it appeared at that time.

current00:56, 15 September 2017Thumbnail for version as of 00:56, 15 September 20171,275 × 1,650, 7 pages (1,006 KB)CXie (WMF) (talk | contribs)User created page with UploadWizard

There are no pages that use this file.