ÜB03 IB
Paper analysis
Abstract
Introduction
= motivation, setting up the context
- explain what’s being done and why
- how are SE biased, what effect?
- compares previous research, nothing really focuses on the biases from psychology in the context of search
Related work
= hooks for the story, show you know other research
- overview over all the work
- goes into detail for each of them
- ties them together
- how to build on this?
- Focus on: Health & yes-no questions
Main
Beliefs during search
- describes retrospective survey on biased beliefs in web search
- how people switch from yes to uncertain to no before and after a web search
- provides reasons
Questions, answers, judgements
- crowd-sourcing of SERPs obtained from yes/no Bing queries (= 2% of all queries)
- filtered out the non-medical questions
- doctors annotated the results as true/false → ground truth
- caption + landing page → system truth
- → 600 SERPs as a dataset
Results
- yes more often than no
- yes ranked higher than no (65%)
- → system bias
Biased SERPs & Search results
- more likely to click on yes
- caption: 2-4x more likely to click on yes
- more likely to skip “no”