Viewpoint Diversity in Search Results

Tim Draws; Nirmal Roy; Oana Inel; Alisa Rieger; Rishav Hada; Mehmet Orcun Yalcin; Benjamin Timmermans; Nava Tintarev

doi:10.1007/978-3-031-28244-7_18

Viewpoint Diversity in Search Results

Tim Draws^*, Nirmal Roy, Oana Inel, Alisa Rieger, Rishav Hada, Mehmet Orcun Yalcin, Benjamin Timmermans, Nava Tintarev

^*Corresponding author for this work

Web Information Systems

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

7 Citations (Scopus)

59 Downloads (Pure)

Abstract

Adverse phenomena such as the search engine manipulation effect (SEME), where web search users change their attitude on a topic following whatever most highly-ranked search results promote, represent crucial challenges for research and industry. However, the current lack of automatic methods to comprehensively measure or increase viewpoint diversity in search results complicates the understanding and mitigation of such effects. This paper proposes a viewpoint bias metric that evaluates the divergence from a pre-defined scenario of ideal viewpoint diversity considering two essential viewpoint dimensions (i.e., stance and logic of evaluation). In a case study, we apply this metric to actual search results and find considerable viewpoint bias in search results across queries, topics, and search engines that could lead to adverse effects such as SEME. We subsequently demonstrate that viewpoint diversity in search results can be dramatically increased using existing diversification algorithms. The methods proposed in this paper can assist researchers and practitioners in evaluating and improving viewpoint diversity in search results.

Original language	English
Title of host publication	Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings
Editors	Jaap Kamps, Lorraine Goeuriot, Fabio Crestani, Maria Maistro, Hideo Joho, Brian Davis, Cathal Gurrin, Annalina Caputo, Udo Kruschwitz
Place of Publication	Cham
Publisher	Springer
Pages	279-297
Number of pages	19
ISBN (Electronic)	978-3-031-28244-7
ISBN (Print)	978-3-031-28243-0
DOIs	https://doi.org/10.1007/978-3-031-28244-7_18
Publication status	Published - 2023
Event	45th European Conference on Information Retrieval, ECIR 2023 - Dublin, Ireland Duration: 2 Apr 2023 → 6 Apr 2023

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher	Springer
Volume	13980
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	45th European Conference on Information Retrieval, ECIR 2023
Country/Territory	Ireland
City	Dublin
Period	2/04/23 → 6/04/23

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

Bias
Evaluation
Metric
Search results
Viewpoint diversity

Access to Document

10.1007/978-3-031-28244-7_18

978-3-031-28244-7_18Final published version, 359 KB

Cite this

Draws, T., Roy, N., Inel, O., Rieger, A., Hada, R., Yalcin, M. O., Timmermans, B., & Tintarev, N. (2023). Viewpoint Diversity in Search Results. In J. Kamps, L. Goeuriot, F. Crestani, M. Maistro, H. Joho, B. Davis, C. Gurrin, A. Caputo, & U. Kruschwitz (Eds.), Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings (pp. 279-297). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13980 ). Springer. https://doi.org/10.1007/978-3-031-28244-7_18

Draws, Tim ; Roy, Nirmal ; Inel, Oana et al. / Viewpoint Diversity in Search Results. Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings. editor / Jaap Kamps ; Lorraine Goeuriot ; Fabio Crestani ; Maria Maistro ; Hideo Joho ; Brian Davis ; Cathal Gurrin ; Annalina Caputo ; Udo Kruschwitz. Cham : Springer, 2023. pp. 279-297 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{38d694f252a34a0088ea02e09c721708,

title = "Viewpoint Diversity in Search Results",

abstract = "Adverse phenomena such as the search engine manipulation effect (SEME), where web search users change their attitude on a topic following whatever most highly-ranked search results promote, represent crucial challenges for research and industry. However, the current lack of automatic methods to comprehensively measure or increase viewpoint diversity in search results complicates the understanding and mitigation of such effects. This paper proposes a viewpoint bias metric that evaluates the divergence from a pre-defined scenario of ideal viewpoint diversity considering two essential viewpoint dimensions (i.e., stance and logic of evaluation). In a case study, we apply this metric to actual search results and find considerable viewpoint bias in search results across queries, topics, and search engines that could lead to adverse effects such as SEME. We subsequently demonstrate that viewpoint diversity in search results can be dramatically increased using existing diversification algorithms. The methods proposed in this paper can assist researchers and practitioners in evaluating and improving viewpoint diversity in search results.",

keywords = "Bias, Evaluation, Metric, Search results, Viewpoint diversity",

author = "Tim Draws and Nirmal Roy and Oana Inel and Alisa Rieger and Rishav Hada and Yalcin, {Mehmet Orcun} and Benjamin Timmermans and Nava Tintarev",

note = "Green Open Access added to TU Delft Institutional Repository {\textquoteleft}You share, we take care!{\textquoteright} – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.; 45th European Conference on Information Retrieval, ECIR 2023 ; Conference date: 02-04-2023 Through 06-04-2023",

year = "2023",

doi = "10.1007/978-3-031-28244-7_18",

language = "English",

isbn = "978-3-031-28243-0",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "279--297",

editor = "Jaap Kamps and Lorraine Goeuriot and Fabio Crestani and Maria Maistro and Hideo Joho and Brian Davis and Cathal Gurrin and Annalina Caputo and Udo Kruschwitz",

booktitle = "Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings",

}

Draws, T, Roy, N, Inel, O, Rieger, A, Hada, R, Yalcin, MO, Timmermans, B & Tintarev, N 2023, Viewpoint Diversity in Search Results. in J Kamps, L Goeuriot, F Crestani, M Maistro, H Joho, B Davis, C Gurrin, A Caputo & U Kruschwitz (eds), Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13980 , Springer, Cham, pp. 279-297, 45th European Conference on Information Retrieval, ECIR 2023, Dublin, Ireland, 2/04/23. https://doi.org/10.1007/978-3-031-28244-7_18

Viewpoint Diversity in Search Results. / Draws, Tim; Roy, Nirmal; Inel, Oana et al.
Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings. ed. / Jaap Kamps; Lorraine Goeuriot; Fabio Crestani; Maria Maistro; Hideo Joho; Brian Davis; Cathal Gurrin; Annalina Caputo; Udo Kruschwitz. Cham: Springer, 2023. p. 279-297 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13980 ).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Viewpoint Diversity in Search Results

AU - Draws, Tim

AU - Roy, Nirmal

AU - Inel, Oana

AU - Rieger, Alisa

AU - Hada, Rishav

AU - Yalcin, Mehmet Orcun

AU - Timmermans, Benjamin

AU - Tintarev, Nava

N1 - Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

PY - 2023

Y1 - 2023

N2 - Adverse phenomena such as the search engine manipulation effect (SEME), where web search users change their attitude on a topic following whatever most highly-ranked search results promote, represent crucial challenges for research and industry. However, the current lack of automatic methods to comprehensively measure or increase viewpoint diversity in search results complicates the understanding and mitigation of such effects. This paper proposes a viewpoint bias metric that evaluates the divergence from a pre-defined scenario of ideal viewpoint diversity considering two essential viewpoint dimensions (i.e., stance and logic of evaluation). In a case study, we apply this metric to actual search results and find considerable viewpoint bias in search results across queries, topics, and search engines that could lead to adverse effects such as SEME. We subsequently demonstrate that viewpoint diversity in search results can be dramatically increased using existing diversification algorithms. The methods proposed in this paper can assist researchers and practitioners in evaluating and improving viewpoint diversity in search results.

AB - Adverse phenomena such as the search engine manipulation effect (SEME), where web search users change their attitude on a topic following whatever most highly-ranked search results promote, represent crucial challenges for research and industry. However, the current lack of automatic methods to comprehensively measure or increase viewpoint diversity in search results complicates the understanding and mitigation of such effects. This paper proposes a viewpoint bias metric that evaluates the divergence from a pre-defined scenario of ideal viewpoint diversity considering two essential viewpoint dimensions (i.e., stance and logic of evaluation). In a case study, we apply this metric to actual search results and find considerable viewpoint bias in search results across queries, topics, and search engines that could lead to adverse effects such as SEME. We subsequently demonstrate that viewpoint diversity in search results can be dramatically increased using existing diversification algorithms. The methods proposed in this paper can assist researchers and practitioners in evaluating and improving viewpoint diversity in search results.

KW - Bias

KW - Evaluation

KW - Metric

KW - Search results

KW - Viewpoint diversity

UR - http://www.scopus.com/inward/record.url?scp=85151135715&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-28244-7_18

DO - 10.1007/978-3-031-28244-7_18

M3 - Conference contribution

AN - SCOPUS:85151135715

SN - 978-3-031-28243-0

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 279

EP - 297

BT - Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings

A2 - Kamps, Jaap

A2 - Goeuriot, Lorraine

A2 - Crestani, Fabio

A2 - Maistro, Maria

A2 - Joho, Hideo

A2 - Davis, Brian

A2 - Gurrin, Cathal

A2 - Caputo, Annalina

A2 - Kruschwitz, Udo

PB - Springer

CY - Cham

T2 - 45th European Conference on Information Retrieval, ECIR 2023

Y2 - 2 April 2023 through 6 April 2023

ER -

Draws T, Roy N, Inel O, Rieger A, Hada R, Yalcin MO et al. Viewpoint Diversity in Search Results. In Kamps J, Goeuriot L, Crestani F, Maistro M, Joho H, Davis B, Gurrin C, Caputo A, Kruschwitz U, editors, Advances in Information Retrieval - 45th European Conference on Information Retrieval, ECIR 2023, Proceedings. Cham: Springer. 2023. p. 279-297. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-28244-7_18