All Stories

  1. Apply Multi-agent Debate to Achieve Human-AI Complementary Team Performance.

    Article • ACM Transactions on Intelligent Systems and Technology, September 2026, ACM (Association for Computing Machinery)

    Gianluca Demartini, Bing Tuo

  2. Scalable Methods for Storing and Retrieving Wikipedia Revision Histories for Large-Scale Analysis

    Article • ACM Transactions on the Web, August 2026, ACM (Association for Computing Machinery)

    Gianluca Demartini

  3. Ideology-Based LLMs for Content Moderation

    Article • ACM Transactions on Intelligent Systems and Technology, April 2026, ACM (Association for Computing Machinery)

    Gianluca Demartini

  4. Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges

    Article • ACM Computing Surveys, November 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  5. Exploring Wikipedia Gender Diversity Over Time — The Wikipedia Gender Dashboard (WGD)

    Article • October 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  6. Preaching to the ChoIR: Lessons IR Should Share with AI

    Article • July 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini, Kevin Roitero, Mark Sanderson, Damiano Spina, Prof.dr.ir. Arjen P. de Vries

  7. Bias in Humans and AI - What To Do About It?

    Article • May 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  8. BiasNavi: LLM-Empowered Data Bias Management

    Article • May 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  9. The Impact of Persona-based Political Perspectives on Hateful Content Detection

    Article • May 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  10. Mapping and Influencing the Political Ideology of Large Language Models using Synthetic Personas

    Article • May 2025, ACM (Association for Computing Machinery)

    Riccardo Lunardi, Kevin Roitero, Gianluca Demartini

  11. Crowdsourcing or AI Sourcing?

    Article • Communications of the ACM, March 2025, ACM (Association for Computing Machinery)

    Gianluca Demartini

  12. Optimizing LLMs with Direct Preferences: A Data Efficiency Perspective

    Article • December 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  13. Hate Speech Detection with Generalizable Target-aware Fairness

    Article • August 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  14. Understanding the Barriers to Running Longitudinal Studies on Crowdsourcing Platforms

    Article • ACM Transactions on Social Computing, July 2024, ACM (Association for Computing Machinery)

    Michael Soprano, Kevin Roitero, Gianluca Demartini

  15. Fairness without Sensitive Attributes via Knowledge Sharing

    Article • June 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  16. How Good are LLMs in Generating Personalized Advertisements?

    Article • May 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  17. Who Determines What Is Relevant? Humans or AI? Why Not Both?

    Article • Communications of the ACM, March 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  18. Editorial: Special Issue on Human in the Loop Data Curation

    Article • Journal of Data and Information Quality, March 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini, Jie Yang

  19. On the Impact of Showing Evidence from Peers in Crowdsourced Truthfulness Assessments

    Article • ACM Transactions on Information Systems, January 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  20. Data Bias Management

    Article • Communications of the ACM, December 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini, Kevin Roitero

  21. Perspectives on Large Language Models for Relevance Judgment

    Article • August 2023, ACM (Association for Computing Machinery)

    Guglielmo Faggioli, Gianluca Demartini, Prof. Noriko Kando

  22. On the Impact of Data Quality on Image Classification Fairness

    Article • July 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini

  23. How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments

    Article • ACM Transactions on Information Systems, May 2023, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini, Michael Soprano

  24. Human-in-the-loop Regular Expression Extraction for Single Column Format Inconsistency

    Article • April 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini

  25. The Community Notes Observatory: Can Crowdsourced Fact-Checking be Trusted in Practice?

    Article • April 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini, Luca Righes

  26. Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

    Article • ACM SIGIR Forum, December 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  27. A Data-Driven Analysis of Behaviors in Data Curation Processes

    Article • ACM Transactions on Information Systems, October 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  28. Combining Human and Machine Confidence in Truthfulness Assessment

    Article • Journal of Data and Information Quality, July 2022, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini, Damiano Spina

  29. Using Computers to Fact-Check Text and Justify the Decision

    Article • Journal of Data and Information Quality, July 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini, Erik Brand, Michael Soprano

  30. Socio-Economic Diversity in Human Annotations

    Article • June 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  31. Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments

    Article • April 2022, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini

  32. Does Evidence from Peers Help Crowd Workers in Assessing Truthfulness?

    Article • April 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  33. Effects of Technological Interventions for Self-regulation: A Control Experiment in Learnersourcing

    Article • March 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  34. Hierarchical Clustering of Corals using Image Clustering

    Article • December 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  35. An Analysis of the Australian Political Discourse in Sponsored Social Media Content

    Article • December 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  36. On the State of Reporting in Crowdsourcing Experiments and a Checklist to Aid Current Practices

    Article • Proceedings of the ACM on Human-Computer Interaction, October 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  37. Charting the Design and Analytics Agenda of Learnersourcing Systems

    Article • April 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  38. Report on the first workshop on bias in automatic knowledge graph construction at AKBC 2020

    Article • ACM SIGIR Forum, December 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  39. Modelling User Behavior Dynamics with Embeddings

    Article • October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  40. The COVID-19 Infodemic

    Article • October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini, Michael Soprano, Damiano Spina

  41. How to make crowd workers earn an hourly wage

    Article • Proceedings of the ACM on Human-Computer Interaction, October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  42. On Understanding Data Worker Interaction Behaviors

    Article • July 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  43. Can The Crowd Identify Misinformation Objectively?

    Article • July 2020, ACM (Association for Computing Machinery)

    Michael Soprano, Gianluca Demartini, Damiano Spina

  44. Representation learning for entity type ranking

    Article • March 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  45. Health Card Retrieval for Consumer Health Search

    Article • November 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  46. On Transforming Relevance Scales

    Article • November 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  47. Understanding Worker Moods and Reactions to Rejection in Crowdsourcing

    Article • September 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  48. Quality Control Attack Schemes in Crowdsourcing

    Article • August 2019, International Joint Conferences on Artificial Intelligence

    Gianluca Demartini

  49. Health Cards for Consumer Health Search

    Article • July 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  50. Implicit Bias in Crowdsourced Knowledge Graphs

    Article • May 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  51. Scalpel-CD: Leveraging Crowdsourcing and Deep Probabilistic Modeling for Debugging Noisy Training Data

    Article • May 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  52. Deadline-Aware Fair Scheduling for Multi-Tenant Crowd-Powered Systems

    Article • ACM Transactions on Social Computing, February 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  53. All Those Wasted Hours

    Article • January 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini, Ujwal Gadiraju

  54. Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data

    Article • Health Information & Libraries Journal, January 2019, Wiley

    Gianluca Demartini

  55. Non-parametric Class Completeness Estimators for Collaborative Knowledge Graphs—The Case of Wikidata

    Article • January 2019, Springer Science + Business Media

    Gianluca Demartini

  56. Semantic Interlinking

    Article • January 2019, Springer Science + Business Media

    Gianluca Demartini

  57. The Impact of Task Abandonment in Crowdsourcing

    Article • IEEE Transactions on Knowledge and Data Engineering, January 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  58. The Evolution of Power and Standard Wikidata Editors: Comparing Editing Behavior over Time to Predict Lifespan and Volume of Edits

    Article • Computer Supported Cooperative Work (CSCW), December 2018, Springer Science + Business Media

    Gianluca Demartini

  59. Can User Behaviour Sequences Reflect Perceived Novelty?

    Article • October 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  60. Moral Panic through the Lens of Twitter

    Article • July 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  61. Investigating User Perception of Gender Bias in Image Search

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  62. On Fine-Grained Relevance Scales

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  63. On the Volatility of Commercial Search Engines and its Impact on Information Retrieval Research

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  64. Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection

    Article • Computer Supported Cooperative Work (CSCW), June 2018, Springer Science + Business Media

    Gianluca Demartini

  65. Measuring the Effect of Public Health Campaigns on Twitter: The Case of World Autism Awareness Day

    Article • January 2018, Springer Science + Business Media

    Gianluca Demartini

  66. Augmenting Intelligence with Humans-in-the-Loop (HumL@WWW2018) Chairs' Welcome & Organization

    Article • January 2018, ACM (Association for Computing Machinery)

    Prof. dr. Lora Aroyo, Anna Lisa Gentile, Christopher Welty, Gianluca Demartini

  67. Chapter 4: Using Twitter as a Data Source: An Overview of Ethical, Legal, and Methodological Challenges

    Article • December 2017, Emerald

    Gianluca Demartini

  68. Understanding Engagement through Search Behaviour

    Article • November 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  69. Considering Assessor Agreement in IR Evaluation

    Article • October 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  70. Modus Operandi of Crowd Workers

    Article • Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, September 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  71. An Introduction to Hybrid Human-Machine Information Systems

    Article • Foundations and Trends® in Web Science, January 2017, Now Publishers

    Gianluca Demartini

  72. Towards building a standard dataset for Arabic keyphrase extraction evaluation

    Article • November 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  73. Scheduling Human Intelligence Tasks in Multi-Tenant Crowd-Powered Systems

    Article • April 2016, ACM (Association for Computing Machinery)

    Gianluca Demartini, Philippe Cudre-Mauroux

  74. Contextualized ranking of entity types based on knowledge graphs

    Article • Journal of Web Semantics, March 2016, Elsevier

    Gianluca Demartini

  75. A Tutorial on Leveraging Knowledge Graphs for Web Search

    Article • January 2016, Springer Science + Business Media

    Gianluca Demartini

  76. The Relationship Between User Perception and User Behaviour in Interactive Information Retrieval Evaluation

    Article • January 2016, Springer Science + Business Media

    Gianluca Demartini

  77. Hybrid human–machine information systems: Challenges and opportunities

    Article • Computer Networks, October 2015, Elsevier

    Gianluca Demartini

  78. Pooling-based continuous evaluation of information retrieval systems

    Article • Information Retrieval, September 2015, Springer Science + Business Media

    Gianluca Demartini

  79. Human Beyond the Machine: Challenges and Opportunities of Microtask Crowdsourcing

    Article • IEEE Intelligent Systems, July 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  80. The Dynamics of Micro-Task Crowdsourcing

    Article • January 2015, ACM (Association for Computing Machinery)

    Gianluca Demartini

  81. Understanding Malicious Behavior in Crowdsourcing Platforms

    Article • January 2015, ACM (Association for Computing Machinery)

    Gianluca Demartini

  82. Correct Me If I'm Wrong

    Article • November 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  83. B-hist: Entity-centric search over personal web browsing history

    Article • Journal of Web Semantics, August 2014, Elsevier

    Gianluca Demartini

  84. Hippocampus

    Article • April 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  85. Effective named entity recognition for idiosyncratic web collections

    Article • January 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  86. Entity disambiguation in tweets leveraging user social profiles

    Article • August 2013, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  87. Large-scale linked data integration using probabilistic reasoning and crowdsourcing

    Article • The VLDB Journal, July 2013, Springer Science + Business Media

    Gianluca Demartini

  88. NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  89. Ontology-Based Word Sense Disambiguation for Scientific Literature

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  90. TRank: Ranking Entity Types Using the Web of Data

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  91. The Bowlogna ontology: Fostering open curricula and agile knowledge bases for Europe's higher education landscape

    Article • Semantic Web – Interoperability Usability Applicability, January 2013, IOS Press

    Gianluca Demartini

  92. ZenCrowd

    Article • April 2012, ACM (Association for Computing Machinery)

    Gianluca Demartini, Philippe Cudre-Mauroux

  93. BowlognaBench—Benchmarking RDF Analytics

    Article • January 2012, Springer Science + Business Media

    Gianluca Demartini

  94. Combining inverted indices and structured search for ad-hoc object retrieval

    Article • January 2012, ACM (Association for Computing Machinery)

    Gianluca Demartini

  95. Predicting the Future Impact of News Events

    Article • January 2012, Springer Science + Business Media

    Gianluca Demartini

  96. From people to entities

    Article • ACM SIGIR Forum, May 2011, ACM (Association for Computing Machinery)

    Gianluca Demartini

  97. Visual interfaces for stimulating exploratory search

    Article • January 2011, ACM (Association for Computing Machinery)

    Gianluca Demartini

  98. Report on INEX 2009

    Article • ACM SIGIR Forum, August 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  99. Why finding entities in Wikipedia is difficult, sometimes

    Article • Information Retrieval, May 2010, Springer Science + Business Media

    Gianluca Demartini

  100. Leveraging personal metadata for Desktop search: The Beagle++ system

    Article • Journal of Web Semantics, March 2010, Elsevier

    Gianluca Demartini

  101. Dear search engine: what's your opinion about...?

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  102. Entity summarization of news articles

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  103. Exploiting click-through data for entity retrieval

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  104. Overview of the INEX 2009 Entity Ranking Track

    Article • January 2010, Springer Science + Business Media

    Gianluca Demartini

  105. Ranking Entities Using Web Search Query Logs

    Article • January 2010, Springer Science + Business Media

    Gianluca Demartini

  106. TAER

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  107. The missing links

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  108. An Architecture for Finding Entities on the Web

    Article • November 2009, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  109. Report on INEX 2008

    Article • ACM SIGIR Forum, June 2009, ACM (Association for Computing Machinery)

    Gianluca Demartini

  110. A Vector Space Model for Ranking Entities and Its Application to Expert Search

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  111. How to Trace and Revise Identities

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  112. L3S at INEX 2008: Retrieving Entities Using Structured Information

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  113. Overview of the INEX 2008 Entity Ranking Track

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  114. A Model for Ranking Entities and Its Application to Wikipedia

    Article • October 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  115. Social recommendations of content and metadata

    Article • January 2008, ACM (Association for Computing Machinery)

    Gianluca Demartini

  116. Leveraging semantic technologies for enterprise search

    Article • January 2007, ACM (Association for Computing Machinery)

    Gianluca Demartini

  117. A Classification of IR Effectiveness Metrics

    Article • January 2006, Springer Science + Business Media

    Gianluca Demartini

  118. L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology

    Article • Springer Science + Business Media

    Gianluca Demartini

  119. Ranking Categories for Web Search

    Article • Springer Science + Business Media

    Gianluca Demartini

  120. Semantically Enhanced Entity Ranking

    Article • Springer Science + Business Media

    Gianluca Demartini