All Stories

  1. Editorial: Special Issue on Human in the Loop Data Curation

    Article • Journal of Data and Information Quality, March 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini, Jie Yang

  2. Who Determines What Is Relevant? Humans or AI? Why Not Both?

    Article • Communications of the ACM, March 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  3. On the Impact of Showing Evidence from Peers in Crowdsourced Truthfulness Assessments

    Article • ACM Transactions on Information Systems, January 2024, ACM (Association for Computing Machinery)

    Gianluca Demartini

  4. Data Bias Management

    Article • Communications of the ACM, December 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini, Kevin Roitero

  5. Perspectives on Large Language Models for Relevance Judgment

    Article • August 2023, ACM (Association for Computing Machinery)

    Guglielmo Faggioli, Gianluca Demartini, Prof. Noriko Kando

  6. On the Impact of Data Quality on Image Classification Fairness

    Article • July 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini

  7. How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments

    Article • ACM Transactions on Information Systems, May 2023, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini, Michael Soprano

  8. Human-in-the-loop Regular Expression Extraction for Single Column Format Inconsistency

    Article • April 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini

  9. The Community Notes Observatory: Can Crowdsourced Fact-Checking be Trusted in Practice?

    Article • April 2023, ACM (Association for Computing Machinery)

    Gianluca Demartini, Luca Righes

  10. Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

    Article • ACM SIGIR Forum, December 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  11. A Data-Driven Analysis of Behaviors in Data Curation Processes

    Article • ACM Transactions on Information Systems, October 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  12. Combining Human and Machine Confidence in Truthfulness Assessment

    Article • Journal of Data and Information Quality, July 2022, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini, Damiano Spina

  13. Using Computers to Fact-Check Text and Justify the Decision

    Article • Journal of Data and Information Quality, July 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini, Erik Brand, Michael Soprano

  14. Socio-Economic Diversity in Human Annotations

    Article • June 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  15. Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments

    Article • April 2022, ACM (Association for Computing Machinery)

    Kevin Roitero, Gianluca Demartini

  16. Does Evidence from Peers Help Crowd Workers in Assessing Truthfulness?

    Article • April 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  17. Effects of Technological Interventions for Self-regulation: A Control Experiment in Learnersourcing

    Article • March 2022, ACM (Association for Computing Machinery)

    Gianluca Demartini

  18. Hierarchical Clustering of Corals using Image Clustering

    Article • December 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  19. An Analysis of the Australian Political Discourse in Sponsored Social Media Content

    Article • December 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  20. On the State of Reporting in Crowdsourcing Experiments and a Checklist to Aid Current Practices

    Article • Proceedings of the ACM on Human-Computer Interaction, October 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  21. Charting the Design and Analytics Agenda of Learnersourcing Systems

    Article • April 2021, ACM (Association for Computing Machinery)

    Gianluca Demartini

  22. Report on the first workshop on bias in automatic knowledge graph construction at AKBC 2020

    Article • ACM SIGIR Forum, December 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  23. Modelling User Behavior Dynamics with Embeddings

    Article • October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  24. The COVID-19 Infodemic

    Article • October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini, Michael Soprano, Damiano Spina

  25. How to make crowd workers earn an hourly wage

    Article • Proceedings of the ACM on Human-Computer Interaction, October 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  26. On Understanding Data Worker Interaction Behaviors

    Article • July 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  27. Can The Crowd Identify Misinformation Objectively?

    Article • July 2020, ACM (Association for Computing Machinery)

    Michael Soprano, Gianluca Demartini, Damiano Spina

  28. Representation learning for entity type ranking

    Article • March 2020, ACM (Association for Computing Machinery)

    Gianluca Demartini

  29. Health Card Retrieval for Consumer Health Search

    Article • November 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  30. On Transforming Relevance Scales

    Article • November 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  31. Understanding Worker Moods and Reactions to Rejection in Crowdsourcing

    Article • September 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  32. Quality Control Attack Schemes in Crowdsourcing

    Article • August 2019, International Joint Conferences on Artificial Intelligence

    Gianluca Demartini

  33. Health Cards for Consumer Health Search

    Article • July 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  34. Implicit Bias in Crowdsourced Knowledge Graphs

    Article • May 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  35. Scalpel-CD: Leveraging Crowdsourcing and Deep Probabilistic Modeling for Debugging Noisy Training Data

    Article • May 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  36. Deadline-Aware Fair Scheduling for Multi-Tenant Crowd-Powered Systems

    Article • ACM Transactions on Social Computing, February 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini

  37. All Those Wasted Hours

    Article • January 2019, ACM (Association for Computing Machinery)

    Gianluca Demartini, Ujwal Gadiraju

  38. Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data

    Article • Health Information & Libraries Journal, January 2019, Wiley

    Gianluca Demartini

  39. Non-parametric Class Completeness Estimators for Collaborative Knowledge Graphs—The Case of Wikidata

    Article • January 2019, Springer Science + Business Media

    Gianluca Demartini

  40. Semantic Interlinking

    Article • January 2019, Springer Science + Business Media

    Gianluca Demartini

  41. The Impact of Task Abandonment in Crowdsourcing

    Article • IEEE Transactions on Knowledge and Data Engineering, January 2019, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  42. The Evolution of Power and Standard Wikidata Editors: Comparing Editing Behavior over Time to Predict Lifespan and Volume of Edits

    Article • Computer Supported Cooperative Work (CSCW), December 2018, Springer Science + Business Media

    Gianluca Demartini

  43. Can User Behaviour Sequences Reflect Perceived Novelty?

    Article • October 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  44. Moral Panic through the Lens of Twitter

    Article • July 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  45. Investigating User Perception of Gender Bias in Image Search

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  46. On Fine-Grained Relevance Scales

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  47. On the Volatility of Commercial Search Engines and its Impact on Information Retrieval Research

    Article • June 2018, ACM (Association for Computing Machinery)

    Gianluca Demartini

  48. Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection

    Article • Computer Supported Cooperative Work (CSCW), June 2018, Springer Science + Business Media

    Gianluca Demartini

  49. Measuring the Effect of Public Health Campaigns on Twitter: The Case of World Autism Awareness Day

    Article • January 2018, Springer Science + Business Media

    Gianluca Demartini

  50. Chapter 4: Using Twitter as a Data Source: An Overview of Ethical, Legal, and Methodological Challenges

    Article • December 2017, Emerald

    Gianluca Demartini

  51. Understanding Engagement through Search Behaviour

    Article • November 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  52. Considering Assessor Agreement in IR Evaluation

    Article • October 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  53. Modus Operandi of Crowd Workers

    Article • Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies, September 2017, ACM (Association for Computing Machinery)

    Gianluca Demartini

  54. An Introduction to Hybrid Human-Machine Information Systems

    Article • Foundations and Trends® in Web Science, January 2017, Now Publishers

    Gianluca Demartini

  55. Towards building a standard dataset for Arabic keyphrase extraction evaluation

    Article • November 2016, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  56. Scheduling Human Intelligence Tasks in Multi-Tenant Crowd-Powered Systems

    Article • April 2016, ACM (Association for Computing Machinery)

    Gianluca Demartini, Philippe Cudre-Mauroux

  57. Contextualized ranking of entity types based on knowledge graphs

    Article • Journal of Web Semantics, March 2016, Elsevier

    Gianluca Demartini

  58. A Tutorial on Leveraging Knowledge Graphs for Web Search

    Article • January 2016, Springer Science + Business Media

    Gianluca Demartini

  59. The Relationship Between User Perception and User Behaviour in Interactive Information Retrieval Evaluation

    Article • January 2016, Springer Science + Business Media

    Gianluca Demartini

  60. Hybrid human–machine information systems: Challenges and opportunities

    Article • Computer Networks, October 2015, Elsevier

    Gianluca Demartini

  61. Pooling-based continuous evaluation of information retrieval systems

    Article • Information Retrieval, September 2015, Springer Science + Business Media

    Gianluca Demartini

  62. Human Beyond the Machine: Challenges and Opportunities of Microtask Crowdsourcing

    Article • IEEE Intelligent Systems, July 2015, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  63. The Dynamics of Micro-Task Crowdsourcing

    Article • January 2015, ACM (Association for Computing Machinery)

    Gianluca Demartini

  64. Understanding Malicious Behavior in Crowdsourcing Platforms

    Article • January 2015, ACM (Association for Computing Machinery)

    Gianluca Demartini

  65. B-hist: Entity-centric search over personal web browsing history

    Article • Journal of Web Semantics, August 2014, Elsevier

    Gianluca Demartini

  66. Hippocampus

    Article • April 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  67. Correct Me If I'm Wrong

    Article • January 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  68. Effective named entity recognition for idiosyncratic web collections

    Article • January 2014, ACM (Association for Computing Machinery)

    Gianluca Demartini

  69. Entity disambiguation in tweets leveraging user social profiles

    Article • August 2013, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  70. Large-scale linked data integration using probabilistic reasoning and crowdsourcing

    Article • The VLDB Journal, July 2013, Springer Science + Business Media

    Gianluca Demartini

  71. NoizCrowd: A Crowd-Based Data Gathering and Management System for Noise Level Data

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  72. Ontology-Based Word Sense Disambiguation for Scientific Literature

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  73. TRank: Ranking Entity Types Using the Web of Data

    Article • January 2013, Springer Science + Business Media

    Gianluca Demartini

  74. The Bowlogna ontology: Fostering open curricula and agile knowledge bases for Europe's higher education landscape

    Article • Semantic Web, January 2013, IOS Press

    Gianluca Demartini

  75. ZenCrowd

    Article • April 2012, ACM (Association for Computing Machinery)

    Gianluca Demartini, Philippe Cudre-Mauroux

  76. BowlognaBench—Benchmarking RDF Analytics

    Article • January 2012, Springer Science + Business Media

    Gianluca Demartini

  77. Combining inverted indices and structured search for ad-hoc object retrieval

    Article • January 2012, ACM (Association for Computing Machinery)

    Gianluca Demartini

  78. Predicting the Future Impact of News Events

    Article • January 2012, Springer Science + Business Media

    Gianluca Demartini

  79. From people to entities

    Article • ACM SIGIR Forum, May 2011, ACM (Association for Computing Machinery)

    Gianluca Demartini

  80. Visual interfaces for stimulating exploratory search

    Article • January 2011, ACM (Association for Computing Machinery)

    Gianluca Demartini

  81. Report on INEX 2009

    Article • ACM SIGIR Forum, August 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  82. Why finding entities in Wikipedia is difficult, sometimes

    Article • Information Retrieval, May 2010, Springer Science + Business Media

    Gianluca Demartini

  83. Leveraging personal metadata for Desktop search: The Beagle++ system

    Article • Journal of Web Semantics, March 2010, Elsevier

    Gianluca Demartini

  84. Dear search engine: what's your opinion about...?

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  85. Entity summarization of news articles

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  86. Exploiting click-through data for entity retrieval

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  87. Overview of the INEX 2009 Entity Ranking Track

    Article • January 2010, Springer Science + Business Media

    Gianluca Demartini

  88. Ranking Entities Using Web Search Query Logs

    Article • January 2010, Springer Science + Business Media

    Gianluca Demartini

  89. TAER

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  90. The missing links

    Article • January 2010, ACM (Association for Computing Machinery)

    Gianluca Demartini

  91. An Architecture for Finding Entities on the Web

    Article • November 2009, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  92. Report on INEX 2008

    Article • ACM SIGIR Forum, June 2009, ACM (Association for Computing Machinery)

    Gianluca Demartini

  93. A Vector Space Model for Ranking Entities and Its Application to Expert Search

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  94. How to Trace and Revise Identities

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  95. L3S at INEX 2008: Retrieving Entities Using Structured Information

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  96. Overview of the INEX 2008 Entity Ranking Track

    Article • January 2009, Springer Science + Business Media

    Gianluca Demartini

  97. A Model for Ranking Entities and Its Application to Wikipedia

    Article • October 2008, Institute of Electrical & Electronics Engineers (IEEE)

    Gianluca Demartini

  98. Social recommendations of content and metadata

    Article • January 2008, ACM (Association for Computing Machinery)

    Gianluca Demartini

  99. Leveraging semantic technologies for enterprise search

    Article • January 2007, ACM (Association for Computing Machinery)

    Gianluca Demartini

  100. A Classification of IR Effectiveness Metrics

    Article • January 2006, Springer Science + Business Media

    Gianluca Demartini

  101. L3S at INEX 2007: Query Expansion for Entity Ranking Using a Highly Accurate Ontology

    Article • Springer Science + Business Media

    Gianluca Demartini

  102. Ranking Categories for Web Search

    Article • Springer Science + Business Media

    Gianluca Demartini

  103. Semantically Enhanced Entity Ranking

    Article • Springer Science + Business Media

    Gianluca Demartini