All Stories

  1. Open-Source Multimedia Retrieval with vitrivr-engine

    Article • October 2025, ACM (Association for Computing Machinery)

    Ralph Gasser, Luca Rossetto

  2. MeGraS: An Open-Source Store for Multimodal Knowledge Graphs

    Article • October 2025, ACM (Association for Computing Machinery)

    Luca Rossetto

  3. The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understanding

    Article • October 2025, ACM (Association for Computing Machinery)

    Luca Rossetto, Hoang Bao Le

  4. Towards a Universal Query Representation for Multimodal Information Retreival

    Article • October 2025, ACM (Association for Computing Machinery)

    Ralph Gasser, Luca Rossetto

  5. Overview of the First CASTLE Grand Challenge at ACM Multimedia 2025

    Article • October 2025, ACM (Association for Computing Machinery)

    Luca Rossetto

  6. NLQxform-UI: An Interactive and Intuitive Scholarly Question Answering System

    Article • July 2025, ACM (Association for Computing Machinery)

    Luca Rossetto, Zhiruo Zhang

  7. Effects of Human Cognition-Inspired Task Presentation on Interactive Video Retrieval

    Article • ACM Transactions on Multimedia Computing Communications and Applications, June 2025, ACM (Association for Computing Machinery)

    Luca Rossetto

  8. Introduction to the 8th Annual Lifelog Search Challenge, LSC'25

    Article • June 2025, ACM (Association for Computing Machinery)

    Luca Rossetto

  9. A SPARQL in the Dark: Shining a Light on Multimodal Lifelogs with LifeGraph 5

    Article • June 2025, ACM (Association for Computing Machinery)

    Luca Rossetto

  10. A Platform for Evaluating Chatbots

    Article • May 2025, ACM (Association for Computing Machinery)

    Luca Rossetto, Daan van der Weijden

  11. The role of user characteristics in the evaluation of recommender systems recommendations

    Article • ACM Transactions on Recommender Systems, April 2025, ACM (Association for Computing Machinery)

    Luca Rossetto, Kathrin Wardatzky

  12. An Extended Evaluation of Single-Label Multi-modal Field of Research Classification Using a Taxonomy-Based Metric

    Article • January 2025, Springer Science + Business Media

    Luca Rossetto

  13. Feature-Driven Video Segmentation and Advanced Querying with vitrivr-Engine

    Article • January 2025, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  14. Simplified Video Retrieval in Virtual Reality with vitrivr-VR

    Article • January 2025, Springer Science + Business Media

    Luca Rossetto

  15. The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-24

    Article • IEEE Access, January 2025, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  16. Estimating the Semantic Density of Visual Media

    Article • October 2024, ACM (Association for Computing Machinery)

    Luca Rossetto

  17. Performance Evaluation in Multimedia Retrieval

    Article • ACM Transactions on Multimedia Computing Communications and Applications, October 2024, ACM (Association for Computing Machinery)

    Ralph Gasser, Luca Rossetto

  18. A Comparison of Late-Fusion Training Strategies for Quad-Modal Joint Embeddings

    Article • September 2024, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  19. General Purpose Multimedia Retrieval with vitrivr at LSC'24

    Article • June 2024, ACM (Association for Computing Machinery)

    Ralph Gasser, Luca Rossetto

  20. LifeGraph 4 - Lifelog Retrieval using Multimodal Knowledge Graphs and Vision-Language Models

    Article • June 2024, ACM (Association for Computing Machinery)

    Luca Rossetto, Kathrin Wardatzky

  21. Spatiotemporal Lifelog Analytics in Virtual Reality with vitrivr-VR

    Article • June 2024, ACM (Association for Computing Machinery)

    Luca Rossetto

  22. Reproducibility Companion Paper of "MMSF: A Multimodal Sentiment-Fused Method to Recognize Video Speaking Style"

    Article • May 2024, ACM (Association for Computing Machinery)

    Luca Rossetto

  23. Introduction to the Seventh Annual Lifelog Search Challenge, LSC'24

    Article • May 2024, ACM (Association for Computing Machinery)

    Luca Rossetto

  24. OpenLifelogCam - A Low-Cost Open-Source Wearable Camera Platform

    Article • May 2024, ACM (Association for Computing Machinery)

    Luca Rossetto

  25. A New Retrieval Engine for Vitrivr

    Article • January 2024, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  26. Augmented Reality Photo Presentation and Content-Based Image Retrieval on Mobile Devices with AR-Explorer

    Article • January 2024, Springer Science + Business Media

    Luca Rossetto

  27. Evaluating Performance and Trends in Interactive Video Retrieval: Insights From the 12th VBS Competition

    Article • IEEE Access, January 2024, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  28. Exploring Multimedia Vector Spaces with vitrivr-VR

    Article • January 2024, Springer Science + Business Media

    Luca Rossetto

  29. QAGCN: Answering Multi-relation Questions via Single-Step Implicit Reasoning over Knowledge Graphs

    Article • January 2024, Springer Science + Business Media

    Luca Rossetto

  30. Single-Label Multi-modal Field of Research Classification

    Article • January 2024, Springer Science + Business Media

    Luca Rossetto

  31. Spatially Localised Immersive Contemporary and Historic Photo Presentation on Mobile Devices in Augmented Reality

    Article • October 2023, ACM (Association for Computing Machinery)

    Luca Rossetto, Tim Bachmann

  32. Advances in lifelog retrieval at the lifelog search challenge 2021

    Article • Multimedia Tools and Applications, September 2023, Springer Science + Business Media

    Luca Rossetto

  33. Novice-Friendly Text-based Video Search with vitrivr

    Article • September 2023, ACM (Association for Computing Machinery)

    Luca Rossetto

  34. Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS

    Article • Multimedia Systems, August 2023, Springer Science + Business Media

    Luca Rossetto

  35. Gesture retrieval and its application to the study of multimodal communication

    Article • International Journal on Digital Libraries, July 2023, Springer Science + Business Media

    Luca Rossetto

  36. Multi-Mode Clustering for Graph-Based Lifelog Retrieval

    Article • June 2023, ACM (Association for Computing Machinery)

    Luca Rossetto

  37. The Best of Both Worlds: Lifelog Retrieval with a Desktop-Virtual Reality Hybrid System

    Article • June 2023, ACM (Association for Computing Machinery)

    Luca Rossetto, Ralph Gasser

  38. A Comparison of Video Browsing Performance between Desktop and Virtual Reality Interfaces

    Article • June 2023, ACM (Association for Computing Machinery)

    Ralph Gasser, Luca Rossetto, Silvan Heller

  39. Introduction to the Sixth Annual Lifelog Search Challenge, LSC’23

    Article • June 2023, ACM (Association for Computing Machinery)

    Luca Rossetto

  40. Trolleys, crashes, and perception—a survey on how current autonomous vehicles debates invoke problematic expectations

    Article • AI and Ethics, April 2023, Springer Science + Business Media

    Luca Rossetto

  41. Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021

    Article • IEEE Access, January 2023, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  42. Exploring Effective Interactive Text-Based Video Search in vitrivr

    Article • January 2023, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  43. Link-Rot in Web-Sourced Multimedia Datasets

    Article • January 2023, Springer Science + Business Media

    Luca Rossetto

  44. Traceable Asynchronous Workflows in Video Retrieval with vitrivr-VR

    Article • January 2023, Springer Science + Business Media

    Luca Rossetto

  45. An Asynchronous Scheme for the Distributed Evaluation of Interactive Multimedia Retrieval

    Article • October 2022, ACM (Association for Computing Machinery)

    Luca Rossetto, Ralph Gasser

  46. Open Challenges of Interactive Video Search and Evaluation

    Article • October 2022, ACM (Association for Computing Machinery)

    Luca Rossetto

  47. IMuR 2022

    Article • October 2022, ACM (Association for Computing Machinery)

    Luca Rossetto

  48. A Multi-Stream Approach for Video Understanding

    Article • October 2022, ACM (Association for Computing Machinery)

    Lutharsanen Kunam, Luca Rossetto

  49. Introduction to the Fifth Annual Lifelog Search Challenge, LSC'22

    Article • June 2022, ACM (Association for Computing Machinery)

    Luca Rossetto

  50. vitrivr at the Lifelog Search Challenge 2022

    Article • June 2022, ACM (Association for Computing Machinery)

    Silvan Heller, Luca Rossetto

  51. Interactive video retrieval evaluation at a distance: comparing sixteen interactive video search systems in a remote setting at the 10th Video Browser Showdown

    Article • International Journal of Multimedia Information Retrieval, January 2022, Springer Science + Business Media

    Luca Rossetto

  52. A Task Category Space for User-Centric Comparative Multimedia Search Evaluations

    Article • January 2022, Springer Science + Business Media

    Luca Rossetto

  53. HyText – A Scene-Text Extraction Method for Video Retrieval

    Article • January 2022, Springer Science + Business Media

    Luca Rossetto

  54. Multi-modal Interactive Video Retrieval with Temporal Queries

    Article • January 2022, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  55. Multi-modal Video Retrieval in Virtual Reality with vitrivr-VR

    Article • January 2022, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  56. On the User-Centric Comparative Remote Evaluation of Interactive Video Search Systems

    Article • IEEE Multimedia, October 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto, Ralph Gasser

  57. Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21

    Article • August 2021, ACM (Association for Computing Machinery)

    Luca Rossetto

  58. Exploring Intuitive Lifelog Retrieval and Interaction Modes in Virtual Reality with vitrivr-VR

    Article • August 2021, ACM (Association for Computing Machinery)

    Silvan Heller, Luca Rossetto, Ralph Gasser

  59. Interactive Multimodal Lifelog Retrieval with vitrivr at LSC 2021

    Article • August 2021, ACM (Association for Computing Machinery)

    Silvan Heller, Luca Rossetto, Ralph Gasser

  60. Exploring Graph-querying approaches in LifeGraph

    Article • August 2021, ACM (Association for Computing Machinery)

    Luca Rossetto, Ralph Gasser

  61. Is the Reign of Interactive Search Eternal? Findings from the Video Browser Showdown 2020

    Article • ACM Transactions on Multimedia Computing Communications and Applications, July 2021, ACM (Association for Computing Machinery)

    Luca Rossetto, Jaeyub Song

  62. Gesture of Interest: Gesture Search for Multi-Person, Multi-Perspective TV Footage

    Article • June 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  63. Interactive Video Retrieval in the Age of Deep Learning – Detailed Evaluation of VBS 2019

    Article • IEEE Transactions on Multimedia, January 2021, Institute of Electrical & Electronics Engineers (IEEE)

    Ralph Gasser, Luca Rossetto

  64. A System for Interactive Multimedia Retrieval Evaluations

    Article • January 2021, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  65. Competitive Interactive Video Retrieval in Virtual Reality with vitrivr-VR

    Article • January 2021, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  66. Considering Human Perception and Memory in Interactive Multimedia Retrieval Evaluations

    Article • January 2021, Springer Science + Business Media

    Luca Rossetto

  67. VideoGraph – Towards Using Knowledge Graphs for Interactive Video Retrieval

    Article • January 2021, Springer Science + Business Media

    Luca Rossetto

  68. Cottontail DB: An Open Source Database for Multimedia

    Article • October 2020, ACM (Association for Computing Machinery)

    Luca Rossetto, Silvan Heller, Ralph Gasser

  69. Towards Using Semantic-Web Technologies for Multi-Modal Knowledge Graph Construction

    Article • October 2020, ACM (Association for Computing Machinery)

    Luca Rossetto

  70. Multi-Stage Queries and Temporal Scoring in Vitrivr

    Article • July 2020, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  71. LifeGraph: A Knowledge Graph for Lifelogs

    Article • June 2020, ACM (Association for Computing Machinery)

    Luca Rossetto

  72. Are You Watching Closely? Content-based Retrieval of Hand Gestures

    Article • June 2020, ACM (Association for Computing Machinery)

    Luca Rossetto

  73. Combining Boolean and Multimedia Retrieval in vitrivr for Large-Scale Video Search

    Article • December 2019, Springer Science + Business Media

    Luca Rossetto, Ralph Gasser

  74. Multimodal Multimedia Retrieval with vitrivr

    Article • June 2019, ACM (Association for Computing Machinery)

    Ralph Gasser, Luca Rossetto

  75. Retrieval of Structured and Unstructured Data with vitrivr

    Article • June 2019, ACM (Association for Computing Machinery)

    Ralph Gasser, Silvan Heller, Luca Rossetto

  76. Interactive Video Retrieval in the Age of Deep Learning

    Article • June 2019, ACM (Association for Computing Machinery)

    Luca Rossetto

  77. V3C1 Dataset

    Article • June 2019, ACM (Association for Computing Machinery)

    Luca Rossetto

  78. VIRTUE

    Article • March 2019, ACM (Association for Computing Machinery)

    Ralph Gasser, Silvan Heller, Luca Rossetto

  79. Deep Learning-Based Concept Detection in vitrivr

    Article • December 2018, Springer Science + Business Media

    Ralph Gasser, Luca Rossetto

  80. V3C – A Research Video Collection

    Article • December 2018, Springer Science + Business Media

    Luca Rossetto

  81. Exploring Cultural Heritage in Augmented Reality with GoFind!

    Article • December 2018, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto

  82. Open-source column

    Article • ACM SIGMultimedia Records, January 2018, ACM (Association for Computing Machinery)

    Luca Rossetto

  83. Competitive Video Retrieval with vitrivr

    Article • January 2018, Springer Science + Business Media

    Ralph Gasser, Luca Rossetto

  84. The Long Tail of Web Video

    Article • January 2018, Springer Science + Business Media

    Luca Rossetto

  85. Multimodal Video Retrieval with the 2017 IMOTION System

    Article • June 2017, ACM (Association for Computing Machinery)

    Luca Rossetto

  86. “Hey, vitrivr!” – A Multimodal UI for Video Retrieval

    Article • January 2017, Springer Science + Business Media

    Luca Rossetto

  87. Enhanced Retrieval and Browsing in the IMOTION System

    Article • December 2016, Springer Science + Business Media

    Luca Rossetto

  88. vitrivr

    Article • October 2016, ACM (Association for Computing Machinery)

    Luca Rossetto

  89. Interactive video search tools: a detailed analysis of the video browser showdown 2015

    Article • Multimedia Tools and Applications, July 2016, Springer Science + Business Media

    Luca Rossetto

  90. Semantic Sketch-Based Video Retrieval with Autocompletion

    Article • March 2016, ACM (Association for Computing Machinery)

    Luca Rossetto

  91. Dealing with Ambiguous Queries in Multimodal Video Retrieval

    Article • January 2016, Springer Science + Business Media

    Luca Rossetto

  92. IMOTION – Searching for Video Sequences Using Multi-Shot Sketch Queries

    Article • January 2016, Springer Science + Business Media

    Luca Rossetto

  93. Searching in Video Collections Using Sketches and Sample Images – The Cineast System

    Article • January 2016, Springer Science + Business Media

    Luca Rossetto

  94. iAutoMotion – an Autonomous Content-Based Video Retrieval Engine

    Article • January 2016, Springer Science + Business Media

    Luca Rossetto

  95. IMOTION — A Content-Based Video Retrieval Engine

    Article • January 2015, Springer Science + Business Media

    Luca Rossetto

  96. Cineast: A Multi-feature Sketch-Based Video Retrieval Engine

    Article • December 2014, Institute of Electrical & Electronics Engineers (IEEE)

    Luca Rossetto