What is it about?
We introduce the Relevance Assessment Tool (RAT), which allows researchers to design complex search engine retrieval effectiveness studies. This Web-based tool consists of different modules that researchers can use to design tests, to collect results from different search engines using a screen-scraping approach, and to collect judgments from a multitude of jurors using a crowdsourcing approach. We designed the software as a Web-based application, which allows for a distributed collection of relevance judgments, and the like. Using the Relevance Assessment Tool allows for much larger search engine studies than previously conducted. To our knowledge, there is no comparable tool that was developed in the academic context. Therefore, no information regarding the design of such software was available to-date.
Featured Image
Read the Original
This page is a summary of: Designing search engine retrieval effectiveness tests with RAT, Information Services & Use, June 2013, IOS Press,
DOI: 10.3233/isu-130691.
You can read the full text:
Resources
SearchStudies: Prof. Dr. Dirk Lewandowski
Prof. Dr. Dirk Lewandowski is a professor of information research and information retrieval at the Hamburg University of Applied Sciences, Germany. He is the editor of Aslib Journal of Information Management (formerly: Aslib Proceedings), a ISI-ranked information science journal.
SearchStudies: Sebastian Sünkler (M.A.)
Sebastian Sünkler is a research assistant and lecturer at the Department of Information at the Hamburg University of Applied Sciences.
Contributors
The following have contributed to this page