Contribution

Methods for Evaluating Interactive Information Retrieval Systems with Users

Resource type
Author/contributor
Title
Methods for Evaluating Interactive Information Retrieval Systems with Users
Abstract
This paper provides overview and instruction regarding the evaluation of interactive information retrieval systems with users. The primary goal of this article is to catalog and compile material related to this topic into a single source. This article (1) provides historical background on the development of user-centered approaches to the evaluation of interactive information retrieval systems; (2) describes the major components of interactive information retrieval system evaluation; (3) describes different experimental designs and sampling strategies; (4) presents core instruments and data collection techniques and measures; (5) explains basic data analysis techniques; and (4) reviews and discusses previous studies. This article also discusses validity and reliability issues with respect to both measures and methods, presents background information on research ethics and discusses some ethical issues which are specific to studies of interactive information retrieval (IIR). Finally, this article concludes with a discussion of outstanding challenges and future research directions.
Publication
Foundations and Trends® in Information Retrieval
Volume
3
Issue
1–2
Pages
1-224
Date
2009/4/28
Journal Abbr
INR
Language
en
DOI
10.1561/1500000012
ISSN
1554-0669, 1554-0677
Accessed
2018-08-07T21:38:06Z
Library Catalog
Citation
Kelly, D. (2009). Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends® in Information Retrieval, 3(1–2), 1–224. https://doi.org/10.1561/1500000012
Field of study