TY - JOUR TI - Methods for Evaluating Interactive Information Retrieval Systems with Users AU - Kelly, Diane T2 - Foundations and Trends® in Information Retrieval AB - This paper provides overview and instruction regarding the evaluation of interactive information retrieval systems with users. The primary goal of this article is to catalog and compile material related to this topic into a single source. This article (1) provides historical background on the development of user-centered approaches to the evaluation of interactive information retrieval systems; (2) describes the major components of interactive information retrieval system evaluation; (3) describes different experimental designs and sampling strategies; (4) presents core instruments and data collection techniques and measures; (5) explains basic data analysis techniques; and (4) reviews and discusses previous studies. This article also discusses validity and reliability issues with respect to both measures and methods, presents background information on research ethics and discusses some ethical issues which are specific to studies of interactive information retrieval (IIR). Finally, this article concludes with a discussion of outstanding challenges and future research directions. DA - 2009/04/28/ PY - 2009 DO - 10.1561/1500000012 DP - www.nowpublishers.com VL - 3 IS - 1–2 SP - 1 EP - 224 J2 - INR LA - en SN - 1554-0669, 1554-0677 UR - https://www.nowpublishers.com/article/Details/INR-012 Y2 - 2018/08/07/21:38:06 ER -