Skip to Main content Skip to Navigation
Conference papers

An Approach for the Selection of Evaluation Methods for Interactive Adaptive Systems Using Analytic Hierarchy Process

Abstract : The evaluation of interactive adaptive systems is the source of many difficulties for novice evaluators as well as for expert ones. Issues arise in the need to identify the appropriate evaluation methods to be used for a given evaluation context. This paper proposes an approach for the choice of evaluation methods for interactive adaptive systems with regard to their suitability depending on specific evaluation contexts. A multicriteria decision making approach, namely the Analytic Hierarchy Process, is proposed for the selection methodology. The approach is based on a pair-wise comparison of a number of criteria that affect the choice of the appropriate evaluation methods. Four user-centred evaluation methods in conjunction with the layered evaluation for interactive adaptive systems are presented in the cases studies. These methods are: user-as-wizard, heuristic evaluation, focus group, and user test. The proposed approach is flexible in the sense that it can be used in the case of different evaluation methods. The results depend on the evaluation context where the methods will be used. Hence, we illustrate the proposed approach in the case of two evaluation contexts.
Document type :
Conference papers
Complete list of metadata

https://hal-uphf.archives-ouvertes.fr/hal-03350506
Contributor : Frédéric Pruvost Connect in order to contact the contributor
Submitted on : Tuesday, September 21, 2021 - 1:25:38 PM
Last modification on : Monday, May 16, 2022 - 9:37:11 AM

Identifiers

Collections

Citation

Amira Dhouib, Abdelwaheb Trabelsi, Christophe Kolski, Neji Mahmoud. An Approach for the Selection of Evaluation Methods for Interactive Adaptive Systems Using Analytic Hierarchy Process. 10th International Conference on Research Challenges in Information Science, RCIS 2016, Institute of Electrical and Electronics Engineers(IEEE), May 2016, Grenoble, France. pp.411-420, ⟨10.1109/RCIS.2016.7549289⟩. ⟨hal-03350506⟩

Share

Metrics

Record views

11