Skip to Main content Skip to Navigation
Journal articles

Test case design for context-aware applications: Are we there yet?

Abstract : Abstract Context Current software systems have increasingly implemented context-aware adaptations to handle the diversity of conditions of their surrounding environment. Therefore, people are becoming used to a variety of context-aware software systems (CASS). This context-awareness brings challenges to the software construction and testing because the context is unpredictable and may change at any time. Therefore, software engineers need to consider the dynamic context changes while testing CASS. Different test case design techniques (TCDT) have been proposed to support the testing of CASS. However, to the best of our knowledge, there is no analysis of these proposals on the advantages, limitations and their effective support to context variation during testing. Objective To gather empirical evidence on TCDT concerned with CASS by identifying, evaluating and synthesizing knowledge available in the literature. Method To undertake a secondary study (quasi-Systematic Literature Review) on TCDT for CASS regarding their assessed quality characteristics, used coverage criteria, test type, and test technique. Results From 833 primary studies published between 2004 and 2014, just 17 studies regard the design of test cases for CASS. Most of them focus on functional suitability. Furthermore, some of them take into account the changes in the context by providing specific test cases for each context configuration (static perspective) during the test execution. These 17 studies revealed five challenges affecting the design of test cases and 20 challenges regarding the testing of CASS. Besides, seven TCDT are not empirically evaluated. Conclusion A few TCDT partially support the testing of CASS. However, it has not been observed evidence on any TCDT supporting the truly context-aware testing, which that can adapt the expected output based on the context variation (dynamic perspective) during the test execution. It is an open issue deserving greater attention from researchers to increase the testing coverage and ensure users confidence in CASS.
Document type :
Journal articles
Complete list of metadata

https://hal-uphf.archives-ouvertes.fr/hal-03402068
Contributor : Kathleen TORCK Connect in order to contact the contributor
Submitted on : Monday, October 25, 2021 - 3:12:24 PM
Last modification on : Friday, May 6, 2022 - 3:42:22 PM

Identifiers

Collections

Citation

Ismayle S. Santos, Rossana M.C. Andrade, Ana Regina Rocha, Santhiago Matalonga, Káthia Marçal de Oliveira, et al.. Test case design for context-aware applications: Are we there yet?. Information and Software Technology, Elsevier, 2017, 88, pp.1-16. ⟨10.1016/j.infsof.2017.03.008⟩. ⟨hal-03402068⟩

Share

Metrics

Record views

6