Evidence-Based Software Engineering

EBSE for...

Technical Reports


Results from Case Study 1 - Quality Checklists

Author(s)Barbara Kitchenham, Pearl Brereton, David Budgen, Li Zhi
InstitutionKeele University and Durham University

This paper reports the results of one research question addressed by a case study undertaken by the EPIC project to investigate the use of Systematic Literature Reviews in software Engineering. The specific research question addressed in this report is:

  • RQ10: How useful are the quality checklists provided in the latest version of the Guidelines for performing systematic literature reviews.

The research question was decomposed into four separate propositions, but this report only addresses the first three propositions.

The results of the study indicate that the checklists in our Systematic Literature Review Guidelines are reasonably complete and lead to the use of a common terminology for quality questions selected for a specific systematic literature review (SLR). However, the Guideline checklists do not provide sufficient help with the construction of a quality checklist for a specific SLR either for novices or for experienced researchers.

We identify a number of ways in which the Guidelines document should be amended including using a much shorter generic checklist, providing criteria for answering questions, and developing a process for quality checklist construction.

BibtexNo bibtex entry
DetailsA PDF version of the report is available.
[Download | QuickRef]