Skip to Main Content

Systematic review

A step by step guide to doing a systematic review or other forms of Evidence Synthesis

Test your search results

As you've probably discovered in creating your search strategy so far, searching is an iterative process so a mandatory part of this process is testing and refining search strategies. You need to be confident your searches are working as you expect and giving you the "right" results before you start translating your master search into other databases and doing supplementary searching.

  • While a bit of "noise" (results that are correctly identified but not relevant) is expected in systematic search results, if your search is too sensitive you will find screening a long and tiresome task. Too much "noise" ends up as 1000s of irrelevant references you have to scan over and subsquently exclude after discovering they are totally unrelated to your topic.
  • A search that is too specific will yield a suspiciously smaller number of results all which seem very relevant, meaning you have likely missed unknown yet relevant results because your search has been too narrow or precise in its approach.
  • Long, complex search strings and strategies are also vulnerable to spelling mistakes, accidental omissions of search terms and incorrectly used boolean combinations, which again means you will have missed identifying relevant results.

 

The consequences of not properly testing searches can be severe!

If issues with searches are discovered during later review stages (often when an expected article has not appeared during the ti/ab screening) the resulting processes are very time consuming. To continue conduct your review correctly you will have to delete all previous results from reference management software and/or Covidence, rewrite, retest and rerun your searches (so as to properly identify any previously missed material) and begin screening from scratch using your new more comprehensive search results.

Testing and refining

Last Updated: Nov 17, 2026 11:58 AM