Skip to Main Content
It looks like you're using Internet Explorer 11 or older. This website works best with modern browsers such as the latest versions of Chrome, Firefox, Safari, and Edge. If you continue with this browser, you may see unexpected results.

Systematic Reviews

This guide describes all steps involved in the conduct of a systematic review

Introduction

The next step of the SR process is to read the full text of each included study and extract the pertinent data using a standardized data extraction/coding form. According to MECIR Box 5.4.a , data collection for systematic reviews should be performed using structured data collection forms. This is mandatory for Cochrane reviews, but advisable for other systematic reviews.

The aim of a meta-analysis is to collate quantitative data from the studies under review in order to provide a more precise effect of the results. This requires diving deep into the data of each of the publications. Scrutinizing the data can also help you uncover additional bias. For example, are the characteristics of both groups under investigation comparable? Data analysis starts with the extraction of the data from the primary articles. Then, the data needs to be standardized and analyzed. Finally, you need to present your findings in an appropriate manner. Tools exist that can assist in every step of the process. Which data you took, how it was extracted and what analysis you did on them all needs to be adequately described in the report.

Dimension Questions/Considerations
Who

Who collected the data?

Who owns the data?

The methods behind the data collection design and process

How

The statistics behind the data cleaning

The algorithms behind the data processing

Where Where is the data stored?
Why For what purpose was the data collected?
When When was the data collected?

Source: Heather Krause, Data Biographies: Getting to Know Your Data

Step 1: Data Extraction

The first step in the process is data extraction. This can be as simple as copying one value of interest from all the articles under review, to collecting large data sets in different formats. Key in this phase is to work meticulously. It can help if the data is extracted by two independent researchers who check each other’s work. Prepare a template that is suitable for capturing all the data.

Tools

Step 2: Data analysis

Once the data is properly retrieved it needs to be standardized so that the results of the different studies can be compared. Then, you can perform the desired analysis on the data. If you do any form of data-analysis (e.g., in a meta-analysis) use statistics to support the validity of your claims. This can be done in Excel in combination with an add-on designed specifically for performing meta-analysis. Alternatively you can do it in JASP, a free tool from the university of Amsterdam designed for statistics on datasets.

We strongly advise to consult a statistician during this phase of the systematic review!

Step 3: Data presentation

When you performed the desired analyses on the data, you need to present them in a suitable way in the report. The classical way of representing the outcome of a meta-analysis is in a forest plot. Forest plots can be made with excel (Tutorial) or with JASP (Tutorial).

Always double check, to make sure that your tables and figures are legible!

Tools for data analysis

Type Tool Used for: Paid/free Tutorial
Word template Cochrane data collection form capturing clinical data from publications free
Word template cochrane Data collection form: RCTs and non-RCTs capturing clinical data from publications free
Data extraction software Systematic Review Data Repository Automatic data extraction from publications free SRDR - Systematic Review Data Repository | Help & Training
Data extraction software DistillerSR Automatic data extraction from publications Paid (free trial) DistillerSR
Data extraction software ATLAS.ti Automatic data extraction from publications Paid (free trial) ATLAS.ti
Data extraction software MAXQDA Automatic data extraction from publications Paid (free trial) MAXQDA
Data extraction software Plot Digitizer Data extraction from graphs Free Tutorial of WebPlotDigitizer - YouTube
Statistical software Excel Statistical analysis, making forrest plots Paid tutorial on how to do a meta-analysis in Excel | Spreadsheet Synthesis - YouTube
Statistical software Excel Meta-essentials Statistical analysis, making forrest plots Free Meta-Analysis-12 Meta Analysis using Meta Essential - YouTube
Statistical software Jasp Statistical analysis, making forrest plots Free Introducing JASP - YouTube