Risk of bias (quality) assessment
Assessment of risk bias in included studies
Two review authors (NH, MM) will independently assess risk of bias for each study using the criteria outlined in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011). We will resolve any disagreement by discussion or by involving a third assessor (EO).
(1) Random sequence generation (checking for possible selection bias)
We will describe for each included study the method used to generate the allocation sequence in sufficient detail to allow an assessment of whether it should produce comparable groups.
We will assess the method as:
low risk of bias (any truly random process, e.g., random number table; computer random number generator);
high risk of bias (any non-random process, e.g., odd or even date of birth; hospital or clinic record number);
unclear risk of bias.
(2) Allocation concealment (checking for possible selection bias)
We will describe for each included study the method used to conceal allocation to interventions prior to assignment and will assess whether intervention allocation could have been foreseen in advance of, or during recruitment, or changed after assignment.
We will assess the methods as:
low risk of bias (e.g., telephone or central randomisation; consecutively numbered sealed opaque envelopes);
high risk of bias (open random allocation; unsealed or non-opaque envelopes, alternation; date of birth);
unclear risk of bias.
(3.1) Blinding of participants and personnel (checking for possible performance bias)
We will describe for each included study the methods used, if any, to blind study participants and personnel from knowledge of which intervention a participant received. We will consider that studies are at low risk of bias if they were blinded, or if we judge that the lack of blinding would be unlikely to affect results. We will assess blinding separately for different outcomes or classes of outcomes.
We will assess the methods as:
low, high or unclear risk of bias for participants;
low, high or unclear risk of bias for personnel.
(3.2) Blinding of outcome assessment (checking for possible detection bias)
We will describe for each included study the methods used, if any, to blind outcome assessors from knowledge of which intervention a participant received. We will assess blinding separately for different outcomes or classes of outcomes.
We will assess methods used to blind outcome assessment as:
low, high or unclear risk of bias.
(4) Incomplete outcome data (checking for possible attrition bias due to the amount, nature and handling of incomplete outcome data)
We will describe for each included study, and for each outcome or class of outcomes, the completeness of data including attrition and exclusions from the analysis. We will state whether attrition and exclusions were reported and the numbers included in the analysis at each stage (compared with the total randomised participants), reasons for attrition or exclusion where reported, and whether missing data were balanced across groups or were related to outcomes. Where sufficient information is reported, or can be supplied by the trial authors, we will re-include missing data in the analyses which we undertake.
We will assess methods as:
low risk of bias (e.g., no missing outcome data; missing outcome data balanced across groups);
high risk of bias (e.g., numbers or reasons for missing data imbalanced across groups; ‘as treated’ analysis done with substantial departure of intervention received from that assigned at randomisation);
unclear risk of bias.
(5) Selective reporting (checking for reporting bias)
We will describe for each included study how we investigated the possibility of selective outcome reporting bias and what we found.
We will assess the methods as:
low risk of bias (where it is clear that all of the study’s pre-specified outcomes and all expected outcomes of interest to the review have been reported);
high risk of bias (where not all the study’s pre-specified outcomes have been reported; one or more reported primary outcomes were not pre-specified; outcomes of interest are reported incompletely and so cannot be used; study fails to include results of a key outcome that would have been expected to have been reported);
unclear risk of bias.
(6) Other bias (checking for bias due to problems not covered by (1) to (5) above)
We will describe for each included study any important concerns we have about other possible sources of bias.
We will assess whether each study was free of other problems (including the compliance of intervention) that could put it at risk of bias:
low risk of other bias;
high risk of other bias;
unclear whether there is risk of other bias.
(7) Overall risk of bias
We will make explicit judgements about whether studies are at high risk of bias, according to the criteria given in the Handbook (Higgins 2011). With reference to (1) to (6) above, we will ass