Use of Mixed Treatment Comparisons in Systematic Reviews

Clinicians and decisionmakers often have to select from multiple available interventions when determining the optimal treatment for disease. Ideally, high-quality randomized controlled trials (RCTs) that estimate the effectiveness of all possible interventions directly against one another would be available to guide decisionmaking. However, interventions are commonly compared with placebo or non-active control in RCTs rather than another active intervention and when direct comparative trials exist they are between two of a larger group of possible treatments. As such decisionmakers are faced with a lack of adequate direct comparative data to make their judgments. In the absence of direct comparative data, indirect comparisons may provide valuable information. For example, if two different interventions have been evaluated against a common comparator, the relative effects of the two interventions compared with each other can be estimated indirectly. Even in the presence of direct comparative data, indirect comparisons may add value to the interpretation of comparative effectiveness, as usually more than two treatments for a given disease are considered in clinical practice (even if all treatments are not directly compared). According to the Conducting Quantitative Synthesis When Comparing Medical Interventions chapter of the Evidence-based Practice Center (EPC) methods guide, investigators may choose to implement an indirect or mixed treatment comparison (MTC) in order to make statistical comparisons between interventions. Several methodologies exist to indirectly compare interventions, as do modes to implement such methodologies. These include anchored indirect comparisons as described by Bucher et al., Frequentist MTC and Bayesian MTC. In the simplest form, interventions that are evaluated against a common comparator in separate trials can be compared to each other indirectly using an anchored indirect treatment comparison approach. This and related approaches have been previously addressed in a heath technology assessment report by Glenny et al. and consequently are not the focus of this report.8 As a generalization of indirect comparisons, when more than two treatments are being compared indirectly, and at least one pair of treatments is being compared both directly and indirectly (a closed loop is present), both direct and indirect types of data can be used to estimate effects in a network meta-analysis using a Bayesian or Frequentist framework. Although these latter methodologies for synthesizing networks of studies with at least one closed loop are frequently employed, best practices for their use are unclear. This report is divided into three parts, each with its own objective. Part one: Summarize publicly available guidance discussing when and how to conduct a MTC as well as how to interpret and report the results of such analysis. We will highlight guidance on methods to synthesize MTCs. However, we will also summarize guidance applicable to network meta-analysis in general when such guidance also applies to MTC. Part two: Identify either Bayesian or Frequentist MTCs that were published since 2006, and summarize their characteristics. Part three: Gather insight from investigators who have conducted either Bayesian or Frequentist MTCs, as identified in part two of this project. More specifically, investigators will be queried about how elements of such methodology should be chosen and reported.