Table 12GRADE Evidence Profile: Predictive value of commercial IGRA for incident active TB in low- and middle-Income countries

No of Participants
(studies)
Study designLimitationsIndirectnessInconsistencyImprecisionPublication BiasQuality of Evidence
(GRADE)1
Importance
A. Outcome: Efficacy of preventive therapy based on IGRA results
No studiesCritical (7-9)
B. Outcome: Prospective predictive value of IGRA for the development of active incident TB? (Do IGRA positive results have a stronger association with subsequent development of active TB compared to IGRA negative results?)
7,392 (3) B1Cohort studiesSerious (-1) B2Serious (-1) B3No serious inconsistency B4Very Serious (-2) B5Likely 6Very low
⊕○○○
Critical (7-9)
C. Outcome: Predictive value of IGRA for the development of active incident TB compared to the TST (Are IGRAs (positive vs. negative) have a stronger statistical association with subsequent active TB than the TST (positive vs. negative)?
7,392 (3) C1Cohort studiesSerious (-1) C2Serious (-1) C3No serious inconsistencyC4Very Serious (-2) C5Likely C6Very low
⊕○○○
Critical (7-9)
D. Outcome: Predictive value of IGRA for subsequent TB when IGRA are evaluated as part of a multivariable clinical algorithm for predicting TB (Additive value of IGRA)
No studiesImportant (4-6)
E. Outcome: Quantitative IGRA levels and subsequent rates of TB
721 (1) E1Cohort of TB case-contactsSerious (-1) E2Serious (-1) E3Serious (-1) E4Very Serious (-2) E5Likely E6Very low
⊕○○○
Important (4-6)
F. Outcome: Immunological phenotypes of discordant-concordant TST/IGRA pairs and subsequent rates of TB
5,861 (2) F1Cohort studiesSerious (-1) F2Serious (-1) F3Serious (-1) F4Very Serious (-2) F5Likely F6Very low
⊕○○○
Important (4-6)
G. Outcome: Sensitivity, Specificity, False positive rates etc for active TB (as surrogates of patient relevant outcomes)
7,392 (3)G1Cohort studiesSerious (-1) G2Serious (-1) G3Serious (-1) G4Very Serious (-2) G5Likely G6Very low
⊕○○○
Important (4-6)
H. Outcome: Utility of repeated or serial IGRA results for predicting subsequent incident active TB
No studiesImportant (4-6)

Footnotes

1

Quality of evidence was rated as high (no points subtracted), moderate (1 point subtracted), low (2 points subtracted), or very low (>2 points subtracted) based on five criteria: study limitations, indirectness of evidence, inconsistency in results across studies, imprecision in summary estimates, and likelihood of publication bias. For each outcome, the quality of evidence started at high when there were randomized controlled trials or high quality observational studies and at moderate when these types of studies were absent. We then subtracted one point when there was a serious issue identified or two points when there was a very serious issue identified in any of the criteria used to judge the quality of evidence.

B1

3 studies were eligible and thus included in the analysis; 1 published (China) and 2 unpublished (Zambia and South Africa). (N refers to numbers that entered follow-up)

B2

Based on the Newcastle-Ottawa scale, study samples were considered to be representative of specific groups of interest (i.e., silicosis patients (China), case-contacts (Zambia), adolescent school-goers) within the population and IGRA exposure groups were drawn from the same sample and therefore unlikely to introduce any bias. However, studies varied with regard to the comparability (adjustments made to effect measures) and outcome (ascertainment, losses to follow-up, reporting) components of the modified NOS. Lack of proper ascertainment of the TB outcome is considered to be the most serious of limitations. A point is deducted.

B3

The results of the studies could be generalized for the specific country/region and for those specific groups of interest. However, the small number of studies warrants caution; a point is deducted for indirectness.

B4

All 3 studies showed similar results and with very little heterogeneity in the pooled incidence rate ratio (I2=0%, p=0.912). No points were deducted.

B5

The number of incident TB cases was small in all studies and the rates of TB fairly moderate; confidence intervals for relative risk estimates were wide (precision > +/- 20%). This is a very serious limitation. Two points are deducted.

B6

Data included did not allow for formal assessment of publication bias using methods such as funnel plots or regression tests. Therefore, publication bias cannot be ruled out. Although no points were deducted, a degree of publication bias is likely because: 1) literature on IGRAs is rapidly exploding and currently unpublished studies may come out in future (although we made an attempt to include unpublished studies, our attempt was not comprehensive; we are aware of at least one unpublished study that was not assessed for this review); 2) there are anecdotal examples of unpublished negative studies on IGRAs; and 3) because a sizeable proportion of IGRA studies have some level of industry involvement or support, the risk of unpublished negative studies (or delayed publication of negative studies) is not trivial.

C1

All three studies provided incidence rates of TB stratified by IGRA as well as TST status at baseline. (N refers to numbers that entered follow-up)

C2

Serious limitations include lack of proper ascertainment of the TB outcome by smear and/culture, IGRA incorporated in the methods to diagnose TB (South Africa) and lack of adjustment of all confounders. A point is deducted.

C3

The results of the studies could be generalized for the specific country/region and for those specific groups of interest. However, the small number of studies warrants caution; a point is deducted for indirectness.

C4

The two tests perform comparably and any differences are not statistically significant as the 95% confidence intervals for the pooled IRRs overlap and there is no heterogeneity in the pooled estimates for either test (IGRA+: IRR=3.2, I2=0%, p=0.899 and TST+: IRR=2.3, I2=0%, p=0.383). No points deducted.

C5

The confidence intervals of the pooled IRRs are wide (precision > +/- 20%). This is a very serious limitation. Two points are deducted.

C6

Publication bias was not formally assessed, but is deemed likely. See B6.

E1

Only the Zambian study examined if there was an exposure-gradient relationship between baseline quantitative IGRA levels and subsequent rates of TB in those levels. (N refers to numbers included in this stratified analysis)

E2

Lack of proper ascertainment of the TB outcome by smear/culture for both studies. The Zambian study is unpublished and only an interim report was available, so quality could not be fully assessed. A point is deducted.

E3

There is only one study. There is serious indirectness. A point is deducted.

E4

There is only one study; inconsistency cannot be assessed. A point is deducted.

E5

The 95% confidence intervals per IGRA stratum were extremely wide (precision > +/- 20%). Two points are deducted.

E6

Publication bias was not formally assessed, but is deemed likely. See B6.

F1

The Zambia and South Africa studies further explored rates for TB in paired concordant and discordant TST/IGRA results. (N refers to number included in this stratified analysis)

F2

Serious limitations include lack of proper ascertainment of the TB outcome by smear and/culture, IGRA incorporated in the methods to diagnose TB (South Africa) and lack of adjustment of all confounders. A point is deducted

F3

Although results may be generalizable to similar L/MIC, there are only two studies. A point is deducted.

F4

Rates of TB during follow-up may be higher in those with double positive TST+/IGRA+ results than in those with double negative results. Both studies seem to suggest this. However, contrasting results are seen with regard to discordant pairs. Pooled estimates were not derived. The inconsistency in results is deemed serious; a point is deducted.

F5

Observed 95% confidence intervals around the rates per strata are wide (precision > +/- 20%).

F6

Publication bias was not formally assessed, but is deemed likely. See B6.

G1

All 3 studies were included in this evaluation of patient-relevant outcomes. The diagnostic accuracy estimates of sensitivity and specificity etc are surrogates of patient-relevant outcomes important for assessing the frequency and impact of either a false negative or false positive IGRA result at baseline. A falsely positive outcome may result in possible isoniazid preventive therapy (IPT) prescription for a period of 6-9months, depending on country guidelines. IPT, although safe, is not without serious adverse effects, notably, clinical hepatitis and the increased possibility of drug resistance in the future. Whilst a falsely negative result may result in no IPT being provided and the individual exposed to at least a 2-fold risk of developing TB in the future.

G2

Serious limitations include lack of proper ascertainment of the TB outcome by smear and/culture, IGRA incorporated in the methods to diagnose TB and lack of adjustment of all confounders for most studies. A point is deducted

G3

Although results may be generalizable to similar L/MIC, there are only three studies. A point is deducted.

G4

There is heterogeneity in individual studies' test accuracy estimates (e.g. specificity/false positive rates). A point is deducted.

G5

The summary estimates of sensitivity and specificity are moderate and the confidence intervals are wide (precision > +/- 20%). Two points are deducted.

G6

Publication bias was not formally assessed, but is deemed likely. See B6.

From: 7, GRADE tables

Cover of Use of Tuberculosis Interferon-Gamma Release Assays (IGRAs) in Low- and Middle- Income Countries
Use of Tuberculosis Interferon-Gamma Release Assays (IGRAs) in Low- and Middle- Income Countries: Policy Statement.
Copyright © World Health Organization 2011.

All rights reserved. Publications of the World Health Organization are available on the WHO web site (www.who.int) or can be purchased from WHO Press, World Health Organization, 20 Avenue Appia, 1211 Geneva 27, Switzerland (tel.: +41 22 791 3264; fax: +41 22 791 4857; e-mail: tni.ohw@sredrokoob).

Requests for permission to reproduce or translate WHO publications – whether for sale or for noncommercial distribution – should be addressed to WHO Press through the WHO web site (http://www.who.int/about/licensing/copyright_form/en/index.html).

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.