Table 11GRADE Evidence Profile: Performance of IGRAs for the diagnosis of LTBI in contacts of active TB in low-and middle-income countries

No of Participants
(studies)
Study designLimitationsIndirectnessInconsistencyImprecisionPublication biasQuality of evidence
(GRADE)1
Importance
A. Efficacy of preventive therapy based on IGRA test results
No StudiesCritical (7-9)
B. Predictive value of IGRA for active TB
9 studies:Covered inPredictive SR:Rangaka et alCritical (7-9)
C. Outcome: Correlation between IGRAs and different gradients of TB exposure (ordinal, continuous, etc.)
3,868 (9)A1Cross-sectionalSerious A2
(-1)
No Serious indirectnessA3SeriousA4
(-1)
No serious imprecision A5Likely A6Low
⊕⊕○○
Critical (7-9)
D. Outcome: Correlation between IGRAs and TB exposure as a dichotomous variable
3,145 (6) B1Mainly cross-sectionalSerious B2
(-1)
No Serious indirectnessB3Serious B4
(-1)
Serious B5
(-1)
LikelyB6Very Low
⊕○○○
Critical (7-9)
E. Outcome: Correlation between IGRA conversions and TB exposure
309 (2) C1LongitudinalSerious C2
(-1)
No Serious indirectnessC3Very SeriousC4
(-2)
SeriousC5
(-1)
LikelyC6Very Low
⊕○○○
Critical
(7-9)
F. Outcome: Sensitivity for active TB (as a surrogate reference standard for LTBI)
No StudiesImportant (4-6)
G. Outcome: Concordance with tuberculin skin test (TST)
5,080 (16)D1Mainly cross-sectionalSerious D2
(-1)
Very SeriousD3
(-2)
Very SeriousD4
(-2)
SeriousD5
(-1)
LikelyD6Very Low
⊕○○○
Important (4-6)

Footnotes:

1

Quality of evidence was rated as high (no points subtracted), moderate (1 point subtracted), low (2 points subtracted), or very low (>2 points subtracted) based on five criteria: imitations, indirectness, inconsistency, imprecision, and publication bias. For each outcome, the quality of evidence started at high when there were randomized controlled trials or high quality observational studies (cross-sectional or cohort studies with diagnostic uncertainty and direct comparison of test results with culture) and at moderate when these types of studies were absent. One point was subtracted when there was a serious issue identified or two points when there was a very serious issue identified in any of the criteria used to judge the quality of evidence.

A1

9 studies were included: 1 study evaluated both T-SPOT.TB and QFT-GIT, 2 studies evaluated T-SPOT.TB, the 6 remaining studies evaluated QFT-GIT(n=5) or QFT-G(n=1).

A2

2 out of 9 studies were unpublished and quality indicators could not be assessed; remaining study populations were considered to be representative, however, only 1 of the remaining 7 studies reported that assessment of test results was performed blinded to other test results. Only 2/7 reported the blood draw had been performed prior to the TST.

A3

33% (3/9) studies were done in low-income settings and the remaining 6 studies were done in middle-income settings. Some indirectness in the choice of reference standard was observed.

A4

Serious heterogeneity in characterization of exposure gradient (some based on index case's smear status, some based on sleeping proximity, etc.) and in estimated effect.

A5

Majority of studies had 200-300 participants, smallest study n=120. Estimated 95%CIs were relatively tight.

A6

Data included in the review did not allow for formal assessment of publication bias using methods such as funnel plots or regression tests. Therefore, publication bias could not be ruled out. Although no points were deducted, it was assumed that some degree of publication bias is likely because: 1) literature on IGRAs is rapidly exploding and currently unpublished studies may come out in future (although an attempt was made to include unpublished studies, despite not being comprehensive); 2) there are anecdotal examples of unpublished negative studies on IGRAs; 3) because a sizeable proportion of IGRA studies have some level of industry involvement or support, the risk of unpublished negative studies (or delayed publication of negative studies) is not trivial.

B1

6 studies were identified: 1 study evaluated both T-SPOT.TB and QFT-G, while 1 study evaluated T-SPOT.TB. The remaining 4 studies all evaluated QFT-GIT.

B2

Only the 4 published studies could be assessed for quality, 50% reported on timing of blood draw prior to TST, 50% reported blinding had been done for assessment of test results and 50% reported industry involvement.

B3

All studies, except one done in low-income setting were done in upper-middle income settings. Some indirectness in the choice of reference standard was noted.

B4

Serious heterogeneity in characterization of exposure gradient (some based on index case's smear status, some based on sleeping proximity, etc.) and in estimated effect.

B5

All but one large study (n=2211) had between 82-301 participants. Studies estimated wide 95%CI, and majority were not significant.

B6

Data included in the review did not allow for formal assessment of publication bias using methods such as funnel plots or regression tests. Therefore, publication bias could not be ruled out. Although no points were deducted, it was assumed some degree of publication bias was likely because: 1) literature on IGRAs is rapidly exploding and currently unpublished studies may come out in future (although an attempt was made to include unpublished studies, despite not being comprehensive); 2) there are anecdotal examples of unpublished negative studies on IGRAs; 3) because a sizeable proportion of IGRA studies have some level of industry involvement or support, the risk of unpublished negative studies (or delayed publication of negative studies) is not trivial.

C1

2 studies were included; both studies evaluated the QFT, one study using the QFT-GIT and the other the QFT-G.

C2

1 study was unpublished and hence not suitable for quality assessment; the other study was a longitudinal study that followed HCWs after a nosocomial infection. Population was representative, blood draw was done prior to TST, and there was no industry involvement, however, blinding was not reported.

C3

Both studies were done in Upper middle income settings, however one was a nosocomial outbreak involving health care workers and may not be generalizeable to other contact settings including household contacts, especially in low income settings. While we did not downgrade for reference standard, we acknowledge there is some indirectness in the choice of reference standard.

C4

Serious heterogeneity between estimated ORs for exposure and conversions, one study shows a positive association between conversions and exposure, while the other shows a significant protective effect of exposure for conversions.

C5

95% CIs are tight and significant for the large unpublished (n=2211), however, CIs range from 0.18-21.12 and 0.69-122.38 for the smaller hospital outbreak study (n=39)

C6

Data included did not allow for formal assessment of publication bias using methods such as funnel plots or regression tests. Therefore, publication bias cannot be ruled out. Although we did not deduct points, we assumed some degree of publication bias is likely because: 1) literature on IGRAs is rapidly exploding and currently unpublished studies may come out in future (although we made an attempt to include unpublished studies, our attempt was not comprehensive); 2) there are anecdotal examples of unpublished negative studies on IGRAs; 3) because a sizeable proportion of IGRA studies have some level of industry involvement or support, the risk of unpublished negative studies (or delayed publication of negative studies) is not trivial.

D1

2 studies included both IGRAs, 3 studies evaluated only T-SPOT.TB, while the rest evaluated a version of the QFT.

D2

11/14 studies did not report on whether personnel assessing test results had been blinded to previous test results or reference standard and 5/14 studies reported industry involvement.

D3

Studies were conducted in low and middle income settings. TB exposure gradient does not necessarily classify the target condition (LTBI) correctly.

D4

47% of studies showed moderate agreement, while 26.5% showed poor agreement and 26.5% fair agreement. In 68% of comparisons, TST estimated a higher prevalence while in the remaining 32% IGRAs estimated a higher prevalence of LTBI.

D5

Due to heterogeneity in effect estimates concordance could not be pooled. However, effects estimated for individual studies were frequently not significant.

D6

Data included did not allow for formal assessment of publication bias using methods such as funnel plots or regression tests. Therefore, publication bias cannot be ruled out. Although points were not deducted, a degree of publication bias is likely because: 1) literature on IGRAs is rapidly exploding and currently unpublished studies may come out in future (although we made an attempt to include unpublished studies, our attempt was not comprehensive); 2) there are anecdotal examples of unpublished negative studies on IGRAs; 3) because a sizeable proportion of IGRA studies have some level of industry involvement or support, the risk of unpublished negative studies (or delayed publication of negative studies) is not trivial.

From: 7, GRADE tables

Cover of Use of Tuberculosis Interferon-Gamma Release Assays (IGRAs) in Low- and Middle- Income Countries
Use of Tuberculosis Interferon-Gamma Release Assays (IGRAs) in Low- and Middle- Income Countries: Policy Statement.
Copyright © World Health Organization 2011.

All rights reserved. Publications of the World Health Organization are available on the WHO web site (www.who.int) or can be purchased from WHO Press, World Health Organization, 20 Avenue Appia, 1211 Geneva 27, Switzerland (tel.: +41 22 791 3264; fax: +41 22 791 4857; e-mail: tni.ohw@sredrokoob).

Requests for permission to reproduce or translate WHO publications – whether for sale or for noncommercial distribution – should be addressed to WHO Press through the WHO web site (http://www.who.int/about/licensing/copyright_form/en/index.html).

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.