We limited the database searches to studies published from 2003 onwards, as the first PCV was introduced globally in 2000 and one of our inclusion criteria was its use at least for three years or more post-introduction. We further applied limits to exclude randomized controlled trials, case-control studies, case reports, and case series studies, as the impact of a vaccination programs is evaluated with post-licensure observational studies [7 ,8 ]. We also restricted the searches to English language publications. The inclusion criteria for this review were: post-licensure observational studies reporting on incidence rates, rate ratios, or percent difference and comparing the outcomes of hospitalised pneumonia, all-cause empyema, all-cause mortality, or pneumonia mortality in any time period before to at least three years after the introduction of either PCV10 or PCV13 into the NIP, allowing more time for indirect and total effects to occur [9 (
link)]. Full details of the inclusion and exclusion criteria are available in the
Online Supplementary Document. We include studies in settings where PCV10 or PCV13 were the first PCV to be introduced into the NIP or where PCV7 was first introduced and subsequently replaced by either PCV10 or PCV13. We excluded studies if the population did not include children 0-9 years, if less than 50% of the catchment population received PCV in the post-PCV period, or if they compared only the PCV7 period to PCV10 or PCV13 period (Table S1 in the
Online Supplementary Document). Two reviewers independently extracted the data and any disagreements were resolved through discussion.
We used the Effective Public Health Practice Project (EPHPP) quality assessment tool for quantitative studies [10 ] to assess the level of risk of bias for each study, as well as to evaluate their internal validity of each study was evaluated considering eight methodological – selection bias of study participants, study design, confounders, blinding, data collection methods, withdrawals of study participants, intervention integrity, and analysis. The protocol is available upon request from the authors.
We did not conduct meta-analyses due to the heterogeneity between studies and case definitions of pneumonia outcomes (case definitions are shown in Table S2 in the
Online Supplementary Document). Study results were stratified by age group, world bank country income status, time since PCV introduction, and PCV valency.