Advertisement

Developing the concept of beneficial non-specific effect of live vaccines with epidemiological studies

  • P. Aaby
    Correspondence
    Corresponding author. Peter Aaby, Bandim Health Project, Indepth Network, Apartado 861, Bissau, Guinea-Bissau.
    Affiliations
    Bandim Health Project, Indepth Network, Bissau, Guinea-Bissau
    Search for articles by this author
  • C.S. Benn
    Affiliations
    Research Centre for Vitamins and Vaccines (CVIVA), Bandim Health Project, Statens Serum Institut, Copenhagen, Denmark

    OPEN, Odense Patient Data Explorative Network, Institute of Clinical Research, Danish Institute of Advanced Science, Odense University Hospital/University of Southern, Odense, Denmark
    Search for articles by this author
Open ArchivePublished:August 23, 2019DOI:https://doi.org/10.1016/j.cmi.2019.08.011

      Abstract

      Background

      Epidemiological and immunological studies are increasingly reporting non-specific effects (NSEs) of vaccines; i.e. vaccines may affect the risk and severity of non-targeted infections. We reviewed how epidemiological studies developed the concept of beneficial NSEs of live vaccines.

      Sources

      This is a personal narrative of how we came to pursue the concept of NSEs in studies of measles vaccine (MV) from the late 1970s. We also searched Pubmed for epidemiological studies of nonspecific/non-specific effects (NSEs) of the most common human vaccines.

      Content

      When smallpox vaccine was introduced around 1800, bacillus Calmette–Guérin (BCG) against tuberculosis in the 1920s and oral polio vaccine (OPV) in the 1960s, there were suggestions that these live attenuated vaccines reduced mortality more than expected. However, scientific follow-up was limited and the concept of beneficial NSEs did not become mainstream. We observed beneficial NSEs after MV was introduced in low-income countries in the 1970s. Subsequent observational studies and randomized trials confirmed beneficial NSEs of smallpox vaccine, BCG and OPV. Recently, beneficial NSEs have been claimed for the non-live diphtheria-tetanus-pertussis and rabies vaccines. However, no non-live vaccine has yet been documented to produce beneficial NSEs.

      Implications

      Observational and experimental research has shown beneficial NSEs of four live attenuated vaccines: smallpox vaccine, BCG, OPV and MV. With immunological evidence now supporting the epidemiological observations, it is urgent to take both the specific and NSEs into account in the planning of vaccination programmes.

      Keywords

      Introduction

      Human vaccines were developed to prevent a specific disease, be it smallpox, tuberculosis, polio or measles infections. The practice for testing new vaccines has been disease specific: does it induce protective antibodies or protective cellular immunity and does it provide clinical protection against the targeted infection. However, this perception of vaccines is crumbling as more and more epidemiological [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Coll Seck A.M.
      • Knudsen K.
      • Whittle H.
      Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
      ,
      • Kristensen I.
      • Aaby P.
      • Jensen H.
      Routine vaccinations and child survival: follow up study in Guinea-Bissau, West Africa.
      ,
      • Aaby P.
      • Jensen H.
      • Samb B.
      • Cisse B.
      • Sodeman M.
      • Jakobsen M.
      • et al.
      Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: re-analysis of West African studies.
      ] and immunological studies [
      • Benn C.S.
      • Netea M.G.
      • Selin L.K.
      • Aaby P.
      A small jab – a big effect: nonspecific immunomodulation by vaccines.
      ,
      • Kleinnijenhuis J.
      • Quintin J.
      • Preijers F.
      • Joosten L.A.
      • Ifrim D.C.
      • Saeed S.
      • et al.
      Bacille Calmette-Guérin induces NOD2-dependent nonspecific protection from reinfection via epigenetic reprogramming of monocytes.
      ,
      • Arts R.J.W.
      • Moorlag S.J.C.F.M.
      • Novakovic B.
      • Li Y.
      • Wang S.Y.
      • Oosting M.
      • et al.
      BCG vaccination protects against experimental viral infection in humans through the induction of cytokines associated with trained immunity.
      ] are finding beneficial or deleterious non-specific effects (NSEs) of vaccines (heterologous or off-target effects). In other words, a vaccine may have effects on infections not targeted by the vaccine.
      Here, we review which human vaccines have been linked to beneficial NSEs and we focus particularly on how epidemiological studies have developed and justified the concept of beneficial NSEs of live vaccines. This is partly a personal story of how we came to use the concept of NSEs of measles vaccine (MV) stating from the late 1970s, but we have also reviewed the literature for possible NSEs of other vaccines (Fig. 1).
      Fig. 1
      Fig. 1Time lines in the study of the non-specific effects of vaccines.

      Methods

      Starting from 1979, in our attempt to understand the incredible high mortality in measles infection in West Africa and how it could be prevented, we came to pursue the concept of NSEs of MV. This led us to conduct investigations of NSEs of other routine vaccines, as outlined in the personal narrative below.
      For the purpose of the present review, we furthermore searched Pubmed until 2019 for epidemiological studies of non-specific/non-specific effects (NSEs) of the most common human vaccines, including smallpox (vaccinia), bacillus Calmette–Guérin (BCG) vaccine against tuberculosis, oral polio vaccine (OPV), measles vaccine (MV), rubella, mumps, pertussis, tetanus, diphtheria, varicella, yellow fever, RSV, rabies, meningitis, hepatitis B, pneumococcus, influenza and malaria (Table S1). Abstracts were reviewed and the papers read if potentially relevant. Immunological studies, animal studies, case reports and papers where other vaccines were the main focus were not considered. For many vaccines there are no real epidemiological data on NSEs; other vaccines were only related to NSEs because the vaccine was co-administered with either MV or pertussis vaccine. We have therefore focused on smallpox vaccine, BCG, OPV, MV and diphtheria–tetanus–pertussis (DTP) where most of the research has been concentrated (see Table S1).
      The introduction of smallpox vaccine around 1800 and of BCG vaccine in 1921 happened long before the medical literature became searchable. However, it is known that already when these vaccines were first introduced, it was discussed whether they had beneficial NSEs [
      • Mayr A.
      Taking advantage of the positive side-effects of smallpox vaccination.
      ,
      • Calmette A.
      Preventive vaccination against tuberculosis with BCG.
      ,
      • Näslund C.
      Resultats des experiences de vaccination par le BCG poursuivies dans le Norrbotten (Suède) (Septembre 1927–Décembre 1931). Vaccination Preventative de Tuberculose, Rapports et Documents.
      ].

      Results

       Non-specific effects of measles vaccine

      Starting from 1979, studies of the mortality of measles-vaccinated and measles-unvaccinated individuals in Guinea-Bissau led to the suggestion that MV had beneficial NSEs.
      In the 1970s, the predominant thinking was that malnutrition was the main determinant for severe measles infection, at the time the single largest killer of children in developing countries. Hence, many believed that measles vaccination would have limited effect on child survival, because frail children saved by MV would probably just die of other infections [
      • Mosley W.H.
      Will primary health care reduce infant and child mortality. With special reference to Africa and Asia.
      ,
      • Hendrickse R.G.
      Problems of future measles vaccination in developing countries.
      ]. This perspective was supported by a paper in the Lancet comparing child mortality in two urban areas in Congo in which MV had been introduced at 7 months of age in one area but not in the other. The paper concluded “it may be useful to think twice before allocating already scarce resources to such a programme [measles vaccination]” [
      The Kasongo Project Team
      Influence of measles vaccination on survival pattern of 7–35-month-old children in Kasongo.
      ].
      In 1979–1980, after a measles epidemic in Guinea-Bissau, a Swedish funded nutritional project showed that nutritional status was not a determinant of the risk of dying of measles infection; there was essentially no difference in anthropometry between children who died or survived measles infection [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles mortality, state of nutrition, and family structure: a community study from Guinea-Bissau.
      ,
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      • Gomes J.
      • Fernandes M.A.
      • et al.
      Determinants of measles mortality in a rural area of Guinea-Bissau: crowding, age, and malnutrition.
      ]. At the time, MV was not used in Guinea-Bissau. Owing to the devastating measles case fatality rates of 21% and 34% for children under 5 years of age in urban and rural areas, MV campaigns were implemented in connection with nutritional surveys in 1979 and 1980 [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      • Gomes J.
      • Fernandes M.A.
      • et al.
      Determinants of measles mortality in a rural area of Guinea-Bissau: crowding, age, and malnutrition.
      ,
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
      ].
      Since measles mortality was not related to nutritional status it raised the question of what would happen to overall mortality when children had received MV. A preliminary check of reported deaths after the MV campaign in the urban area suggested that nearly all deaths had occurred among children who on the day of the campaign had not been home because they had travelled to visit family in rural areas [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
      ]. The difference was stunning, sixfold higher mortality for children who were unvaccinated than those who had received MV during the campaign (Table 1). A strong survival benefit of MV was also supported by the small data set from a rural area (Table 1). In a later ‘natural experiment’, none of the vaccinated children had seroconverted after MV during a 1-month period; they had received an ineffective vaccine. Comparing the mortality of children who had received effective MV versus ineffective MV showed a threefold reduction in mortality after effective MV (Table 1). Maybe even more important, a re-examination of the Congo study showed that mortality from 7 to 36 months of age among the measles-vaccinated children was 53% (–9 to 80%) lower than among the unvaccinated children from the control areas (Table 1) [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Coll Seck A.M.
      • Knudsen K.
      • Whittle H.
      Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
      ,
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and child mortality.
      ].
      Table 1Initial studies of the effect of measles vaccine on child survival
      StudyDesign; age at vaccination; who compared; follow-up periodMortality rate (deaths/person-yearsVaccine efficacy against death (95% CI)Measles death among unvaccinated deaths
      UnvaccinatedVaccinated
      Bissau, urban
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
      6–36 months; MV campaign participants vs absent; 12 months14.2% (10/70.5)1.9% (7/361.0)86% (65–95%)0% (0/10)
      Bissau, Rural
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      • Gomes J.
      • Fernandes M.A.
      • et al.
      Determinants of measles mortality in a rural area of Guinea-Bissau: crowding, age, and malnutrition.
      6–36 months; MV campaign participants vs absent; 13 months6.6% (5/75.3)4.1% (7/170.3)38% (–95 to 80%)0% (0/5)
      Congo [Zaire]
      The Kasongo Project Team
      Influence of measles vaccination on survival pattern of 7–35-month-old children in Kasongo.
      7–9 months; different areas; 24 months3.4% (66/1811.2)1.7% (6/348.8)53% (–9 to 80%)NA
      Bissau,

      “Natural experiment”
      • Aaby P.
      • Pedersen I.R.
      • Knudsen K.
      • da Silva M.C.
      • Mordhorst C.H.
      • Helm-Petersen N.C.
      • et al.
      Child mortality related to seroconversion or lack of seroconversion after measles vaccination.
      7–24 month; effective MV vs ineffective MV; 24 months(ineffective vaccine)

      7.5% (7/92.8)
      2.5% (6/244.6)67% (3–89%)29% (2/7)
      Senegal
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Knudsen K.
      • Seck A.M.
      • Bennett J.
      • et al.
      Divergent mortality for male and female recipients of low-titer and high-titer measles vaccines in rural Senegal.
      9–18 months; vaccinated vs unvaccinated same area; 23 months5.3% (86/1610.5)3.2% (90/2806.7)40% (19–55%)22% (11/51)
      Burundi
      • Chen R.T.
      • Weierbach R.
      • Bisoffi Z.
      • Cutts F.
      • Rhodes P.
      • Ramaroson S.
      • et al.
      A “post-honeymoon period” measles outbreak in Muyinga Sector, Burundi.
      9–23 months; vaccinated vs unvaccinated same community4.7% (51/1083.4)1.2% (14/1201.2)75% (55–86%)3% (3/86)
      CI, confidence interval; MV, measles vaccine; NA, not available.
      The observations were not based on individually randomized trials (RCTs) but it was unlikely that selection biases could explain a difference in mortality of more than 50%. In Guinea-Bissau, there were no apparent differences in health or social conditions between travelling and non-travelling children [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
      ,
      • Mogensen S.W.
      • Aaby P.
      • Smedman L.
      • Martins C.L.
      • Rodrigues A.
      • Benn C.S.
      • et al.
      Introduction of standard measles vaccination in an urban African community in 1979 and overall child survival: a reanalysis of data from a cohort study.
      ]. In Congo, children from two areas had been compared after the introduction of MV in one area; in the year prior to the MV experiment there had been no mortality difference between the two areas [
      The Kasongo Project Team
      Influence of measles vaccination on survival pattern of 7–35-month-old children in Kasongo.
      ]. Importantly, measles did not usually cause more than 10–15% of all deaths; prevention of measles infection could thus not explain the reductions in mortality of more than 50% [
      • De Quadros C.A.
      • Izurieta H.
      • Venczel L.
      • Carrasco P.
      Measles eradication in the Americas : progress to date.
      ].
      These observations of strong non-specific reductions in mortality after MV raised numerous issues. We briefly describe three key questions.

       Were the findings of non-specific benefits of MV consistent?

      To assure that the trends were reproducible, further studies of measles epidemics and MV were initiated in Senegal, Kenya and Bangladesh [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Knudsen K.
      • Seck A.M.
      • Bennett J.
      • et al.
      Divergent mortality for male and female recipients of low-titer and high-titer measles vaccines in rural Senegal.
      ,
      • Aaby P.
      • Leeuwenburg J.
      Patterns of transmission and severity of measles infection. A reanalysis of data from the Machakos area, Kenya.
      ,
      • Aaby P.
      • Bhuyia A.
      • Nahar L.
      • Knudsen K.
      • Francisco A.
      • Strong M.
      The survival benefit of measles immunisation may not be explained entirely by the prevention of measles disease.
      ]. The observation that MV had strong beneficial effects on overall child survival turned out to be reproducible. In Guinea-Bissau, it had been possible to compare the general mortality rate before and after the introduction of MV and this suggested a reduction of more than 50% [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
      ]. Before and after studies from Senegal (n = 2), Congo and India found similar reductions in mortality [
      • Aaby P.
      • Whittle H.C.
      • Benn C.S.
      Vaccine programmes must consider their effect on general resistance.
      ]. Surprisingly, the benefit from MV was more important for females than for males in several studies and the benefit was stronger when MV was given early in life [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Coll Seck A.M.
      • Knudsen K.
      • Whittle H.
      Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
      ].
      To assess how much reduction was due to measles prevention and how much was not explained by measles prevention, the vaccine efficacy against death (VED) was estimated in studies including all deaths or excluding measles cases (Table 2). In the larger studies, there was no difference in the VED estimates with and without censoring for measles infection. Hence, the specific protection against measles infection contributed little to the reduction in overall mortality after the introduction of MV (Table 2).
      Table 2Mortality rate ratios for measles-vaccinated and measles-unvaccinated children with and without measles cases/measles deaths in the survival analysis
      StudyDesign; age at vaccination; who compared; follow-up periodVaccine efficacy against death (95% CI)
      Including measles cases in survival analysisExcluding measles cases in survival analysis
      Bissau, ‘Natural experiment’
      • Aaby P.
      • Pedersen I.R.
      • Knudsen K.
      • da Silva M.C.
      • Mordhorst C.H.
      • Helm-Petersen N.C.
      • et al.
      Child mortality related to seroconversion or lack of seroconversion after measles vaccination.
      7–24 month; effective MV vs ineffective MV; 24 months67% (3–89%)35% (–162 to 84%)
      Guinea-Bissau
      • Aaby P.
      • Knudsen K.
      • Jensen T.G.
      • Thaarup J.
      • Poulsen A.
      • Sodemann M.
      • et al.
      Measles incidence, vaccine efficacy, and mortality in two urban African areas with high vaccination coverage.
      9–23; vaccinated vs unvaccinated in same area; 19 months64% (37–79%)65% (35–81%)
      Senegal
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Knudsen K.
      • Seck A.M.
      • Bennett J.
      • et al.
      Divergent mortality for male and female recipients of low-titer and high-titer measles vaccines in rural Senegal.
      9–18 months; vaccinated vs unvaccinated same area; 23 months40% (19–55%)40% (18–55%)
      Burundi
      • Chen R.T.
      • Weierbach R.
      • Bisoffi Z.
      • Cutts F.
      • Rhodes P.
      • Ramaroson S.
      • et al.
      A “post-honeymoon period” measles outbreak in Muyinga Sector, Burundi.
      9–23 months; vaccinated vs unvaccinated same community75% (55–86%)74% (48–87%)
      CI, confidence interval; MV, measles vaccine.

       Could mortality be reduced further with early MV?

      We examined whether further reductions in mortality could be obtained by using medium-titre measles vaccine (MTMV) or high-titre measles vaccine (HTMV) from 4 months of age [
      • Aaby P.
      • Jensen H.
      • Samb B.
      • Cisse B.
      • Sodeman M.
      • Jakobsen M.
      • et al.
      Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: re-analysis of West African studies.
      ,
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ]. In the 1970s, WHO had recommended MV from 9 months of age based on seroconversion studies [
      • Aaby P.
      • Martins C.L.
      • Garly M.L.
      • Rodrigues A.
      • Benn C.S.
      • Whittle H.C.
      The optimal age of measles immunization in low-income countries: a secondary analysis of the assumptions underlying the current policy.
      ], but studies in the early 1980s showed that HTMV could be immunized from 4 months of age, in the presence of maternal measles antibodies. Hence, RCTs with MTMV and HTMV were initiated in Guinea-Bissau, The Gambia, Senegal [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ] and Sudan.
      HTMV was clearly protective against measles infection in Guinea-Bissau and Senegal. However, the RCTs of HTMV were disastrous with nearly twofold higher mortality for females who had received HTMV. The HTMV recipients had higher mortality than control children only after controls had received standard-titre MV at 9–10 months of age [
      • Aaby P.
      • Jensen H.
      • Samb B.
      • Cisse B.
      • Sodeman M.
      • Jakobsen M.
      • et al.
      Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: re-analysis of West African studies.
      ,
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ]. Since HTMV was protective against measles infection this made little sense. It was speculated that this was an adverse event or that HTMV had come too close to the natural disease, inducing immunosuppression similar to measles infection [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Coll Seck A.M.
      • Knudsen K.
      • Whittle H.
      Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
      ]. However, these speculations did not fit the data; the negative effects did not occur in the first months after HTMV, but only after 9–10 months of age when the controls had received standard MV [
      • Aaby P.
      • Jensen H.
      • Samb B.
      • Cisse B.
      • Sodeman M.
      • Jakobsen M.
      • et al.
      Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: re-analysis of West African studies.
      ,
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ].

       Could the non-specific benefits of MV be ascribed to long-term excess mortality after measles infection?

      Measles deaths are usually considered to be death within 1 month of a measles rash. However, we speculated that measles cases could have continued to increase mortality from other causes: ‘delayed excess mortality’. If measles infection had delayed excess mortality, MV would appear to have a much larger overall effect than expected based on just preventing the acute measles mortality [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
      ]. Studies of long-term morbidity and mortality after acute measles infection were therefore conducted in Guinea-Bissau, Senegal and Bangladesh [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Knudsen K.
      • Seck A.M.
      • Bennett J.
      • et al.
      Divergent mortality for male and female recipients of low-titer and high-titer measles vaccines in rural Senegal.
      ,
      • Aaby P.
      • Simondon F.
      • Samb B.
      • Cisse B.
      • Jensen H.
      • Lisse I.M.
      • et al.
      Low mortality after mild measles infection compared to uninfected children in rural West Africa.
      ,
      • Aaby P.
      • Lisse I.
      • Mølbak K.
      • Knudsen K.
      • Whittle H.
      No persistent T lymphocyte immunosuppression or increased mortality after measles infection: a community study from Guinea-Bissau.
      ,
      • Aaby P.
      • Samb B.
      • Andersen M.
      • Simondon F.
      No long-term excess mortality after measles infection: a community study from Senegal.
      ].
      The epidemiological studies did not find delayed excess mortality after measles infection. In the available studies from Guinea-Bissau, Senegal and Bangladesh, after the acute phase of measles there was rather a trend for lower mortality infection than uninfected, unvaccinated controls (Table S2). Noteworthy, the lower mortality after measles infection was not a selection bias due to the frail children having died already of measles infection; the same trend of lower mortality after measles infection was found in situations with no acute measles mortality [
      • Aaby P.
      • Simondon F.
      • Samb B.
      • Cisse B.
      • Jensen H.
      • Lisse I.M.
      • et al.
      Low mortality after mild measles infection compared to uninfected children in rural West Africa.
      ]. Hence, these studies suggested that measles infection could have a beneficial effect on survival and they refuted the hypothesis that the mortality reduction after MV was due to prevention of long-term excess mortality after measles infection.

       Summarizing the evidence

      The triangulation of all available observations on measles infection, MV and mortality made it inevitable that at least standard-titre MV had such NSEs (Table 3). First, the before–after studies and the studies comparing mortality for vaccinated and unvaccinated children suggested that MV had beneficial NSEs which could not be explained by disease-specific prevention. Second, these effects could not be explained by measles infection having delayed excess mortality. Third, the observations that MV had stronger effect when given early and for females were incompatible with an only disease-specific prevention perspective, but were potentially compatible with the non-specific perspective [
      • Aaby P.
      • Martins C.L.
      • Ravn H.
      • Rodrigues A.
      • Whittle H.C.
      • Benn C.S.
      Is early measles vaccination better than later measles vaccination?.
      ,
      • Higgins J.P.T.
      • Soares-Weiser K.
      • López-López J.A.
      • Kakourou A.
      • Chaplin K.
      • Christensen H.
      • et al.
      Association of BCG, DTP, and measles containing vaccines with childhood mortality: systematic review.
      ]. Fourth, the observation that the VED was nearly the same with and without censoring for measles infection in the analysis was incompatible with an only disease-specific prevention perspective but potentially explainable from the perspective that MV as well as mild measles infection may have beneficial NSEs (Table S2).
      Table 3Epidemiological observations on measles vaccination measles infection in relation to the ‘specific-disease-prevention hypothesis’ and the ‘beneficial nonspecific effects hypothesis’
      ObservationMV prevents only acute measles infection and its long-term consequencesMV has nonspecific beneficial effects
      Very low mortality after MVDoes not support: The vaccine efficacy against death is nearly the same with and without censoring for measles infection in the analysis; No long-term excess mortality after measles infectionSupport: There is clear reduction in mortality even when all measles cases have been censored
      MV has a stronger beneficial effect for females than malesDoes not support: Measles infection is equally severe for females and males so effect of MV should not differ by sexCompatible: Beneficial immune training may differ for females and males
      HTMV associated with higher mortalityDoes not support: HTMV was protective against measles infection so should not be associated with higher mortalitySupport: See text. HTMV had beneficial NSEs until they received non-live vaccine after the MV.
      The negative HTMV only seen after 9 months of ageDoes not support: Cannot be explainedSupport: Standard MV given in the control group at 9–10 months of age
      Mild measles infection associated with beneficial effects on survivalDoes not support: We are vaccinating to prevent the diseaseCompatible: This is compatible with MV also having a beneficial effect
      Stronger effect when given earlyDoes not support: When given early MV should have less effect due to interference from maternal antibodiesSupport: Other studies have found stronger beneficial NSEs after early vaccination
      The vaccine efficacy against death is nearly the same with and without censoring for measles infectionDoes not support: Since MV prevents measles death this observation is contradictoryCompatible: While MV will reduce the measles mortality some of the unvaccinated children may have benefitted from a natural measles infection. The net impact of measles infection on mortality may therefore be less than the deaths classified as being due to acute measles infection.
      MV, measles vaccine.
      Given the consistency of these observations, we eventually formulated the hypothesis that MV had beneficial NSEs [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Coll Seck A.M.
      • Knudsen K.
      • Whittle H.
      Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
      ]. Subsequent studies have strongly supported this perspective. In a review of the potential NSEs on child mortality of BCG, DTP and MV sponsored by the World Health Organization (WHO)'s Strategic Advisory Group of Experts on immunization (SAGE) in 2013–2014, MV was associated with a 46% reduction in mortality [
      • Higgins J.P.T.
      • Soares-Weiser K.
      • López-López J.A.
      • Kakourou A.
      • Chaplin K.
      • Christensen H.
      • et al.
      Association of BCG, DTP, and measles containing vaccines with childhood mortality: systematic review.
      ].
      The measles–mumps–rubella (MMR) vaccine, used in high-income countries instead of MV, has also been associated with beneficial NSEs. In Denmark both the first and the second dose of MMR was associated with reductions in the risk of hospital admissions, particularly for respiratory infections and long-lasting admissions [
      • Sørup S.
      • Benn C.S.
      • Poulsen A.
      • Krause T.
      • Aaby P.
      • Ravn H.
      Live vaccine against measles, mumps, and rubella and the risk of hospital admissions for nontargeted infections.
      ,
      • Sørup S.
      • Jensen A.K.G.
      • Aaby P.
      • Benn C.S.
      Revaccination with measles-mumps-rubella vaccine and infectious disease morbidity: a Danish register-based cohort study.
      ]. In a large study from the United States replicating the Danish study, having a live vaccine (mostly MMR) rather than an inactivated vaccine as the most recent vaccination was associated with a twofold reduction in the risk of admission [
      • Bardenheier B.H.
      • McNeil M.M.
      • Wodi A.P.
      • McNicholl J.
      • DeStefano F.
      Risk of nontargeted infectious disease hospitalizations among U.S. children following inactivated and live vaccines, 2005–2014.
      ]. In a Dutch study there was also a very strong beneficial NSEs of MMR, but this was ascribed to ‘healthy vaccinee bias’ since diphtheria-tatanus-acellular-pertussis (DTaP) vaccine was also associated with reductions in admissions [
      • Tielemans S.M.A.J.
      • de Melker H.E.
      • Hahné S.J.M.
      • Boef A.G.C.
      • van der Klis F.R.M.
      • Sanders E.A.M.
      • et al.
      Non-specific effects of measles, mumps, and rubella (MMR) vaccination in high income setting: population based cohort study in The Netherlands.
      ]. The social context for the Danish and the Dutch study are very different. In The Netherlands the parents are called actively to bring their child for vaccination and less than 0.5% are not vaccinated with MMR before 24 months of age [
      • Tielemans S.M.A.J.
      • de Melker H.E.
      • Hahné S.J.M.
      • Boef A.G.C.
      • van der Klis F.R.M.
      • Sanders E.A.M.
      • et al.
      Non-specific effects of measles, mumps, and rubella (MMR) vaccination in high income setting: population based cohort study in The Netherlands.
      ]. Hence, the Dutch system selected a very frail subgroup as ‘unvaccinated’ controls and therefore very ‘beneficial’ effects were associated with any new vaccine. Still it was possible to show with the Dutch data that the beneficial effect of MMR was significantly stronger than the beneficial effect of DTaP [
      • Benn C.S.
      • Sørup S.
      • Aaby P.
      Beneficial non-specific reduction in hospital admissions for respiratory infections following MMR and MenC vaccinations in The Netherlands.
      ]. Furthermore, DTaP was associated with an increase in risk of admission when DTaP was given after MMR [
      • Benn C.S.
      • Sørup S.
      • Aaby P.
      The sequence of vaccinations to test the non-specific effects of vaccines.
      ], something which should not happen if the effect of all new vaccines is mostly a product of ‘healthy vaccinee bias’.

       New questions arising

      The fact that MV had beneficial NSEs raised an interesting question. It could potentially have negative effects to stop MV after eradication of measles infection. Smallpox vaccine was the only vaccine which had been stopped (1980) after disease eradication (1977). We therefore decided to examine whether smallpox vaccine had beneficial effects which could be detected long after smallpox had disappeared. We started studies of smallpox vaccination in Guinea-Bissau in 1997 to document whether it was likely that there were beneficial NSEs of smallpox vaccine and therefore negative effects of stopping the vaccine.

       Non-specific effects of smallpox vaccine

      NSEs of smallpox vaccine were already noted in the first decade after the introduction of vaccinia. Dr Gierl, the first smallpox vaccinator in Bayern, noted that vaccinia seemed to protect against many other diseases: “vaccinated persons are less susceptible to infectious diseases such as measles, scarlet fever, whooping cough than non-vaccinated persons” [
      • Mayr A.
      Taking advantage of the positive side-effects of smallpox vaccination.
      ]. Historical demographic studies from several European countries have noted that the decline in general mortality in the first part of the 19th century was much larger than could be explained by the absence of smallpox deaths [
      • Mercer A.J.
      Smallpox and epidemiological-demographic change in Europe: the role of vaccination.
      ].
      When we decided to examine the potential NSEs of smallpox vaccination in Guinea-Bissau, no vaccination register covered the population and the assessment was therefore based on reading smallpox scars in both urban and rural areas of Guinea-Bissau. We later identified a small subgroup with documented smallpox vaccination in a public health register and were able to show that nearly everyone with a documented smallpox vaccine had a smallpox scar 30–60 years after vaccination.
      The impact of smallpox vaccination on survival, controlled for known confounders, was much stronger than expected, the reduction in adult mortality being 40% or more even though there was no longer any smallpox infection (Table 4). Subsequently we were able to show similar results in Denmark using Danish school health registers with documented vaccination status at school entry and follow-up of all individuals through public registers. From school entry at 7 years of age to 45 years of age, being smallpox and BCG vaccinated was associated with 46% (95% CI 19–64%) lower mortality from natural causes of death whereas there was no link to accidents, suicides and murders [
      • Rieckmann A.
      • Villumsen M.
      • Sørup S.
      • Haugaard L.K.
      • Ravn H.
      • Roth A.
      • et al.
      Vaccinations against smallpox and tuberculosis are associated with better long-term survival: a Danish case-cohort study 1971–2010.
      ]. The data from Guinea-Bissau and Denmark suggested also that smallpox vaccination had provided some protection against human immunodeficiency virus (HIV)-1 infection. Since smallpox vaccine downregulates the CCR5 receptor, there may indeed be biological basis for such an effect [
      • Rieckmann A.
      • Villumsen M.
      • Jensen M.L.
      • Ravn H.
      • da Silva Z.J.
      • Sørup S.
      • et al.
      The effect of smallpox and Bacillus calmette-Guerin vaccination on the risk of human immunodeficiency virus-1 infection in Guinea-Bissau and Denmark.
      ].
      Table 4Smallpox vaccination and adult survival
      StudyScreening for scarsAge groupFollow-upMortality (deaths/100 person-years or N)Adjusted MRR vaccinia scar/no scarAdjustments and comments
      Vaccinia-scarNo scar
      Guinea-Bissau: Epidemiological study of scar and adult mortality
      • Aaby P.
      • Gustafson P.
      • Roth A.
      • Rodrigues A.
      • Fernandes M.
      • Sodemann M.
      • et al.
      Vaccinia scars associated with better survival for adults. An observational study from Guinea-Bissau.
      Urban area: 1893 adults25 years or older4 years2.5 (61/2447.2)3.3 (40/1199.4)0.61 (0.40–0.92)Adjusted age and sex

      Individuals with BCG scars are excluded
      Guinea-Bissau: Epidemiological study of scar and adult mortality within an HIV case control study
      • Jensen M.L.
      • Dave S.
      • van der Loeff M.S.
      • da Costa C.
      • Vincent T.
      • Leligdowicz A.
      • et al.
      Vaccinia scars associated with improved survival among adults in rural Guinea-Bissau.
      Rural area: 367 adults25 years and older3 years11.6 (29/251)25.7 (9/35)0.22 (0.08–0.61)Adjusted age, sex, village and HIV status

      Individuals with BCG scars are excluded
      BCG, bacillus Calmette–Guérin; HIV, human immunodeficiency virus; MRR, mortality rate ratio.

       Non-specific effects of BCG vaccine

      Calmette wrote in 1931 about BCG that “The general mortality of 8075 vaccinated children exposed to tuberculous infection, aged from one month to one year … has been 4.6%, whereas in non-vaccinated children of the same age, living under similar conditions, it is at least 16%, and often exceeds 25%. … Can it be that tuberculous infection plays a more important part in infant mortality than we have supposed? … Or does the harbouring of BCG, followed by its digestion and elimination, confer on the organism a special aptitude to resist those other infections which are so frequent in young children? [
      • Calmette A.
      Preventive vaccination against tuberculosis with BCG.
      ] (At the time, BCG was administered orally.) Similar observations and interpretations were made by Näslund, the Swedish physician responsible for introducing BCG in northern Sweden in the 1920s [
      • Näslund C.
      Resultats des experiences de vaccination par le BCG poursuivies dans le Norrbotten (Suède) (Septembre 1927–Décembre 1931). Vaccination Preventative de Tuberculose, Rapports et Documents.
      ]. Näslund may have been the first to have used the concept of ‘non-specific’ immunological effects (9).
      While a concept of non-specific immunity continued to be mentioned in immunological studies [
      • Mackaness G.B.
      The immunological basis of acquired cellular resistance.
      ] it does not seem to have been investigated in public health studies of BCG or smallpox vaccine after the Second World War (Table S1). The overwhelming focus was on the specific protection against TB and NSEs may have been perceived to be irrelevant. It may also have been linked to declining enthusiasm for BCG after the Lübeck catastrophe, where BCG was contaminated with infectious tuberculosis bacilli [
      BMJ. The Lübeck catastrophe. A general review.
      ].
      In the 1970s, BCG was used in clinical studies of non-specific immunotherapy for a number of human malignancies. After some successful reports with melanoma and leukaemia, results were more variable and the use of BCG was limited. However, since its first use in 1976, BCG has continued to be used for superficial bladder cancer [
      • van der Meijden A.P.
      Non-specific immunotherapy with B.C.G.in superficial bladder cancer: an overview.
      ].
      Inspired by the studies of MV, we started in the mid-1990s to examine whether BCG might also have beneficial NSEs for child survival in low-income countries [
      • Aaby P.
      • Bukh J.
      • Lisse I.M.
      • Smits A.J.
      Measles mortality, state of nutrition, and family structure: a community study from Guinea-Bissau.
      ]. The initial studies suggested a beneficial non-specific effect. To make sure that the beneficial effect was really due to BCG vaccinations and not to selection biases between vaccinated and unvaccinated children, we examined in several studies of BCG vaccinated children whether having or not having a BCG scar or a positive tuberculin skin test (TST) was associated with better survival. That was the case. Among BCG-vaccinated children having a BCG scar or a positive TST was associated with around 40% lower mortality in several studies [
      • Garly M.L.
      • Martins C.L.
      • Balé C.
      • Baldé M.A.
      • Hedegaard K.L.
      • Gustafson P.
      • et al.
      BCG scar and positive tuberculin reaction and reduced infant and childhood mortality in West Africa: a non-specific beneficial effect of BCG?.
      ]. Numerous observational studies have subsequently supported that BCG is associated with much lower all-cause mortality. In the review of the potential NSEs on child mortality of BCG, DTP and MV sponsored by the SAGE in 2013–2014, BCG vaccination was associated with 47% [
      • Higgins J.P.T.
      • Soares-Weiser K.
      • López-López J.A.
      • Kakourou A.
      • Chaplin K.
      • Christensen H.
      • et al.
      Association of BCG, DTP, and measles containing vaccines with childhood mortality: systematic review.
      ] reduction in child mortality.
      It is difficult to get permission to test in RCTs vaccines already recommended by WHO. However, it became possible to test BCG Denmark among low-birth-weight (LBW) children because Guinea-Bissau recommended late BCG vaccination for LBW children. In the LBW group, BCG at birth reduced neonatal mortality by 38% (17–54%) in three RCTs [
      • Biering-Sørensen S.
      • Aaby P.
      • Lund N.
      • Monteiro I.
      • Jensen K.
      • Eriksen H.B.
      • et al.
      Early BCG and neonatal mortality among low-birth-weight infants: a randomised controlled trial.
      ]. BCG strongly reduced the risk of neonatal sepsis [
      • Schaltz-Buchholzer F.
      • Biering-Sørensen S.
      • Lund N.
      • Monteiro I.
      • Umbasse P.
      • Fisker A.B.
      • et al.
      Early Bacille Calmette-Guérin vaccination, hospitalizations and hospital deaths: analysis of a secondary outcome in three randomized trials from Guinea-Bissau.
      ]). Two subsequent RCTs in India using BCG-Russia found no benefit among extreme LBW children (<2.000 kg) [
      • Jayaraman K.
      • Adhisivam B.
      • Nallasivan S.
      • Krishnan R.G.
      • Kamalarathnam C.
      • Bharathi M.
      • et al.
      Two randomized trials of the effect of the Russian strain of Bacillus calmette-Guerin alone or with oral polio vaccine on neonatal mortality in infants weighing <2000 g in India.
      ]. This may relate to the strain of BCG, as several studies have found the BCG-Denmark is much better in inducing a BCG scar but also provides more adverse events than BCG-Russia [
      • Curtis N.
      BCG vaccination and all-cause neonatal mortality.
      ].

       Non-specific effects of OPV

      Having shown beneficial NSEs of three other live vaccines, we became interested in whether OPV, the other commonly used live vaccine, had beneficial NSEs. The literature provides some historical support for this idea.
      From the 1950s and onwards, USSR virologist Voroshilova worked with the immune training potential of live enterovirus vaccines (LEVs), including OPV. In huge studies involving hundreds of thousands of individuals, it was shown that LEV/OPV significantly reduced the risk of influenza and acute respiratory infection [
      • Voroshilova M.F.
      Potential use of nonpathogenic enteroviruses for control of human disease.
      ].
      When OPV was first introduced in South America in the early 1960s, Contreras showed that OPV interfered with the replication of other enteroviruses and suggested that this resulted in fewer diarrhoea deaths in Chile and Brazil. Hence, he proposed that massive vaccination with OPV could be used as a non-specific measure to combat infant diarrhoea [
      • Contreras G.
      Sabin's vaccine used for nonspecific prevention of infant diarrhea of viral etiology.
      ,
      • Contreras G.
      Effect of the administration of oral poliovirus vaccine on infantile diarrhoea mortality.
      ]. It is unclear why these effects were not pursued in subsequent decades.
      No study at the time disproved the beneficial NSEs. OPV has usually been co-administered with DTP in the first months of life, and it has therefore been difficult to separate the effects of OPV and DTP. However, in some studies either DTP or OPV was missing for logistic reasons and it then became possible to assess their relative importance. All these studies have indicated that OPV only is associated with lower mortality than OPV + DTP or than DTP only [
      • Aaby P.
      • Rodrigues A.
      • Biai S.
      • Martins C.
      • Veirum J.E.
      • Benn C.S.
      • et al.
      Oral polio vaccination and low case fatality at the paediatric ward in Bissau, Guinea-Bissau.
      ,
      • Mogensen S.W.
      • Andersen A.
      • Rodrigues A.
      • Benn C.S.
      • Aaby P.
      The introduction of diphtheria-tetanus-pertussis and oral polio vaccine among young infants in an urban African community: a natural experiment.
      ].
      Furthermore, from the late 1990s numerous national OPV campaigns were organized as part of a plan to eradicate polio and in response to regional outbreaks of polio infection. Though few studies have been made, campaigns with OPV appeared to be associated with major reductions in mortality. In Health and Demographic Surveillance System studies in Guinea-Bissau, Ghana and Burkina Faso, where it has been possible to follow the general mortality rate before and after campaigns, campaign-OPV has been associated with 10–30% reduction in the overall mortality rate [
      • Andersen A.
      • Fisker A.B.
      • Rodrigues A.
      • Martins C.
      • Ravn H.
      • Lund N.
      • et al.
      National immunization campaigns with oral polio vaccine reduce all-cause mortality: a natural experiment within seven randomized trials.
      ,
      • Welaga P.
      • Hodgson A.
      • Debpuur C.
      • Aaby P.
      • Ravn H.
      • Binka F.
      • et al.
      Measles vaccination and MDG4: increasing coverage and increasing child survival in Northern Ghana.
      ,
      • Schoeps A.
      • Nebié E.
      • Fisker A.B.
      • Sié A.
      • Zakane A.
      • Müller O.
      • et al.
      No effect of an additional early dose of measles vaccine on hospitalization or mortality in children: a randomized controlled trial.
      ]. Boosting with campaign-OPV is also beneficial, each additional campaign is further enhancing the beneficial NSEs [
      • Andersen A.
      • Fisker A.B.
      • Rodrigues A.
      • Martins C.
      • Ravn H.
      • Lund N.
      • et al.
      National immunization campaigns with oral polio vaccine reduce all-cause mortality: a natural experiment within seven randomized trials.
      ]. Given the large number of campaigns which have been organized the last 20–25 years, the campaigns have contributed very significantly to the reduction in child mortality in many low-income countries.
      In a large RCT of OPV at birth (OPV0), receiving BCG + OPV0 versus only BCG was associated with a 32% reduction in infant mortality or until they received campaign OPV [
      • Lund N.
      • Andersen A.
      • Hansen A.S.
      • Jepsen F.S.
      • Barbosa A.
      • Biering-Sørensen S.
      • et al.
      The effect of oral polio vaccine at birth on infant mortality: a randomized trial.
      ]. In RCTs, OPV has also been compared back to back with inactivated polio vaccine (IPV) in randomized trials in Bangladesh and Finland and been found to be associated with less morbidity [
      • Upfill-Brown A.
      • Taniuchi M.
      • Platts-Mills J.A.
      • Kirkpatrick B.
      • Burgess S.L.
      • Oberste M.S.
      • et al.
      Non-specific effects of oral polio vaccine on diarrheal burden and etiology among Bangladeshi children.
      ,
      • Seppälä E.
      • Viskari H.
      • Hoppu S.
      • Honkanen H.
      • Huhtala H.
      • Simell O.
      • et al.
      Viral interference induced by live attenuated virus vaccine (OPV) can prevent otitis media.
      ].
      Given that there has been virtually no polio infection in most countries in the last 20 years, these effects of OPV are clearly beneficial NSEs.

       The HTMV enigma

      Four live vaccines have been associated with strong beneficial NSEs. From this perspective, it was an enigma that HTMV, also a live vaccine, had deleterious NSEs; furthermore, standard MV had stronger beneficial NSEs for females, but HTMV was associated with increased female mortality. Initially, it was hypothesized that standard MV had beneficial NSEs in addition to the preventive specific disease effects [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Coll Seck A.M.
      • Knudsen K.
      • Whittle H.
      Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
      ], and that HTMV, in contrast, did not have beneficial NSEs. Since females no longer experienced the beneficial NSEs of standard MV, female recipients of HTMV appeared to have higher mortality [
      • Aaby P.
      • Samb B.
      • Simondon F.
      • Knudsen K.
      • Seck A.M.
      • Bennett J.
      • et al.
      A comparison of vaccine efficacy and mortality during routine use of high-titre Edmonston-Zagreb and Schwarz standard measles vaccines in rural Senegal.
      ]. This was a poor explanation. It did not consider that the trend in all HTMV studies was that female HTMV recipients not only had higher mortality than female controls, but also had higher mortality than male HTMV recipients [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ]. In the pre-vaccination era in West Africa, girls did not have higher mortality than boys [
      • Aaby P.
      • Benn C.S.
      • Nielsen J.
      • Lisse I.M.
      • Rodrigues A.
      • Ravn H.
      Testing the hypothesis that diphtheria-tetanus-pertussis vaccine has negative non-specific and sex-differential effects on child survival in high-mortality countries.
      ].

       NSEs of non-live vaccines: resolving the HTMV enigma

      In the pursuit of the non-specific effects of vaccines, in the 1990s, the Bandim Health Project in Guinea-Bissau therefore initiated new studies, not only of smallpox vaccine, BCG and OPV, but also of DTP, hepatitis B vaccine (HBV) and IPV [
      • Kristensen I.
      • Aaby P.
      • Jensen H.
      Routine vaccinations and child survival: follow up study in Guinea-Bissau, West Africa.
      ,
      • Aaby P.
      • Benn C.S.
      • Nielsen J.
      • Lisse I.M.
      • Rodrigues A.
      • Ravn H.
      Testing the hypothesis that diphtheria-tetanus-pertussis vaccine has negative non-specific and sex-differential effects on child survival in high-mortality countries.
      ,
      • Aaby P.
      • Hedegaard K.
      • Sodemann M.
      • Nhante E.
      • Veirum J.E.
      • Jakobsen M.
      • et al.
      Childhood mortality after oral polio immunisation campaign in Guinea-Bissau.
      ,
      • Garly M.L.
      • Jensen H.
      • Martins C.L.
      • Balé C.
      • Balde M.A.
      • Lisse I.M.
      Aaby P Hepatitis B vaccination associated with higher female than male mortality in Guinea-Bissau: an observational study.
      ,
      • Aaby P.
      • Garly M.L.
      • Nielsen J.
      • Ravn H.
      • Martins C.
      • Balé C.
      • et al.
      Increased female-male mortality ratio associated with inactivated polio and diphtheria-tetanus-pertussis vaccines: observations from vaccination trials in Guinea-Bissau.
      ]. As of today, beneficial NSEs have been shown for four live vaccines [
      • Aaby P.
      • Gustafson P.
      • Roth A.
      • Rodrigues A.
      • Fernandes M.
      • Sodemann M.
      • et al.
      Vaccinia scars associated with better survival for adults. An observational study from Guinea-Bissau.
      ,
      • Jensen M.L.
      • Dave S.
      • van der Loeff M.S.
      • da Costa C.
      • Vincent T.
      • Leligdowicz A.
      • et al.
      Vaccinia scars associated with improved survival among adults in rural Guinea-Bissau.
      ,
      • Andersen A.
      • Fisker A.B.
      • Rodrigues A.
      • Martins C.
      • Ravn H.
      • Lund N.
      • et al.
      National immunization campaigns with oral polio vaccine reduce all-cause mortality: a natural experiment within seven randomized trials.
      ,
      • Lund N.
      • Andersen A.
      • Hansen A.S.
      • Jepsen F.S.
      • Barbosa A.
      • Biering-Sørensen S.
      • et al.
      The effect of oral polio vaccine at birth on infant mortality: a randomized trial.
      ,
      • Aaby P.
      • Martins C.L.
      • Garly M.L.
      • Bale C.
      • Andersen A.
      • Rodrigues A.
      • et al.
      Non-specific effects of standard measles vaccine at 4.5 and 9 months of age on childhood mortality: randomised controlled trial.
      ]. Unfortunately, the studies of DTP and other non-live vaccines found these vaccines to be associated with deleterious NSEs for females [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      The WHO review of the possible nonspecific effects of diphtheria-tetanus-pertussis vaccine.
      ,
      • Aaby P.
      • Ravn H.
      • Fisker A.B.
      • Rodrigues A.
      • Benn C.S.
      Is diphtheria-tetanus-pertussis (DTP) associated with increased female mortality? A meta-analysis testing the hypotheses of sex-differential non-specific effects of DTP vaccine.
      ]. This opened a new explanation of why the live HTMV had been associated with deleterious NSEs. HTMV had been given so early at 4–5 months of age in the RCTs that nearly all children in the HTMV groups had received DTP after HTMV; this was not the case in the control groups receiving standard MV at 9–10 months of age. DTP after MV is associated with increased female mortality [
      • Aaby P.
      • Ravn H.
      • Fisker A.B.
      • Rodrigues A.
      • Benn C.S.
      Is diphtheria-tetanus-pertussis (DTP) associated with increased female mortality? A meta-analysis testing the hypotheses of sex-differential non-specific effects of DTP vaccine.
      ] and, therefore, HTMV ended up being associated with increased female mortality. This explanation fitted all studies on MTMV and HTMV [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ]. In fact, before the HTMV recipients received DTP they had significantly lower mortality than controls who had not received MV [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ].

       Beneficial NSEs of non-live vaccines: DTP and rabies vaccine?

      A number of WHO-sponsored reports have reported large reductions in child mortality after DTP vaccine (Table 5). These reductions clearly suggest beneficial NSEs since the reductions are far larger than can be explained by prevention of pertussis, tetanus and diphtheria infections. However, the reports have a number of problems. First, the data have been collected with ‘survival bias’, meaning that data was better for those who survived than those who died [
      • Jensen H.
      • Benn C.S.
      • Lisse I.M.
      • Rodrigues A.
      • Andersen P.K.
      • Aaby P.
      Survival bias in observational studies of the impact of routine vaccinations on childhood survival.
      ]. This may happen because it can be difficult to get accurate information from the children who had already died, e.g. the parents threw the vaccination card away after the child died. If such children are classified as unvaccinated, it may exaggerate the benefit of the vaccine because some vaccinated deaths were misclassified as ‘unvaccinated’. Second, in many studies which reported beneficial NSEs of DTP, DTP had actually been co-administered with BCG [
      • Breiman R.F.
      • Streatfield P.K.
      • Phelan M.
      • Shifa N.
      • Rashi M.
      • Yunus M.
      Effect of infant immunization on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data.
      ]. In the official WHO schedule BCG should be given at birth and DTP only from 6 weeks of age. However, in many rural areas in low-income countries BCG is often delayed and therefore become co-administered with DTP. There is now substantial evidence that mortality is lower when BCG is co-administered with DTP than when DTP is administered after BCG [
      • Aaby P.
      • Andersen A.
      • Ravn H.
      • Khalequzzaman Md
      Co-administration of BCG and diphtheria-tetanus-pertussis (DTP) vaccinations may reduce infant mortality more than the WHO-schedule of BCG first and then DTP. A re-analysis of demographic surveillance data from rural Bangladesh.
      ,
      • Hirve S.
      • Bavdekar A.
      • Juvekar S.
      • Benn C.S.
      • Nielsen J.
      • Aaby P.
      Non-specific and sex-differential effects of vaccinations on child survival in rural western India.
      ,
      • Aaby P.
      • Ravn H.
      • Roth A.
      • Rodrigues A.
      • Lisse I.M.
      • Diness B.R.
      • et al.
      Early diphtheria-tetanus-pertussis vaccination associated with higher female mortality and no difference in male mortality in a cohort of low birthweight children: an observational study within a randomised trial.
      ]. When studies with survival bias or co-administration of BCG and DTP were excluded, DTP-vaccinated children had higher mortality than DTP-unvaccinated children [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      The WHO review of the possible nonspecific effects of diphtheria-tetanus-pertussis vaccine.
      ]. Hence, there are no valid studies to suggest that DTP has beneficial NSEs.
      Table 5Studies with survival bias assessing the effect of DTP vaccination compared with no DTP vaccination. Studies used by SAGE
      Country and study referenceAge groupAssessment of ‘unvaccinated’;

      % excluded for no information
      Mortality rate per 1000 person-years (deaths/follow-up time)Bias index
      The bias index measures the mortality rate ratio for unvaccinated versus vaccinated (any vaccine) children. When vaccinated dead children gets misclassified as ‘unvaccinated’ the bias index will become very high. It was >2.0 in all studies. In studies with assessment of status for both vaccinated and unvaccinated and prospective follow-up the bias index has been less than 1.7.
      (i.e. MRR for unvaccinated vs vaccinated children)
      MRR (95% CI) for DTP-vaccinated versus DTP-unvaccinated
      UnvaccinatedVaccinated
      Bangladesh
      The Bangladesh study is based on community registers and it is assumed that all information is available since no child is excluded for lack of information. However, there is no documentation that ‘unvaccinated’ was actively verified. The study had problems with registration of early events since children who subsequently moved had highly significantly lower vaccination coverage.
      • Breiman R.F.
      • Streatfield P.K.
      • Phelan M.
      • Shifa N.
      • Rashi M.
      • Yunus M.
      Effect of infant immunization on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data.
      6 weeks-9 monthsDefault; none67 (329/1783651 days)20 (362/6677421 days)3.40 (2.93–3.95)0.52 (0.31–0.87)
      Burkina Faso
      • Vaugelade J.
      • Pinchinat S.
      • Guielle G.
      • Elguero E.
      • Simondon F.
      Lower mortality in vaccinated children: follow up study in Burkina Faso.
      0–7 months, 6 months follow-upDefault; none120 (281/28128 person-months)52 (64/14662 person-months)2.29 (1.74–3.00)1.00 (0.60–1.67)
      Papua New Guinea
      • Lehmann D.
      • Vail J.
      • Firth M.J.
      • de Klerk N.H.
      • Alpers M.P.
      Benefits of routine immunisations on childhood survival in Tari, Southern Highlands province, Papua New Guinea.
      29 days to 5 monthsDefault; none233 (92/144285 days)31 (38/448418 days)7.52 (5.15–10.97)0.48 (0.22–1.09)
      India
      Health centre provided all vaccinations. Vaccinations coverage was very high. Hence, unvaccinated children would be a small group of frail children in the 6–8 week age range whereas DTP vaccinated children would tend to be 5–6 months old on average. Hence, the comparison is between different age groups and between healthy and frail children but not between different vaccination groups. The researchers themselves did not make a comparison between DTP vaccinated and DTP unvaccinated children, but the SAGE reviewers included this age-unadjusted comparison as an estimate of the effect of DTP. This comparison is ‘unnatural’ both because it is age unadjusted and because the control group does not reflect the general population of children [26].
      • Krishnan A.
      • Srivastava R.
      • Dwivedi P.
      • Ng N.
      • Byass P.
      • Pandav C.S.
      Non-specific sex-differential effect of DTP vaccination may partially explain the excess girl child mortality in Ballabgarh, India.
      6 weeks to 8 monthsHealth centre vaccinations; none200 (23/1381 person-months)29 (183/74937 person-months)6.82 (4.42–10.52)0.28 (0.20–0.40)
      Ghana
      • Bawah A.A.
      • Phillips J.F.
      • Adjuik M.
      • Vaughan-Smith M.
      • Macleod B.
      • Binka F.N.
      The impact of immunization on the association between poverty and child survival: evidence from Kassena-Nankana district of northern Ghana.
      0–59 monthsDefault; noneData not provided; since estimates for some vaccines versus no vaccine were 0.14 (0.13–0.16) the MRR must be at least sevenfold higher for unvaccinated than for vaccinated children7.14 (6.25–7.69)0.15 (0.14–0.16)
      a The bias index measures the mortality rate ratio for unvaccinated versus vaccinated (any vaccine) children. When vaccinated dead children gets misclassified as ‘unvaccinated’ the bias index will become very high. It was >2.0 in all studies. In studies with assessment of status for both vaccinated and unvaccinated and prospective follow-up the bias index has been less than 1.7.
      b The Bangladesh study is based on community registers and it is assumed that all information is available since no child is excluded for lack of information. However, there is no documentation that ‘unvaccinated’ was actively verified. The study had problems with registration of early events since children who subsequently moved had highly significantly lower vaccination coverage.
      c Health centre provided all vaccinations. Vaccinations coverage was very high. Hence, unvaccinated children would be a small group of frail children in the 6–8 week age range whereas DTP vaccinated children would tend to be 5–6 months old on average. Hence, the comparison is between different age groups and between healthy and frail children but not between different vaccination groups. The researchers themselves did not make a comparison between DTP vaccinated and DTP unvaccinated children, but the SAGE reviewers included this age-unadjusted comparison as an estimate of the effect of DTP. This comparison is ‘unnatural’ both because it is age unadjusted and because the control group does not reflect the general population of children
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      .
      Recently, it was hypothesized that rabies vaccine may have beneficial NSEs [
      • Gessner B.D.
      • Knobel D.L.
      • Conan A.
      • Finn A.
      Could the RTS,S/AS01meningitis safety signal really be a protective effect of rabies vaccine?.
      ,
      • Pollard A.J.
      • Finn A.
      • Curtis N.
      Non-specific effects of vaccines: plausible and potentially important, but implications uncertain.
      ]. The key observation leading to this suggestion is the RCTs of RTS,S/AS01 malaria vaccine which found that RTS,S/AS01 malaria vaccine was associated with a higher incidence of meningitis and cerebral malaria [
      • Gessner B.D.
      • Knobel D.L.
      • Conan A.
      • Finn A.
      Could the RTS,S/AS01meningitis safety signal really be a protective effect of rabies vaccine?.
      ] and higher female mortality [
      • Klein S.L.
      • Shann F.
      • Moss W.J.
      • Benn C.S.
      • Aaby P.
      RTS,S/AS01 malaria vaccine and increased mortality in girls.
      ]. Rather than ascribing this to a deleterious effect of RTS,S/AS01 malaria vaccine, it was suggested that rabies vaccine, which had been used as a control vaccine in one of the two age groups, in which RTS,S/AS01 malaria vaccine was tested, had beneficial NSEs [
      • Gessner B.D.
      • Knobel D.L.
      • Conan A.
      • Finn A.
      Could the RTS,S/AS01meningitis safety signal really be a protective effect of rabies vaccine?.
      ]. Furthermore, epidemiological studies of rabies vaccine to dogs in South Africa suggesting strong beneficial NSEs were taken as support for the hypothesis [
      • Knobel D.L.
      • Arega S.
      • Reininghaus B.
      • Simpson G.J.G.
      • Gessner B.D.
      • Stryhn H.
      • et al.
      Rabies vaccine is associated with decreased all-cause mortality in dogs.
      ]. Against the hypothesis speaks that non-specific/non-specif was also associated with increased female mortality in the age group in which conjugated meningococcal vaccine had been used as control vaccine [
      • Klein S.L.
      • Shann F.
      • Moss W.J.
      • Benn C.S.
      • Aaby P.
      RTS,S/AS01 malaria vaccine and increased mortality in girls.
      ]. The reported beneficial NSEs of rabies vaccine among dogs [
      • Knobel D.L.
      • Arega S.
      • Reininghaus B.
      • Simpson G.J.G.
      • Gessner B.D.
      • Stryhn H.
      • et al.
      Rabies vaccine is associated with decreased all-cause mortality in dogs.
      ] may be due to survival bias, since the collection of vaccination information was not as good for the dogs that had died.
      As of now there is no study supporting beneficial NSEs of non-live vaccines.

       Implications and conclusions

      Most trends noted in the development of the concept of the NSEs of MV starting from 1979 turned out to be consistent in later studies. Several RCTs of MV, BCG and OPV have found strong beneficial NSEs [
      • Biering-Sørensen S.
      • Aaby P.
      • Lund N.
      • Monteiro I.
      • Jensen K.
      • Eriksen H.B.
      • et al.
      Early BCG and neonatal mortality among low-birth-weight infants: a randomised controlled trial.
      ,
      • Lund N.
      • Andersen A.
      • Hansen A.S.
      • Jepsen F.S.
      • Barbosa A.
      • Biering-Sørensen S.
      • et al.
      The effect of oral polio vaccine at birth on infant mortality: a randomized trial.
      ,
      • Aaby P.
      • Martins C.L.
      • Garly M.L.
      • Bale C.
      • Andersen A.
      • Rodrigues A.
      • et al.
      Non-specific effects of standard measles vaccine at 4.5 and 9 months of age on childhood mortality: randomised controlled trial.
      ], though the results have not been universally consistent [
      • Jayaraman K.
      • Adhisivam B.
      • Nallasivan S.
      • Krishnan R.G.
      • Kamalarathnam C.
      • Bharathi M.
      • et al.
      Two randomized trials of the effect of the Russian strain of Bacillus calmette-Guerin alone or with oral polio vaccine on neonatal mortality in infants weighing <2000 g in India.
      ,
      • Fisker A.B.
      • Nebie E.
      • Schoeps A.
      • Martins C.
      • Rodrigues A.
      • Zakane A.
      • et al.
      A two-centre randomised trial of an additional early dose of measles vaccine: effects on mortality and measles antibody levels.
      ].
      The search for beneficial NSEs have generated several tentative generalizations which have been remarkably consistent: First, live vaccines have beneficial NSEs. Second, early vaccination enhances the beneficial NSEs. Third, boosting with live vaccines enhances the beneficial NSEs. Fourth, maternal priming with a similar antigen may also enhance the beneficial NSEs in the offspring. Fifth, so far all studies have shown that non-live vaccines are associated with higher female than male mortality. Sixth, sequence of vaccinations is important with the latest vaccine having the strongest NSEs. Seventh, a non-live vaccine administered after a live vaccine will reduce the beneficial NSEs of the live vaccine.
      These generalizations do not mean that beneficial NSEs are invariable effects which will always occur. The NSEs are generated through the immune system, and other immune training interventions, conditions or infections may therefor interfere to produce unexpected results [
      • Fisker A.B.
      • Nebie E.
      • Schoeps A.
      • Martins C.
      • Rodrigues A.
      • Zakane A.
      • et al.
      A two-centre randomised trial of an additional early dose of measles vaccine: effects on mortality and measles antibody levels.
      ]. Most health research is still conducted within a one problem one solution paradigm, e.g. one infection one vaccine or one deficiency one supplementation. It is rarely examined whether these solutions interact but they often do. For example, when BCG was co-administered with DTP it reduced the negative effect of DTP [
      • Aaby P.
      • Andersen A.
      • Ravn H.
      • Khalequzzaman Md
      Co-administration of BCG and diphtheria-tetanus-pertussis (DTP) vaccinations may reduce infant mortality more than the WHO-schedule of BCG first and then DTP. A re-analysis of demographic surveillance data from rural Bangladesh.
      ]; when DTP was administered after HTMV this had a strong negative effect for female survival [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ]; when campaigns with OPV are implemented it will reduce the differential effects of other exposures that the children have experienced [
      • Welaga P.
      • Hodgson A.
      • Debpuur C.
      • Aaby P.
      • Ravn H.
      • Binka F.
      • et al.
      Measles vaccination and MDG4: increasing coverage and increasing child survival in Northern Ghana.
      ]. With the increase in new vaccines and other interventions the number of interactions will increase. To optimize the benefits of public health interventions it is essential that the potential interactions are studied systematically, so that negative interactions can be limited or prevented.
      Historically, ideas about NSEs of a vaccine have been suggested many times, but there is usually no clear documentation which explains why the interest faded again or the studies were dismissed. The current studies of NSEs have been based on the perceived need to measure the effect on overall mortality, not merely on the targeted disease. Hopefully, the interest will not disappear this time. There are huge potentials in assessing the NSEs of different vaccines in different disease environment and with different interacting interventions with a view to further improve overall health [
      • Benn C.S.
      • Fisker A.B.
      • Rieckmann A.
      • Jensen A.G.
      • Aaby P.
      How to evaluate potential non-specific effects of vaccines: the quest for randomized trials or time for triangulation?.
      ]. Vaccinology has had a clear preference for RCTs and observational studies have often been dismissed [
      Strategic advisory group of experts on immunization.
      ]. However, there are reasons to be cautious with respect to methodology in studying the NSEs on morbidity and mortality. Many issues cannot be studied in an RCT because it would be considered unethical since the vaccine is already recommended by WHO [
      • Benn C.S.
      • Fisker A.B.
      • Rieckmann A.
      • Jensen A.G.
      • Aaby P.
      How to evaluate potential non-specific effects of vaccines: the quest for randomized trials or time for triangulation?.
      ]. Furthermore, the predictive value of an RCT may be limited if other immune stimulatory interventions are implemented while the study is ongoing; for example, OPV campaigns or vitamin A supplementation may change the overall result in RCTs of vaccines like MV, OPV and BCG [
      • Andersen A.
      • Fisker A.B.
      • Rodrigues A.
      • Martins C.
      • Ravn H.
      • Lund N.
      • et al.
      National immunization campaigns with oral polio vaccine reduce all-cause mortality: a natural experiment within seven randomized trials.
      ,
      • Welaga P.
      • Hodgson A.
      • Debpuur C.
      • Aaby P.
      • Ravn H.
      • Binka F.
      • et al.
      Measles vaccination and MDG4: increasing coverage and increasing child survival in Northern Ghana.
      ,
      • Lund N.
      • Andersen A.
      • Hansen A.S.
      • Jepsen F.S.
      • Barbosa A.
      • Biering-Sørensen S.
      • et al.
      The effect of oral polio vaccine at birth on infant mortality: a randomized trial.
      ]. Hence, most certainty can be obtained if different methods, including RCTs, natural experiments and observational studies, can be used and point in the same direction [
      • Benn C.S.
      • Fisker A.B.
      • Rieckmann A.
      • Jensen A.G.
      • Aaby P.
      How to evaluate potential non-specific effects of vaccines: the quest for randomized trials or time for triangulation?.
      ]. This process called triangulation has been used in several studies of NSEs.
      So far, the only major policy implication of the NSEs of vaccines has been that HTMV was withdrawn by WHO in 1992 because it was associated with increased female mortality [
      • Aaby P.
      • Jensen H.
      • Samb B.
      • Cisse B.
      • Sodeman M.
      • Jakobsen M.
      • et al.
      Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: re-analysis of West African studies.
      ]. However, based on what we know now, it would seem appropriate to test how NSEs of vaccines could possibly improve the current vaccination schedule and child survival. Since BCG is often delayed, the median age of vaccination being more than 1 month in Africa [
      • Thysen S.M.
      • Byberg S.
      • Pedersen M.
      • Rodrigues A.
      • Ravn H.
      • Martins C.
      • et al.
      BCG coverage and barriers to BCG vaccination in Guinea-Bissau: an observational study.
      ], providing BCG vaccination within the first days of life consistently would probably reduce mortality very considerably. The relative benefit of different strains of BCG should be determined [
      • Biering-Sørensen S.
      • Aaby P.
      • Lund N.
      • Monteiro I.
      • Jensen K.
      • Eriksen H.B.
      • et al.
      Early BCG and neonatal mortality among low-birth-weight infants: a randomised controlled trial.
      ,
      • Jayaraman K.
      • Adhisivam B.
      • Nallasivan S.
      • Krishnan R.G.
      • Kamalarathnam C.
      • Bharathi M.
      • et al.
      Two randomized trials of the effect of the Russian strain of Bacillus calmette-Guerin alone or with oral polio vaccine on neonatal mortality in infants weighing <2000 g in India.
      ]. It should be examined how the negative effects of DTP can be reduced, possibly through co-administration with BCG [
      • Aaby P.
      • Andersen A.
      • Ravn H.
      • Khalequzzaman Md
      Co-administration of BCG and diphtheria-tetanus-pertussis (DTP) vaccinations may reduce infant mortality more than the WHO-schedule of BCG first and then DTP. A re-analysis of demographic surveillance data from rural Bangladesh.
      ]. If MV could be given earlier [
      • Fisker A.B.
      • Hornshøj L.
      • Rodrigues A.
      • Balde I.
      • Fernandes M.
      • Benn C.S.
      • et al.
      Effects of the introduction of new vaccines in Guinea-Bissau on vaccine coverage, vaccine timeliness, and child survival: an observational study.
      ] it would increase the period with a beneficial live vaccine as the last vaccination. Furthermore, it should not be recommended to give a non-live vaccine after MV as this has consistently produced increased female mortality [
      • Aaby P.
      • Ravn H.
      • Benn C.S.
      • Rodrigues A.
      • Samb B.
      • Ibrahim S.A.
      • et al.
      Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
      ]. Can other live vaccines replace the beneficial NSEs of OPV, when OPV is removed and substituted with IPV as planned [
      • Fish E.N.
      • Flanagan K.L.
      • Furman D.
      • Klein S.L.
      • Kollmann T.R.
      • Jeppesen D.L.
      • et al.
      Changing oral vaccine to inactivated polio vaccine might increase mortality.
      ]? We need to consider whether it is optimal for both females and males to have the same vaccination schedules.
      Once we start measuring the NSEs of vaccines systematically many more patterns that may improve child survival will emerge.

      Transparency declaration

      No conflicts of interest to declare. The lead author (the manuscript's guarantor) affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained. The work on NSEs of vaccines has been supported by the Danish Council for Development Research , Ministry of Foreign Affairs, Denmark [grant number 104.Dan.8.f. ], Novo Nordisk Foundation and European Union FP7 support for OPTIMUNISE (grant: Health- F3-2011-261375 ). CSB held a starting grant from the ERC ( ERC-2009-StG-243149 ). CVIVA is supported by a grant from the Danish National Research Foundation ( DNRF108 ). PA held a research professorship grant from the Novo Nordisk Foundation. No funding body had any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

      Appendix A. Supplementary data

      The following is the Supplementary data to this article:

      References

        • Aaby P.
        • Samb B.
        • Simondon F.
        • Coll Seck A.M.
        • Knudsen K.
        • Whittle H.
        Non-specific beneficial effect of measles immunisation: analysis of mortality studies from developing countries.
        Br Med J. 1995; 311: 481-485
        • Kristensen I.
        • Aaby P.
        • Jensen H.
        Routine vaccinations and child survival: follow up study in Guinea-Bissau, West Africa.
        BMJ. 2000; 321: 1435-1438
        • Aaby P.
        • Jensen H.
        • Samb B.
        • Cisse B.
        • Sodeman M.
        • Jakobsen M.
        • et al.
        Differences in female-male mortality after high-titre measles vaccine and association with subsequent vaccination with diphtheria-tetanus-pertussis and inactivated poliovirus: re-analysis of West African studies.
        Lancet. 2003; 361: 2183-2188
        • Benn C.S.
        • Netea M.G.
        • Selin L.K.
        • Aaby P.
        A small jab – a big effect: nonspecific immunomodulation by vaccines.
        Trends Immunol. 2013; 34: 431-439
        • Kleinnijenhuis J.
        • Quintin J.
        • Preijers F.
        • Joosten L.A.
        • Ifrim D.C.
        • Saeed S.
        • et al.
        Bacille Calmette-Guérin induces NOD2-dependent nonspecific protection from reinfection via epigenetic reprogramming of monocytes.
        Proc Natl Acad Sci U S A. 2012; 109: 17537-17542
        • Arts R.J.W.
        • Moorlag S.J.C.F.M.
        • Novakovic B.
        • Li Y.
        • Wang S.Y.
        • Oosting M.
        • et al.
        BCG vaccination protects against experimental viral infection in humans through the induction of cytokines associated with trained immunity.
        Cell Host Microbe. 2018; 23 (e5): 89-100
        • Mayr A.
        Taking advantage of the positive side-effects of smallpox vaccination.
        J Vet Med. 2004; B 51: 199-201
        • Calmette A.
        Preventive vaccination against tuberculosis with BCG.
        Proc Roy Soc Med. 1931; : 1481-1490
        • Näslund C.
        Resultats des experiences de vaccination par le BCG poursuivies dans le Norrbotten (Suède) (Septembre 1927–Décembre 1931). Vaccination Preventative de Tuberculose, Rapports et Documents.
        Institut Pasteur, Paris1932
        • Mosley W.H.
        Will primary health care reduce infant and child mortality. With special reference to Africa and Asia.
        in: Vallin J. Lopez A.D. Health policy, social policy and mortality prospects. Ordina, Liege1985: 103-137
        • Hendrickse R.G.
        Problems of future measles vaccination in developing countries.
        Trans R Soc Trop Med Hyg. 1975; 69: 31-34
        • The Kasongo Project Team
        Influence of measles vaccination on survival pattern of 7–35-month-old children in Kasongo.
        Zaire Lancet. 1981; i: 764-767
        • Aaby P.
        • Bukh J.
        • Lisse I.M.
        • Smits A.J.
        Measles mortality, state of nutrition, and family structure: a community study from Guinea-Bissau.
        J Infect Dis. 1983; 147: 693-701
        • Aaby P.
        • Bukh J.
        • Lisse I.M.
        • Smits A.J.
        • Gomes J.
        • Fernandes M.A.
        • et al.
        Determinants of measles mortality in a rural area of Guinea-Bissau: crowding, age, and malnutrition.
        J Trop Pediatr. 1984; 30: 164-168
        • Aaby P.
        • Bukh J.
        • Lisse I.M.
        • Smits A.J.
        Measles vaccination and reduction in child mortality: a community study from Guinea-Bissau.
        J Infect. 1984; 8: 13-21
        • Aaby P.
        • Pedersen I.R.
        • Knudsen K.
        • da Silva M.C.
        • Mordhorst C.H.
        • Helm-Petersen N.C.
        • et al.
        Child mortality related to seroconversion or lack of seroconversion after measles vaccination.
        Pediatr Infect Dis J. 1989; 8: 197-200
        • Aaby P.
        • Samb B.
        • Simondon F.
        • Knudsen K.
        • Seck A.M.
        • Bennett J.
        • et al.
        Divergent mortality for male and female recipients of low-titer and high-titer measles vaccines in rural Senegal.
        Am J Epidemiol. 1993; 138: 746-755
        • Chen R.T.
        • Weierbach R.
        • Bisoffi Z.
        • Cutts F.
        • Rhodes P.
        • Ramaroson S.
        • et al.
        A “post-honeymoon period” measles outbreak in Muyinga Sector, Burundi.
        Int J Epidemiol. 1994; 23: 185-193
        • Aaby P.
        • Knudsen K.
        • Jensen T.G.
        • Thaarup J.
        • Poulsen A.
        • Sodemann M.
        • et al.
        Measles incidence, vaccine efficacy, and mortality in two urban African areas with high vaccination coverage.
        J Infect Dis. 1990; 162: 1043-1048
        • Aaby P.
        • Bukh J.
        • Lisse I.M.
        • Smits A.J.
        Measles vaccination and child mortality.
        Lancet. 1981; ii: 93
        • Mogensen S.W.
        • Aaby P.
        • Smedman L.
        • Martins C.L.
        • Rodrigues A.
        • Benn C.S.
        • et al.
        Introduction of standard measles vaccination in an urban African community in 1979 and overall child survival: a reanalysis of data from a cohort study.
        BMJ Open. 2016; 6e011317
        • De Quadros C.A.
        • Izurieta H.
        • Venczel L.
        • Carrasco P.
        Measles eradication in the Americas : progress to date.
        J Infect Dis. 2004; 189
        • Aaby P.
        • Leeuwenburg J.
        Patterns of transmission and severity of measles infection. A reanalysis of data from the Machakos area, Kenya.
        J Infect Dis. 1990; 161: 171-174
        • Aaby P.
        • Bhuyia A.
        • Nahar L.
        • Knudsen K.
        • Francisco A.
        • Strong M.
        The survival benefit of measles immunisation may not be explained entirely by the prevention of measles disease.
        Int J Epidemiol. 2003; 32: 106-115
        • Aaby P.
        • Whittle H.C.
        • Benn C.S.
        Vaccine programmes must consider their effect on general resistance.
        BMJ. 2012; 344: e3769
        • Aaby P.
        • Ravn H.
        • Benn C.S.
        • Rodrigues A.
        • Samb B.
        • Ibrahim S.A.
        • et al.
        Randomized trials comparing inactivated vaccine after medium- or high-titer measles vaccine with standard titer measles vaccine after inactivated vaccine: a meta-analysis.
        Pediatr Infect Dis J. 2016; 35: 1232-1241
        • Aaby P.
        • Martins C.L.
        • Garly M.L.
        • Rodrigues A.
        • Benn C.S.
        • Whittle H.C.
        The optimal age of measles immunization in low-income countries: a secondary analysis of the assumptions underlying the current policy.
        BMJ Open. 2012; 2e000761
        • Aaby P.
        • Simondon F.
        • Samb B.
        • Cisse B.
        • Jensen H.
        • Lisse I.M.
        • et al.
        Low mortality after mild measles infection compared to uninfected children in rural West Africa.
        Vaccine. 2002; 21: 120-126
        • Aaby P.
        • Lisse I.
        • Mølbak K.
        • Knudsen K.
        • Whittle H.
        No persistent T lymphocyte immunosuppression or increased mortality after measles infection: a community study from Guinea-Bissau.
        Pediatr Inf Dis J. 1996; 15: 39-44
        • Aaby P.
        • Samb B.
        • Andersen M.
        • Simondon F.
        No long-term excess mortality after measles infection: a community study from Senegal.
        Am J Epidemiol. 1996; 143: 1035-1041
        • Benn C.S.
        • Fisker A.B.
        • Rieckmann A.
        • Jensen A.G.
        • Aaby P.
        How to evaluate potential non-specific effects of vaccines: the quest for randomized trials or time for triangulation?.
        Expert Rev Vaccines. 2018; https://doi.org/10.1080/14760584.2018.1471987
        • Aaby P.
        • Martins C.L.
        • Ravn H.
        • Rodrigues A.
        • Whittle H.C.
        • Benn C.S.
        Is early measles vaccination better than later measles vaccination?.
        Trans R Soc Trop Med Hyg. 2015; 109: 16-28
        • Higgins J.P.T.
        • Soares-Weiser K.
        • López-López J.A.
        • Kakourou A.
        • Chaplin K.
        • Christensen H.
        • et al.
        Association of BCG, DTP, and measles containing vaccines with childhood mortality: systematic review.
        BMJ. 2016; 355: i5170
        • Sørup S.
        • Benn C.S.
        • Poulsen A.
        • Krause T.
        • Aaby P.
        • Ravn H.
        Live vaccine against measles, mumps, and rubella and the risk of hospital admissions for nontargeted infections.
        JAMA. 2014; 311: 826-835
        • Sørup S.
        • Jensen A.K.G.
        • Aaby P.
        • Benn C.S.
        Revaccination with measles-mumps-rubella vaccine and infectious disease morbidity: a Danish register-based cohort study.
        CID. 2019; 68: 282-290
        • Bardenheier B.H.
        • McNeil M.M.
        • Wodi A.P.
        • McNicholl J.
        • DeStefano F.
        Risk of nontargeted infectious disease hospitalizations among U.S. children following inactivated and live vaccines, 2005–2014.
        Clin Inf Dis. 2017; 65: 729-737
        • Tielemans S.M.A.J.
        • de Melker H.E.
        • Hahné S.J.M.
        • Boef A.G.C.
        • van der Klis F.R.M.
        • Sanders E.A.M.
        • et al.
        Non-specific effects of measles, mumps, and rubella (MMR) vaccination in high income setting: population based cohort study in The Netherlands.
        BMJ. 2017; 358: j3862
        • Benn C.S.
        • Sørup S.
        • Aaby P.
        Beneficial non-specific reduction in hospital admissions for respiratory infections following MMR and MenC vaccinations in The Netherlands.
        BMJ Rapid Response to BMJ. 2017; 358 (2017): j3862
        • Benn C.S.
        • Sørup S.
        • Aaby P.
        The sequence of vaccinations to test the non-specific effects of vaccines.
        BMJ Rapid Response to BMJ. 2017; 358 (2017): j3862
        • Mercer A.J.
        Smallpox and epidemiological-demographic change in Europe: the role of vaccination.
        Popul Stud. 1985; 39: 287-307
        • Aaby P.
        • Gustafson P.
        • Roth A.
        • Rodrigues A.
        • Fernandes M.
        • Sodemann M.
        • et al.
        Vaccinia scars associated with better survival for adults. An observational study from Guinea-Bissau.
        Vaccine. 2006; 24: 5718-5725
        • Jensen M.L.
        • Dave S.
        • van der Loeff M.S.
        • da Costa C.
        • Vincent T.
        • Leligdowicz A.
        • et al.
        Vaccinia scars associated with improved survival among adults in rural Guinea-Bissau.
        PLoS One. 2006; 1: e101
        • Rieckmann A.
        • Villumsen M.
        • Sørup S.
        • Haugaard L.K.
        • Ravn H.
        • Roth A.
        • et al.
        Vaccinations against smallpox and tuberculosis are associated with better long-term survival: a Danish case-cohort study 1971–2010.
        Int J Epidemiol. 2017; 46: 695-705
        • Rieckmann A.
        • Villumsen M.
        • Jensen M.L.
        • Ravn H.
        • da Silva Z.J.
        • Sørup S.
        • et al.
        The effect of smallpox and Bacillus calmette-Guerin vaccination on the risk of human immunodeficiency virus-1 infection in Guinea-Bissau and Denmark.
        Open Forum Infect Dis. 2017; 4: ofx130
        • Mackaness G.B.
        The immunological basis of acquired cellular resistance.
        J Epx Med. 1964; 120: 105-120
      1. BMJ. The Lübeck catastrophe. A general review.
        BMJ. 1931; 1: 986-988
        • van der Meijden A.P.
        Non-specific immunotherapy with B.C.G.in superficial bladder cancer: an overview.
        In Vivo. 1991; 5: 599-604
        • Garly M.L.
        • Martins C.L.
        • Balé C.
        • Baldé M.A.
        • Hedegaard K.L.
        • Gustafson P.
        • et al.
        BCG scar and positive tuberculin reaction and reduced infant and childhood mortality in West Africa: a non-specific beneficial effect of BCG?.
        Vaccine. 2003; 21: 2782-2790
        • Biering-Sørensen S.
        • Aaby P.
        • Lund N.
        • Monteiro I.
        • Jensen K.
        • Eriksen H.B.
        • et al.
        Early BCG and neonatal mortality among low-birth-weight infants: a randomised controlled trial.
        Clin Inf Dis. 2017; 65: 1183-1190
        • Schaltz-Buchholzer F.
        • Biering-Sørensen S.
        • Lund N.
        • Monteiro I.
        • Umbasse P.
        • Fisker A.B.
        • et al.
        Early Bacille Calmette-Guérin vaccination, hospitalizations and hospital deaths: analysis of a secondary outcome in three randomized trials from Guinea-Bissau.
        J Infect Dis. 2019; 219: 624-632
        • Jayaraman K.
        • Adhisivam B.
        • Nallasivan S.
        • Krishnan R.G.
        • Kamalarathnam C.
        • Bharathi M.
        • et al.
        Two randomized trials of the effect of the Russian strain of Bacillus calmette-Guerin alone or with oral polio vaccine on neonatal mortality in infants weighing <2000 g in India.
        Pediatr Infect Dis J. 2019; 38: 198-202
        • Curtis N.
        BCG vaccination and all-cause neonatal mortality.
        Pediatr Infect Dis J. 2019; 38: 195-197
        • Voroshilova M.F.
        Potential use of nonpathogenic enteroviruses for control of human disease.
        in: Prog med virol. vol. 36. Karger, Basel1989: 191-202
        • Contreras G.
        Sabin's vaccine used for nonspecific prevention of infant diarrhea of viral etiology.
        Bull Pan Am Health Organ. 1974; 8: 123-132
        • Contreras G.
        Effect of the administration of oral poliovirus vaccine on infantile diarrhoea mortality.
        Vaccine. 1989; 7: 211-212
        • Aaby P.
        • Rodrigues A.
        • Biai S.
        • Martins C.
        • Veirum J.E.
        • Benn C.S.
        • et al.
        Oral polio vaccination and low case fatality at the paediatric ward in Bissau, Guinea-Bissau.
        Vaccine. 2004; 22: 3014-3017
        • Mogensen S.W.
        • Andersen A.
        • Rodrigues A.
        • Benn C.S.
        • Aaby P.
        The introduction of diphtheria-tetanus-pertussis and oral polio vaccine among young infants in an urban African community: a natural experiment.
        EBioMedicine. 2017; 17: 192-198
        • Andersen A.
        • Fisker A.B.
        • Rodrigues A.
        • Martins C.
        • Ravn H.
        • Lund N.
        • et al.
        National immunization campaigns with oral polio vaccine reduce all-cause mortality: a natural experiment within seven randomized trials.
        Front Public Health. 2018; 6: 13
        • Welaga P.
        • Hodgson A.
        • Debpuur C.
        • Aaby P.
        • Ravn H.
        • Binka F.
        • et al.
        Measles vaccination and MDG4: increasing coverage and increasing child survival in Northern Ghana.
        Front Public Health. 2018; 6: 28
        • Schoeps A.
        • Nebié E.
        • Fisker A.B.
        • Sié A.
        • Zakane A.
        • Müller O.
        • et al.
        No effect of an additional early dose of measles vaccine on hospitalization or mortality in children: a randomized controlled trial.
        Vaccine. 2018; 36: 1965-1971
        • Lund N.
        • Andersen A.
        • Hansen A.S.
        • Jepsen F.S.
        • Barbosa A.
        • Biering-Sørensen S.
        • et al.
        The effect of oral polio vaccine at birth on infant mortality: a randomized trial.
        Clin Infect Dis. 2015; 61: 1504-1511
        • Upfill-Brown A.
        • Taniuchi M.
        • Platts-Mills J.A.
        • Kirkpatrick B.
        • Burgess S.L.
        • Oberste M.S.
        • et al.
        Non-specific effects of oral polio vaccine on diarrheal burden and etiology among Bangladeshi children.
        Clin Infect Dis. 2017; 65: 414-419
        • Seppälä E.
        • Viskari H.
        • Hoppu S.
        • Honkanen H.
        • Huhtala H.
        • Simell O.
        • et al.
        Viral interference induced by live attenuated virus vaccine (OPV) can prevent otitis media.
        Vaccine. 2011; 29: 8615-8618
        • Aaby P.
        • Samb B.
        • Simondon F.
        • Knudsen K.
        • Seck A.M.
        • Bennett J.
        • et al.
        A comparison of vaccine efficacy and mortality during routine use of high-titre Edmonston-Zagreb and Schwarz standard measles vaccines in rural Senegal.
        Trans Roy Soc Trop Med Hyg. 1996; 90: 326-330
        • Aaby P.
        • Benn C.S.
        • Nielsen J.
        • Lisse I.M.
        • Rodrigues A.
        • Ravn H.
        Testing the hypothesis that diphtheria-tetanus-pertussis vaccine has negative non-specific and sex-differential effects on child survival in high-mortality countries.
        BMJ Open. 2012; 2e000707
        • Aaby P.
        • Hedegaard K.
        • Sodemann M.
        • Nhante E.
        • Veirum J.E.
        • Jakobsen M.
        • et al.
        Childhood mortality after oral polio immunisation campaign in Guinea-Bissau.
        Vaccine. 2005; 23: 1746-1751
        • Garly M.L.
        • Jensen H.
        • Martins C.L.
        • Balé C.
        • Balde M.A.
        • Lisse I.M.
        Aaby P Hepatitis B vaccination associated with higher female than male mortality in Guinea-Bissau: an observational study.
        PIDJ. 2004; 23: 1086-1092
        • Aaby P.
        • Garly M.L.
        • Nielsen J.
        • Ravn H.
        • Martins C.
        • Balé C.
        • et al.
        Increased female-male mortality ratio associated with inactivated polio and diphtheria-tetanus-pertussis vaccines: observations from vaccination trials in Guinea-Bissau.
        PIDJ. 2007; 26: 247-252
        • Aaby P.
        • Martins C.L.
        • Garly M.L.
        • Bale C.
        • Andersen A.
        • Rodrigues A.
        • et al.
        Non-specific effects of standard measles vaccine at 4.5 and 9 months of age on childhood mortality: randomised controlled trial.
        BMJ. 2010; 341: c6495
        • Aaby P.
        • Ravn H.
        • Benn C.S.
        The WHO review of the possible nonspecific effects of diphtheria-tetanus-pertussis vaccine.
        Pediatr Infect Dis J. 2016; 35: 1247-1257
        • Aaby P.
        • Ravn H.
        • Fisker A.B.
        • Rodrigues A.
        • Benn C.S.
        Is diphtheria-tetanus-pertussis (DTP) associated with increased female mortality? A meta-analysis testing the hypotheses of sex-differential non-specific effects of DTP vaccine.
        Trans R Soc Trop Med Hyg. 2016; 110: 570-581
        • Breiman R.F.
        • Streatfield P.K.
        • Phelan M.
        • Shifa N.
        • Rashi M.
        • Yunus M.
        Effect of infant immunization on childhood mortality in rural Bangladesh: analysis of health and demographic surveillance data.
        Lancet. 2004; 364: 2204-2211
        • Vaugelade J.
        • Pinchinat S.
        • Guielle G.
        • Elguero E.
        • Simondon F.
        Lower mortality in vaccinated children: follow up study in Burkina Faso.
        BMJ. 2004; 329: 1309-1311
        • Lehmann D.
        • Vail J.
        • Firth M.J.
        • de Klerk N.H.
        • Alpers M.P.
        Benefits of routine immunisations on childhood survival in Tari, Southern Highlands province, Papua New Guinea.
        Int J Epidemiol. 2005; 34: 138-148
        • Krishnan A.
        • Srivastava R.
        • Dwivedi P.
        • Ng N.
        • Byass P.
        • Pandav C.S.
        Non-specific sex-differential effect of DTP vaccination may partially explain the excess girl child mortality in Ballabgarh, India.
        Trop Med Int Health. 2013; 18: 1329-1337
        • Bawah A.A.
        • Phillips J.F.
        • Adjuik M.
        • Vaughan-Smith M.
        • Macleod B.
        • Binka F.N.
        The impact of immunization on the association between poverty and child survival: evidence from Kassena-Nankana district of northern Ghana.
        Scand J Pub Health. 2010; 38: 95-103
        • Jensen H.
        • Benn C.S.
        • Lisse I.M.
        • Rodrigues A.
        • Andersen P.K.
        • Aaby P.
        Survival bias in observational studies of the impact of routine vaccinations on childhood survival.
        Trop Med Int Health. 2007; 12: 5-14
        • Aaby P.
        • Andersen A.
        • Ravn H.
        • Khalequzzaman Md
        Co-administration of BCG and diphtheria-tetanus-pertussis (DTP) vaccinations may reduce infant mortality more than the WHO-schedule of BCG first and then DTP. A re-analysis of demographic surveillance data from rural Bangladesh.
        EBioMedicine. 2017; 22: 173-180
        • Hirve S.
        • Bavdekar A.
        • Juvekar S.
        • Benn C.S.
        • Nielsen J.
        • Aaby P.
        Non-specific and sex-differential effects of vaccinations on child survival in rural western India.
        Vaccine. 2012; 30: 7300-7308
        • Aaby P.
        • Ravn H.
        • Roth A.
        • Rodrigues A.
        • Lisse I.M.
        • Diness B.R.
        • et al.
        Early diphtheria-tetanus-pertussis vaccination associated with higher female mortality and no difference in male mortality in a cohort of low birthweight children: an observational study within a randomised trial.
        Arch Dis Child. 2012; 97: 685-691
        • Gessner B.D.
        • Knobel D.L.
        • Conan A.
        • Finn A.
        Could the RTS,S/AS01meningitis safety signal really be a protective effect of rabies vaccine?.
        Vaccine. 2017; 35: 716-721
        • Pollard A.J.
        • Finn A.
        • Curtis N.
        Non-specific effects of vaccines: plausible and potentially important, but implications uncertain.
        Arch Dis Child. 2017; 102: 1077-1081
        • Klein S.L.
        • Shann F.
        • Moss W.J.
        • Benn C.S.
        • Aaby P.
        RTS,S/AS01 malaria vaccine and increased mortality in girls.
        mBio. 2016; 7: e00514-e00516
        • Knobel D.L.
        • Arega S.
        • Reininghaus B.
        • Simpson G.J.G.
        • Gessner B.D.
        • Stryhn H.
        • et al.
        Rabies vaccine is associated with decreased all-cause mortality in dogs.
        Vaccine. 2017; 35: 3844-3849
        • Fisker A.B.
        • Nebie E.
        • Schoeps A.
        • Martins C.
        • Rodrigues A.
        • Zakane A.
        • et al.
        A two-centre randomised trial of an additional early dose of measles vaccine: effects on mortality and measles antibody levels.
        Clin Infect Dis. 2018; 66: 1573-1580
      2. Strategic advisory group of experts on immunization.
        Week Epidemiol Rec. 2014; 89: 233-235
        • Thysen S.M.
        • Byberg S.
        • Pedersen M.
        • Rodrigues A.
        • Ravn H.
        • Martins C.
        • et al.
        BCG coverage and barriers to BCG vaccination in Guinea-Bissau: an observational study.
        BMC Public Health. 2014; 14: 1037
        • Fisker A.B.
        • Hornshøj L.
        • Rodrigues A.
        • Balde I.
        • Fernandes M.
        • Benn C.S.
        • et al.
        Effects of the introduction of new vaccines in Guinea-Bissau on vaccine coverage, vaccine timeliness, and child survival: an observational study.
        Lancet Glob Health. 2014; 2: e478-e487
        • Fish E.N.
        • Flanagan K.L.
        • Furman D.
        • Klein S.L.
        • Kollmann T.R.
        • Jeppesen D.L.
        • et al.
        Changing oral vaccine to inactivated polio vaccine might increase mortality.
        Lancet. 2016; 387: 1054-1055