Skip to main content

Classifying maternal deaths in Suriname using WHO ICD-MM: different interpretation by Physicians, National and International Maternal Death Review Committees

Abstract

Plain English summary

The World Health Organization (WHO) provides a framework (ICD-MM) to classify pregnancy-related deaths systematically, which enables global comparison among countries. We compared the classification of pregnancy-related deaths in Suriname by the attending physician and by the national maternal death review (MDR) committee and among the MDR committees of Suriname, Jamaica and the Netherlands. There were 89 possible pregnancy-related deaths in Suriname between 2010 and 2014. Nearly half (47%) were classified differently by the Surinamese MDR committee as compared to the classification of the attending physicians. All three MDR committees agreed that 18% (n = 16/89) of the cases were no maternal deaths. Out of the remaining 73 cases, there was disagreement regarding whether 15% (n = 11) were maternal deaths. The Surinamese and Jamaican MDR committees achieved greater consensus in classification than the Surinamese and the Netherlands MDR committees. The Netherlands MDR committee classified more deaths as unspecified than Surinamese and the Jamaican MDR committees. Underlying causes that achieved a high level of agreement among the three committees were abortive outcomes and obstetric hemorrhage, while little agreement was reported for unspecified and other direct causes.

The issues encountered during maternal death classification using the ICD-MM guidelines included classification of suicide during early pregnancy; when to assume pregnancy without objective evidence; how to count maternal deaths occurring outside the country of residence; the relevance of direct or indirect cause attribution; and how to select the underlying cause when direct and indirect conditions or multiple comorbidities co-occur. Addressing these classification barriers in future revisions of the ICD-MM guidelines could enhance the feasibility of maternal death classification and facilitate global comparison.

Background

Insight into the underlying causes of pregnancy-related deaths is essential to develop policies to avert preventable deaths. The WHO International Classification of Diseases-Maternal Mortality (ICD-MM) guidelines provide a framework to standardize maternal death classifications and enable comparison in and among countries over time. However, despite the implementation of these guidelines, differences in classification remain. We evaluated consensus on maternal death classification using the ICD-MM guidelines.

Methods

The classification of pregnancy-related deaths in Suriname during 2010–2014 was compared in the country (between the attending physician and the national maternal death review (MDR) committee), and among the MDR committees from Suriname, Jamaica and the Netherlands. All reviewers applied the ICD-MM guidelines. The inter-rater reliability (Fleiss kappa [κ]) was used to measure agreement.

Results

Out of the 89 cases certified by attending physicians, 47% (n = 42) were classified differently by the Surinamese MDR committee. The three MDR committees agreed that 18% (n = 16/89) of these cases were no maternal deaths, and, therefore, excluded from further analyses. However, opinions differed whether 15% (n = 11) of the remaining 73 cases were maternal deaths. The MDR committees achieved moderate agreement classifying the deaths into type (direct, indirect and unspecified) (κ = 0.53) and underlying cause group (κ = 0.52). The Netherlands MDR committee classified more maternal deaths as unspecified (19%), than the Jamaican (7%) and Surinamese (4%) committees did. The mutual agreement between the Surinamese and Jamaican MDR committees (κ = 0.69 vs κ = 0.63) was better than between the Surinamese and the Netherlands MDR committees (κ = 0.48 vs κ = 0.49) for classification into type and underlying cause group, respectively. Agreement on the underlying cause category was excellent for abortive outcomes (κ = 0.85) and obstetric hemorrhage (κ = 0.74) and fair for unspecified (κ = 0.29) and other direct causes (κ = 0.32).

Conclusions

Maternal death classification differs in Suriname and among MDR committees from different countries, despite using the ICD-MM guidelines on similar cases. Specific challenges in applying these guidelines included attribution of underlying cause when comorbidities occurred, the inclusion of deaths from suicides, and maternal deaths that occurred outside the country of residence.

Peer Review reports

Background

The maternal mortality ratio (MMR) is a robust indicator of health care quality, inequality and inequity in and among countries [1]. Most maternal deaths are preventable in low, middle and high resource settings, as was the case for 47% of maternal deaths in Suriname between 2010 and 2014 [2, 3]. To develop prevention strategies, accurate data on the number of maternal deaths and insight into underlying causes are essential [2, 4, 5]. However, the assignment of a reliable underlying cause of death and the subsequent classification can be a challenge [6].

The World Health Organization (WHO) aimed to create uniform maternal death classification guidelines to enhance usability, improve comparability and decrease coding errors [7,8,9]. Therefore, the WHO launched the International Classification of Diseases-Maternal Mortality (ICD-MM) in 2012, an application of International Classification of Diseases-10th edition (ICD-10) to classify deaths during pregnancy, childbirth and the puerperium [7].

Difficulties in attributing the underlying causes can result in inconsistencies in classification in and among countries, despite using the ICD-MM guidelines [8, 10]. When a European expert panel reviewed pregnancy-related deaths across 13 European countries, they identified 14% more maternal deaths than what the national registries of the individual countries included [11]. Classification is especially complicated when comorbidities occur, and the start of the chain of events resulting in maternal death has to be determined [10]. Consequently, underlying cause attribution may vary, or the causes are unknown or unclear, resulting in underreporting. This is not only an issue in low- and middle-income countries but also in high-income countries and was reported by various Maternal Death Review (MDR) committees, including those from Suriname, Jamaica and the Netherlands [3, 12, 13].

Therefore, this study aimed to assess the applicability of the ICD-MM guidelines by investigating the classification of maternal deaths in one country and across three countries. First, the cause of death as determined by the attending physician was compared to the assessment of the Surinamese MDR committee. Second, cases were shared with the national MDR committees from Jamaica and the Netherlands, and their assessments were compared to the findings of the Surinamese MDR committee. Following these findings, the classification difficulties are discussed, and recommendations for improving the ICD-MM guidelines’ applicability and international comparability of maternal mortality are provided.

Methods

Study design

A population-based reproductive age mortality survey (RAMoS) was conducted in 2015 to identify pregnancy-related deaths in Suriname between 2010 and 2014 [3]. A total of 89 possible maternal deaths were identified and reviewed by the national MDR committee of Suriname, Jamaica (both middle-income countries) and the Netherlands (high-income country).

Settings

Suriname is an upper middle-income South American country on the Caribbean coast with 570,496 inhabitants in 2017 [14, 15]. Out of the approximately 10,000 births annually, 86% occur in five hospitals, 6% in primary care centers and the remaining 8% deliver at home or is not registered [16]. When death occurs, the attending physician in Suriname has an obligation to complete a death certificate documenting the causes and circumstances of the death. The Bureau of Public Health codes the cause of death using ICD-10 [3]. A national MDR committee was established to audit and classify the pregnancy-related cases. The committee consisted of specialists in obstetrics, internal medicine, midwifery and, on request, other specialists such as cardiologists, intensive care specialists and neurologists were invited. Classification was consensus-based, and according to the WHO ICD-MM guidelines [3].

Jamaica, a Caribbean island nation with 2.9 million inhabitants, is an upper middle-income country. Their MDR committee was established in 1998, and classified maternal deaths according to the ICD-MM [12]. Three members from this multidisciplinary committee (midwives, obstetricians, epidemiologists, public health practitioners, and pathologists), volunteered to review the Surinamese cases: a reproductive health epidemiologist and two obstetricians.

The Netherlands is a high-income country with 17.3 million inhabitants [17]. The MDR committee of the Dutch Society of Obstetricians and Gynecology, was established in 1981 and currently uses the ICD-MM guidelines for maternal death classification [13]. Seven committee members classified the pregnancy-related deaths of this study independently. In case of uncertainty or unclarity, cases were discussed with other members to achieve consensus on the final classification.

Definitions

Pregnancy-related deaths occur during pregnancy, delivery and puerperium. Maternal deaths are defined as those occurring during pregnancy or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, where the cause of death is related to or aggravated by pregnancy or its management, not from coincidental or accidental causes [7]. Direct deaths are due to obstetric complications, while indirect deaths result from non-obstetric pre-existing diseases, or diseases developing during pregnancy, that is aggravated by the physiologic effects of pregnancy. If the underlying cause is unknown or undetermined, the death is classified as unspecified. Coincidental deaths are deaths that occur during pregnancy, childbirth and puerperium due to external causes that are not related to the pregnancy. Each pregnancy-related death can be assigned to one of nine groups: group 1–6 (direct deaths), group 7 (indirect deaths), group 8 (unspecified deaths), or group 9 (coincidental deaths) (Fig. 1) [7]. The underlying cause of death is the disease or condition that initiated the chain of events leading to death [6, 7].

Fig. 1
figure1

Groups of underlying causes of death during pregnancy, childbirth and the puerperium in mutually exclusive, totally inclusive groups [7]

Data collection and analysis

Pregnancy-related deaths (n = 89) occurring in Suriname between 2010 and 2014 were identified by a Reproductive Age Mortality Survey (RAMoS) [3]. Medical files were summarized, and the underlying causes of death, as attributed by the attending physicians, were extracted from the available death certificate. All possible pregnancy-related deaths were audited by the Surinamese MDR committee and classified according to the ICD-MM [3]. In Suriname, we compared the underlying cause attributed by the attending physicians (documented on the death certificate or in the medical record) to the findings of the national MDR committee.

The Jamaican and Dutch MDR committees reviewed and classified the same 89 pregnancy-related deaths into maternal death or not, type of maternal death and one of the nine ICD-MM groups. Cases classified as not maternal by all three review teams were excluded from further analysis. The classification in type of death (direct, indirect and unspecified) and the WHO group of underlying cause were compared, using correlation analysis to assess agreement among the three review teams (IBM SPSS version 24.0; Armonk, New York, USA). The inter-rater reliability (IRR) was calculated by Fleiss kappa (for three raters). The kappa (κ) value range from − 1 to + 1, where 0 represents no agreement and one perfect agreement. Negative values indicate that the observed agreement is less than that expected from chance alone [18]. A κ below 0.2 indicates poor agreement and above 0.8 very good agreement. The overall value of kappa is the weighted average of the individual kappa value per category. A p-value < 0.05 only indicates that agreement between raters is significantly better than expected by chance [18, 19]. Discrepant cases were described to highlight sources of disagreement and facilitate further refinement of regional and global guidelines.

We performed two sensitivity analyses to evaluate the agreement across the MDR committees in type and underlying cause attribution. First, we excluded mortality cases that were not classified as maternal deaths by at least one MDR committee. Next, we assessed whether agreement on type and underlying cause attribution was better for maternal deaths with complete files.

Results

Out of 89 pregnancy-related deaths, 53 (60%) medical files were complete, 14 (16%) were unavailable, and 22 were incomplete. The three MDR committees utilized all available information to analyze the 89 deaths.

Classification in Suriname: attending physicians and the Surinamese MDR committee

In 42 (47%) of 89 pregnancy-related deaths the cause attributed by the attending physician and the MDR committee differed; seventeen had no underlying cause attributed by the attending physician, and in 25 cases, different causes were concluded by the MDR committee. Differences were mostly due to the mode of death or symptoms having been recorded as the underlying cause. Two autopsies had been performed, one on a possible late maternal death and another on a woman who had developed a pulmonary embolism after a placental abruption.

Classification by the MDR committees of Suriname, Jamaica and the Netherlands

Maternal death classification

The Surinamese MDR committee classified 65 deaths as maternal, the Jamaican MDR committee 70 and the Netherlands MDR committee 69. Based on 50,051 live births in the audited period, this corresponded with an MMR of 130, 140 and 138 per 100.000 live births, respectively. The three MDR committees agreed unanimously that 18% (n = 16/89) of the pregnancy-related deaths were not maternal deaths: 12 late maternal deaths, two coincidental deaths and two with negative pregnancy tests (Additional file 1). Exclusion of these cases resulted in a total of 73 cases, used for further analyses (Fig. 2). However, opinions differed in 15% (n = 11/73) of the cases (Table 1).

Fig. 2
figure2

Flowchart of the pregnancy-related deaths classified by maternal death review (MDR) committees of Suriname, Jamaica and the Netherlands

Table 1 Pregnancy-related deaths lacking consensus among maternal death review (MDR) committees whether to classify as maternal deaths

Classification into type of maternal deaths (direct, indirect and unspecified)

Of the 73 cases considered as maternal deaths by at least one MDR committee, classification into type of maternal death differed for 31 (42%) cases. The overall kappa was 0.53 (95% CI 0.44—0.62); p < 0.001 and was only fair for the unspecified category (κ = 0.29 (95% CI 0.16 – 0.43); p < 0.001) (Table 2). The Netherlands committee (19%, n = 14/73) classified more cases as unspecified compared to Surinamese (4%, n = 3/73) and Jamaican committees (7%, n = 5/73) (Table 2 and Additional file 2). Agreement between the MDR committees of Suriname and Jamaica (κ = 0.69 (95% CI 0.53–0.86); p < 0.001) was higher than between the committees of Suriname and the Netherlands (κ = 0.48 (95% CI 0.32 – 0.63); p < 0.001) (Table 2). Out of 41 maternal deaths classified as direct by the Surinamese committee, the Jamaican committee classified five cases differently (four indirect, one unspecified), while the Dutch committee classified ten cases otherwise (three indirect, seven unspecified).

Table 2 Agreement among Maternal Death Review (MDR) committees in classification into the type of maternal death

Classification into WHO ICD-MM groups of underlying causes

Table 3 compares the underlying causes of maternal deaths according to the nine ICD-MM groups as classified by the three MDR committees. Table 4 summarizes levels of agreement between the three MDR committees for each ICD-MM underlying cause group. The overall kappa was 0.52 (95% CI 0.47–0.58); p < 0.001, with the highest agreement for abortive outcomes (κ = 0.85) and obstetric hemorrhage (κ = 0.74) and the lowest for the unspecified (κ = 0.29) and other direct causes (κ = 0.32).

Table 3 Classification of maternal deaths underlying causes according to the ICD-MM by the three maternal death review (MDR) committees
Table 4 Level of agreement of underlying causes according to WHO ICD-MM by maternal death review (MDR) committees of Suriname, Jamaica and the Netherlands

Agreement between the Surinamese and Jamaican MDR committees was higher (overall κ = 0.63; 95% CI 0.53–0.73); p < 0.001 than between the Surinamese and Dutch committees (overall κ = 0.49; 95% CI 0.39–0.59); p < 0.001. The lowest agreement between the Surinamese and the Jamaican MDR committees was for other direct obstetric causes (κ = 0.36) and highest for obstetric hemorrhage (κ = 0.79) and indirect deaths (κ = 0.78). Agreement was poor between the Surinamese and the Dutch MDR committee for unspecified (κ = 0.14) and other direct deaths (κ = 0.25).

The sensitivity analyses on the agreement between the MDR committees in type and underlying causes was performed on 62 cases (by excluding all mortality cases that were assessed as being not maternal). These showed slightly better overall agreement for classification in type of maternal death (κ = 0.61 vs 0.53) and underlying cause (κ = 0.58 vs 0.52) compared to the primary analysis (Additional file 3). Fifty-three maternal death cases had complete files. Analysis of only the cases with complete files also showed better overall agreement for classification in type of maternal death (κ = 0.69 vs 0.53), and underlying cause (κ = 0.58 vs 0.52) than the primary analysis.

Evaluation of the level of agreement for the ICD-MM underlying cause among the MDR committees showed better agreement between Suriname and Jamaica (κ = 0.69 vs 0.66) than between Suriname and the Netherlands (κ = 0.54 vs 0.53) when applied to the 62 maternal deaths, as well as when applied to the 53 complete files respectively (Additional file 3).

Cycle of morbid events leading to death and classification by countries’ MDR committees.

Consensus among the Surinamese, Jamaican and Dutch committees was fair for the other direct obstetric causes, with three cases identically classified (two presumed amniotic fluid embolisms, one suicide at 24 weeks) (Table 4 and Additional file 4). The cases with discrepancies in groups of underlying cause were characterized by either multiple comorbidities and longer chain of events or rapidly evolving death without opportunities for additional diagnostic evaluation (Fig. 3).

Fig. 3
figure3

Maternal death classification difficulties in simple and complex chain of events

Discussion

This study explored consistency in classifying pregnancy-related deaths in Suriname at two levels. First, underlying cause attribution by the attending physicians, and the Surinamese MDR committee was compared; conclusions differed in 47% of cases. Second, the classification of three national MDR committees of Suriname, Jamaica and the Netherlands were compared applying the WHO ICD-MM guidelines to the same cases. There was 15% disagreement among these committees on whether selected pregnancy-related deaths met the criteria to be defined as maternal deaths. They achieved moderate agreement (k = 0.53) on classifying cases as direct, indirect or unspecified, with greater consensus between the Surinamese and Jamaican MDR committees (k = 0.69) than the Surinamese and Netherlands MDR committees (k = 0.48). The MDR committee of the Netherlands, a high-income country, classified more deaths as unspecified than those from the middle-income countries of Suriname and Jamaica. There was higher concurrence among the three MDR committees in underlying cause attribution to abortive outcomes, obstetric hemorrhage and indirect maternal deaths, but only fair agreement on a mix of cases (other direct obstetric causes and unspecified).

The large difference (47%) in underlying cause attribution for maternal death between the attending physicians and the Surinamese MDR committee is not unusual. Similar differences were also seen in Malawi, where poor agreement between healthcare providers and the research team on maternal death classification was reported [20]. Another study found a 40% difference in underlying cause attribution in a multi-country survey that compared health provider findings with external reviewers among Low- and Middle-Income Countries (LMIC) [6]. The abovementioned examples illustrate the importance of multidisciplinary case discussion and consensus-based underlying cause attribution.

Besides inconsistent underlying cause attribution, poor coding of pregnancy-related deaths, misidentification, or misclassification can result in inadequate certification and is associated with underreporting [2, 12, 21]. Due to underreporting, vital statistics could miss at least 50% of the maternal deaths [22]. Hence, since maternal death certificates are also completed by non-obstetricians (e.g. in the rural interior or when indirect maternal deaths occurred), all clinicians would benefit from training to correctly complete death certificates.

The MDR committees in our study encountered specific challenges for which no clear guidance was available from the ICD-MM guidelines. These included (1) determining the fact of pregnancy with limited evidence; (2) inclusion of deaths from suicide, especially in early pregnancy and (3) whether and how to count maternal deaths outside the country of residence. It is unclear what the minimally acceptable evidence of pregnancy should be without medical confirmation and under which circumstances information from verbal autopsy alone could be used to confirm pregnancy. While the ICD-MM classifies suicide during pregnancy and puerperium as a direct maternal death, this is clearer for puerperal psychosis and postpartum depression than for events early in pregnancy [7]. The trigger for suicide may be social/circumstantial (partner rejection, domestic violence, unintended pregnancy), rather than clinical (pre-existing mental disorder or hormonal changes impacting mental health) [23, 24]. In addition, the ICD-MM guidelines do not elaborate on how to classify maternal deaths from suicide (direct vs indirect) when underlying mental disorders existed [23]. Finally, opinions differed in this study on the inclusion of a resident who had been under local care but died in another country. As no global guidance exists on whether to count such events in the country where the women dies or the country of residence, there is a chance that these cases are not reported at all (excluded in the country where she died and not reported in the country where she lived). Since all births are included in the national birth registry (denominator), we suggest including the mother also in the country where she died (numerator). Importantly, in these situations information is ideally exchanged between countries to facilitate local reporting and sharing of “lessons to be learned”.

Consensus between the MDR committees of Suriname and Jamaica was higher than between those of Suriname and the Netherlands. The cases the Dutch committee considered unspecified but were assigned other diagnoses by the other committees had limited information on the disease course, and lacked confirmatory diagnostic tests such as laboratory results, ultrasounds, Computed Tomography (CT) or Magnetic Resonance Imaging (MRI) scans compared to the cases with more agreement. Advanced diagnostics were often unavailable due to financial or logistic constraints, such as the minimal laboratory capacity in the rural interior areas. In these cases, the MDR committees in LIMC must often rely on clinical judgement to make a diagnosis. Practicing medicine with greater uncertainty regarding diagnosis and treatment outcomes and fewer possibilities to provide evidence-based care is more commonplace in LMIC and possibly explains the more consistent results between the MDR committees of the two middle-income countries.

Classification into type of maternal death (direct, indirect and unspecified) differed in 42% of cases, only achieving moderate agreement among the three MDR committees. Dividing maternal deaths into direct and indirect conditions is pragmatic as preventive programs to avert direct deaths differ from indirect deaths [25]. However, this division has been questioned by the MDR committees in the United Kingdom (UK) and the Netherlands, especially for women with concurrent direct and indirect comorbidities [26]. In both middle and high-income countries, several pre-existing conditions such as obesity, diabetes mellitus, and hypertensive diseases are increasing and the risk of pregnant women to develop direct and indirect complications of pregnancy (e.g. postpartum hemorrhage, eclampsia, cardiovascular diseases) [26,27,28]. This coexistence of multiple conditions in an individual is known as multimorbidity and is one of the challenges of modern medicine [29, 30]. These conditions obfuscate the strict demarcation between direct and indirect deaths and reduce their relevance. Instead, adding multimorbidity categories, such as (non)communicable diseases and (pre-existing) mental disorders to the ICD-MM guidelines would be more pertinent.

We conducted a sensitivity analysis to explore whether consensus improved with the exclusion of (1) cases without consensus among the MDR committees in the classification as maternal deaths, and (2) cases with incomplete information. As expected, the exclusion of the cases with uncertainty improved the level of agreement. These exclusions strengthened the consensus that already existed between the Surinamese and Jamaican MDR committees. However, since differences are small, these analyses suggest that, even with limited information, MDR committees can reach reliable conclusions on the probable types and underlying causes of maternal deaths.

Our data showed that when the cycle of events leading to death had fewer incidents (Fig. 3), underlying cause attribution was more straightforward (as with abortion-related and obstetric hemorrhage). Selecting the initiating event from a chain of multiple events is more difficult in complex cases, resulting in a discrepancy in underlying cause classification in our study. Two high-income countries, the United Kingdom (UK) and the Netherlands, also reported such differences in underlying cause attribution [10]. Their MDR committees discussed selected cases where disagreement was expected during a meeting attended by most members of both committees. While the Netherlands classified a death by the primary underlying pathology, the UK more pragmatically focused on the acute fatal complication [10]. They suggested that decision-making may be guided by what best informs local practice in the absence of global guidance. However, this approach could result in heterogeneity and complicates comparison among countries.

Reliable underlying cause attribution may be improved by combining clinical data with autopsy findings [31, 32]. However, autopsy for maternal death is seldom performed in low resource countries such as Suriname, where only two cases were investigated [3]. It may be useful to revisit verbal autopsy techniques to improve collection and interpretation of information on signs, symptoms and risk factors [33]. Another possible option is the minimally invasive autopsy. This includes collection of blood, cerebrospinal fluid and tissue samples for histologic and microbiologic analysis [34]. This option could be explored to assist in identifying the underlying causes of maternal death.

Strengths and limitations

This study’s strength is its unique comparison of the classification of the same cases by physicians and (inter)national MDR committees from three different settings applying the WHO ICD-MM guidelines. Limitations include difficulties in interpreting cases with limited information and, possibly, by a high-income country being unfamiliar with the different contexts of LMIC. The inter-rater reliability should be carefully interpreted as the overall kappa may not be reliable for rare observations, such as group 1 (abortive outcomes) and group 4 (pregnancy-related infections).

Conclusion and recommendations

This is the first study comparing audit and ICD-MM classification of the same maternal deaths by MDR committees of different countries, revealing the difficulties and challenges. Accurately completing the death certificate, training in performing audits and applying the WHO ICD-MM guidelines to code and classify the death should be encouraged [12, 17]. We suggest that the WHO guidelines should elaborate more on the following aspects:

  1. 1

    Clearly define and describe how to classify suicide during (early) pregnancy or puerperium.

  2. 2

    Provide guidance on the minimal acceptable evidence of early pregnancy in the absence of objective clinical evidence (e.g. a pregnancy test), and specify on the use of information obtained through verbal autopsy.

  3. 3

    Specify where maternal deaths of citizens who die outside of their country of residence should be counted to ensure that all maternal deaths globally are counted.

  4. 4

    Discuss the relevance of classification in direct or indirect causes and the addition of classification in multimorbidity categories.

  5. 5

    Provide guidance on selecting the underlying causes when concurrent comorbid direct and indirect conditions exist, or multiple direct complications co-occur.

Availability of data

The datasets used and analyzed for this study are available from the corresponding author upon request.

Abbreviations

WHO:

World Health Organization

ICD-MM:

International Classification of Diseases-Maternal Mortality

MDR:

Maternal Death Review

LIMC:

Low and Middle-Income countries

UK:

United Kingdom

MRI:

Magnetic Resonance Imaging

CT:

Computed Tomography

References

  1. 1.

    Regional Task Force for Maternal Mortality Reduction (GTR). Guidelines for Maternal Death Surveillance and Response (MDSR): Region of the Americas. 2015. p. 124. https://www.msh.org/sites/msh.org/files/mdsr_guidelines_lac_2015_english.pdf. Accessed 2 Feb 2020.

  2. 2.

    World Health Organization. Trends in Maternal Mortality: 2000–2017. Estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations Population Division. 2019. https://www.who.int/reproductivehealth/publications/maternal-mortality-2000-2017/en/. Accessed 15 Jan 2020.

  3. 3.

    Kodan LR, Verschueren KJC, Van RJ, Kanhai HHH, Bloemenkamp KWM. Maternal mortality audit in Suriname between 2010 and 2014, a reproductive age mortality survey. BMC Pregnancy Childbirth. 2017;17(275):1–9.

    Google Scholar 

  4. 4.

    Lewis G. Beyond the Numbers: Reviewing maternal deaths and complications to make pregnancy safer. Br Med Bull. 2003;67(830):27–37.

    Article  Google Scholar 

  5. 5.

    World Health Organization. Maternal Death Surveillance and Response. Technical Guidance. Information for action to prevent maternal death. 2013. p. 38. https://apps.who.int/iris/bitstream/handle/10665/87340/9789241506083_eng.pdf;jsessionid=4468B088F37504154939965B0202688A?sequence=1. Accessed 28 Jan 2020.

  6. 6.

    Pasha O, McClure EM, Saleem S, Sunder S, Lokangaka A, Tshefu A, et al. A prospective cause of death classification system for maternal deaths in low and middle-income countries: results from the Global Network Maternal Newborn Health Registry. BJOG An Int J Obstet Gynaecol. 2017;1:7.

    Google Scholar 

  7. 7.

    World Health Organization. ICD-10 to deaths during pregnancy, childbirth and the puerperium: ICD-MM, Vol. 129. 2015. p. 30–3. https://apps.who.int/iris/bitstream/handle/10665/70929/9789241548458_eng.pdf?sequence=1. Accessed 25 Mar 2020.

  8. 8.

    Ameh CA, Adegoke A, Pattinson RC, van den Broek N. Using the new ICD-MM classification system for attribution of cause of maternal death–a pilot study. BJOG. 2014;121:32–40.

    Article  Google Scholar 

  9. 9.

    Say L, Chou D. Better understanding of maternal deaths-the new WHO cause classification system. BJOG An Int J Obstet Gynaecol. 2011;118(SUPPL. 2):15–7.

    Article  Google Scholar 

  10. 10.

    van den Akker T, Bloemenkamp KWM, van Roosmalen J, Knight M. Classification of maternal deaths: where does the chain of events start? Lancet. 2017;390(10098):922–3.

    Article  Google Scholar 

  11. 11.

    Salanave B, Bouvier-Colle M-H, Varnoux N, Alexander S, Macfarlane A. Classification differences and maternal mortality: a European study. MOMS Group. MOthers’ Mortality and Severe morbidity. Int J Epidemiol. 1999;28(1):64–9.

    CAS  Article  Google Scholar 

  12. 12.

    McCaw-Binns AM, Mullings JA, Holder Y. Vital registration and under-reporting of maternal mortality in Jamaica. Int J Gynecol Obstet. 2015;128(1):62–7.

    Article  Google Scholar 

  13. 13.

    Schutte JM, Steegers EAP, Schuitemaker NWE, Santema JG, De Boer K, Pel M, et al. Rise in maternal mortality in the Netherlands. BJOG An Int J Obstet Gynaecol. 2010;117(4):399–406.

    CAS  Article  Google Scholar 

  14. 14.

    Worldbank Data Suriname. https://data.worldbank.org/country/suriname. Accessed 6 Jul 2020.

  15. 15.

    Pan American Health Organization. Health in the Americas. Suriname. https://www.paho.org/salud-en-las-americas-2017/?p=4307. Accessed 6 Jul 2020.

  16. 16.

    Ministry of Social Affairs and Public Housing. Suriname Multiple Indicator Cluster Survey 2018, Survey Findings Report. 2019 https://statistics-suriname.org/wp-content/uploads/2019/08/Suriname-MICS-6-Survey-Findings-Report.pdf. Accessed 10 Jul 2020.

  17. 17.

    Worldbank Data Jamaica. https://data.worldbank.org/country/jamaica?view=chart. Accessed 6 Jul 2020.

  18. 18.

    Worldbank Data Netherlands. https://data.worldbank.org/country/netherlands?view=chart. Accessed 6 Jul 2020.

  19. 19.

    Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: Key concepts, approaches, and applications. Res Soc Adm Pharm. 2013;9(3):330–8.

    Article  Google Scholar 

  20. 20.

    Joseph L. Fleiss, Bruce Levin MCP. The measurement of interrater agreement. Statistical methods for rates and proportions. 2003. p. 598–626. http://0-doi.wiley.com.brum.beds.ac.uk/https://0-doi-org.brum.beds.ac.uk/10.1002/0471445428.ch18. Accessed 14 Dec 2020.

  21. 21.

    Owolabi H, Ameh CA, Bar-Zeev S, Adaji S, Kachale F, van den Broek N. Establishing cause of maternal death in Malawi via facility-based review and application of the ICD-MM classification. BJOG. 2014;121:95–101.

    Article  Google Scholar 

  22. 22.

    Abouchadi S, Zhang WH, De Brouwere V. Underreporting of deaths in the maternal deaths surveillance system in one region of Morocco. PLoS ONE. 2018;13(1):1–15.

    Article  Google Scholar 

  23. 23.

    Horon IL. Underreporting of maternal deaths on death certificates and the magnitude of the problem of maternal mortality. Am J Public Health. 2005;95(3):478–82.

    Article  Google Scholar 

  24. 24.

    Hasegawa J, Katsuragi S, Tanaka H, Kubo T, Sekizawa A, Ishiwata I, et al. How should maternal death due to suicide be classified? Discrepancy between ICD-10 and ICD-MM. BJOG An Int J Obstet Gynaecol. 2020;665:7.

    Google Scholar 

  25. 25.

    Daniela CF, Clara C, Carine R, Prabha SC, Siham S. The contribution of suicide and injuries to pregnancy-related mortality in low and middle-income countries: A systematic review and meta-analysis. Lancet Psychiatry. 2014;1(3):213–25.

    Article  Google Scholar 

  26. 26.

    Cross S, Bell JS, Graham WJ. What you count is what you target: the implications of maternal death classification for tracking progress towards reducing maternal mortality in developing countries. Bull World Health Organ. 2010;88(2):147–53.

    Article  Google Scholar 

  27. 27.

    van den Akker T, Nair M, Goedhart M, Schutte J, Schaap T, Knight M. Maternal mortality: direct or indirect has become irrelevant. Lancet Glob Health. 2017;5(12):e1181–2.

    Article  Google Scholar 

  28. 28.

    Nair M, Nelson-Piercy C, Knight M. Indirect maternal deaths: UK and global perspectives. Obstet Med. 2017;10(1):10–5.

    Article  Google Scholar 

  29. 29.

    McCaw-Binns a, Lewis-Bell K. Small victories, new challenges: two decades of maternal mortality surveillance in Jamaica Pequeñas victorias, nuevos desafíos: dos décadas de vigilancia de la mortalidad materna en Jamaica. West Indian Med J 58(6):518–32.

  30. 30.

    Nicholson K, Terry AL, Fortin M, Williamson T, Bauer M, Thind A. Prevalence, characteristics, and patterns of patients with multimorbidity in primary care: a retrospective cohort analysis in Canada. Br J Gen Pract. 2019;69(686):E647–56.

    Article  Google Scholar 

  31. 31.

    Violan C, Foguet-Boreu Q, Flores-Mateo G, Salisbury C, Blom J, Freitag M, et al. Prevalence, determinants and patterns of multimorbidity in primary care: a systematic review of observational studies. PLoS ONE. 2014;9(7):3–11.

    Article  Google Scholar 

  32. 32.

    McCaw-Binns A, Holder Y, Mullings J. Certification of Coroners cases by pathologists would improve the completeness of death registration in Jamaica. J Clin Epidemiol. 2015;68(9):979–87.

    Article  Google Scholar 

  33. 33.

    Lucas S. Maternal death, autopsy studies, and lessons from path. PLoS Med. 2008;5(2):0220–6.

    Article  Google Scholar 

  34. 34.

    Campbell O, Ronsmans C. Verbal autopsies for maternal deaths. Maternal Health and Safe Motherhood Programme. (1995). World Health Organization workshop, London, 10–13 January 1994. 1995. https://apps.who.int/iris/bitstream/handle/10665/61029/WHO_FHE_MSM_95.15.pdf;jsessionid=96C0842EB772ABDE077E1C17A27F84FE?sequence=1. Accessed 15 Jul 2020.

  35. 35.

    Castillo P, Martínez MJ, Ussene E, Jordao D, Lovane L, Ismail MR, et al. Validity of a minimally invasive autopsy for cause of death determination in adults in mozambique: an observational study. PLoS Med. 2016;13(11):1–15.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the Surinamese MDR committee members who reviewed the 2010-2014 cases (the gynecologists/obstetricians : H. Kanhai, G. Essed, P. Goerdin, R. Charles, H. Karansingh, R. Tjon A Fat, L. Olmtak, M. Sietaram, O. Ramkhelawan, K. Ramkhelawan, S. Mohan, M. Dipoikromo, gynecology residents then: F. Rigters and S. Cornelisse, internal medicine specialists: K. Waldring, S. Vreden, A. Niekoop, J. Adhin, P. Issa and A. Punwasi, anaesthesiologists: M. Tjon Sie Fat, D. Nahar, neurologist: S. de Jong and midwives: M. Fitz Jim, S. Abente, S. Holband, A. Naarden, J. Kloppenburg). We are very grateful that Raez Paidin (then medical student) translated the cases in English. We also thank the Jamaican MDR committee members who volunteered to classify these cases (the obstetrician D. McDonald and L. Campbell). We are thankful to the Dutch MDR committee members who voluntarily reviewed the cases (the gynaecologists/obstetricians: J. Schutte, J. van Roosmalen, S. Kuppens, T. van den Akker, J. Stekelenburg, N. Schuitemaker and J. Zwart). We also thank Dr. Peter Zuithoff for his advice in the statistical analysis.

Funding

No funding was received.

Author information

Affiliations

Authors

Contributions

Conceptualization: LK, MR, KB. RAMOS and case summaries: KV. Methodology: LK, AM, MR. Supervision: JB, MR, KB, AM. Writing—first draft: LK, MR. Writing—tables and figures: KV, LK, AM. Writing—review and editing: all authors. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lachmi R. Kodan.

Ethics declarations

Ethics approval and consent to participate

The medical ethical review board of the Surinamese Central Committee on Research Involving Human Subjects [Reference number: VG 006-15] approved the RAMoS on March 9th, 2015 and an amendment to share anonymized cases with the Jamaican and Dutch maternal mortality committee [May 23rd, 2018; Reference number: VG 006-16 A]. The chair of the Jamaican and Dutch committees signed an agreement that cases will only be used for research purposes.

Consent for publication

This manuscript contains individual deceased person’s data in an anonymized aggregated form. Consent was obtained from the Ministry of Health, and personal consent was not applicable.

Competing interests

The authors declare that they have no competing interests. The authors alone are responsible for the contents and writing of the paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Case description of the 2010–2014 pregnancy-related deaths in Suriname classified as “no maternal death” by all three MDR committees.

Additional file 2.

Case description of the 2010–2014 maternal deaths of Suriname classified as “unspecified”.

Additional file 3.

Sensitivity analysis for type of maternal death and WHO ICD-MM group of underlying causes.

Additional file 4.

Case description of 2010–2014 maternal deaths in Suriname classified as “other direct obstetric causes”.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kodan, L.R., Verschueren, K.J.C., McCaw-Binns, A.M. et al. Classifying maternal deaths in Suriname using WHO ICD-MM: different interpretation by Physicians, National and International Maternal Death Review Committees. Reprod Health 18, 46 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12978-020-01051-1

Download citation

Keywords

  • Inter-rater reliability
  • Chain of events
  • WHO ICD-MM
  • Classification
  • Pregnancy-related deaths
  • Underlying cause
  • Maternal death review committees