- Open Access
Reply to the EFSA (2016) on the relevance of recent publications (Hofmann et al. 2014, 2016) on environmental risk assessment and management of Bt-maize events (MON810, Bt11 and 1507)
Environmental Sciences Europe volume 29, Article number: 12 (2017)
The Erratum to this article has been published in Environmental Sciences Europe 2017 29:20
In this commentary, we respond to a report of the EFSA GMO Panel (EFSA EFSA Supp Publ, 1) that criticises the outcomes of two studies published in this journal (Hofmann et al. Environ Sci Eur 26: 24, 2; Environ Sci Eur 28: 14, 3). Both publications relate to the environmental risk assessment and management of Bt-maize, including maize events MON810, Bt11 and maize 1507. The results of Hofmann et al. (Environ Sci Eur 26: 24, 2), using standardised pollen mass filter deposition measurements, indicated that the EFSA Panel model had underestimated pollen deposition and, hence, exposure of non-target organisms to Bt-maize pollen. The results implied a need for safety buffer distances in the kilometre range for protected nature reserve areas instead of the 20–30 m range recommended by the EFSA Panel. As a result, the EFSA Panel revised their model (EFSA EFSA J 13: 4127, 4), adopting the slope of the empirical data from Hofmann et al. The intercept, however, was substantially reduced to less than 1% at one point by introducing further assumptions based on the estimates of mainly panel members, citing possible ‘uncertainty’. Hofmann et al. (Environ Sci Eur 28: 14, 3) published extensive empirical data regarding pollen deposition on leaves. These results were part of a larger 3-year study involving detailed measurements of pollen release, dispersal and deposition over the maize flowering period. The data collected in situ confirmed the previous predictions of Hofmann et al. (Environ Sci Eur 26: 24, 2). Mean levels and observed variability of pollen deposition on maize and four lepidopteran host plants exceeded the assumptions and disagreed with the conclusions of the EFSA Panel. The EFSA Panel reacted in a report (EFSA EFSA Supp Publ, 1) criticising the methods and outcomes of the two published studies of Hofmann et al. while reaffirming their original recommendations. We respond here point-by-point, showing that the critique is not justified. Based on our results on Urtica leaf pollen density, we confirm the need for specific environmental impact assessments for Bt-maize cultivation with respect to protected habitats within isolation buffer distances in the kilometre range.
In this commentary, we respond to a report of the GMO Panel of the European Food Safety Authority (EFSA) in 2016  that criticises the outcomes of two of Hofmann et al.’s studies published in this journal in 2014 and 2016 [2, 3]. Both publications relate to the environmental risk assessment and management of Bt-maize in the EU , including maize events MON810, Bt11 and maize 1507.
Evaluating non-target effects is part of the environmental risk assessment process prior to release and commercial use of genetically modified organisms (GMOs) as prescribed in EU regulations . Bt-maize shares transgenes in its DNA that are derived from the soil bacterium Bacillus thuringiensis, which enables the plant to express insecticidal toxins [6, 7]. While protecting the plant against target herbivores, these toxins are also known to negatively affect non-target organisms such as Lepidoptera . Because Bt toxins are expressed in all tissues of the plant, they are also dispersed into the environment by pollen. This leads to exposure to the toxin by non-target organisms, such as Lepidoptera larvae, which feed on host plant leaves.
In their initial environmental risk assessment regarding Bt-maize cultivation, the EFSA Panel used a mathematical model to form their opinions [4, 9–13]. The model was developed by members of the GMO Panel at the time [14–17] and has been used in regulatory risk assessments since 2009 . The model consists of two combined equations: a dose–distance relationship and a dose–mortality relationship for five hypothetical species feeding on nettle (Urtica diocia) leaves. The model was the first approach to this problem and used a limited dataset—both for exposure and effects—and thus required a series of assumptions [8, 18]. The dose–distance relationship, for example, was based until 2015 on a small dataset on pollen deposition derived from exposure of slides near to a single maize field for 7 days . Assumptions were made to transfer the pollen deposition measurements from this technical sampling to pollen density on Urtica leaves. This base led the EFSA Panel to recommend isolation buffer distances of 20–30 m as being sufficient to protect sensitive non-target Lepidoptera in cultivation areas of Bt-maize events MON810, Bt 11 and 1507. The EFSA Panel regarded their calculations as overestimating exposure risks and effects, reflecting a worst-case scenario [4, 14].
Hofmann et al.  analysed a representative dataset on maize pollen deposition measurements collected using a standardised method at 214 sites over 10 years from inside maize fields to 4.42 km from the nearest maize pollen source. The results significantly exceeded the deposition estimates made by the EFSA GMO Panel for distances greater than 10 m [9–13]. The EFSA model, which relied on extrapolation of observations that were limited to a distance of up to 7 m from field edges, resulted in a much steeper negative slope compared with measured deposition, as illustrated in Fig. 5 of  (see Additional file 1: Figure S1). Based on their empirical results, Hofmann et al.  confirmed the findings of previous studies [20–24] that isolation buffer distances in the kilometre range are likely to be required to maintain the threshold limits calculated by the EFSA Panel for effective protection of sensitive Lepidoptera. In addition to other impacts, these results also affected legislation in Germany.
The German Advisory Council on the Environment (SRU) (, chapter 12.3.3) recommended isolation buffer distances of at least 1000 m from protected habitats. The SRU has demanded that an environmental impact assessment be carried out regarding specific local conditions when Bt-maize cultivation is planned within the buffer distance. Isolation buffer distances in the range of 800–3000 m from protected habitats have been implemented in some German States (e.g. Brandenburg, Baden-Württemberg, Bavaria, Saxony). Outside of the isolation buffer zone, cultivation is permitted.
The EFSA Panel published a revised risk model  to incorporate the new data of Hofmann et al. . Instead of adapting their model to the published empirical deposition data, the EFSA Panel decided to incorporate the slope of the distance relationship in  but to reduce the intercept by several factors to lower the exposure estimate. In this work, the EFSA Panel classified the estimates of previous studies [9–12] as being ‘unrealistically high’. Thus, the Panel introduced a whole set of new uncertainty factors to adjust the exposure estimate to a ‘realistic’ level.
The EFSA Panel calculated three scenarios (Table 1 ):
The ‘direct comparison’ (DC) scenario divided the original data by 4 (factor 0.25) based on the argument that it was necessary to make the empirical data ‘compatible’ with the EFSA exposure model, which was based on a shorter flowering and exposure period (e.g. 7 days instead of average 4 weeks). The justification for the original shorter period in the EFSA model was that >92% of pollen shed  would take place within the first 7 days.
For the ‘most realistic’ (MR) scenario, the EFSA Panel determined 8 uncertainty factors using averaged estimates decided by the panel members (see Additional file 1: Table S2). The resulting uncertainty factor of 0.0376 was applied in addition to the DC factor to reduce the measured deposition data from the standardised technical sampling to 0.94% (0.25 × 0.0376 = 0.0094 = 0.94%) of initial values.
A third ‘conservative’ (CO) scenario was calculated to simulate the worst case (1 in 40 cases) for protection of highly sensitive species in nature reserve areas. Here, a factor of 9 was employed to reflect the variation between sites based on the pollen mass filter (PMF) measurements . However, the variation within sites (e.g. between plants, leaves and within leaf surfaces), was not included. The EFSA Panel applied this factor to their reduced `most realistic´ MR dataset, and not to the original data. This led to a combined reduction factor of 0.0846 being applied to the mean dose–distance relationship of the data  to determine the worst-case scenario.
In addition, the EFSA Panel introduced a hypothetical 1 × 1 km2 nature reserve area to their revised model. Exposure and mortality effects were averaged within this model nature reserve by calculating weighted averages over three distances (for an adjacent nature reserve: 5, 500, 1000 m). Thus, the estimates of exposure and effects were further diminished.
After revising their model, the EFSA Panel concluded  that no changes to the previously proposed 20–30 m buffer between Bt-maize cultivation and protected areas would be required under ‘realistic’ or even ‘worst case’ assumptions.
In contrast to the EFSA Panel’s approach, an integrated 3-year assessment in the region of the Biosphärenreservat Schorfheide-Chorin nature reserve in Brandenburg, Germany [3, 26, 27] covered the whole process of pollen exposure, including the configuration of maize fields and nature reserve areas within a 1250 km2 region (35 km × 35 km). The study provided a comprehensive dataset based on standardised measurements and included meteorological data, pollen release rates and aerial concentrations inside and outside of selected maize fields. The work modelled pollen dispersal for all maize fields in the area and evaluated pollen deposition using standardised technical sampling as well as direct measurements of plant leaves. In 2010, a total of 5377 measurements of pollen density on the leaves of maize and four lepidopteran host plant species inside and outside maize fields were collected over the whole flowering period. The integrated assessment enabled the determination of relationships between pollen release rates, aerial concentrations and deposition on the PMF samplers according to national (German VDI Standard 4330-3 ) and European (CEN-TS 16817-1 ) standards with plant-specific leaf pollen density. By calibrating the plant-specific leaf deposition data to the standardised deposition measurements, a distance relationship for pollen deposition on host plant leaves was determined. This relationship was used to estimate the amount and variability in the pollen density on the leaves of maize, Urtica and three other host plants in the range from 0.2 m to the next pollen source (within the field) to 4.42 km away under commercial cultivation conditions.
These field-based data are in line with results of model scenarios [22, 30–32]. The studies regarded realistic complex field configurations under commercial cultivation and they showed the overlapping exposure and effects with an enlarged tail in the distance relationship well beyond the 20–30 m range in contrast to the isolated single-field approach in the EFSA Panel risk assessment.
The EFSA Panel  reacted to the findings of Hofmann et al.  by ignoring the relevance of these empirically based results and stated that “EFSA considers that the previous risk assessment conclusions and risk management recommendations on maize MON810, Bt11 and 1507 for cultivation made by the Panel on Genetically Modified Organisms remain valid and applicable”. The EFSA Panel justified this opinion based on supposed methodological errors in .
In this commentary, we respond point-by-point to the EFSA Panel opinion  and demonstrate that their critique is not substantiated. As a basis for this discussion, we compare the estimates of the EFSA model scenarios on the dose–distance relationship for leaf pollen density on Urtica with the empirically based findings of [2, 3]. Finally, we discuss the implications for risk assessment and management with regard to sensitive butterfly species in protected habitats.
This commentary focuses on the aspects of pollen dispersal and deposition as part of the exposure model in the EFSA Panel ERA model . For a critical discussion of other assumptions employed by the EFSA Panel model concerning the variation in Bt-concentration and the sensitivity of species to this toxin as well as the dose–effect relationship and the subsequent potential underestimation of effects we refer to [8, 18, 33, 34].
Comparing the EFSA scenarios for the dose–distance relationship of Urtica leaf pollen density with the empirical findings of Hofmann et al.
Figure 1 compares the outcomes of the EFSA Panel model  with the empirically based results of Hofmann et al. [2, 3] on the dose–distance relationship for Urtica leaf pollen density. The blue circles indicate the results of [2, 3] showing the variability of mean pollen density on Urtica leaves during the flowering period for each site over the distance range derived from the standardised PMF pollen deposition data (n = 216) calibrated to Urtica leaf pollen density by in situ measurements close to the pollen source (n = 834). Grey circles indicate the results for the variability of single density values close to the source, and 95% confidence intervals (blue vertical bars) show those for the mean density values at each site.
For all following equations, d denotes leaf pollen density in n/cm2 and S represents distance in m.
The findings of the regression analysis in Hofmann et al.  based on empirical data are as follows:
For the ‘realistic scenario’ (RS), the mean regression with a 95% confidence interval is taken according to Eq. 1 (below), indicating the variability of leaf pollen density values for Urtica over a distance range of 0.2 m from the pollen source (within the field) to 4.42 km away under common cultivation conditions (solid blue line in Fig. 1):
The variability of mean leaf pollen density is denoted by the 95% confidence interval for the mean regression curve. Figure 1 displays the 95% confidence interval for the mean density values for each site and flowering period (thin blue lines around the mean) and the 95% confidence values for single leaf density values with a factor of 48 around the mean on a normal scale (green and cyan lines). The corresponding dose–distance relationship indicating the ‘worst case’ scenario (1 in 40 cases; WC) is given by the upper 95% confidence boundary for leaf density values (cyan line) by Eq. 2:
The three scenarios of the EFSA Panel model (DC, MR, CO) are given in Table 1  as follows:
The comparison in Fig. 1 shows that all three EFSA model scenarios [1, 4] underestimate the variability and intensity of leaf pollen deposition over the whole dose–distance relationship (from close to the source within a field to 4.42 km away) compared with our results based on realistic and worst-case estimates. The ratio between the MR scenario of the EFSA Panel and the ‘realistic’ mean regression of pollen density on Urtica leaves based on the deposition measurements in [2, 3] is 0.0138 (difference indicated by the red arrow in Fig. 1). The ratio between the DC scenario of the EFSA Panel and the RS based on [2, 3] is 0.368 (difference indicated by the pink arrow in Fig. 1). For the worst-case scenario, the ratio between the CO of the EFSA Panel and the WC based on the results of [2, 3] is 0.00273 (difference indicated by the orange arrow in Fig. 1).
We further note that in Fig. 1 in the EFSA Panel’s report , the dose–distance relationship ‘EF’ does not relate to the ‘most realistic’ scenario of the EFSA Panel , although it is implied to do so. The factor applied (0.396) is different from that of the original MR scenario in  (0.0376). The EF line for the EFSA Panel MR scenario should correctly be 10 times lower and would thus lie below the leaf density data of Lang et al.  as shown in Fig. 2.
Furthermore, data of Lang et al.  agree well with our assessment as these results depict mean leaf density measurements on single days at each site in one region without representing the variability of leaf density values over time and space under common cultivation. Their confidence limits, again, correspond well with our results and confirm the extent of variation to be expected.
Reply to EFSA Panel 
Relationship of standardised pollen deposition to leaf pollen density
The EFSA acknowledges the value of the standardised method as the basis for data collection but argues that the “most important gap in the information in Hofmann et al.  is that there are no data to enable any calibration between pollen density measured by the mechanical sampler and the pollen density per cm 2 leaf surface as encountered on a host plant by a NT lepidopteran larva at the same spatial location”.
Hofmann et al.  focused on the distance relationship in pollen deposition as measured by the PMF standardised technical sampling method. The calibration of the standardised pollen deposition measurements to plant-specific leaf pollen density per cm2 for maize, Urtica and three other Lepidoptera host plants has been presented in detail in  and the corresponding reports on the research project [26, 27].
As explained above (see the “Background” section), the experiments analysed in  included an integrated assessment of pollen release rates, aerial pollen concentrations and pollen deposition measurements at the same location, which enabled calibration between standardised pollen deposition data and leaf pollen density data collected through in situ measurements in the field.
In contrast, the EFSA Panel based its estimate of Urtica leaf pollen density on the model in , which was developed using a small dataset of pollen deposited on Vaseline-coated slides collected in the US . The EFSA Panel further divided the results by a factor of 3 based on studies in the US  and Germany  stating that slides probably overestimate leaf deposition. Further, the EFSA Panel assumed a factor of 2.85 based on data from Hungary  to infer to Urtica leaf pollen density. However, these studies have little in common. All use different methods, present data from different sites, regions and years, and are not standardised to allow either direct comparison or meaningful combination in a single model.
In the EFSA Panel’s revised model approach [1, 4] the base of exposure was modified to incorporate the PMF data. However, data were modified to compensate for assumed uncertainties; the EFSA Panel applied 8 additional factors based on their average expert estimates that led to a combined reduction factor of 0.0094 as explained above (see also Additional file 1: Table S2; Table 1 ). This meant that the additional factors actually decreased the assumed pollen deposition values to lower than the original model assumptions. The relationship factor between PMF pollen deposition data and the mean leaf pollen deposition according to the EFSA Panel is thus 73 times lower than the factor of 0.68 that was based on field measurements, as documented in  (see Fig. 1). The inherent uncertainty of the EFSA Panel’s approach is reflected in the exposure assessment and may explain the discrepancies between the EFSA model estimates of the dose–distance relationship and our empirically based findings.
Consistency of the dose–distance relationship
The EFSA Panel argues that the “dose–distance relationship, derived by Hofmann et al.  from regression on logarithmic scales, should have been based on their data from samplers placed at distances from the nearest maize crop ranging from 0.8 m to 4.4 km only. However, Hofmann et al.  also included samples taken from within the crop which, in the context of their regression analysis, were assigned, a negative value as distance from the crop edge. Consequently, because logarithms of negative numbers do not exist, such data cannot validly be used to contribute towards the calculation of the regression relationship on logarithmic scales. Hofmann et al.  wrongly included these withincrop data in their regression calculations. EFSA  did not highlight this limitation, because for protected habitats, at distances of the order of more than tens of metres from a maize field, the inclusion or exclusion of a few data points from within the maize crop would make little difference to the relationship derived. However, it must be emphasised that in the Hofmann et al.  publication there is no valid published information concerning the relationship between pollen deposition and distance from within the Bt-maize crop or at any distance up to 0.8 m from the edge of the crop”.
Any dispersal of pollen starts from a maize plant as the pollen source, with dispersal distances being greater than zero. In our study, we took 0.2 m as the closest distance from the target plant to the next maize plant (the pollen source), which is incorporated in the within-field data. The results of the statistical analysis in (, Figure 3) (see Additional file 1: S3) clearly show that a distance of 0.2 m is an appropriate starting value for the regression analysis. The results gave a consistent dose–distance relationship over the entire distance range: from 0.2 m from the pollen source inside the field to 4.42 km away, as shown in the statistical analysis in , Figures 3 and 4 (see Additional file 1: S3, S4). Owing to the variability in field shapes and configurations, this was the best way to describe the variation in pollen deposition inside and at the edge of maize fields. In contrast, the EFSA Panel model uses negative distance values for inside-field sites and this trend continues with a sudden drop in deposition levels at field edges (zero distance). In reality, there cannot be a negative distance to a maize plant as a pollen source, which leads to inconsistencies. Furthermore, the EFSA Panel’s split-level model with its sudden drop in deposition values at the field edge (distance 0 m) is not grounded in reality. Instead, the variability in pollen deposition is high both within fields and at field edges, with overlapping values; indeed, the decrease in deposition is represented by a smooth curve [39, 40], as seen in our field data.
The EFSA argues that “the data published in Hofmann et al.  recorded the distance to the nearest maize crop, but gave no information regarding the number of maize fields in the area contributing to pollen deposition, or their location, or maize variety”.
Isolation buffer distances according to the EFSA Panel’s recommendations only consider distance to the next maize field. No other information is taken into account. This constraint is reflected representatively by the Hofmann et al. study .
The strength of the Hofmann et al. data lies in the wide range of conditions encountered over 10 years of collecting field data collection at different sites and regions. These data represent the variability of deposition under common cultivation conditions including different field sizes and configurations, varieties, regions and environmental conditions and relative positions of the measurement site to the field with respect to wind direction. Hofmann et al.  analysed data from more than 20 research and monitoring projects at 214 sites. The Additional file 1 with detailed data on the maize field configurations, meteorology and other background information can be found in the reports of the respective projects, which are cited in Table 1 of .
The EFSA postulated that the method Hofmann et al. used for estimating the density of pollen on individual leaves did “not employ random sampling, but is designed to deliberately include areas of high pollen density on leaves, resulting in statistically biased, overestimates of pollen deposition”.
The EFSA argument is based on an incorrect interpretation of the sampling method. Random sampling is not the only way of obtaining unbiased samples. Sometimes other methods perform better for statistical reasons (theoretically shown in Section 11.4 of ). The method used for sampling in situ pollen leaf deposition has been validated and is published in an international peer-reviewed scientific journal . The method relies on a stratified sampling design. It was developed after four different sampling designs had been evaluated. Random sampling was one of the four methods tested, but it failed to sufficiently represent the high variability of leaf deposition data. The combined structured design resulted in 27 samples (microscopic fields) per leaf consisting of three transects with five samples and two clusters in areas of high and low pollen density with four samples each. This method best depicted the variability of pollen deposition on plant leaves in terms of mean, variance and peak values of the true total variability of leaf pollen density values, as shown in Table 1 of  (see Additional file 1: S5; column ‘Total’). Hence, the results of the method were balanced and not biased.
Furthermore, three leaves from three plants were counted for each site and date, resulting in 81 measurements. The measurements were repeated on the same leaves and plants and in the same areas defined at the beginning of the study covering the whole flowering period. These comprehensive measurements allowed for the detailed assessment of variability in leaf pollen deposition in detail for each site over time. Based on a statistically validated sampling design, these data represent the most detailed leaf deposition measurements reported in the literature so far. The results also indicated that mean leaf measurements of single plants or days were not representative and that leaf pollen deposition over the flowering period must be considered. Furthermore, a detailed statistical analysis of the data distribution clearly shows that there was no bias in the data distribution ( Figure 4, see Additional file 1: S6).
In contrast, the data of the EFSA Panel [1, 4] relied on estimates derived mostly from single or a few measurements, reflecting mean leaf pollen density values of single leaves, plants or days only. Measurements covering variation over the entire flowering period are not included. For example, the data from Lang et al. , cited in the EFSA Panel , were based on single measurements of mean leaf pollen density taken only once during flowering at each site.
Standardised methods and data
EFSA Panel criticises the Hofmann et al. data, stating, “all the data from within the Bt-maize crop and at crop edges were standardised to relate to the same distance from the pollen source. The relationship used for the standardisation was the Hofmann et al.  dose–distance relationship for distances from 0.8 m to 4.45 km, but, as explained in Section 3.1.2, above, this cannot be used for data within the maize crop and at crop edges. Hence, all data have been standardised, involving potential multiplication or division by five fold or more, using a relationship with no evidential basis for the data on which it is used. The standardisation is unnecessary; information should be given which facilitates identification of the relationship between pollen deposition dose and distance, as in Perry et al. , Hofmann et al.  and Lang et al. )”.
Leaf pollen density data vary considerably between days, within days, between sites and within sites, between plants, between leaves and on the leaf surface [3, 26, 43]. Thus, methods and data must be standardised to achieve comparable results. Furthermore, an appropriate method must be used for each task. To assess the variability of pollen deposition between sites and over distances, standardised methods are required, such as the PMF [2, 28, 29]. To assess the variability of leaf pollen density values within a site, between plants and leaves and on the leaf surface, direct in situ measurements are appropriate [3, 42].
The distance relationship for Urtica leaf pollen deposition was based on standardised measurements using the PMF at 214 sites covering a distance range from 0.2 m to the next pollen source inside a field to up to 4.42 km away. These measurements were calibrated to Urtica leaf density by 836 in situ measurements close to the source. The results provide a consistent dose–distance relationship for the whole distance range. In contrast to the EFSA Panel’s statement, no breaks, further standardisation, or multiplication of data were applied in the statistical analysis of the distance relationship for pollen deposition on Urtica leaves. Pollen deposition values were calibrated by parallel measurements at the same site, which validates the calibration because the dose–distance relationship is based on consistently observed data. Furthermore, the results at the same site were supported by standardised technical measurements of pollen release rates continuously recorded by a volumetric pollen monitor with omnidirectional inlet (PMO). The data from the pollen monitor represented the temporal changes and intensity of pollen shedding over the flowering period. The results regarding the dose–distance relationship for Urtica leaf pollen deposition showing variability over distance are displayed in Fig. 1.
The data from Lang et al.  cited by the EFSA Panel  relied on single measurements of mean leaf density values per site by washing pollen off of single leaves. The measurements were taken on different days with no measure of the intensity of pollen shedding or deposition at the site. Therefore, the data do not represent the variability in leaf pollen density over space and time as illustrated by our measurements over the flowering period (see Fig. 1 and ; Figures 3 and 4, Additional file 1: S6, S7). Thus the methods of Lang et al. give no representative data for comparison of the results between sites: Further, standardised deposition measurements were not applied. Thus, unfortunately, the results of that study cannot be generalised. However, the data lie within our confidence boundaries, so they do not contradict our more representative results.
Exposure of protected habitats
The EFSA Panel argues: “Hofmann et al.  reported no data on pollen deposition outside maize fields; in particular, no data are presented that would enable verification of pollen deposition assumptions on host plants found in protected habitats”.
As documented in Hofmann et al. , pollen deposition was measured inside and outside of maize fields, which included nature reserve areas. The study area encompasses a region with rich biological diversity that is well known for its nature reserve areas [26, 27]. Further, considerable maize pollen deposition inside protected areas, and particularly on the leaves of protected butterfly host plants, was found in previous studies [23, 24, 44] concerning the region of the Ruhlsdorfer Bruch nature reserve area in Brandenburg, an area listed according to the Fauna–Flora-Habitats-Directive (FFH) and inhabited by protected Lepidoptera.
During sampling in those studies, Bt-maize was grown in the vicinity of the study area and transgenic Bt-maize pollen was positively detected in several sites covering the nature reserve area. Up to distances of 250 m from the next maize field, the furthest measuring point, Bt-maize pollen was identified using polymerase chain reaction methods (PCR) on PMF samples taken in the centre of the nature reserve area. These results were supported by detection of Bt-maize pollen on the leaves of various Lepidopteran host plants.
Border rows of 20 m had been used by the farmers in the area as a buffer to the protected area. These measurements are therefore particularly relevant for evaluating the EFSA Panel’s proposed mitigation measure of 20–30 m buffer areas.
Thus, the results from the Ruhlsdorfer Bruch study demonstrate that the buffer distances proposed by the EFSA Panel would have been insufficient to prevent protected butterfly species in nature reserve areas from maize pollen exposure. In fact, Bt-maize pollen deposition and maize pollen densities on leaves up to 3000 n/cm2 were detected within the protected area. One possible reason for these high pollen densities is that maize pollen can be lifted by thermal gusts, which occur particularly in the summer on bright and windy days. These conditions also encourage maize pollen release and dispersal by wind to farther distances [22, 26, 45–48].
No need for model revision?
The EFSA assumes that it “…is generally agreed that pollen deposition declines with increasing distance from the nearest pollen source, but proposed relationships governing this decline differ (see review by Perry et al. ). In particular, for the GMO Panel Scientific Opinions published prior to 2014 [9–13] the assumed dose of pollen on host plants within the Bt-maize source crop was almost seven times greater than that assumed under the relationship for mechanical samplers published by Hofmann et al. . Furthermore, outside the source crop, the assumed dose was greater than that assumed by Hofmann et al.  up to 9 m from the crop edge. In contrast, beyond 9 m from the edge of the crop, and in particular at distances greater than 30 m, the dose assumed by Hofmann et al.  was much larger than that assumed in GMO Panel Scientific Opinions. Since within and close to the Bt-maize field the estimates of mortality made by the GMO Panel [9–13] exceed those that would be derived assuming the Hofmann et al.  relationship, there was no need to revise the consequences for the previous EFSA risk assessment conclusions and risk management recommendations for Bt-maize for NT larvae within the field and its margins”.
The recommendations of the EFSA Panel prior to 2015 [9–13] based their exposure estimates on the model of Perry et al. [14–17], which takes the mean pollen density of Urtica leaves as cumulative 7-day deposition values of 589.9 n/cm2 within the maize source crop and 221.8 n/cm2 at the field edge. Perry et al.’s model relies on the assumption that >92% of total pollen deposition during the flowering period occurs in the first 7 days . Thus, the mean pollen density on Urtica leaves per day for the whole flowering period was calculated as 85.56 n/cm2 within the field and 31.69 n/cm2 at the field edge (see , Table A1, at the bottom of the table). The in situ measurements within-field pollen density on Urtica leaves by Hofmann et al.  demonstrated density values up to 13,802 n/cm2 and mean pollen density values up to 2710 n/cm2. That is, the empirical values were more than four times greater than those estimated by the EFSA Panel (pollen density in the field according to  2710 n/cm2 divided by leaf density in the field according to  589.9 n/cm2 = 4.5). Furthermore, mean daily pollen density on Urtica leaves was 244 n/cm2, which is 2.8 times higher than the EFSA Panel’s estimate (mean daily pollen density according to  244 n/cm2 divided by leaf density according to  85.56 n/cm2 = 2.8).
The standardised technical PMF sampler allows us to determine integrated deposition over the entire exposure period. The relationship between the results of standardised technical sampling using the PMF sampler and leaf pollen density measurements was experimentally evaluated based on parallel field measurements. The relationship between the PMF results and the mean daily pollen density on Urtica leaves was described by a calibration factor of 0.68, leading to an estimate of 234 n/cm2 for the mean daily leaf pollen density value over the flowering period at sites close to the pollen source (0.2 m) as average estimate taking into account the observed variability over time and between different sites under commercial cultivation and years. This value is 2.7 times higher than the EFSA Panel’s estimate of 85.56 n/cm2 for within-field mean daily leaf pollen density.
When determining adequate buffer isolation distances, it is important to define threshold levels of leaf pollen density that must not be exceeded. For their proposed isolation buffer distances of 20–30 m, the EFSA Panel calculated a maximum threshold value for mean leaf pollen density of 0.28 n/cm2 at 20 m and 0.01 n/cm2 at 30 m ( log10 d = 2346−0.145E for distances E = 20 m and E = 30 m, where d is the leaf density in n/cm2 and E is distance in m). Considering the assessment based on the observed data of [2, 3], these thresholds can be consistently attained only at a kilometre or farther (1000 m; mean leaf pollen density with Urtica ‘realistic’ mean regression = 1.6 n/cm2; upper 95% confidence boundary for ‘worst case’ scenario = 69 n/cm2). Therefore Hofmann et al. [2, 3] recommended buffer isolation distances in the kilometre range instead of 20–30 m.
The comparison of leaf density values for Urtica in Fig. 1 confirms this conclusion for the actual EFSA Panel model [1, 4]. All three EFSA Panel scenarios (MR, DC, CO) generate considerably lower estimates than the one based on our observations, which covers the whole distance range from 0.2 to 4.42 km. The calculated threshold values at 20–30 m of the EFSA Panel scenarios can only be met beyond the kilometre range.
Variability of leaf deposition data
Variability in leaf density matters because the dose–response curve for the toxicity of Bt pollen is highly non-linear, leading to considerably severer effects on sensitive Lepidoptera species [14, 36]. Despite acknowledging the relevance of this variability for exposure assessments in 2015 , the EFSA Panel focused only on mean values in 2016 . Hofmann et al.  observed high variability in Urtica leaf pollen density values with a 95% upper confidence boundary of 2270 n/cm2 and maximum leaf density values of up to 13,802 n/cm2 close to the pollen source (0.2 m). The upper 95% confidence boundary indicating worst-case scenario based on the Hofmann et al. data follows the power function d CS = 3949S −0.585 (see Fig. 1). This exceeds the corresponding ‘conservative’ scenario of the EFSA Panel for a worst-case scenario (d CO = 10.8S −0.585) by more than 100 times.
The interpretation of pollen deposition data and how to use them for risk assessments and risk management of Bt-maize differ widely between the approach of the EFSA Panel and the studies of Hofmann et al. The estimates of the EFSA Panel [1, 4] depend on an exposure model that is based only partially on observational data. To fill these data gaps, the model relies on the judgements of various experts, which leads to considerable uncertainty. We suggest that the estimates of leaf pollen deposition should be based rather on measured data, as shown in our previous integrated assessment study using standardised methods [3, 26]. This approach, using the most comprehensive dataset published in the literature so far, also has the advantage of representing realistic cultivation conditions. In our opinion, the validity of that study is not called into question by the arguments of the EFSA Panel .
Furthermore, the Hofmann et al.  data were incorporated inappropriately into the EFSA Panel model [1, 4] as depositions were greatly reduced based on new assumptions and with no consideration of measured variation.
A comparison of the three scenarios of the EFSA Panel model [1, 4] on the dose–distance relationship incorporating their own expert estimates shows that all three lie far below our empirical findings on Urtica leaf pollen density values. According to our results, the EFSA Panel underestimates the dose–distance relationship for the ‘most realistic’ scenario by a factor of 0.0138 (72-fold) compared with the empirically based results. For the ‘worst case’ scenario based on a 1:40 probability, the factor of underestimation is 0.00273 (365-fold).
According to our results, the conclusion of the EFSA GMO Panel [1, 4] “that the previous GMO Panel risk assessment conclusions and risk management recommendations on maize MON810, Bt11 and 1507 for cultivation remain valid and applicable” is, therefore, not scientifically justified.
In our opinion, to fulfil the requirements of an environmental risk assessment for Bt-maize cultivation aiming to protect sensitive species in nature reserve areas, deposition levels should be set in accordance with observed data. A realistic representation of the data must take into account the different sources of variability inherent to pollen release and deposition in the field. Thus, recommendations should incorporate data representing the variability of pollen deposition between sites and within sites, including the heterogeneous distribution between plants and on leaf surfaces, as detected in our field measurements.
According to our results, buffer isolation distances in the kilometre range, with specific environmental impact assessments in case of commercial cultivation of Bt-maize within this zone, are necessary to attain deposition levels that are associated with no more than a 0.5 to 1% mortality for highly sensitive butterfly species in the EU.
European Food Safety Authority
pollen mass filter, a passive aerosol sampler according to Association German Engineeers VDI Standard 4330-3/CEN TS 16817-1
a volumetric pollen monitor with omnidirectional inlet (TIEM technic GbR, Dortmund, Germany)
genetically modified organism
- FFH areas:
areas listed according to the EU FFH Habitats Directive (fauna–flora-habitats-Directive)
European Food Safety Authority (2016) Relevance of a new scientific publication (Hofmann et al. 2016) for previous environmental risk assessment conclusions and risk management recommendations on the cultivation of Bt-maize events MON810, Bt11 and 1507. EFSA Supp Publ; EN-1070
Hofmann F, Otto M, Wosniok W (2014) Maize pollen deposition in relation to the distance from the nearest pollen source under common cultivation—results of 10 years of monitoring (2001–2010). Environ Sci Eur 26:24
Hofmann F, Kruse-Plass M, Kuhn U, Otto M, Schlechtriemen U, Schröder B, Vögel R, Wosniok W (2016) Accumulation and variability of maize pollen deposition on leaves of European Lepidoptera host plants and relation to release rates and deposition determined by standardised technical sampling. Environ Sci Eur 28:14
European Food Safety Authority (2015) Scientific opinion updating risk management recommendations to limit exposure of non-target Lepidoptera of conservation concern in protected habitats to Bt-maize pollen. EFSA J 2015(13):4127
Directive 2001/18/EC of the European Parliament and of the Council on the deliberate release into the environment of genetically modified organisms and repealing Council Directive 90/220/EEC (2001) Off J Eur Commun 106/1
Höfte H, Whitely H (1989) Insecticide crystal proteins of Bacillus thuringiensis. Microbiol Rev 53:242–255
Glare TR, O’Callaghan M (2000) Bacillus thuringiensis: biology, ecology and safety. Wiley, Chichester
Lang A, Otto M (2010) A synthesis of laboratory and field studies on the effects of transgenic Bacillus thuringiensis (Bt) maize on non-target Lepidoptera. Entomol Exp Appl 135:121–134
European Food Safety Authority (2009) Scientific opinion of the panel on genetically modified organisms on applications (EFSA-GMO-RX-MON810) for the renewal of authorisation for the continued marketing of (1) existing food and food ingredients produced from genetically modified insect resistant maize MON810; (2) feed consisting of and/or containing maize MON810, and maize MON810 for feed use (including cultivation); and of (3) food additives and feed materials produced from maize MON810, all under Regulation (EC) No 1829/2003 from Monsanto. EFSA J 7:1149. doi: 10.2903/j.efsa.2009.1149
European Food Safety Authority (2011) Scientific opinion updating the evaluation of the environmental risk assessment and risk management recommendations on insect resistant genetically modified maize 1507 for cultivation. EFSA J 9:2429. doi:10.2903/j.efsa.2429
European Food Safety Authority (2011) Statement supplementing the evaluation of the environmental risk assessment and risk management recommendations on insect resistant genetically modified maize Bt11 for cultivation. EFSA J 9:2478. doi:10.2903/j.efsa.2478
European Food Safety Authority (2012) Scientific opinion supplementing the conclusions of the environmental risk assessment and risk management recommendations on the genetically modified insect resistant maize 1507 for cultivation. EFSA J 2012(10):2934. doi:10.2903/j.efsa.2934
European Food Safety Authority (2012) Scientific opinion supplementing the conclusions of the environmental risk assessment and risk management recommendations for the cultivation of the genetically modified insect resistant maize Bt11 and MON810. EFSA J 10:3016. doi:10.2903/j.efsa.3016
Perry JN, Devos Y, Arpaia S, Bartsch D, Gathmann A, Hails RS, Kiss J, Lheureux K, Manachini B, Mestdagh S, Neemann G, Ortego F, Schiemann J, Sweet JB (2010) A mathematical model of exposure of non-target Lepidoptera to Bt-maize pollen expressing Cry1Ab within Europe. Proc Biol Sci B. 277:1417–1425
Perry JN, Devos Y, Arpaia S, Bartsch D, Gathmann A, Hails RS, Kiss J, Lheureux K, Manachini B, Mestdagh S, Neemann G, Ortego F, Schiemann J, Sweet JB (2011) The usefulness of a mathematical model of exposure for environmental risk assessment. Proc Biol Sci 278:982–984
Perry JN, Devos Y, Arpaia S, Bartsch D, Ehlert C, Gathmann A, Hails RS, Hendriksen NB, Kiss J, Messean A, Mestdagh S, Neemanbe CC (2012) No evidence requiring change in the risk assessment of Inachisn G, Nuti M, Sweet JB, Tebbe CC. Estimating the effects of Cry1F Bt-maize pollen on non-target Lepidoptera using a mathematical model of exposure. J Appl Ecol 49:29–37
Perry JN, Arpaia S, Bartsch D, Birch N, Devos Y, Gathmann A, Gennaro A, Kiss J, Messean A, Mestdagh S, Nuti M, Sweet JB (2013) Teb io larvae. Ecol Modell 268:103–122
Holst N, Lang A, Lövei G, Otto M (2013) Increased mortality is predicted of Inachis io larvae caused by Bt-maize pollen in European farmland. Ecol Modell 250:126–133
Wraight CL, Zangerl AR, Carroll MJ, Berenbaum MR (2000) Absence of toxicity of Bacillus thuringiensis pollen to black swallowtails under field conditions. Proc Natl Acad Sci USA 97:7700–7703
Hofmann F (2007) Kurzgutachten zur Abschätzung der Maispollendeposition in Relation zur Entfernung von Maispollenquellen mittels technischem Pollensammler PMF. BfN, Bonn. http://www.bfn.de/fileadmin/MDB/documents/themen/agrogentechnik/07-05-31_Gutachten_Pollendeposition_end.pdf. Accessed 24 Oct 2016
Ober S, Hofmann F, Schlechtriemen U, Kuhn U, Wedl N, von der Ohe W, von der Ohe K, Radtke J, Müller A, Kalchschmid A, Kruse L, Epp R (2007) Durchführung eines Pollenmonitorings von Mais im Naturschutzgebiet Ruhlsdorfer Bruch. Potsdam: Fachbeiträge des Landesumweltamtes Brandenburg. http://www.mugv.brandenburg.de/cms/media.php/2320/fb_109.pdf. Accessed 29 Oct 2012
Hofmann F, Janicke L, Janicke U, Wachter R, Kuhn U (2009a) Modellrechnungen zur Ausbreitung von Maispollen unter Worst-Case-Annahmen mit Vergleich von Freilandmessdaten. Bonn: Bundesamt für Naturschutz 47. http://www.bfn.de/fileadmin/MDB/documents/service/Hofmann_et_al_2009_Maispollen_WorstCase_Modell.pdf. Accessed 28 Aug 2015
Hofmann F, Schlechtriemen U, Kuhn U, von der Ohe W, von der Ohe K, Kruse L, Epp R, Müller E, Kalchschmid A, Wachter R, Vögel R (2009b) Durchführung eines Pollenmonitorings an Kulturmais in FFH-Lebensräume Projektbericht 2008. Heft 110, Potsdam: Fachbeiträge des Landesumweltamtes Brandenburg. http://www.mugv.brandenburg.de/cms/media.php/2320/fb_110.pdf. Accessed 29 Oct 10 2012
Hofmann F, Epp R, Kruse L, Kalchschmid A, Maisch B, Müller E, Kuhn U, Kratz W, Ober S, Radtke J, Schlechtriemen U, Schmidt G, Schröder W, von der Ohe W, Vögel R, Wedl N, Wosniok W (2010) Monitoring of Bt-Maize pollen exposure in the vicinity of the nature reserve Ruhlsdorfer Bruch in northeast Germany 2007 to 2008. Umweltwiss Schadst Forsch 229:251
German Advisory Council on the Environment (SRU) (2008) Sustainable development, innovation and climate protection: a German perspective. SRU, Berlin
Hofmann F, Ober S, Janicke L, Janicke U, Kuhn U, Schlechtriemen U, Unselt C, Wittich KP (2013) Eintrag von Maispflanzenteilen in die Umwelt: Abschätzung der Umweltexposition für die Risikobewertung transgener Pflanzen. Bundesamt für Naturschutz, Bonn
Vögel R, Ober S, Hofmann F, Unseld C (2013) Agrogentechnik und Naturschutz-Wie können Schutzgebiete und aquatische Systeme wirksam vor dem Eintrag von Bt-Toxin geschützt werden? Potsdam: Fachbeiträge des Landesamtes für Gesundheit, Umwelt und Verbraucherschutz, Brandenburg. http://www.lugv.brandenburg.de/cms/detail.php/bb1.c.310761.de. Accessed July 20 2015
Association of German Engineers (2007) VDI-Standard: 4330 Blatt 3-monitoring the effects of genetically modified organisms (GMO)-pollen monitoring-technical pollen sampling using pollen mass filter (PMF) and sigma-2 sampler. Beuth, Berlin
European Committee for Standardization (2015) CEN TS 16817-1 (DIN SPEC 33971) Technical specification-ambient air-monitoring the effects of genetically modified organisms (GMO)-pollen monitoring. Part 1: technical pollen sampling using pollen mass filter (PMF) and Sigma-2-sampler. Brussels
Bøhn T, Aheto DW, Mwangala FS, Fischer K, Bones IL, Simoloka C, Fischer K, Mbeule I, Schmidt G, Breckling B (2016) Pollen-mediated gene flow and seed exchange in smallscale Zambian maize farming, implications for biosafety assessment. Sci Rep. 6:34483. doi:10.1038/srep34483
Reuter H, Breckling B, Wurbs A, Höltl K (2008) Modelling maize cross-pollination probabilities on the regional level—exemplary simulations for the county Elbe Elster in Brandenburg, Germany. In: Breckling B, Reuter H, Verhoeven R (eds) Implications of GM-crop cultivation at large spatial scales. Theorie in der Ökologie 14. Peter Lang, Frankfurt, pp 54–58
Reuter H, Böckmann S, Breckling B (2008) Analysing cross pollination studies in maize. In: Breckling B, Reuter H, Verhoeven R (eds) Implications of GM-crop cultivation at large spatial scales. Theorie in der Ökologie 14. Peter Lang, Frankfurt
Van Frankenhuyzen K (2013) Cross-order and cross-phylum activity of Bacillus thuringiensis pesticidal proteins. J Invertebr Pathol 114:79–85
Hilbeck A, Otto M (2015) Specificity and combinatorial effects of Bacillus thuringiensis cry toxins in the context of GMO environmental risk assessment. Front Environ Sci 3:71
Lang A, Oehen B, Ross J-H, Bieri K, Steinbrich A (2015) Potential exposure of butterflies in protected habitats by Bt-maize cultivation: a case study in Switzerland. Biol Cons 192:369–377
Pleasants JM, Hellmich RL, Dively GP, Sears MK, Stanley-Horn DE, Mattila HR, Foster JE, Clark TL, Jones GD (2001) Corn pollen deposition on milkweeds in and near cornfields. Proc Natl Acad Sci USA 98:11919–11924
Lang A, Ludy CV (2004) Dispersion and deposition of Bt-maize pollen in field margins. J Plant Dis Prot 111:417–428
Darvas B, Cso´ti A, Adel G, Peregovits L, Ronkay L, Lauber E, Polgar L (2004) Some data to the risk analysis of Bt-corn pollen and protected lepidopteran species in Hungary. No¨ve´nyve´delem 40:441–449
Janicke U, Janicke L (2013) Validierung der Ausbreitungsrechnung für Maispollen. In: Vögel R, Ober S, Hofmann F, Unseld C (eds) Agrogentechnik und Naturschutz-Wie können Schutzgebiete und aquatische Systeme wirksam vor dem Eintrag von Bt-Toxin? Geschützt werden Fachbeiträge des Landesamtes für Gesundheit, Umwelt und Verbraucherschutz pp 19–34
Jarosz N, Loubet B, Durand B, Foueillassar X, Huber L (2005) Variations in maize pollen emission and deposition in relation to microclimate. Environ Sci Technol 39:4377–4384
Thompson SK (2002) Sampling, 2nd edn. Wiley, New York
Hofmann F, Otto M, Kuhn U, Ober S, Schlechtriemen U, Vögel R (2011) A new method for in situ measurement of Bt-maize pollen deposition on host-plant leaves. Insect 2:12–21
Hofmann F, Schlechtriemen U, Kuhn U, Wittich K-P, Koch W, Ober S, Vögel R, Otto M (2013) Variation of maize pollen shedding in North Germany and its relevance for GMO-monitoring. Theorie in der Ökologie 17:19–25
Hofmann F, Epp R, Kalchschmid A, Kratz W, Kruse L, Kuhn U, Maisch B, Müller E, Ober S, Radtke J, Schlechtriemen U, Schmidt G, Schröder W, von der Ohe W, Vögel R, Wedl N, Wosniok W (2008) GVO-Pollenmonitoring zum Bt-Maisanbau im Bereich des NSG/FFH-Schutzgebietes Ruhlsdorfer Bruch. Umweltwiss Schadst Forsch 20:275–289
Aylor DE, Boehm MT (2006) Quantifying aerial concentrations of maize pollen in the atmospheric surface layer using remote-piloted airplanes and lagrangian stochastic modeling. J Appl Meteor Climatol 45:1003–1015
Boehm MT, Aylor DE, Shields EJ (2008) Maize pollen dispersal under convective conditions. J Appl Meteorol Climatol. 47:291–307
Brunet Y, Foueillassar X, Audran A, Garrigou D, Dayau S, Tardieu L (2003) Evidence for long-range transport of viable maize pollen. In: Slagelse BB (ed) 1st European Conference on the coexistence of genetically modified crops with conventional and organic crops. Danish Institute of Agricultural Sciences, Helsingor pp 74–76
Arritt RW, Clark CA, Goggi AS, Lopez-Sanchez H, Westgate ME, Riese JM (2006) Lagrangian numerical simulations of canopy air flow effects on maize pollen dispersal. Field Crop Res 102:151–162
All authors made substantial and equal contributions to the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
This study was supported by the Federal Agency for Nature Conservation (BfN) with funds provided by the Federal Ministry for Environment, Nature Conservation and Nuclear Safety.
The original version of this article was revised. In the captions of Figure 1, the grey circle and the pink broken line were attributed the wrong way round, which has now been switched to be corrected, and is explained further in the erratum to this article.
An erratum to this article is available at http://dx.doi.org/10.1186/s12302-017-0114-0.
About this article
Cite this article
Kruse-Plass, M., Hofmann, F., Kuhn, U. et al. Reply to the EFSA (2016) on the relevance of recent publications (Hofmann et al. 2014, 2016) on environmental risk assessment and management of Bt-maize events (MON810, Bt11 and 1507). Environ Sci Eur 29, 12 (2017) doi:10.1186/s12302-017-0106-0
- Genetically modified organisms
- Environmental risk assessment
- Host plants
- Non-target organisms
- Pollen deposition
- Isolation buffer zones