- Open Access
Limits of Concern: suggestions for the operationalisation of a concept to determine the relevance of adverse effects in the ERA of GMOs
Environmental Sciences Europe volume 30, Article number: 39 (2018)
The European Food Safety Authority proposed a concept for the environmental risk assessment of genetically modified plants in the EU that is based on the definition of thresholds for the acceptability of potential adverse effects on the environment. This concept, called Limits of Concern (LoC), needs to be further refined to be implemented in the environmental risk assessment of genetically modified organisms.
We analyse and discuss how LoC can be defined for the environmental risk assessment for three different types of genetically modified plants. We outline protection goals relevant to the genetically modified plants in question and discuss existing concepts and suggestions for acceptability thresholds from the environmental risk assessment of different regulatory areas. We make specific recommendations for the setting and use of LoC for each type of genetically modified plant.
The LoC concept can be suitably applied for the environmental risk assessment of genetically modified organisms, if the different protection goals in agro-environments are specifically considered. Not only biodiversity protection goals but also agricultural protection goals need to be addressed. The different ecosystem services provided by weeds inside and outside agricultural fields have to be considered for genetically modified herbicide-tolerant crops. Exposure-based LoCs are suggested based on knowledge about dose–effect relationships between maize pollen and non-target Lepidoptera for insect-resistant maize. Due to the long-term nature of biological processes such as spread and establishment, LoCs for genetically modified oilseed rape should be defined for the presence of the genetically modified plant or its genetically modified traits in relevant protection goals.
When setting LoCs, the focus should be on protection goals which are possibly affected. Potential overlaps of the LoC concept with the ecosystem service concept have to be clarified to harmonise protection levels in the agro-environment for different stressors. If additional impacts on agro-biodiversity resulting from the cultivation of genetically modified plants are to be avoided, then high protection levels and low thresholds for acceptable effects (i.e. LoC) should be set.
In the European Union, it is a crucial task and required by European legislation (Directive 2001/18/EC , Regulation (EC) No. 1829/2003 , and Implementing Regulation (EU) No. 503/2013 ) to assess environmental risks before introducing a genetically modified organism (GMO) into the environment or placing a product consisting of or containing GMO or parts of GMO onto the market. When carrying out an environmental risk assessment (ERA) of the GMO in question, the applicant has to follow the respective legislative provisions, in particular Annex II of Directive 2001/18/EC which lies down the principles for the ERA, and the Commission’s guidance notes supplementing Annex II , as well as the amendments of Annex II and III . In addition, the European Food Safety Authority (EFSA) issued guidance documents for the ERA of GMOs (e.g. [6,7,8,9]). In 2010, the EFSA published a revised version of its guidance document which introduced a novel concept into the ERA of GMOs, the Limits of Concern (LoC ).
Limits of Concern have been introduced into the ERA requirements for GMOs to delimit those observed adverse effects which are not likely to cause environmental harm from those effects which have the potential to cause harm with respect to an identified protection goal in the agro-environment . Defining environmental harm of a GMO for agro-ecosystems requires that (i) ecological entities, habitats as well as ecosystem functions and services to be preserved have explicitly been set out and (ii) their relevance for the specific GMO in question has been identified [10, 11]. Therefore, an important aspect when delimiting negligible from significant adverse effects for ERA purposes is the knowledge of what constitutes harm for defined protection goals . Protection goals are “natural resources (e.g. arthropod natural enemies, bees) or natural resource services (e.g. regulation of arthropod pest populations, pollination) that are to be protected as set out by EU legislations” . These protection goals include biodiversity, protected species and habitats, but also ecosystem functions and ecosystem services as well as different areas of protection such as water, soil and human and animal health . Different approaches of how to operationalise protection goals and harm thresholds for ERA purposes have been suggested: (i) In the LoC approach suggested for the ERA of GMOs, the assessment endpoints are representatives of the relevant protection goal . An assessment endpoint (e.g. a specific non-target organism or a biological function) acts as a proxy for a natural resource or resource service that requires protection and could be adversely affected by a specific stressor. Measurement endpoints are then defined for these assessment endpoints (e.g. mortality, abundance, etc.), and LoCs are set to define the level of protection . (ii) In the ecosystem service approach, initially suggested for the ERA of plant protection products (PPPs) and later also for GMOs, protection goals are operationalised by identifying relevant ecosystem services and their key drivers [12, 13]. Then, specific protection goal (SPG) options are derived for each combination of key drivers and ecosystem service that may be affected [12, 13]. The formulation of SPG options also allows defining what magnitude of effect can be tolerated. The ecosystem service concept has recently been proposed for ERA use, not only for PPPs, but also for other stressors in agro-environments, such as GMOs, invasive alien species  or plant pests . Additionally, EFSA issued two related scientific opinions that address the coverage of endangered species and the ecological recovery of non-target organisms in the ERA [15, 16]. Both documents further emphasise the need to set a common protection level for agro-ecosystems independent of the stressor.
When evaluating environmental harm due to GMO cultivation, it still has to be tackled what kind of effect is considered adverse and no longer acceptable for a particular agro-environmental protection goal. So far, generally agreed definitions and criteria about what constitutes an environmental harm exist neither for natural ecosystems nor for agro-ecosystems. For example, when assessing impacts of invasive alien species on biodiversity, either the threatening of populations of native species or the significant alteration of ecosystem processes or properties is considered as a threat to biodiversity [17, 18]. Further specifications are needed to determine, i.e. the “minimum biodiversity level for the efficient and sustainable functioning of the particular agro-ecosystem” . The biodiversity of functional groups is most relevant to ecosystem functions . Recently, some authors discussed what thresholds for biodiversity losses might be acceptable and whether—on a global scale—safe limits for them can be set without compromising important earth system processes [20, 21]. In addition, when setting such thresholds, this must not come into conflict with normative requirements of legislative provisions, such as for species and habitats protected at EU (e.g. FFH Directive) or national level.
A general appraisal of the LoC concept as well as suggestions for its operationalisation for ERA use has already been provided . One of the basic elements of the ERA of genetically modified plants (GMP) is the comparative safety assessment [6, 9]. For the food and feed risk assessment, so-called “equivalence limits”, composed of values from commercial plant varieties with a history of safe use, are used to put any differences found into the context of harm [23, 24]. For the ERA and the establishment of environmental safety of a GMP, a similar claim does not exist when using conventional comparators (for further discussion see ). Using LoCs is, therefore, necessary to define whether observed differences between the GMP and the non-genetically modified (GM) comparator are biologically relevant and may cause environmental harm [6, 9, 24]. EFSA has explored the difference between biological relevance and statistical significance of an observed effect further in a scientific opinion . In this opinion, expert judgment decides whether an effect is considered biologically relevant or not. This is particularly useful for the definition of LoCs for GMO risk assessment, as effects observed in the ERA are judged not only by their statistical outcome (e.g. the results of tests for difference and equivalence), but also by expert evaluation. Against this background, LoCs are understood as acceptability thresholds, either quantitatively or qualitatively, for adverse effects on biological entities, functions or processes. LoCs trigger regulatory concern due to the possibility (a) that the observed effects indicate harm to protection goals or (b) because these effects are valued as being important for specific protection goals. This definition leaves room to assign importance to observed adverse effects for which harm to the specific protection goal cannot be proven at the time being; e.g. in case that adverse effects are observed for a single species, but the consequences for the species community or the ecosystem functions provided by this species cannot be determined. Legislative provisions which define protection goals often aim to protect populations, communities or ecosystems and their services. Thus, extrapolating from effects observed at the organism level in the ERA to higher levels of biological organisation or ecosystem functions or processes is required.
In this article, we evaluate the LoC concept for three types of GMOs, representing three different areas of risk in the ERA according to EFSA . The selection of relevant protection goals and the setting of LoCs are inherent components of the problem formulation which is the start of any ERA procedure . Consequently, LoCs are principally relevant to all risk areas which have to be addressed in the ERA of a particular GMO. We base our suggestions on a conceptual framework for assessing environmental harm due to GMO cultivation elaborated by Kowarik et al. . Adverse environmental effects of GMOs which impact protection goals are not always testable within the ERA, in particular in case of (i) indirect effects, e.g. effects occurring through a causal chain of events, (ii) delayed effects or (iii) effects that occur in environmental contexts not encountered during the ERA. Kowarik et al.  recommend the use of indicators in order to assess adverse effects of a GMO in the ERA. These indicators may be selected at different levels within a chain of adverse effects. Limits of Concern have to be set for the particular indicator chosen for the relevant protection goal. Indicators, and consequently LoCs, can be selected at the trigger or exposure level (i.e. the GMP itself or the non-selective herbicide), at the process level (i.e. processes that may lead to adverse effects) or at the effect/risk level where adverse effects are detectable (Fig. 1).
Three different types of GMOs and their specific potential environmental risks represent the respective areas of risk as outlined in the ERA guidance document by EFSA (see also “Methods”). We first determined which protection goals are relevant to each GMO. We then discuss whether thresholds for the acceptability of adverse effects with relevance for the specific GMO have already been proposed, e.g. in other regulatory areas. Finally, we address aspects that we consider most important for the setting of LoCs for each GMO. Specific links are made to the ecosystem service concept and to current developments in the ERA of GMOs or other relevant stressors in the agricultural environment.
Results and discussion
Example 1: GM oilseed rape
Relevant protection goals to be considered in the ERA of GM oilseed rape
Protected species represent important protection goals for the ERA of GMPs . Wild species that are able to hybridise with cultivated oilseed rape (i.e. crop-wild relatives) are part of the agro-biodiversity in agro-ecosystems. Relevant species belong to the genera Brassica, Sinapis, Raphanus, Rapistrum, Hirschfeldia, Eruca and Erucastrum . Some of them are protected or are considered threatened, either EU-wide (e.g. , Annex II) or on a national scale, such as Crambe tatarica . An important question is whether the genetic constitution of species is a relevant criterion in legislative acts. For example, the genetic constitution of species protected under the FFH Directive does not constitute a specific criterion when defining their favourable conservation status . In contrast, some national provisions for nature protection (e.g. the German Nature Protection Law § 1) conserve the characteristic features of nature which may cover a specific genetic constitution . The national responsibility concept includes information on the genetic constitution of populations as well [30,31,32].
In addition, some of the wild relatives of oilseed rape represent old crop varieties that are still cultivated in some parts of Europe, such as Eruca sativa, Brassica rapa, Raphanus raphistrum and Sinapis alba  and constitute important and threatened plant genetic resources [33, 34]. Wild relatives are also considered as an important breeding material for crop improvement . About 18% (i.e. 25 species) of crop-wild relatives of the genus Brassica are considered to be threatened in Europe . In-field cultivation of local, traditional and rustic breeds and varieties as well as their in situ conservation are recognised measures for the maintenance of plant genetic resources which is an important protection goal outlined in several EU-wide and international provisions for the conservation of agricultural biodiversity [35,36,37,38].
Also, crop landraces contribute to the diversity of plant genetic resources in agriculture , and therefore represent important protection goals for GM oilseed rape. Commission Directive 2008/62/EC defines landraces as “a set of populations or clones of a plant species which are naturally adapted to the environmental conditions of their region” . Their conservation and sustainable use are important aims in the EU . The genetic status of crop landraces and the risk of genetic erosion have been specified in the respective legislation . Landraces are listed neither in the EU common catalogue of plant varieties nor in national seed catalogues, but represent an important component of Europe’s threatened agro-biodiversity .
Also, habitats are biodiversity protection goals relevant to outcrossing and persistent GM crops such as GM oilseed rape, due to their ability to invade and potentially alter the species composition, structure or function of protected habitats. Habitat conservation is one of the cornerstones of the conservation of biodiversity in Europe as laid down by the FFH Directive  and also at national level. Feral oilseed rape occupies mainly open and disturbed habitats, either naturally or by human intervention, and establishes as a pioneer plant . Some habitat types frequently occupied by feral oilseed rape, e.g. ruderal habitats that occur in agricultural landscapes, are included in national Red Lists such as the Red List of threatened habitat types in Austria  or the German Red Data Book on endangered habitats . If GM feral oilseed rape or hybrids with wild relatives spread into these habitats, they can compromise nature conservation goals, if the specific conservation objectives of the particular habitat are adversely affected.
Evaluating thresholds for the acceptability of adverse effects
For effects on species due to vertical gene transfer of GM oilseed rape
The EFSA guidance document suggests a stepwise procedure for the ERA of GM oilseed rape, using stepwise information requirements to assess adverse effects of GM oilseed rape on wild relatives due to vertical gene transfer . Stage 1 information requirements include information on hybridisation with relatives . Depending on a GMP’s ability to outcross and hybridise (yes/no decision), the next stage is entered. Stage 2 should explore whether the GM trait increases the fitness of compatible relatives under agricultural conditions (yes/no decision) and—in case the answer is yes—whether environmental or agricultural impacts are evident, which can provide a link to the LoC concept. In case the GMO hybridises with compatible relatives outside production systems, further information is required in stages 3 and 4 to assess any alterations of the fitness, the range and population size of those plants. Another link to the LoC concept can be provided by evaluating whether changes in the population size of compatible relatives cause any environmental harm. However, further guidance is missing on how to evaluate environmental harm and no acceptability thresholds are proposed in the guidance document. Potential adverse effects on species and on habitats are not separately addressed.
For effects on habitats due to spread and establishment of GM oilseed rape
The stepwise evaluation procedure in the EFSA guidance document requires to evaluate the GMP’s ability to establish in the cropping area or outside agricultural production systems, e.g. in natural habitats . In case the GMP is more persistent than its conventional counterpart, it needs to be evaluated if an agricultural or environmental impact is evident (in-field) or if environmental damage will occur outside production systems . As for effects on species (see above), no further guidance is given which impacts on agricultural or natural habitats are considered acceptable.
Aspects to be considered when setting LoCs
Current requirements for the risk assessment of GM plants that are able to outcross and spread are based on documented harm to biodiversity. A similar way is followed when biodiversity risks of invasive alien species (IAS) are evaluated in the European Union. For both, IAS and GM oilseed rape, it is difficult to predict their spread and persistence in the environment  and their impact on biodiversity. Regulation (EU) No 1143/2014 on the prevention and management of the introduction and spread of IAS provides a regulatory framework with the aim to prevent or minimise threats to biodiversity in the European Community . The probability of having a significant adverse impact upon biodiversity or the related ecosystem services is one of the criteria for an alien species to be listed as an IAS which also entails management actions (, Article 4). In this context, Essl et al. have proposed the following effects as biodiversity threats: (i) threatening of populations of native species, (ii) endangerment or extinction of native species and (iii) alteration of ecosystem processes or properties (e.g. nutrient cycling) . If, according to the state of knowledge, no negative impacts to biodiversity are evident or likely, the species is considered as non-invasive and no management measures are required .
If similar benchmarks are also applied for GM oilseed rape, impacts on biodiversity have to be clearly evident before any thresholds for acceptability are exceeded and restrictions for cultivation or other management measures are justified. Consequently, the spread and establishment of GM oilseed rape in a natural habitat or its hybridisation with a wild relative would only constitute environmental harm if adverse impacts on biodiversity in Europe had previously been documented. For example, the hybridisation between alien species and native species is only considered as a threat to biodiversity, if effects on native populations are evident .
During commercial cultivation of GM oilseed rape, specific conservation objectives may be at risk in natural habitats if GM oilseed rape or GM hybrids with wild relatives establish. Whether specific conservation goals of a certain natural habitat are affected can only be decided if these are actually known. Therefore, decisions need to be taken on a case-by-case basis, considering the specific conservation objectives for the species or habitat in question. However, this procedure is not feasible within the EU-wide authorization procedure for GM crops, but must be carried out for the particular protected site in case adverse effects due to a GMP or a GM crop–wild hybrid have been observed. Similar to IAS, management action is then only required in areas of conservation concern where adverse effects have been documented and if a certain damage threshold is exceeded [17, 47].
Another approach is to define LoCs for indicators rather than for documented adverse effects on the relevant protection goals. During the ERA, several natural processes of a GM plant are assessed [6, 10]. The more of them occur (e.g. hybridisation with a wild relative, fertility of the GM crop–wild hybrid, ability to backcross into wild relatives), the higher the risk for environmental harm . Similarly, for spread and establishment of a GMP or of hybrids with wild relatives, the more frequently a GMP occurs in a particular habitat, the higher is its potential for harm . If spread, establishment and hybridisation are per se considered acceptable in agro-environments, they do not exceed the LoC and no risk management measures are required. This has recently been the case with the reporting of maize–teosinte hybrids in European agro-ecosystems [48,49,50]. Due to the GM trait conferring herbicide tolerance, the occurrence of GM maize × teosinte hybrids was considered to be restricted to agricultural fields and therefore, the potential harm considered manageable . However, with other traits than herbicide tolerance, e.g. insect resistance, GM maize × teosinte hybrids may spread also to natural habitats.
These natural processes may be considered unacceptable for certain protected objects, e.g. for species or habitats of conservation concern. In this case spread, establishment or hybridisation constitutes an unacceptable process even if no impact on a native population or natural habitat is evident). Similarly, cross-pollination of GM oilseed rape with rare crop varieties, protected and endangered crop–wild species or crop landraces may be considered a threat to agricultural protection goals, and therefore valued as unacceptable (Fig. 2).
To determine whether the biological processes of hybridisation or cross-pollination are acceptable, it is required to further specify the relevant protection objectives for the protected entities in the respective laws and regulations. This includes taking decisions about the genetic condition of the respective populations of wild relatives or crop varieties to be preserved (i.e. a GM free status) or the specific genetic status to be avoided (e.g.the presence of GM constructs or traits). For landraces, the risk of genetic erosion as defined by Commission Directive 2008/62/EC  could be extended to specifically cover the presence of GM constructs due to cross-pollination with GM crops.
When setting LoCs, it has to be considered that GM oilseed rape—once released—is non-retrievable from the environment and that any potential adverse effect on relevant protection goals may also be non-reversible. Experience with IAS shows that eradication of already wide-spread IAS is rarely successful . Other crop plants such as maize do not outcross, spread or persist without human intervention in a particular environment and can be removed once the cultivation has been terminated. Recently, experiments indicated that hybridization of cultivated maize with a weedy relative, the teosinte, can occur  and may, therefore, also spread and persist in the environment. It is most difficult to retrieve populations of feral crop plants such as GM oilseed rape from the environment, because (i) oilseed rape can build up long persisting soil seed banks and establish stable and self-dispersing feral populations [53, 54] and (ii) there is evidence that feral oilseed rape populations disperse beyond the arable land [55, 56]. Feral oilseed rape is expected to persist up to 20 years or even longer [57,58,59]. The presence of populations of GM oilseed rape in the agro-environment may, therefore, compromise relevant biodiversity and agricultural protection goals also in the long term.
Example 2: GMHT crops
Relevant protection goals to be considered in the ERA of GMHT crops
Biodiversity protection goals
The aim of any herbicide use is to control weeds in the field where a crop is grown. This applies to GM herbicide-tolerant crops and to any other non-GM crop as well. However, rare or protected, but also common weed species require protection in agricultural landscapes . It has been recognised in the ERA of PPPs that plant species growing in-field need protection as they are important for the provision of particular ecosystem services and for the support and maintenance of farmland biodiversity . Weeds have been identified as key drivers for supporting food webs at higher trophic levels [61,62,63]. In addition, it has been recognised that certain in-field species need specific protection because they are rare or endangered . Rare and endangered species play an important role as they provide aesthetic values and cultural ecosystem services in agro-ecosystems [12, 61]. Consequently, the ERA of active ingredients as well as of PPPs requires data of non-target plants not only off-field but also in-field [64, 65]. The maintenance of biodiversity is an overarching protection goal for terrestrial plants in agricultural systems . In Europe, around 40 species of policy plants, i.e. plant species that are listed under European or international policy instruments, are subject to major threats by intensive arable farming . At national level, Member States started different activities to promote the protection of arable plant species: (i) some Red Lists have been developed specifically for weed species (e.g.  for Slovakia,  for Poland) or for threatened biotope types including arable and fallow land (e.g.  for Germany;  for Austria); (ii) areas important for the conservation of the biodiversity of segetal plant species were identified ( for Austria); (iii) some Member States made suggestions which communities of arable plants to conserve ( for United Kingdom,  for Germany). An important aspect when conserving rare weeds is their in situ protection which comprises the establishment and definition of “important arable plant areas” (, United Kingdom), “protection fields” ([71, 72], Germany) or “biodiversity hotspots” (, Austria). Arable land can be an important refuge for many rare, endangered or threatened species where they grow under specific environmental or agronomic conditions [43, 68, 73]. As these species depend on the specific habitat conditions for their growth, Red Lists for endangered biotope types are also an important instrument for the conservation of arable plants [43, 44]. The previous statements underline that it is required to define protection goals also at Member State level.
Agricultural protection goals
For the ERA of GMHT crops, EFSA  refers to two legislative documents comprising agricultural protection goals: the Biodiversity Action Plan for Agriculture  and Directive 2009/128/EC on the sustainable use of pesticides . Agricultural protection goals relevant to GMHT crops are (i) the integration of biodiversity and sustainability into agricultural production practices such as the diversification of production types and cultivated varieties (including crop rotation), (ii) less input of agrochemicals (including PPPs) and (iii) maintenance of diversity of crop varieties. Directive 2009/128/EC on the sustainable use of pesticides promotes integrated pest management with the focus on non-chemical methods and also aims at the reduction of risks and impacts of pesticide use on human health and the environment . According to this Directive, EU Member States are requested to define reduction targets for pesticide use for particular crops. Another aim of the Directive is to limit the levels of pesticide use in order not to increase the risk for resistance development in populations of harmful organisms (see ; Annex III).
Evaluating thresholds for the acceptability of adverse effects
For effects on weeds and non-target plants
The ERA of plant protection products recommends applying the ecosystem service concept, thereby treating non-target plants differently according to their role as key drivers for different ecosystem services in-field and off-field .
In the field, the specific function of non-target plants, e.g. the provision of food or habitat for higher trophic levels, is considered as more important than the biodiversity of the whole plant community . Consequently, the magnitude of acceptable effects for various in-field non-target plants depends on the ecosystem service they provide . Medium effects are considered as acceptable for plants which act as key drivers of the food web support service, and medium to large effects for plants which are key drivers of aesthetic values and genetic resources .
In the off-field area, non-target plant populations are considered important drivers for a range of ecosystem services and should not be affected by the herbicides . Therefore, only negligible effects are considered acceptable.
For effects on weed-related biodiversity
The ERA of GMOs requires an assessment whether changes in the crop management method adversely affect the biodiversity of higher trophic levels, e.g. due to changes in the weed flora . Also, ERA requirements for active ingredients of PPPs demand to assess the potential impacts on biodiversity and indirect effects via alteration of the food web . However, those effects have so far been left unconsidered in the ERA of PPPs . Hence, no specific threshold values for indirect food web effects are available yet in the ERA of PPPs.
Any LoCs set for weed-related biodiversity effects will have to be linked to LoCsfor in-field non-target plants. The former also depend on the strength of the trophic link between plants and the biological entities representing weed-related biodiversity, e.g. different arthropod taxa, as well as the specific protection goal that needs to be considered for the individual biological entity.
For the off-field area, indirect effects on non-target arthropods by the loss of off-field host plants have been recognised as important in the ERA of PPPs . Specific protection goals for non-target off-field plants have been suggested by EFSA  which require that they are not affected by the PPPs. If effects are not accepted on non-target off-field plants, then consequently they should not be tolerated on the arthropod community living on them.
For effects on agricultural protection goals
In the ERA of PPP and of GMOs, it is a clear policy goal to avoid the development of resistance in target organisms. Experience from the ERA of GMOs with insect resistance shows that even low risks for target organisms to develop resistance are not accepted and risk mitigation measures are readily proposed, such as Insect-Resistance Management plans for insect-resistant maize . Although the spatial and temporal scope of the resistance development is generally not specified for insect-resistant GMOs, it can be assumed that management measures aim to avoid resistance within the EU territory, and that this requirement is, in principal, temporally not limited.
The respective legislative provisions for the ERA of PPPs and active ingredients require data on the occurrence of resistance or the possibility that target organisms develop resistance [64, 65]. Appropriate risk management strategies are required if resistance development is likely. Whether the resistance risk is deemed acceptable depends on its likelihood to occur and the possible consequences thereof . In principle, the risk is considered acceptable only if a PPP can be used without any condition or restrictions and no avoidance strategy is required . However, management measures can be used to sufficiently reduce the risk of resistance development, such as, e.g. specifications of a good plant protection practice, limiting the number of applications or dose rates and restrictions for the application timing .
When evaluating the risk that weeds develop resistance due to GMHT crop cultivation, the crop needs to be assessed together with the non-selective herbicide and compared to different weed management options currently used . Risk managers decide whether risk mitigation measures are to be applied in order to avoid that weeds develop resistance to the non-selective herbicides. EFSA used risk scenarios for the assessment of glyphosate resistance occurring in GMHT soybean . The relative weed-resistance risk was determined for different crop rotations and weed management options which considered the frequency of glyphosate herbicides applied to the GMHT crop, the adoption of no or reduced tillage systems and crop rotational aspects (see  for details). Such risk scenarios can help to determine which changes in the management regime are considered as acceptable or not and, consequently, to set the LoC.
The acceptability thresholds which have been suggested so far refer solely to the resistance risk of target organisms, but not to potential effects on any other agricultural protection goal.
Aspects to be considered when setting LoCs
Align acceptability thresholds for non-target plants used for PPPs with LoCs for GMHT crops
In the ERA of GMHT crops, thresholds for the acceptability of effects need to be considered for non-target plants in-field and off-field as applied in the ERA of PPPs. Different protection goals apply to these plants in in-field and off-field areas and therefore, different LoCs for in-field and off-field plant populations and weed-related biodiversity are necessary for GMHT crops.
Define different LoCs for species of conservation concern
Species of conservation concern, i.e. rare and endangered species, pose a considerable challenge in the ERA of GMPs. Since rare weed species are not commonly present in arable fields, it is challenging to assess potential adverse effects on them during ERA testing. The field scale level may not be sufficient to detect adverse effects on these species. It has been shown that the loss of less common weed species was not apparent when comparing field sites, but only with an indicator for regional upscaling . In addition, rare and protected species will be underrepresented in any abundance-based selection of surrogate or focal species for ERA purposes .
In the USA, the decline of Monarch butterfly populations has been caused by large reductions of their larval host plant in agricultural areas with intensively grown herbicide-tolerant soybean and corn [82,83,84]. It cannot be ruled out that other reasons such as toxic effects through the consumption of Bt maize pollen and herbicide residues contributed as well. Over a time period of 11 years, host plants in agricultural fields were considerably reduced as well as the egg production of the US Midwest Monarch butterfly population . It generally shows that indirect effects through agricultural practices on individual species, either alone or in combination with other adverse effects, can be severe .
For species of conservation concern, the magnitude of accepted effects should, therefore, be lower than for species which are not protected or endangered (see also ). For PPPs, it has been suggested that no adverse effects should be tolerated for in-field endangered species, also recognising that specific measures will be necessary to reach this protection goal . Adverse effects on rare or threatened arable plants should be avoided to neither deteriorate their population status nor to risk their extinction . The selection of these species should be based on their nomination in the following listings:
Annex II of Council Directive 92/43/EEC on the conservation of natural habitats of wild fauna and flora .
Listings for the national responsibility for the conservation of species .
Listing of declining arable species .
Species of special aesthetic value and representatives of cultural ecosystem services .
Rare and endangered or protected species need to be treated differently from common and widespread in-field plant species and require a different, more conservative LoC in the ERA of GMOs. Even small effects on these species should not be tolerated and will require specific risk mitigation measures. In this context, the responsibility to apply specific management measures to protect rare and endangered or protected species in agricultural fields is with the individual Member States .
Consider the role of the GMHT crop in the crop rotation
Crop rotation significantly affects weed communities and suppresses weed seed densities in comparison to monocultures (see references in ). Traditionally, in many European countries maize, sugar beet and oilseed rape are used as break crop for summer or winter cereals . Break crops are important for sustaining certain weed populations, in particular dicotyledonous weed species, if the crop rotation is dominated by cereals ([92, 93] and references therein). If GMHT crops are used as break crops, dicotyledonous weed species are particularly adversely affected. The British Farm Scale Evaluations have shown that effects of GM maize and GM spring oilseed rape as break crops on the weed seed bank were traceable for at least two seasons after their cultivation . When defining LoCs for effects on weed communities, it is important to consider a GMHT crop’s role in crop rotation, e.g. by applying a more conservative LoC for a GMHT crop that is used as break crop.
Choose a relevant indicator/ecological entity for the ERA before setting LoCs
It is important to choose a relevant indicator for the assessment of potential adverse effects of the GMHT crop on the weed community or higher trophic levels. Kowarik et al.  proposed a range of indicators for this purpose. Experience with GMHT crops from the British Farm Scale Evaluations has shown that the most prominent and significant effect of GMHT crops was on weed biomass [92, 93]. Also plant density and in particular final plant density before harvest were suitable parameters indicating substantial differences in weed management between conventional and GMHT crops. Therefore, in addition to the indicators suggested by Kowarik et al. , further indicators such as the reduction in weed biomass or weed density for assessing effects on in-field plant populations have been proposed .
There is evidence that weedy plants with specific functional traits can be affected by the non-selective herbicides and/or different types of crop management in different ways. For example, in GMHT oilseed rape, dicotyledons were significantly affected by the non-selective herbicide treatment, but monocotyledons not . In addition, reproductive and non-reproductive weed species should be separately assessed, particularly at the end of the growing season, because population numbers of reproductive species indicate whether their seed bank will be sufficiently replenished at the end of the growing season. These aspects would have to be taken into account, if indicators are selected for the ERA and thresholds for the acceptability of effects are defined.
For in-field plants exposed to non-selective herbicides, it is important to consider that actually a specific weed community is the affected entity rather than the plant population of a specific taxon. However, if considering higher trophic levels and food web-related effects, the importance of a particular species may be valued higher than the weed community. This is demonstrated by the weed species Chenopodium album which is an important food resource for the skylark Alauda arvensis [96, 97]. An example from North America is the already mentioned Monarch butterfly, a species which is an obligate herbivore of milkweed species growing on agricultural land . In Europe, 21 lepidopteran associations with weeds were identified and considered at high risk when cultivating GM herbicide-tolerant crops . In particular, monophagous lepidopteran species occurring on weed species that cannot be controlled well by conventional herbicides were predicted to be prone to significant declines if non-selective herbicides were applied .
Similar to weeds, invertebrates respond to GMHT management in different ways depending on what functional group they belong to . Detected adverse effects of GMHT cultivation relate to different taxonomic levels such as orders, genera and species [101,102,103]. For taxa at higher trophic levels (e.g. birds), adverse effects at the population level of a species may be more relevant than for the functional group. In this context, the usefulness of the ecosystem service concept is emphasised, because it allows defining the ecological entity which is to be protected, in accordance with the defined and relevant protection goal . Consequently, a differentiation of the LoC may be necessary according to the ecological entity selected for the risk assessment.
Define weed thresholds before setting LoCs in-field
While for the ERA of PPPs, specific protection goals for off-field non-target plants have been proposed, no such protection goals have been defined for in-field plants . In practice, it will be hardly feasible to differentiate—as proposed by EFSA —non-target plants in the field according to their role as key driver supporting different ecosystem services. A range of plant taxa certainly supports not only a single but also several ecosystem services; therefore, individual ecosystem services may be difficult to address when protecting a particular species. In addition, there are currently no specific requirements to protect in-field non-crop plants according to current EU agricultural policies, leaving room for individual Member States to define the relevant protection level .
In the European Union, IPM (Integrated Pest Management) programmes and strategies have become important due to Directive 2009/128/EC on the sustainable use of pesticides (, Article 1). This Directive aims at the reduction of risks and impacts on human health and the environment due to pesticide use by a range of measures implemented at the national level. It encourages the use of alternative approaches to (i) reduce pesticide use, (ii) monitor pesticides and (iii) prohibit pesticides in sensitive areas. Member States are requested to promote low-pesticide-input management, in particular by implementing the principles of IPM. The IPM principles require monitoring of harmful organisms as well as the use of threshold values for decision making for plant protection measures (see  Annex III). Consequently, a range of countries currently develop or plan to develop crop-specific IPM guidelines .
In arable fields, there is a trade-off between different ecosystem services. If provisioning services such as food, feed, fibre or fuel are maximised, this often comes at the expense of others, namely regulating services (e.g. pollination or biocontrol), supporting services (e.g. soil formation) and cultural services (e.g. recreation). Balancing of the different services is, therefore, inevitable if certain protection goals are to be met [105, 106]. In this respect, weed thresholds could serve as an initial approach. They define the minimum size of weed communities required to sustain the flora and fauna that provide the regulating services.
Supporting certain levels of weed densities does not necessarily result in yield penalties or unacceptable yield reductions [105, 107]. Low-input use of pesticides and herbicides in conventional arable crops has been tested for profitability in different crops in large-scale experiments in the UK [91, 107, 108]). Weed densities at which the control costs, namely herbicide application, equal the economic return, can be calculated on the basis of weed-yield relationships [109, 110]. These specific weed densities or thresholds can then be used as a management tool. Weed–yield relationships differ between crops and locations  as well as cropping systems (e.g. organic and conventional ). Clearly, weed thresholds have to be determined for a particular crop and the specific weed community in a particular environmental and agronomic context.
Consider agricultural protection goals
Potential adverse effects due to the use of non-selective herbicides on agricultural protection goal(s) need to be assessed in the ERA of GMHT crops. Hence, assessment endpoints are required which reflect relevant agricultural protection goals such as the sustainable use of pesticides, reduced inputs of chemical herbicides, or the diversity of crop types within a specific crop rotation. It is important to note that the adverse effect on agricultural protection goals is mediated by a range of weed management decisions and the consequences thereof (e.g. amount and timing of herbicide applications, crop rotation, etc.). Changes in weed management decisions are difficult to assess during the pre-market ERA of GMOs as they involve a comparison with the weed management decisions in conventional crops that differ regionally and temporally throughout the EU. Current herbicide regimes in soybean or maize include the application of pre-emergence and/or post-emergence residual or foliar herbicides [77, 79, 113]. The number of post-emergence herbicide applications in conventional maize ranges from 0.4 to 2.3 depending on the country . The predicted herbicide regimes for GMHT soybean or maize in the EU include two scenarios: the substituted post-emergence herbicide application (see, e.g. substitution scenario in [77, 79]) and the worst-case scenarios with different non-selective herbicide applications combined with residual herbicides [77, 79, 113].
Currently, resistance development is the sole agricultural protection goal considered in the ERA of PPPs and GMOs. Other agricultural protection goals such as crop diversity or reduction of pesticide use are relevant as well, and setting LoCs for potential effects on them should be taken into account, also considering regional differences of the receiving environment. In this context, it has to be kept in mind that some production systems (e.g. organic, IPM) have higher restrictions for applying additional and alternative herbicides and therefore, they are more vulnerable to shifts in the weed flora, e.g. due to resistant weeds.
Example 3: Bt maize
Relevant protection goals to be considered in the ERA of Bt maize
Biodiversity protection goals
Before 2010 species of conservation concern were considered in the ERA of Bt maize by assessing adverse effects on the surrogate species Monarch butterfly which has no relevance for European agro-ecosystems . With its ERA guidance document , EFSA introduced the necessity to consider potentially affected protection goals in the problem formulation of the ERA of GMOs. These protection goals refer to species and habitats listed in Annexes II and IV of the FFH Directive . In 2015, EFSA proposed risk management measures for protected non-target Lepidoptera occurring in protected habitats in the agricultural landscape  and a year later, EFSA also outlined in detail specific aspects of how to consider endangered species when conducting the ERA . Species are considered to be endangered if they are listed on Red Lists (globally, nationally or regionally) or if they are rare .When selecting non-target focal species for the ERA of GMOs, Hilbeck et al.  also recommended considering the legal protection status and the Red List status of the species as well as the national responsibility for their conservation to better address conservation aspects. For field trials, EFSA recognised that in addition to data on focal species, specific data on ecosystem services might be needed .
To operationalise biodiversity protection goals for the ERA of PPPs, EFSA has developed specific guidance using the ecosystem service concept as a conceptual framework . Terrestrial non-target arthropods were identified as key drivers for a range of ecosystem services (e.g. pollination, pest and disease regulation, nutrient cycling, genetic resources and aesthetic values) for which specific protection goal options were defined. As EFSA favours an equal level of protection for agro-ecosystems regardless of the type of stressor and recognises the need for a harmonised approach when considering biodiversity in the ERA of regulated products , these considerations also apply to GMPs. In their recently developed SPG options for ERA schemes, EFSA suggested to use the ecosystem service concept also for the ERA of GMOs . The suggestions specifically address non-target Lepidoptera using the case study of Bt maize 1507. The cultural service was identified as ecosystem service most relevant to Lepidoptera, while other services (e.g. regulating services such as pest regulation or pollination) provided by lepidopteran species were considered less relevant .
Agricultural protection goals
The Biodiversity Action Plan for Agriculture  emphasizes the need to integrate biodiversity and sustainability considerations into agricultural production practices. Some of the priorities are also relevant to insect-resistant GMPs, and in particular Bt maize, such as less agricultural inputs (including PPPs) and the avoidance of resistance development. Both priorities correspond with the European Directive 2009/128/EC on the sustainable use of pesticides which aims at limiting the levels of pesticide use in order not to increase the risk for resistance development in populations of harmful organisms (, Annex III). Another important aim of this Directive is to promote low-pesticide-input pest management, in particular integrated pest management (IPM).
The use of Bt maize may result in resistance development in the target pest or the occurrence of secondary pests. Both may lead to changes in the cultivation, management and harvesting techniques of crop plants . Changes of pest control practices may indirectly affect the environment. Resistance development in target organisms has been identified as a risk in the ERA of Bt maize and led to the adoption of Insect Resistance Management (IRM) plans as a risk mitigation measure to delay the resistance evolution in lepidopteran target organisms when cultivating Bt maize [118, 119]. Avoidance of resistance development is, therefore, not only an important goal of European environmental policies, but also an implicit protection goal in the ERA of GMOs.
While the potential role of GMOs, in particular Bt crops, in integrated pest management is currently being investigated for European agro-ecosystems , it was already questioned in 2001 that Bt crops are at all compatible with IPM systems because they constitutively express and produce insecticidal toxins . Also, experiences gained in the USA with many years of Bt crop cultivation show that a majority of farmers plant Bt maize even at predicted low pest pressure (e.g. corn rootworm or European corn borer), thereby contradicting general IPM principles .
Another protection goal relevant to Bt crops is to limit the use of applied pesticides [35, 74]. Although it is reported that under certain conditions and in certain areas, less conventional pesticides are used with Bt maize compared to conventional maize , assessments of pesticide use in the ERA of Bt crops should be in accordance with relevant protection goals, e.g. pesticide reduction targets, at EU and Member State level. According to Directive 2009/128/EC, Member States need to adopt National Action Plans setting national targets to reduce the risks and impacts of pesticide use on human health and the environment . No aggregated information is available yet on objectives and measures set by EU Member States; however, some of the existing National Action Plans have been criticised for neither being ambitious in reducing reliance on pesticides in agriculture nor being legally binding [124, 125]. In this context, EFSA specifically refers to the consideration of “strategic goals for the adoption of certain pest management regimes (e.g. integrated pest management and biological control)” which could serve as the appropriate basis when comparing risks of GMPs with conventional crops. Whether insecticidal toxins produced in Bt crops count as pesticides [121, 126] is an additional issue in this discussion.
Evaluating thresholds for the acceptability of adverse effects
For effects assessed in laboratory studies
In the ERA of PPPs, biocides and chemical substances, but not GMOs, acceptability thresholds for toxicity/exposure ratios are commonly used as trigger values for lower tier testing (laboratory testing). If trigger values are not exceeded, they generally indicate an acceptable risk, as the predicted environmental exposure of the species is considered to be below the amount of toxin for which effects have been observed in the tests. If trigger values are exceeded, further refinements of the assessment (e.g. of the exposure values) or risk mitigation measures are required. Hence, trigger values constitute risk-based acceptability thresholds, as they indicate an acceptable risk rather than the absence of adverse effects.
There are inconsistencies in EFSA’s ERA guidelines whether the LoC should be defined (a) at the effect level or (b) at the risk level. Ad (a): According to the proposed LoC concept, the observed differences (in effects) between the GMP and its conventional counterpart are compared to the “minimum relevant ecological effect that is deemed biologically significant […]” . This LoC needs to be aligned to the effect size that is desired to be detected by a specific statistical test design . Therefore, the LoC could be considered to be set at the effect level. Ad (b): EFSA also requires that in the risk characterisation each identified risk is estimated and appropriate risk management measures shall be proposed “… where levels of risk exceed threshold levels” . The risk management measures are needed to reduce environmental risks to levels within the LoC (see Figure 4 in ). This indicates that the LoC can also be based at the risk level. It is generally questionable what role LoCs should have for laboratory studies. General shortcomings of applying LoCs for laboratory toxicity testing are outlined by Dolezel et al. . In addition EFSA acknowledges that “standardised methods and models used at tier 1 levels do not measure the specific protection goals directly” . When linking the ERA with specific protection goals, EFSA recommends using a reference tier which is defined as a “sophisticated experimental system or model that is practical for higher-tier use” . Consequently, it can be supposed that defined maximum tolerable effects should not be directly matched with results from testing at lower tiers such as laboratory (toxicity) testing.
For effects assessed in other than laboratory studies
Since 2011 non-target Lepidoptera have been addressed in the ERA of insect-resistant Bt maize lines (MON810, Bt11, 1507) as representatives of biodiversity and ecosystem services. In several of its scientific opinions, EFSA modelled effects on non-target Lepidoptera by Bt maize at local scale, i.e. on larvae within fields and their margins, and at larger scales, i.e. over a landscape and growing season [77, 116, 118, 119, 127,128,129,130]. Conclusions and risk management recommendations refer to two different protection goals: to non-target Lepidoptera occurring within fields and their margins as well as to non-target Lepidoptera of conservation concern occurring in protected habitats. EFSA has provided specific suggestions for acceptable thresholds for non-target Lepidoptera in this context.
As operational thresholds EFSA chose maximum tolerable mortalities of (a) 1% for non-target lepidopteran species not of conservation concern and (b) 0.5% for those which are of conservation concern. EFSA considered 0.5% mortality for group (b) species to be a negligible effect, while the 1% acceptable effect level was considered to be small . EFSA, however, stressed that the thresholds proposed are arbitrary and “… should be subject to amendment according to the protection goals…” .
Aspects to be considered when setting LoCs
Define different LoCs for different spatial areas in agro-environments
As regards the agro-environment, a distinction needs to be drawn between areas designated for crop cultivation (in-field) and the surrounding areas (off-field, see, e.g. ERA of PPPs). The rationale for this is that the in-field and off-field areas are habitats which provide different ecosystem services. Within agricultural fields, trade-offs between production services and other services, e.g. regulating services, are evident. In case of intended off-field measures (e.g. mowing) or unintended effects from the field (e.g. spray drift), some trade-offs are also evident in off-field habitats. In the ERA of PPPs, small–medium effects are tolerable on non-target arthropods in-field, while only negligible effects on these organisms are tolerated off-field .
A similar distinction of the agro-environment has to be drawn when assessing adverse effects of Bt maize on non-target Lepidoptera. In the off-field area, non-target Lepidoptera need to be better protected than in the field where the crop is grown. Although generally few lepidopteran non-target species occur in agricultural fields , thresholds for the acceptability of effects still need to be determined. As with the ERA of PPPs, some effects on non-target organisms might be acceptable in the field but not off-field (see also above). In the ERA of Bt maize, effects on non-target Lepidoptera mostly consider species occurring in field margins and, therefore, off-field habitats. Off-field areas are considered all areas surrounding a field (e.g. hedgerows, grass strips, adjacent field, unmanaged bare land, roads) and can be considered equivalent to field margins as defined by Roy et al.  and referred to by EFSA for the ERA of GMOs . Against this background and to harmonise protection goals for ERA purposes as required by EFSA, effects by GM crops on non-target lepidopteran species in off-field areas need to be small to negligible. Clearly, for endangered or protected Lepidoptera occurring in protected sites or biodiversity hotspots within the agro-environment [133,134,135], no additional adverse effects due to Bt maize cultivation should be tolerated at all (see also ).
Consider exposure-based LoCs for non-target Lepidoptera
Adverse effects of Bt maize on Lepidoptera are mediated via ingestion of the pollen by larval stages. The exposure of lepidopteran larvae, e.g. in field margins, to Bt maize is a suitable indicator for ERA purposes, as it directly links the potential for adverse effects with the relevant protection goal. The larval stage is the relevant entity on which the potential stressor operates . Standardised methodologies for the assessment and the monitoring of lepidopteran larvae have been developed and tested for practicality [136,137,138]. Methods are also available for assessing and monitoring Bt maize pollen deposition on leaves of lepidopteran host plants [139,140,141].
Assessing the exposure of lepidopteran larvae to Bt maize pollen means that acceptability thresholds are defined at the exposure rather than at the effect or risk level. Similarly, in the regulation of ambient air pollutants, acceptability thresholds for adverse effects are defined either based on emission values or atmospheric input values [142, 143]. For example, critical loads of air pollutants are set as ecological limits for the input of atmospheric pollutants into a particular ecosystem. No adverse effects on the ecosystem are expected as long as the critical load is not exceeded (see Annex I of Gothenburg-Protocol and ). Exposure levels are defined as “critical levels” when they exceed levels above which adverse effects may occur on certain environmental receptors, such as trees, other plants or natural ecosystems . Importantly, recommendations for critical load and critical level values for ambient air quality are based on well-established scientific knowledge such as physiological and ecological effects of nitrogen-containing pollutants on the most sensitive type of vegetation or ecosystem . Hence, LoCs for Bt maize could also be set as exposure-based acceptability thresholds if Bt maize pollen is used as an exposure-based indicator.
EFSA’s scientific opinion on Bt maize 1507 provides an example for an exposure-based threshold for Bt maize pollen . If maize 1507 is cultivated on less than 5% of the farmed agricultural area, then the mortality for lepidopteran species was calculated to fall below an acceptability threshold of 1% and no risk management measures were required (Fig. 3a).
Another possibility is to define the maximum deposition of Bt maize pollen on host plants in field margins at anthesis that can be tolerated without entailing adverse effects on the larvae. It requires that dose–effect relationships of Bt maize pollen on non-target Lepidoptera are known and that worst-case pollen depositions are taken into account. The dose–effect relationships should be species- and toxin specific and consider that the toxin content in the pollen of Bt maize events can vary just as the sensitivity of non-target lepidopteran larvae. The hereof calculated maximum pollen deposition which does not harm non-target Lepidoptera constitutes a LoC at the exposure level for a specific Bt maize event (Fig. 3b).
Although controversially discussed, data on pollen deposition of Bt maize and on larval food plants under field conditions are available [141, 145,146,147,148,149,150]. Also, dose–effect relationships for lepidopteran larvae with different sensitivities to the respective Bt toxin from laboratory studies have been reported [118, 151,152,153,154]. It is important to notice that these relationships are based on mortalities observed under laboratory conditions. Assessment factors will, therefore, be needed to cover uncertainties, e.g. due to the extrapolation of results from the lab to the field, between species, or due to varying Bt toxin expression in pollen in different environments.
Consider the status of receiving environments when setting LoCs
The receiving environment and its specific biological and non-biological features may also have an impact on effects of GMPs. While this aspect is exemplified for Bt maize, it is also relevant for GM oilseed rape or other GM crops. According to EFSA, the acceptability of effects might be far less in a landscape with low non-target arthropod diversity than in a landscape supporting a high non-target arthropod diversity . It is known that biodiversity levels vary considerably across European agricultural landscapes. Differences in habitat quality and habitat features in agro-environments affect species richness and abundance of butterflies [155, 156]. Species diversity of butterflies depends on the level of agricultural intensity  as well as on landscape context . These circumstances are reflected by the geographically diverging species richness of European butterflies and by the unequal distribution of threatened and endemic butterfly species across Europe .
Therefore, also the natural fluctuations of lepidopteran populations need to be considered in a particular environment. Significant declines in European butterfly populations have been recorded over the last 25 years, mainly due to changes in land use including agricultural intensification . The latter comes along with extensive chemical inputs such as insecticides and fungicides causing negative effects on European farmland biodiversity . Considering natural fluctuations for a LoC requires defining what is the minimum environmental quality or the minimum population size to be preserved in a specific receiving environment. In this context, it is important to note that acceptability thresholds for adverse effects due to GMPs may also depend on the individual status of a population in a specific receiving environment. If a population has already declined, this may influence decisions on the acceptability of any further pressure on this population through additional stressors. In cases the reduction of a population (or its cause) is on-going, is not understood or is irreversible, a further reduction in the population size is practically unacceptable . Consequently, it is necessary to define a specific environmental context, e.g. the level of biodiversity and the causes for its current status in the respective agro-ecosystem, to put the acceptability thresholds for additional adverse effects into context. However, tolerating additional impacts by GMP cultivation in environments with comparably higher biodiversity levels would still contribute to an overall reduction in biodiversity; it must be avoided and considered when setting LoCs.
Conclusions and outlook
The issue of what constitutes environmental harm when cultivating GMP is closely linked with the question of what should be protected in European agro-ecosystems. The integration of protection goals into the environmental risk assessment carried out for stressors in the agro-environment such as GMPs is a novel feature, and the operationalisation for ERA purposes poses still unsolved challenges. The European Food Safety Authority proposed two approaches on how to operationalise protection goals in the ERA: the LoC approach and the ecosystem service approach. Both are useful but they need further specifications to be fit for purpose. In addition, overlaps between them will have to be clarified to harmonise the protection level for common protection goals in agro-environments. For example, also, the ecosystem service concept provides the opportunity to include thresholds for the acceptability of adverse effects. A major challenge is to define the relevant effect categories (e.g. negligible, small, medium, large) which are used when defining the maximum tolerable effect for a specific protection goal and align them among the two approaches. This step shall ensure that protection levels are comparable for similar protection goals for both concepts. The classification of effect categories should be transparent and relate to the specific protection goal in question.
In this context, it is important to note that the respective legislative acts for the protection and conservation of agricultural biodiversity lack some essential specifications: They do (i) neither provide benchmarks for biodiversity in arable production systems, (ii) nor define what constitutes a “good ecological status”, (iii) nor determine what environmental quality should be preserved in dynamic and resilient agro-ecosystems. In addition, knowledge of the essential ecological processes relevant to a particular ecosystem service is limited . Although it has been generally postulated that any minimum level of biodiversity to sustain certain ecosystem functions can be maintained by a certain set of functionally distinct species , knowledge is incomplete on which and how many species and functions are actually necessary to sustain a certain ecosystem service.
When setting LoC, the regional level of farmland biodiversity in the receiving environment should be considered. This relates, if existing, e.g. to diverse field margins and natural landscape elements, the regional crop diversity and alternative food sources for higher trophic levels, since these components influence the likely magnitude of impacts on biodiversity in agricultural landscapes. Because biodiversity in agricultural landscapes as well as crop management systems highly vary across Europe, any decision on the acceptability of adverse impacts during the EU-wide ERA should consider worst-case scenarios. If adverse impacts in receiving environments with poor biodiversity are not accepted, and this forms the benchmark, then they are also not tolerated in receiving environments with a rich or more diverse biodiversity. This kind of approach would safeguard the prevention of further biodiversity losses in European agro-ecosystems.
The proposed ecosystem service concept for the ERA cannot be applied in a general manner, but requires considering different protection goals at several levels. For example, in-field and off-field habitats in the agro-environment are subject to different protection goals. Also different protection levels are assigned to biological entities, functions and processes occurring in various spatial areas of the agricultural landscape as they provide different ecosystem services. It has been acknowledged that effects outside the crop production area should not exceed negligible effects, although a specification of this effect class has still to be made for different ecological entities, functions and ecosystem services. In contrast, provisioning services in the field are often valued higher at the expense of other ecosystem services, e.g. regulating services. If the “safe ecological limits” of these other services have already been reached, needs to be assessed case-by-case for a specific stressor in a defined receiving environment. Species of conservation concern which occur in the agro-environment or within agricultural fields are difficult to assess during the ERA; however, they need higher protection levels than common and widespread species.
In contrast to biodiversity protection goals, agricultural protection goals have so far not been largely addressed in the ERA of GMPs although they are specifically outlined in the corresponding EFSA guidance documents. For insect-resistant and herbicide-tolerant GMPs, it is a relevant agricultural protection goal to avoid the development of resistant target organisms. For this protection goal, acceptability thresholds have already been implicitly set in the ERA of those kinds of GMPs, and risk management measures have already been required. In the future, defining LoCs for agricultural protection goals will necessitate additional specifications, e.g. with respect to the particular crop rotation or the relevant crop production type to be used as a baseline for the comparison with the GMO. By now, the ERA needs to account for a sustainable use of pesticides, e.g. by defining LoCs for changes in pesticide and herbicide application when cultivating GM crops. If available, national targets for pesticide use can facilitate the setting of acceptability thresholds for the use of non-selective herbicides when cultivating GM crops.
LoCs for GM oilseed rape
In the ERA of GMOs, natural processes such as cross-pollination and hybridisation of GM oilseed rape with wild relatives or spread and establishment of GM plants in natural habitats are currently not considered adverse for the environment. However, these processes may compromise biodiversity as well as agricultural protection goals. The current risk assessment provisions are based on the evidence of impacts on biodiversity due to GM oilseed rape cultivation which is in analogy with the risk assessment of invasive alien species. However, control and eradication measures are hardly promising, once GM oilseed rape has established in the environment and threats to biodiversity are evident. Due to the ability of GM oilseed rape to independently spread and to build up soil seed reservoirs, post approval management measures, such as control of feral oilseed rape, are unlikely to succeed in the long term.
Hybridisation of GM oilseed rape with compatible wild relatives can constitute an unacceptable adverse effect if these are of conservation concern. Also, the conservation of plant genetic resources, comprising landraces, conservation varieties as well as crop–wild species, are specific agricultural protection goals, for which cross-pollination with GM oilseed rape may be unacceptable. So far, these agricultural protection goals have not been recognised in the ERA of GM oilseed rape.
Consequently, it is necessary to specify the genetic constitution of species and varieties which are able to cross-pollinate with GM oilseed rape to justify any decisions on the acceptance or non-acceptance of gene flow and hybridisation between them. Case-by-case evaluations have to clarify whether the specific conservation goals of natural habitats of conservation concern are put at risk in case GM oilseed rape spreads and establishes.
It also needs to be considered that once GM oilseed rape is approved for cultivation, hybridisation with compatible relatives, spread into and establishment in certain habitat types will occur by chance to both, protected and unprotected species and habitats. If cross-pollination and hybridisation with protected species and the occurrence or establishment of GM oilseed rape in habitats of conservation concern are considered unacceptable, then specific management measures need to be set up (e.g. the removal of the plants from the habitat). Otherwise, no such management measures will be required. In practice, however, it will be difficult to apply and manage different LoCs for species and habitats with different conservation status.
LoCs for GMHT crops
The assessment of environmental risks of GMHT crops is covered by two distinct ERA requirements—for the GMO and for the related PPP to be used with the GMHT crop. Adverse effects of GMHT crops are mediated by the non-selective herbicide applied with the GMHT crop. Therefore, it is important to consider the GMHT crop together with its non-selective herbicide when discussing LoCs, in particular if protection goals related to biodiversity and ecosystem services are to be harmonised among different stressors in agro-environments, as intended by EFSA .
Weed communities play a crucial role in the assessment of adverse effects of the cultivation of GMHT crops and their weed management. In the context of the ERA of PPPs, EFSA has provided guidance for the definition of acceptable effects for weeds and non-target plants in-field and off-field. In the crop production area, there is a need for balancing different ecosystem services, such as food production and other ecosystem services. Recently, Milner and Boyd suggested a system of risk-based pesticide use to make trade-offs between environmental costs and food production more explicit; it would require, inter alia, knowledge on pesticide residues in the environment as well as setting safe environmental limits for pesticide use . At smaller scales, it has been shown that such trade-offs are manageable by the ecosystem service approach . Recognising that weeds are important drivers of ecosystem services also in-field, minimum levels of weed biodiversity in different crops and in different receiving environments still have to be defined to sustain the related ecosystem services. In this context, the application of weed thresholds is a useful tool to define thresholds for the acceptability of effects on weeds in agricultural fields. Consequently, LoCs for effects on higher trophic levels (e.g. arthropods or birds) in-field must be aligned to acceptability thresholds for weeds in-field, but also need to consider that the knowledge on quantitative links between weeds and higher trophic levels is largely limited . In contrast to the obviously needed balancing of ecosystem services in the field, it is evident that off-field effects of herbicides used with GMHT crops need to be largely avoided.
LoCs for Bt maize
For the ERA of Bt maize, non-target butterflies are considered important representatives of biodiversity, but they have also been attributed important ecosystem services. When assessing adverse effects on non-target Lepidoptera in laboratory studies, discrepancies are evident regarding the application of effect-based and risk-based acceptability thresholds. Using LoCs based on the exposure of non-target lepidopteran larvae to Bt maize pollen is a practical way to operationalise the LoC concept in the ERA of Bt maize. However, scrutiny will be needed whether LoCs for non-target Lepidoptera need differentiation depending on the larval stage, species, and population affected. In addition, protection levels for lepidopteran species occurring in agro-ecosystems and the relevant spatial and temporal scales need to be harmonised among the ERAs of different stressors and linked to protection goals relevant to non-target Lepidoptera.
High protection levels and low acceptability thresholds are recommended when introducing GM plants in European agricultural production systems to preserve their agro-biodiversity. When defining LoCs, it has to be considered that current agricultural practices are already compromising terrestrial and aquatic agro-biodiversity [166, 167] and, at the same time, they serve as a comparator for the evaluation of potential adverse effects due to GMO cultivation. Consequently, additional impacts on biodiversity due to GMP cultivation must not be considered acceptable in order not to further accept declines of biodiversity and ecosystem services in European agro-ecosystems.
In 2013, the German Federal Agency for Nature Conservation commissioned the project ‘Limits of Concern for the Risk Assessment of GM plants’. The overall aim of this project was to critically evaluate the concept of Limits of Concern introduced by EFSA for its practical implementation in GMO risk assessment. A general appraisal of the concept and proposals for improvements of the general concept for use in ERA practice has been made . Another aim of the project was to discuss the use of the LoC concept for specific types of GMOs.
Three different types of GMOs were used to evaluate the concept of Limits of Concern for three areas of risk which have to be assessed during the ERA of GMOs, as proposed by EFSA . Using examples of GM oilseed rape, herbicide-tolerant GM crops and insect-resistant Bt maize, different aspects relating to the setting of LoCs were evaluated. The evaluations were based on the conceptual framework for the assessment of ecological damage for GM crops by Kowarik et al. . The authors suggested a methodology for assessing ecological damage due to GMO cultivation, considering not only the potential adverse effect by the GMO, but also taking possibly affected protection goals into account .
In general, we evaluated EFSA guidance documents and scientific opinions for the ERA of GMOs. In addition, we consulted provisions from other regulatory areas, such as invasive alien species (for GM oilseed rape), PPPs (for herbicide-tolerant crops and Bt maize) as well as ambient air quality (for Bt maize). This was done with a view to find out whether they contain thresholds for the acceptability of environmental effects or risks which could also be relevant to GMO risk assessment.
GM oilseed rape was chosen to represent the risk area “persistence and invasiveness including plant-to-plant gene flow” according to the ERA requirements . For setting LoC for this risk area, the specific GM trait is of minor relevance, as here the important aspect is the plant’s ability to hybridise with wild relatives and establish outside cultivated areas. However, considering a specific GM trait may change the potential for an adverse effect and would have to be considered separately and case-specifically. Legislative provisions regarding the ERA of invasive alien species were analysed to evaluate environmental harm thresholds for organisms that are able to spread and establish in different environmental compartments.
GM herbicide-tolerant (GMHT) plants were selected to represent the risk area “impacts of the specific cultivation, management and harvesting techniques”. In this case, the specific crop type is of minor relevance as the focus is on the potential adverse effect due to the non-selective herbicide on weeds as target organisms. For this purpose, the provisions of two different authorization regimes were considered: (i) Directive 2001/18/EC and its Annexes which require the assessment of impacts due to the specific cultivation, management and harvesting regime and (ii) Regulation (EC) No. 1107/2009 which applies for placing of plant protection products on the market [1, 168]. Aspects from the latter regulation and related documents were addressed, in case they were considered relevant to the assessment of potential adverse effects of the combined use of GMHT crops and the corresponding herbicides on weed communities and related biodiversity.
Insect-resistant (Bt) maize was chosen for the risk area “interactions of the GMP with non-target organisms” . For this case study, the potential effects of Bt maize on non-target Lepidoptera were addressed. Existing EFSA guidance documents and opinions were analysed regarding suggestions for acceptability thresholds for non-target organisms, and specifically, non-target Lepidoptera. Also, legislative provisions for the regulation of ambient air quality were drawn on as an example for exposure-based acceptability thresholds.
The project benefited from three workshops conducted in 2015 for each type of GMO and each area of risk, with experts having relevant knowledge in, e.g. weed ecology, ecotoxicology of Bt maize, herbicide tolerance or ecology of invasive alien species. During the workshops options were discussed how to define LoCs for each particular case study.
In this article, we analyse the LoC concept for three different types of GMO intended for cultivation: GM oilseed rape, GM herbicide-tolerant crops and insect-resistant Bt maize. In the “Results and discussion” section, the following questions are addressed for each type of GMO in individual subchapters:
Which protection goals are relevant to the specific GMO and area of risk?
Have thresholds already been proposed for the acceptability of adverse effects or risks relevant to the GMO?
Which aspects have to be taken into consideration when setting LoCs for the specific GMO in question?
European Food Safety Authority
environmental risk assessment
genetically modified organism
genetically modified plant
integrated pest management
Limits of Concern
plant protection product
specific protection goal
invasive alien species
Directive 2001/18/EC of the European Parliament and of the Council of 12 March 2001 on the deliberate release into the environment of genetically modified organisms and repealing Council Directive 90/220/EEC. OJ L 106:1–39
Regulation (EC) No 1829/2003 of the European Parliament and of the Council of 22 September 2003 on genetically modified food and feed. OJ L 268:1–23
Commission Implementing Regulation (EU) No 503/2013 of 3 April 2013 on applications for authorisation of genetically modified food and feed in accordance with Regulation (EC) No 1829/2003 of the European Parliament and of the Council and amending Commission Regulations (EC) No 641/2004 and (EC) No 1981/2006. OJ L 157:1–48
Commission Decision of 24 July 2002 establishing guidance notes supplementing Annex II to Directive 2001/18/EC of the European Parliament and of the Council on the deliberate release into the environment of genetically modified organisms and repealing Council Directive 90/220/EEC. (notified under document number C(2002) 2715) (2002/623/EC) OJ L 200:22–33
Commission Directive (EU) 2018/350 of 8 March 2018 amending Directive 2001/18/EC of the European Parliament and of the Council as regards the environmental risk assessment of genetically modified organisms. OJ L 67:30–45
EFSA (2010) Guidance on the environmental risk assessment of genetically modified plants. EFSA J 8(11):1879
EFSA (2010) Scientific Opinion on the risk assessment of potential impacts of genetically modified plants on non-target organisms. EFSA J 8(11):1877
EFSA (2010) Statistical considerations for the safety evaluation of GMOs. EFSA J 8(1):1250
EFSA (2011) Guidance on selection of comparators for the risk assessment of genetically modified plants and derived food and feed. EFSA J 9(5):2149
Kowarik I, Bartz R, Heink U (2008) Bewertung ‘ökologsicher Schäden’ infolge des Anbaus von gentechnisch veränderten Organismen (GVO) in der Landwirtschaft. Naturschutz und Biologische Vielfalt. Heft 56. Bundesamt für Naturschutz. Bonn - Bad Godesberg
Heink U, Bartz R, Kowarik I (2012) How useful are the concepts of familiarity, biological integrity, and ecosystem health for evaluating damages by GM crops? J Agric Environ Ethics 25:3–17
EFSA (2010) Scientific opinion on the development of specific protection goal options for environmental risk assessment of pesticides, in particular in relation to the revision of the Guidance Documents on Aquatic and Terrestrial Ecotoxicology (SANCO/3268/2001 and SANCO/10329/2002). EFSA J 8(10):1821
EFSA (2016) Guidance to develop specific protection goal options for environmental risk assessment at EFSA, in relation to biodiversity and ecosystem services. Scientific Committee. EFSA J 14(6):4499
Gilioli G, Schrader G, Baker RHA, Ceglarska E, Kertész VK, Lövei G, Navajas M, Rossi V, Tramontini S, van Lenteren JC (2014) Environmental risk assessment for plant pests: a procedure to evaluate their impacts on ecosystem services. Sci Total Environ 468–469:475–486
EFSA (2016) Scientific opinion on coverage of endangered species in environmental risk assessments at EFSA. EFSA J 14(2):4312
EFSA (2016) Recovery in environmental risk assessments at EFSA. EFSA J 14(2):4313
Essl F, Nehring S, Klingenstein F, Milasowszky N, Nowack C, Rabitsch W (2011) Review of risk assessment systems of IAS in Europe and introducing the German-Austrian Black List Information System (GABLIS). J Nat Conserv 19:339–350
Blackburn TM, Essl F, Evans T, Hulme PE, Jeschke JM, Kühn I, Kumschick S, Marková Z, Mrugala A, Pergl J, Pysek P, Rabitsch W, Ricciardi A, Richardson DM, Sendek A, Vilà M, Wilson JRU, Winter M, Genovesi P, Bacher S (2014) A unified classification of alien species based on the magnitude of their environmental impacts. PLoS Biol 12(5):e1001850
Winfree R, Reilly JR, Bartomeus I, Cariveau DP, Williams NM, Gibbs J (2018) Species turnover promotes the importance of bee diversity for crop pollination at regional scales. Science 359(6377):791–793
Oliver TH (2016) How much biodiversity loss is too much? Science 353(6296):220–221
Steffen W, Richardson K, Rockström J, Cornell SE, Fetzer I, Bennett EM, Biggs R, Carpenter SR, de Vries W, de Wit CA, Folke C, Gerten D, Heinke J, Mace GM, Persson LM, Ramanathan V, Reyers B, Sörlin S, Sörlin S (2016) Planetary boundaries: guiding human development on a changing planet. Science. https://doi.org/10.1126/science.1259855
Dolezel M, Miklau M, Heissenberger A, Reichenbecher W (2017) Are Limits of Concern a useful concept to improve the environmental risk assessment of GM pants? Environ Sci Eur 29:7
EFSA (2010) Scientific opinion on statistical considerations for the safety evaluation of GMOs. EFSA J 8(1):1250
Perry J, Ter Braak CJF, Dixon PM, Duan J, Hails R, Huesken A, Lavielle M, Marvier M, Scardi M, Schmidt K, Tothmeresz B, Schaarschmidt F, van der Voet H (2009) Statistical aspects of environmental risk assessment of GM plants for effects on non-target organisms. Environ Biosafety Res 8:65–78
EFSA (2011) Statistical significance and biological relevance. EFSA J 9(9):2372
Pascher K, Gollmann G (1997) Ökologische Risikoabschätzung von Freisetzungen gentechnisch veränderter Organismen für die spezielle Situation in Österreich. Forschungsbericht 4/97. Bundesministerium für Gesundheit und Konsumentenschutz, Wien
Council Directive 92/43/EEC of 21 May 1992 on the conservation of natural habitats and of wild fauna and flora. OJ L 206:7–50
Adler W (1994) Exkursionsflora von Österreich. Eugen Ulmer, Stuttgart und Wien
Breckling B, Menzel G (2005) Gentechnisch veränderter, herbizidresistenter Raps. Natur und Landschaft. 7:316–319
Gruttke H, Ludwig G, Schnittler M, Binot-Hafke M, Fritzlar F, Kuhn J, Assmann T, Brunken H, Denz O, Detzel P, Henle K, Kuhlmann M, Laufer H, Matern A, Meinig H, Müller-Motzfeld G, Schütz P, Voith J, Welk E (2004) Memorandum: Verantwortlichkeit Deutschlands für die weltweite Erhaltung von Arten. In: Gruttke H (ed) Ermittlung der Verantwortlichkeit für die Erhaltung mitteleuropäischer Arten. Naturschutz und Biologische Vielfalt. Heft 8. Bundesamt für Naturschutz, Bonn – Bad Godesberg
Gruttke H, Ludwig G (2004) Konzept zur Ermittlung der Verantwortlichkeit für die weltweite Erhaltung von Arten mit Vorkommen in Mitteleuropa: Neuerungen, Präzisierungen und Anwendungen. Natur und Landschaft 79(6):271–275
Ludwig G, May R, Otto C (2007) Verantwortlichkeit Deutschlands für die weltweite Erhaltung der Farn- und Blütenpflanzen. BfN Skripten, Band 220. Bundesamt für Naturschutz, Bonn - Bad Godesberg
Bilz M, Kell SP, Maxted N, Landsdown RV (2011) European Red List of vascular plants. Chapter 4: Crop wild relatives—species selection and results. Publications Office of the European Union. Luxembourg. https://portals.iucn.org/library/sites/library/files/documents/RL-4-016.pdf. Accessed 22 Nov 2016
Hammer K, Khoshbakht K (2005) Towards a ‘red list’ for crop plant species. Genet Resour Crop Evol 52(3):249–265
EC (2001) Biodiversity Action Plan for Agriculture. Communication from the Commission to the Council and the European Parliament. COM(2001)162 final
CBD (1992) Convention on biological diversity. https://bch.cbd.int. Accessed 28 Sept 2016
CBD (2011) updated global strategy for plant conservation 2011–2020. https://www.cbd.int. Accessed 28 Sept 2016
FAO (2001) International treaty on plant genetic resources for food and agriculture. http://www.fao.org/plant-treaty/en/. Accessed 22 Nov 2016
Veteläinen M, Negri V, Maxted N (2009) European landraces on farm conservation, management and use. Biodiversity Technical Bulletin No. 15, Biodiversity International. Rome, Italy
Commission Directive 2008/62/EC of 20 June 2008 providing for certain derogations for acceptance of agricultural landraces and varieties which are naturally adapted to the local and regional conditions and threatened by genetic erosion and for marketing of seed and seed potatoes of those landraces and varieties. OJ L 162:13–19
Negri V, Maxted N, Veteläinen M (2009) European landrace conservation: an introduction. In: Veteläinen M, Negri V, Maxted N (eds) European landraces on farm conservation, management and use. Biodiversity International, Rome, Italy. http://www.biodiversityinternational.org. Accessed 20 June 2017
Pascher K, Dolezel M (2005) Koexistenz von gentechnisch veränderten, konventionellen und biologisch angebauten Kulturpflanzen in der österreichischen Landwirtschaft.. Forschungsbericht der Sektion IV. Band 2/2005. Bundesministerium für Gesundheit und Frauen, Wien
Traxler A, Minarz E, Englisch T, Fink B, Zechmeister H, Essl F (2005) Rote Liste der gefährdeten Biotoptypen Österreichs: Moore, Sümpfe und Quellfluren; Hochgebirgsrasen, Polsterfluren, Rasenfragmente und Schneeböden; Äcker, Ackerraine. Weingärten und Ruderalfluren; Zwergstrauchheiden; Geomorphologisch geprägte Biotoptypen, Umweltbundesamt
Finck P, Heinze S, Raths U, Riecken U, Ssymank A (2017) Rote Liste der gefährdeten Biotoptypen Deutschlands. Naturschutz und Biologische Vielfalt. Heft 156. Bundesamt für Naturschutz, Bonn - Bad Godesberg
Sukopp U, Sukopp H (1993) Das Modell der Einführung und Einbürgerung nicht einheimischer Arten. Ein Beitrag zur Diskussion über die Freisetzung gentechnisch veränderter Kulturpflanzen. GAIA 2(5):267–288
Regulation (EU) No 1143/2014 of the European Parliament and of the Council of 22 October 2014 on the prevention and management of the introduction and spread of invasive alien species. OJ L 317:35–55
Nehring S, Hesse K-J (2008) Invasive alien plants in marine protected areas: the Spartina anglica affair in the European Wadden Sea. Biol Invasions 10:937–950
Pardo G, Fuertes S, Fernández-Cavada S, Betrán E, Cirujeda A, Marí AI, Aibar J, Zaragoza C, Perdiguer A, Llenes JM, Montull JM, Taberner A (2015) Presencia de teosinte (Zea spp.) como mala hierba en los regadíos del valle del Ebro. In: XV Congreso de la Sociedad Española de Malherbología: La Malherbología y la Transferencia tecnológica: Sevilla, 19–22 Oct 2015. pp 417–424
Pardo G, Cirujeda A, Marí AI, Albar J, Fuertes S, Taberner A (2016) El teosinte: descripción, situación actual en el valle del Ebro y resultados de los primeros ensayos. Vida Rural 408:42–48
Trtikova M, Lohn A, Binimelis R, Chapela I, Oehen B, Zemp N, Widmer A, Hilbeck A (2017) Teosinte in Europe—searching for the origin of a novel weed. Sci Rep 7:1560. https://doi.org/10.1038/s41598-017-01478-w
Devos Y, Ortiz-Garcia S, Hokanson KE, Raybould A (2018) Teosinte and maize × teosinte hybrid plants in Europe—Environmental risk assessment and management implications for genetically modified maize. Agric Ecosyst Environ 259:19–27
Veitch CR, Clout MN (2002) Turning the tide: the eradication of invasive species. In: Veitch CR, Clout MN (eds) Proceedings of the international conference on eradication of island invasives. Occasional Paper of the IUCN Species Survival Commission No. 27
Pascher K, Narendja F, Rau D (2006) Feral oilseed rape—investigations on its potential for hybridisation. Bundesministerium für Gesundheit und Frauen, Sektion IV
Pascher K, Macalka S, Rau D, Gollmann G, Reiner H, Glössl J, Grabherr G (2010) Molecular differentiation of commercial varieties and feral populations of oilseed rape (Brassica napus L.). BMC Evol Biol. https://doi.org/10.1186/1471-2148-10-63
Breckling B, Menzel G (2004) Self-organised pattern in oilseed rape distribution—an issue to be considered in risk analysis. In: Breckling B, Verhoeven R (eds) Risk hazard damage: specification of criteria to assess environmental impact of genetically modified organisms. Naturschutz und Biologische Vielfalt. Heft 1. Bundesamt für Naturschutz, Bonn-Bad Godesberg
Crawley MJ, Brown SL (2004) Spatially structured population dynamics in feral oilseed rape. Proc R Soc Lond B Biol Sci 271(1551):1909–1916
Claessen D, Gilligan CA, Van den Bosch F (2005) Which traits promote persistence of feral GM crops? Part 2: implications of metapopulation structure. Oikos 110(1):30
Claessen D, Gilligan CA, Lutman PJW, Van den Bosch F (2005) Which traits promote persistence of feral GM crops? Part 1: implications of environmental stochasticity. Oikos 110(1):20
Lutman PJW, Berry K, Payne RW, Simpson E, Sweet JB, Champion GT, May MJ, Wightman P, Walker K, Lainsbury M (2005) An update on the persistence of seeds from crops of conventional and herbicide tolerant oilseed rape (Brassica napus). In: Messéan A (ed) Proceedings of the Second International Conference on Co-Existence between GM and non-GM based agricultural supply chains. Montpellier, France
Sanvido O, Romeis J, Gathmann A, Gielkens M, Raybould A, Bigler F (2012) Evaluating environmental risks of genetically modified crops: ecological harm criteria for regulatory decision-making. Environ Sci Policy 15:82–91
EFSA (2014) Scientific Opinion addressing the state of the science on risk assessment of plant protection products for non-target terrestrial plants. EFSA J 12(7):3800
Hawes C, Haughton AJ, Osborne JL, Roy DB, Clark SJ, Perry J, Rothery P, Bohan DA, Brooks DR, Champion GT, Dewar AJG, Roy DB, Woiwod IP, Daniels MJ, Young JEB, Parish AM, Scott RJ, Firbank G, Squire GR (2003) Responses of plants and invertebrate trophic groups to contrasting herbicide regimes in the Farm Scale Evaluations of genetically modified herbicide-tolerant crops. Phil Trans R Soc Lond B 358:1899–1913
Ruby T, Rana SA, Rana N, Inayat TP, Siddiqui MJI, Abbas MN (2011) Weeds as viable habitat for arthropod species in croplands of central Punjab. Pak J Agri Sci. 48(2):145–152
Regulation (EU) No 283/2013 of 1 March 2013 setting out the data requirements for active substances, in accordance with Regulation (EC) No 1107/2009 of the European Parliament and of the Council concerning the placing of plant protection products on the market. OJ L 93:1–84
Regulation (EU) No 284/2013 of 1 March 2013 setting out the data requirements for plant protection products, in accordance with Regulation (EC) No 1107/2009 of the European Parliament and of the Council concerning the placing of plant protection products on the market. OJ L 93:85–152
Elias P, Elias P, Baranec T (2005) The new red list of Slovak endangered weeds. International Scientific Conferences on Threatened Weedy Plant Species, Slovak University of Agriculture, Nitra, Sept 20-21, 2005
Bomanovska A (2010) Threat to arable weeds in Poland in the light of national and regional Red Lists. Plant Breed Seed Sci 61:55–74
Traxler A, Minarz E, Höttinger H, Pennerstorfer J, Schmatzberger A, Banko G, Placer K, Hadrobolec M, Gaugitsch H (2005) Biodiversitäts-Hotspots der Agrarlandschaft als Eckpfeiler für Risikoabschätzung und Monitoring von GVO. Bundesministerium für Gesundheit und Frauen, Wien
Byfield AJ, Wilson PJ (2005) Important arable plant areas: identifying priority sites for arable plant conservation in the United Kingdom. Plantlife International. https://www.plantlife.org.uk/uk/discover-wild-plants-nature/habitats/arable-farmland/important-arable-plant-areas. Accessed 26 Jan 2016
Meyer S, Hilbig W, Steffen K, Schuch S (2013) Ackerwildkrautschutz—Eine Bibliographie. BfN Skripten. Band 351. Bundesamt für Naturschutz, Bonn, Bad Godesberg
van Elsen T, Loritz H (2013) Vielfalt aus der Samentüte? Naturschutz und Landschaftsplanung. 45(5):155–160
Meyer S, Leuschner C (2015) 100 Äcker für die Vielfalt. Universitätsverlag Goettingen, Initiativen zur Förderung der Ackerwildkrautflora in Deutschland
Van Elsen T, Berg M, Drenckhahn D, Dunkel F-G, Eggers T, Garve E, Kaiser B, Marquart H, Pilotek D, Rodi D, Wicke G (2006) Karlstadter Positionspapier zum Schutz der Ackerwildkräuter. Zeitschrift für Pflanzenkrankheiten und Pflanzenschutz, Sonderheft XX:527–533
Directive 2009/128/EC of the European Parliament and of the Council of 21 October 2009 establishing a framework for Community action to achieve the sustainable use of pesticides. OJ L 309:71–86
Umweltbundesamt (2015) Protection of Biodiversity in the Risk Assessment and Risk Management of Pesticides (Plant Protection Products and Biocides) with a focus on arthropods, soil organisms and amphibian. Texte 76/2015, Umweltbundesamt Dessau-Roßlau, Germany
Alix A, Bakker F, Barrett K, Brühl CA, Coulson M, Hoy S, Jansen JP, Jepson P, Lewis G, Neumann P, Süßenbach D, van Vliet P (eds) (2010) ESCORT 3: Linking non-target arthropod testing and risk assessment with protection goals. Hotel Zuiderduin, The Netherlands, 8–11th March 2010, Society of Environmental Toxicology and Chemistry (SETAC), USA
EFSA (2012) Scientific Opinion supplementing the conclusions of the environmental risk assessment and risk management recommendations for the cultivation of the genetically modified insect resistant maize 1507 for cultivation. EFSA J 10(11):2934
Eaeg O (2015) Efficacy evaluation of plant protection products. PP 1/213 (4) Resistance risk analysis. European and mediterranean plant protection organization. EPPO Bull 45(3):371–387
EFSA (2012) Scientific Opinion on herbicide tolerant genetically modified soybean 40-3-2 for cultivation. EFSA J 10(6):2753
Squire GR, Hawes C, Begg GS, Young MW (2009) Cumulative impact of GM herbicide-tolerant cropping on arable plants assessed through species-based and functional taxonomies. Environ Sci Pollut Res Int 16:85–94
Hilbeck A, Weiss G, Oehen B, Roembke J, Jaensch S, Teichmann H, Lang A, Otto M, Tappeser B (2014) Ranking matrices as operational tools for the environmental risk assessment of genetically modified crops on non-target organisms. Ecol Indic 36:367–381
Brower LP, Taylor OR, Williams EH, Slayback DA, Zubieta RR, Ramirez MI (2012) Decline of monarch butterflies overwintering in Mexico: is the migratory phenomenon at risk? Insect Conserv Divers. https://doi.org/10.1111/j.1752-4598.2011.00142.x
Pleasants JM, Williams EH, Brower LP, Oberhauser KS, Taylor OR (2016) Letter to the editor: conclusion of no decline in summer monarch population not supported. Ann Entomol Soc Am 109(2):169–171
Pleasants JM, Oberhauser KS (2013) Milkweed loss in agricultural fields because of herbicide use: effect on the monarch butterfly population. Insect Conserv Divers 6(2):135–144
Stenoien C, Nail KR, Zalucki JM, Parry H, Oberhauser KS, Zalucki MP (2016) Monarchs in decline: a collateral landscape-level effect of modern agriculture. Insect Sci 25(4):528–541
Storkey J, Meyer S, Still KS, Leuschner C (2012) The impact of agricultural intensification and land-use change on the European arable flora. Proc R Soc Lond B Biol Sci 279:1421–1429
Ludwig G, Schnittler M (2009) Rote Liste der Pflanzen Deutschlands. Bundesamt für Naturschutz. https://www.bfn.de/themen/rote-liste.html. Accessed 28 Jun 2016
IUCN (2010) European Red List. http://www.iucnredlist.org/initiatives/europe. Accessed 29 Jun 2016
IUCN (2010) Red List of Threatened Species. Version 2010.1. http://www.iucnredlist.org/. Accessed 29 Jun 2016
Kremen C, Miles A (2012) Ecosystem services in biologically diversified versus conventional farming systems: benefits, externalities, and trade-offs. Ecol Soc 17(4):1–40
Squire GR, Hawes C, Bohan DA, Brooks DR, Champion GT, Firbank LG, Haughton AJ, Heard MS, May MJ, Perry JN, Young MW (2005) Biodiversity effects of the management associated with GM cropping systems in the UK. DEFRA, UK. http://randd.defra.gov.uk/Default.aspx?Menu=Menu&Module=More&Location=None&Completed=0&ProjectID=11546. Accessed 17 Feb 2016
Heard MS, Hawes C, Champion GT, Clark SJ, Firbank LG, Haughton AJ, Parish AM, Perry JN, Rothery P, Roy DB, Scott RJ, Skellern MP, Squire GR, Hill MO (2003) Weeds in fields with contrasting conventional and genetically modified herbicide-tolerant crops. II. Effects on individual species. Philos Trans R Soc Lond B Biol Sci 358:1833–1846
Heard MS, Hawes C, Champion GT, Clark SJ, Firbank G, Haughton AJ, Parish AM, Perry JN, Rothery P, Scott RJ, Skellern MP, Squire GR, Hill MO (2003) Weeds in fields with contrasting conventional and genetically modified herbicide-tolerant crops. I. Effects on abundance and diversity. Philos Trans R Soc Lond B Biol Sci 358:1819–1832
Firbank LG, Rothery P, May MJ, Clark SJ, Scott RJ, Stuart RC, Boffey CWH, Brooks DR, Champion GT, Haughton AJ, Hawes C, Heard MS, Dewar AM, Perry JN, Squire GR (2006) Effects of genetically modified herbicide-tolerant cropping systems on weed seedbanks in two years of following crops. Biol Lett 2:140–143
Dolezel M, Miklau M, Heissenberger A (in press) Limits of Concern für die Risikobewertung von GVP. Endbericht zum F + E Vorhaben. Bundesamt für Naturschutz, Bonn, Bad Godesberg
Watkinson AR, Freckleton RP, Robinson RA, Sutherland WJ (2000) Predictions of biodiversity response to genetically modified herbicide-tolerant crops. Science 289(1554):1554–1557
Marshall EJP, Brown VK, Boatman ND, Lutman PJW, Squire GR, Ward LK (2003) The role of weeds in supporting biological diversity within crop fields. Weed Res 43:77–89
Luna T, Dumroese RK (2013) Monarchs (Danaus plexippus) and milkweeds (Asclepias species). Native Plants 14(1):5–14
Hilbeck A, Meier M, Benzler A (2008) Identifying indicator species for post-release monitoring of genetically modified, herbicide resistant crops. Euphytica 164:903–912
Hawes C, Haughton AJ, Bohan DA, Squire GR (2009) Functional approaches for assessing plant and invertebrate abundance patterns in arable systems. Basic Appl Ecol 10:34–42
Haughton AJ, Champion GT, Hawes C, Heard MS, Brooks DR, Bohan DA, Clark SJ, Dewar AM, Firbank LG, Osborne JL, Perry JN, Rothery P, Roy DB, Scott RJ, Woiwod IP, Birchall C, Skellern MP, Walker JH, Baker P, Browne EL, Dewar AJG, Garner BH, Haylock LA, Horne SL, Mason NS, Sands RJN, Walker MJ (2003) Invertebrate responses to the management of genetically modified herbicide-tolerant and conventional spring crops. II. Within-field epigeal and aerial arthropods. Philos Trans R Soc Lond B Biol Sci 358(1439):1863–1877
Roy DB, Bohan DA, Haughton AJ, Hill MO, Osborne JL, Clark SJ, Perry JN, Rothery P, Scott RJ, Brooks DR, Champion GT, Hawes C, Heard MS, Firbank LG (2003) Invertebrates and vegetation of field margins adjacent to crops subject to contrasting herbicide regimes in the farm scale evaluations of genetically modified herbicide-tolerant crops. Philos Trans R Soc Lond B Biol Sci 358(1439):1879–1898
Chamberlain DE, Freeman SN, Vickery JA (2007) The effects of the GMHT crops on bird abundance in arable fields in the UK. Agric Ecosyst Environ 118:350–356
Barzman M, Bàrberi P, Birch ANE, Boonekamp P, Dachbrodt-Saaydeh S, Graf B, Hommel B, Jensen JE, Kiss J, Kudsk P, Lamichhane JR, Messéan A, Moonen A-C, Ratnadass A, Ricci P, Sarah J-L, Sattin M (2015) Eight principles of integrated pest management. Agron Sustain Dev 35(4):1199–1215
Power AG (2010) Ecosystem services and agriculture: trade-offs and synergies. Philos Trans R Soc Lond B Biol Sci 365:2959–2971
Nienstedt KM, Bock TCM, van Wensem J, Monforts M, Hart A, Aagaard A, Alix A, Boeston J, Bopp SK, Brown C, Capri E, Forbes V, Köpp H, Liess M, Luttik R, Maltby L, Sousa JP, Streissl F, Hardy AR (2012) Development of a framework based on an ecosystem services approach for deriving specific protection goals for environmental risk assessment of pesticides. Sci Total Environ 415(1):31–38
Swanton CJ, Weaver S, Cowan P, Van Acker R, Deen W, Shreshta A (1999) Weed thresholds: theory and applicability. J Crop Prod 2(1):9–29
Young JEB, Griffin MJ, Alford DV, Ogilvy SE (eds) (2001) Reducing agrochemical use on the arable farm: the talisman and SCARAB projects. DEFRA, London
Zanin G, Sattin M (1988) Threshold level and seed production of velvetleaf (Abutilon theophrasti Medicus) in maize. Weed Res 28(5):347–352
O`Donovan JT (1996) Weed economic thresholds: useful agronomic tool or pipe dream? Phytoprotection 77(1):13–28
Lutman PJW, Bowerman P, Palmer GM, Whytock GP (2000) Prediction of competition between oilseed rape and Stellaria media. Weed Res 40(3):255–269
Ryan MR, Smith RG, Mortensen DA, Teasdale JR, Curran WS, Seidel R, Shumway DL (2009) Weed-crop competition relationships differ between organic and conventional cropping systems. Weed Res 49:572–580
Devos Y, Cougnon M, Vergucht S, Bulcke R, Haesaert G, Steurbaut W, Reheul D (2008) Environmental impact of herbicide regimes used with genetically modified herbicide-resistant maize. Trans Res 17:1059–1077
Meissle M, Mouron P, Musa T, Bigler F, Pons X, Vasileiadis VP, Otto S, Antichi D, Kiss J, Palinkas Z, Dorner Z, van der Weide R, Groten J, Czembor E, Adamczyk J, Thibord J-B, Melander B, Cordsen Nielsen G, Poulsen RT, Zimmermann O, Verschwele A, Oldenburg E (2010) Pests, pesticide use and alternative options in European maize production: current status and future prospects. J Appl Entomol 134:357–375
Dolezel M, Miklau M, Hilbeck A, Otto M, Eckerstorfer M, Heissenberger A, Tappeser B, Gaugitsch H (2011) Scrutinizing the current practice of the Environmental Risk Assessment of GM maize applications for cultivation in the EU. Environ Sci Eur 23:33
EFSA (2015) Scientific Opinion updating risk management recommendations to limit exposure of non-target Lepidoptera of conservation concern in protected habitats to Bt-maize pollen. EFSA J 13(7):4127
Schoonjans R, Luttik R (2014) Editorial: specifying biodiversity-related protection goals for environmental risk assessment. EFSA J 12(6):e14062
EFSA (2011) Scientific Opinion updating the evaluation of the environmental risk assessment and risk management recommendations on insect resistant genetically modified maize 1507 for cultivation. EFSA J 9(11):2429
EFSA (2011) Statement supplementing the evaluation of the environmental risk assessment and risk management recommendations on insect resistant genetically modified maize Bt11 for cultivation. EFSA J 9(12):2478
Arpaia S, Messean A, Birch NA, Hokannen H, Härtel S, van Loon J, Lovei G, Park J, Spreafico H, Squire GR, Steffan-Dewenter I, Tebbe C, van der Voet H (2014) Assessing and monitoring impacts of genetically modified plants on agroecosystems: the approach of the AMIGA project. Entomologica 2(154):79–86
Hilbeck A (2001) Implications of transgenic, insecticidal plants for insect and plant biodiversity. Perspect Plant Ecol Evol Syst 4(1):43–61
Gray ME (2010) Relevance of traditional integrated pest management (IPM) strategies for commercial corn producers in a transgenic agroecosystem: a bygone era? Agric Food Chem. https://doi.org/10.1021/jf102673s
Benbrook CM (2012) Impacts of genetically engineered crops on pesticide use in the US—the first sixteen years. Environ Sci Eur 24(24):1–13
Frische T, Egerer S, Matezki S, Pickl C, Wogram J (2018) 5-Point programme for sustainable plant protection. Environ Sci Eur 30(8):17
PAN (2013) Reducing pesticide use across the EU. Pesticide action network Europe. https://www.pan-europe.info. Accessed 28 Jun 2016
Naranjo SE (2011) Impacts of Bt transgenic cotton on integrated pest management. J Agric Food Chem 59(11):5842–5851
EFSA (2012) Scientific opinion supplementing the conclusions of the environmental risk assessment and risk management recommendations for the cultivation of the genetically modified insect resistant maize Bt11 and MON 810. EFSA J 10(12):3016
EFSA (2012) Scientific opinion updating the risk assessment conclusions and risk management recommendations on the genetically modified insect resistant maize 1507. EFSA J 10(10):2933
EFSA (2012) Scientific opinion updating the risk assessment conclusions and risk management recommendations on the genetically modified insect resistant maize MON 810. EFSA J 10(12):3017
EFSA (2012) Scientific opinion updating the risk assessment conclusions and risk management recommendations on the genetically modified insect resistant maize Bt11. EFSA J 10(12):3018
EFSA (2015) Scientific Opinion addressing the state of the science on risk assessment of plant protection products for non-target arthropods. EFSA J 13(2):3996
Gathmann A, Wirooks L, Hothorn LA, Bartsch D, Schuphan I (2006) Impact of Bt maize pollen (MON810) on lepidopteran larvae living on accompanying weeds. Mol Ecol 15:2677–2685
Lang A, Oehen B, Ross J-H, Bieri K, Steinbrich A (2015) Potential exposure of butterflies in protected habitats by Bt maize cultivation: a case study in Switzerland. Biol Cons 192:369
Arpaia S, Baldacchino F, Bosi S, Burgio G, Errico S, Magarelli RA, Masetti A, Santorsola S (2018) Evaluation of the potential exposure of butterflies to genetically modified maize pollen in protected areas in Italy. Insect Sci. https://doi.org/10.1111/1744-7917.12591
Manachini B, Bazan G, Schicchi R (2018) Potential impact of genetically modified Lepidoptera-resistant Brassica napus in biodiversity hotspots: sicily as a theoretical model. Insect Sci. https://doi.org/10.1111/1744-7917.12588
VDI (2010) Monitoring the effects of genetically modified organisms (GMO). Standardised monitoring of butterflies and moths (Lepidoptera). Transect method, light trap and larval survey. VDI 4330. Verein Deutscher Ingenieure. Beuth Verlag, Berlin
Lang A, Theißen B, Dolek M (2013) Standardised methods for the GMO monitoring of butterflies and moths: the whys and hows. BioRisk. 8:15–38
Lang A, Dolek M, Theißen B, Zapp A (2011) Are adult crambid snout moths (Crambinae) and larval stages of Lepidoptera suitable tools for an environmental monitoring of transgenic crops? Insects 2(3):400–411
Hofmann F, Kruse-Plass M, Kuhn U, Otto M, Schlechtriemen U, Schröder B, Vögel R, Wosniok W (2016) Accumulation and variability of maize pollen deposition on leaves of European Lepidoptera host plants and relation to release rates and deposition determined by standardised technical sampling. Environ Sci Eur 28(1):14
Hofmann F, Otto M, Kuhn U, Ober S, Schlechtriemen U, Vögel R (2011) A new method for in situ measurement of Bt-maize pollen deposition on host-plant leaves. Insects 2:12–21
Hofmann F, Otto M, Wosniok W (2014) Maize pollen deposition in relation to the distance from the nearest pollen source under common cultivation—Results of 10 years of monitoring (2001–2010). Environ Sci Eur 26:24
Directive 2001/81/EC of the European Parliament and of the Council of 23 October 2001 on national emission ceilings for certain atmospheric pollutants. OJ L 309:22–30
Directive 2008/50/EC of the European parliament and of the council of 21 May 2008 on ambient air quality and cleaner air for Europe. OJ L 152:1–44
WHO (2000) Air Quality Guidelines for Europe. WHO Regional Publications, European Series, No 91. World Health Organization. http://www.euro.who.int/de/publications/abstracts/air-quality-guidelines-for-europe. Accessed 16 Mar 2016
Hofmann F, Schlechtriemen U, Kuhn U, Wittich K-P, Koch W, Ober S, Vögel R, Otto M (2013) Variation of maize pollen shedding in North Germany and its relevance for GMO-monitoring. In: Breckling B, Verhoeven R (eds). GM-crop cultivation—ecological effects on a landscape scale. Proceedings of the third GMLS conference, Bremen; 2012
Hofmann F, Kruse-Plass M, Kuhn U, Otto M, Schlechtriemen U, Schröder B, Vögel R, Wosniok W (2016) Accumulation and variability of maize pollen deposition on leaves of European Lepidoptera host plants and relation to release rates and deposition determined by standardised technical sampling. Environ Sci Eur 28:14
Zangerl AR, McKenna D, Wraight CL, Carroll M, Ficarello P, Warner R, Berenbaum MR (2001) Effects of exposure to event 176 Bacillus thuringiensis corn pollen on monarch and black swallowtail caterpillars under field conditions. PNAS 98(21):11908–11912
Lang A (2004) Monitoring the impact of Bt maize on butterflies in the field: estimation of required sample sizes. Environ Biosafety Res 3(1):55–66
Lang A, Ludy C, Vojtech E (2004) Dispersion and distribution of Bt maize pollen in field margins. J Plant Dis Prot 111(5):417–428
Schuppener M, Muehlhause J, Mueller A-K, Rauschen S (2012) Environmental risk assessment for the small tortoiseshell Aglais urticae and a stacked Bt maize with combined resistances against Lepidoptera and Chrysomelidae in central European agrarian landscapes. Mol Ecol 21(18):4646–4662
Felke M, Lorenz N, Langenbruch GA (2002) Laboratory studies on the effects of pollen from Bt maize on larvae of some butterfly species. JAppl Entomol 126(6):320–325
Felke M, Langenbruch GA (2003) Wirkung von Bt mais-pollen auf raupen des tagpfauenauges im Laborversuch. Gesunde Pflanzen 55(1):1–7
Hellmich RL, Siegfried BD, Sears MK, Stanley-Horn DE, Daniels MJ, Mattila HR, Spencer T, Bidne KG, Lewis LC (2001) Monarch larvae sensitivity to Bacillus thuringiensis-purified proteins and pollen. PNAS 98(21):11925–11930
Holst N, Lang A, Lövei G, Otto M (2013) Increased mortality is predicted of Inachis io larvae caused by Bt maize pollen in European farmland. Ecol Modell 250:126–133
Kuussaari M, Heliölä J, Luoto M, Pöyry J (2007) Determinants of local species richness of diurnal Lepidoptera in boreal agricultural landscapes. Agric Ecosyst Environ 122:366–376
Aviron S, Sanvido O, Romeis J, Herzog F, Bigler F (2009) Case-specific monitoring of butterflies to determine potential effects of trasngenic Bt maize in Switzerland. Agric Ecosyst Environ 131:137–144
Ekroos J, Heliölä J, Kuussaari M (2010) Homogenization of lepidopteran communities in intensively cultivated agricultural landscapes. J Appl Ecol 47:459–467
van Swaay C, Cuttelod, A., Collins S, Maes D, Lopez Munguira M, Sasic M, Settele R, Verstrael T, Warren M, Wiemers M, Wynhoff I (2010) European Red List of Butterflies. http://ec.europa.eu/environment/nature/conservation/species/redlist/downloads/European_butterflies.pdf. Accessed 16 Mar 2016
EEA (2013) The European Grassland Butterfly Indicator: 1990–2011. European Environment Agency. https://www.eea.europa.eu/publications/the-european-grassland-butterfly-indicator-19902011. Accessed 14 Mar 2016
Geiger F, Bengtsson J, Berendse F, Weisser WW, Emmerson M, Morales MB, Ceryngier P, Liira J, Tscharntke T, Winqvist C et al (2010) Persistent negative effects of pesticides on biodiversity and biological control potential on European farmland. Basic Appl Ecol 11(2):97–105
IUCN (2012) IUCN red list categories and criteria: version 3.1, 2nd edn. IUCN, Gland
Zhang W, Ricketts TH, Kremen C, Carney K, Swinton SM (2007) Ecosystem services and dis-services to agriculture. Ecol Econ 64(2):253–260
Swift MJ, Izac A-MN, van Noordwijk M (2004) Biodiversity and ecosystem services in agricultural landscapes—are we asking the right questions? Agric Ecosyst Environ 104:113–134
Milner AM, Boyd IL (2017) Towards pesticidovigilance. Science 357(6357):1232–1234
Kempenaar C, Lotz LAP, van der Horst CLM, Beltman WHJ, Leemans KJM, Bannink AD (2007) Trade-off between costs and environmental effects of weed control on pavements. Crop Prot 26:430–435
EC (2015) Report from the Commission to the European Parliament and the Council. The mid-term review of the EU Biodiversity Strategy to 2020. COM (2015) 187 final
EC (2015) The State of Nature in the EU. Reporting under the EU Habitats and Birds Directives 2007–2012. European Commission. Luxembourg: Office for Official Publications of the European Union
Regulation (EC) No 1107/2009 of the European Parliament and of the Council of 21 October 2009 concerning the placing of plant protection products on the market and repealing Council Directives 79/117/EEC and 91/414/EEC. OJ L 309:1–50
MD designed, coordinated and carried out the study and drafted the manuscript. MM assisted in carrying out the study and the drafting of the manuscript. WR and AH contributed to the study design and provided feedback to the manuscript. All authors read and approved the final manuscript.
We would like to thank the experts participating in the three workshops of this project.
The authors declare that they have no competing interests.
Availability of data and materials
Not applicable, as no datasets were collected for this research.
Consent for publication
Ethics approval and consent to participate
This project was supported by the German Federal Agency for Nature Conversation (BfN) Research & Development Grant No. 351389 0200, Title: ‘Limits of Concern for the risk assessment of genetically modified plants’.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.