SEPA March 2007 Evaluation of the U.S. EPA Pesticide Product Reregistration Process: Opportunities for Efficiency and Innovation Promoting Environmental Results •« • Through Evaluation ------- Table of Contents Acronyms iv Acknowledgments v Preface v Executive Summary vi 1. Introduction 1-1 1.1 Purpose and Evaluation Questions 1-1 1.2 Evaluation Audience 1-2 1.3 Program Description 1-2 1.3.1 Statutory Framework 1-2 1.3.2 Product Reregistration Process 1-4 1.3.3 Roles in the Product Reregistration Process 1-6 1.3.4 Product Reregistration Program Logic Model 1-7 1.4 Review of Related Evaluations 1-9 1.4.1 Funding and Accountability 1-9 1.4.2 Reregistration Policy 1-9 1.4.3 Information Management 1-10 1.4.4 Performance Management 1-11 1.5 Organization of Report 1-12 2. Methods 2-1 2.1 Data Collection Methods 2-1 2.2 Data Collection Approach 2-5 2.3 Data Analysis 2-7 3. Progress on Product Reregistration 3-1 3.1 Status of Product Reregistration 3-1 3.2 Duration of the Product Reregistration Process 3-4 4. Reregistration Eligibility Decisions 4-1 4.1 Issues with REDs 4-1 4.2 Case Studies 4-2 4.2.1 Rodenticide Cluster 4-2 4.2.2 Captan 4-4 4.2.3 Dicofol 4-5 4.3 Alternative Strategies for Implementing Mitigation 4-6 4.3.1 Memoranda of Agreement- Chlorpyrifos and Phosmet 4-6 4.3.2 Propanil Pilot Project 4-8 5. DCI Justifications and Preparation 5-1 5.1 Preparation of DCI Justification Package 5-1 5.1.1 Template for DCI Justification Package 5-1 5.1.2 Supporting Data 5-2 5.1.3 Tracking 5-2 5.2 Resources and Staff Time 5-3 5.3 Approval of the DCI Justification Package 5-3 6. Data Requirements and Review 6-1 ------- 6.1 Data Management of Registrant Responses 6-1 6.2 Acute Toxicity and Product Chemistry Analysis 6-4 6.2.1 Background on Acute Toxicity and Product Chemistry Guidelines 6-4 6.2.2 Design of Analysis 6-5 6.2.3 Audit Conclusions 6-5 6.3 2,4-D Streamlined Data Requirements 6-6 6.3.1 2,4-D Batching Approach 6-7 6.3.2 2,4-D Storage Stability Requirements 6-7 6.3.3 Pros and Cons of this Approach 6-7 6.4 Communication 6-8 6.5 Management and Staffing 6-9 7. Label Assessments and Reviews 7-1 7.1 Label Assessment-Special Review and Reregistration Division 7-1 7.2 Label Review- Registration Division 7-2 7.3 Ziram Pilot Project 7-3 7.4 Workload Management and Other Issues 7-3 7.5 Current Strategy to Expedite Product Reregistration 7-4 8. Suggested Changes to Process Design and Other Recommendations 8-1 8.1 RED Development 8-1 8.1.1 Improve Transition of Cases from Reregistration Branches to PRB 8-1 8.1.2 Require More Participation by RD in the Development of Label Tables 8-2 8.2 Implementation of RED-Specified Mitigation 8-2 8.2.1 Implement Mitigation in an Expedited Manner When Cost-Effective 8-2 8.2.2 Pursue Additional Regulatory Action When Warranted 8-3 8.2.3 Further Explore Self-Certified or Electronic Labels 8-4 8.3 DCI Justifications and Preparation 8-4 8.3.1 Ensure that DCIs Are Prepared According to the Package Template 8-4 8.3.2 Modify Format of Supporting Data in Risk Assessments 8-4 8.4 Streamlined Data Requirements 8-5 8.4.1 Conduct Additional Analyses to Determine Value of Product-Specific Data 8-5 8.4.2 Leverage Related Efforts for Process Improvements 8-5 8.4.3 Expand Batching Approaches to Reduce Number of Requested Studies 8-5 8.4.4 Encourage Use of Self-Certified Product Chemistry Data 8-6 8.5 Registrant Responses 8-6 8.5.1 Create Incentives for Registrants to Provide Expedited Responses 8-6 8.5.2 Establish Procedures and Pursue Suspensions 8-7 8.5.3 Retain Data Review Functions within PRB 8-7 8.6 Label Reviews and the Role of the Registration Division 8-7 8.6.1 Discontinue Label Assessments within SRRD 8-8 8.6.2 Improve Transition of Cases from SRRD to RD 8-8 8.7 Management, Resources, and Staffing 8-8 8.7.1 Reevaluate Allocation of SRRD Resources 8-9 8.7.2 Maintain Emphasis on Product Reregistration 8-9 8.7.3 Pursue SWAT Teams and Other Strategies to Reduce Backlog 8-9 8.7.4 Obtain Support for DCI Preparation 8-10 8.8 Communication 8-10 8.9 Performance Management 8-11 ------- 8.9.1 Improve Performance Measures and Strategic Targets 8-11 8.9.2 Incorporate Product Reregistration into PARS 8-11 8.10 Information Management 8-11 8.10.1 Continue to Prioritize an Integrated Tracking System 8-12 8.10.2 Maintain Web Site as a Repository of Reregistration Decisions 8-12 Appendix A Interview Guide 1 Appendix B Individuals Interviewed or Consulted 6 List of Exhibits Figure 1-1. Overview of Product Reregistration Process Figure 1-2. Logic Model: U.S. EPA Office of Pesticide Programs Product Reregistration Figure 3-1. Universe of Pesticide Products at End of FY2006 Figure 3-2. Distribution of Completed Actions through the End of FY2006 Figure 3-3. Actions Completed from FY2002 through FY2006 Figure 3-4. Actions Completed in FY2006 Compared to Target Figure 3-5. Duration of Product Reregistration Process for All Products (Reregistered and Conditional or Unconditional Reregistered Products) Figure 3-6. Duration of Period from RED Signature to Product Sent to PM (Panel A), Duration of Period from Sent to PM to Decision (Panel B) Figure 3-7. Duration of Period from RED Signature to Product Sent to PM for Products that are Not Yet Completed Table 2-1. Summary of Data Collection Methods Table 3-1. Cumulative Completed Reregistration Actions through FY2006 Table 3-2. Products with Actions Pending at the End of FY2006 Table 3-3. Mean Duration of Process for All Products and by RED Case Table 3-4. Mean Duration of Process for RED Case by the Number of Products Table 3-5. Median Duration of Process for All Products and by RED Case Table 3-6. Median Duration of Process for RED Case by the Number of Products Table 3-7. Product Reregistration Completion Status by Fiscal Year ------- Acronyms AD Antimicrobials Division Al Active Ingredient BEAD Biological and Economic Analysis Division BPPD Biopesticides and Pollution Prevention Division CBI Confidential Business Information CFR Code of Federal Regulations CRM Chemical Review Manager CRS Congressional Research Service CSF Confidential Statement of Formula DCI Data Call-In EPA U.S. Environmental Protection Agency FEAD Field and External Affairs Division FFDCA Federal Food, Drug, and Cosmetic Act FIFRA Federal Insecticide, Fungicide, and Rodenticide Act FQPA Food Quality Protection Act FR Federal Register FTE Full-Time Equivalent GAO General Accountability Office GPRA Government Performance and Results Act HED Health Effects Division HHDA Hazard to Humans and Domestic Animals IRED Interim Reregistration Eligibility Decision ISB Information Services Branch IMC Information Management Council ITRMD Information Technology and Resource Management Division MOA Memorandum of Agreement MRID Master Record Identification Number NRDC Natural Resources Defense Council OGC Office of General Counsel OIG Office of Inspector General OMB Office of Management and Budget OPP Office of Pesticide Programs OPPIN Office of Pesticide Programs Information Network OPPTS Office of Prevention, Pesticides, and Toxic Substances PARS Performance Appraisal and Recognition System PART Program Assessment Rating Tool PDCI Product-Specific Data Call-in PM Product Manager PPDC Pesticide Program Dialogue Committee PPE Personal Protective Equipment PPLS Pesticide Product Label System PRA Paperwork Reduction Act PRB Product Reregistration Branch PRIA Pesticide Registration Improvement Act of 2003 PRN Pesticide Registration Notice PSB Program Support Branch RCS Regulatory Coordination Staff RD Registration Division RED Reregistration Eligibility Decision REI Restricted Entry Interval RUP Restricted Use Pesticide SEE Senior Environmental Employment SOP Standard Operating Procedure SRRD Special Review and Reregistration Division TRED Tolerance Reassessment Eligibility Decision USDA U.S. Department of Agriculture WPS Worker Protection Standard IV ------- Acknowledgments In Fall 2005 the U.S. Environmental Protection Agency (EPA) Office of Pesticide Programs (OPP) entered the EPA Program Evaluation Competition and was selected for an evaluation of its product reregistration process. This competition, jointly sponsored by the Office of Policy, Economics and Innovation and the Office of the Chief Financial Officer, encourages the effective use of program evaluation throughout EPA. As a subcontractor to Industrial Economics, Abt Associates conducted this evaluation under EPA contract EP-W-04-023. The Abt Associates evaluation team gratefully acknowledges the input and guidance provided by Peter Caulkins, OPP Special Review and Reregistration Division, and Yvonne Watson, EPA Office of Policy, Economics, and Innovation, throughout the design and implementation of the evaluation. We also appreciate the time made available by OPP staff members to meet with the evaluation team, which provided us with critical information on their roles, responsibilities, and perspectives on product reregistration that would not have otherwise been available. Preface As a subcontractor to Industrial Economics, Abt Associates conducted this evaluation under EPA contract EP-W-04-023. This report reflects the information made available to Abt Associates either by EPA or through published sources. A substantial amount of the information is qualitative in nature and was collected through a series of interviews with EPA staff. The findings presented in this report are based on the information made available to the evaluation team. Further, the conclusions and recommendations presented in this report are those of the evaluation team and are not necessarily reflective of EPA's position. ------- Executive Summary The U.S. Environmental Protection Agency (EPA) Office of Pesticide Programs (OPP) conducts a comprehensive review of pesticides initially registered before November 1, 1984, to ensure that they meet contemporary health and safety standards and labeling requirements. After the registrant signals its intent to reregister an active ingredient, EPA conducts science reviews, develops a risk assessment and publishes it for public comment, and issues a Reregistration Eligibility Decision (RED). EPA then must reregister each of the individual pesticide products that contains the active ingredient. This final step in the process - pesticide product reregistration - is the focus of this evaluation. Product reregistration consists of three basic steps, which are completed by either the OPP Special Review and Reregistration Division (SRRD) or the Registration Division (RD): (1) SRRD sends registrants a Data Call-In (DCI) notice requesting the needed product-specific data. (2) SRRD receives and evaluates the requested studies from the registrants and conducts a preliminary label assessment. (3) RD reregisters a product if it was found to meet its standards by issuing a reregistration notice and stamping a revised label that includes the necessary mitigation. Evaluation Purpose and Approach There is considerable interest within EPA to streamline and expedite the product reregistration process. The purpose of this evaluation is to identify potential opportunities for innovation and streamlining of the product reregistration process in order to (1) ensure timelier implementation of the mitigation measures specified in the RED, and (2) make the process as efficient as possible in order to decrease the amount of time needed for product reregistration and use resources in the most effective manner. The evaluation was designed to answer the following questions: • What components of REDs have caused delays in product reregistration? • What problems, bottlenecks, or unnecessary duplication of efforts occur in the product reregistration process that are under the control of OPP? • What innovations or streamlining in process could result in more timely implementation of mitigation specified in the RED and/or more efficient production of outputs? • What are the pros and cons of each of the proposed innovations or streamlining measures? • What is the optimal allocation of tasks between the Special Review and Reregistration Division and the Registration Division? • Are any external entities or considerations impeding the product reregistration process? The methodology employed several data collection methods, including interviews, document review, reregistration program data, case studies, and subject matter experts. Product Reregistration Progress Since beginning reregistration in the late 1980s, EPA has completed reregistration actions for 7,358 products. Reregistration actions for 11,948 products (conventional and antimicrobial) vi ------- were pending as of October 2006. Of the pending reregistration actions, the products are distributed through all phases of the pesticide reregistration process. Most of the products (9,088 or 76%) have not yet had the Data Call-in (DCI) approved by the Office of Management and Budget (OMB). The FY2006 REDs resulted in 6,722 products that will require DCIs. On average, it took more than 54 months to reregister a product. On average, approximately 41 months were needed to transmit the reregistration package to the Product Manager (PM) in RD, and after the reregistration package had been sent to the PM, it took approximately 14 months to complete the reregistration process. The distribution of these data indicated that they are skewed such that the mean (average) is not adequate to represent the average duration of the process; the median time is more informative in this instance. The median time to complete product the product reregistration process was 30 months. Product Reregistration Delays Associated with REDs The Registration Eligibility Decisions (REDs) and subsequent activities were found to be a source of delay in product reregistration. REDs were often published before they are complete or before all outstanding issues were properly addressed. These documents represented a "snapshot in time" of the data made available to EPA, and registrants often provided additional data that warrant amending the RED. Some registrants were inclined to challenge the contents of a RED as a way to delay implementing mitigation. Also, some REDs did not represent decisions or included provisions for additional studies, such that product reregistration could not be effectively implemented after the RED was published. REDs sometimes contained small errors, most of which were straightforward and easy to address. The label tables often contained language that RD or SRRD Product Reregistration Branch (PRB) believe could been improved or that is not consistent with labeling for other products. Many of these issues only became apparent at implementation, which was during the product reregistration process. Post-RED issues were not given high priority in work plans and adequate resources within the four SRRD reregistration branches, as statutory deadlines required continued focus on REDs. Staff from the reregistration branches were often unavailable to assist with post-RED issues. Given the length of time from when a RED was published, to when post-RED issues were addressed, to when product reregistration was conducted, the Chemical Review Manager (CRM) who wrote the RED was often no longer in that position. Problems, Bottlenecks, and Unnecessary Duplications of Effort Because of the length of the product reregistration process, as well as the delays that often occur, the mitigation identified in the RED is often not implemented for several years. This delay is particularly troublesome given that the universe of pesticides includes those that were registered prior to November 1, 1984. EPA has made several attempts to implement RED- specified mitigation as soon as possible, including through memoranda of agreement and requests to registrants. Even with regulatory action as a possible consequence of non- response, registrants did not submit amended labels for a substantial number of products. There is substantial backlog in the number of DCIs that need to be approved by the Office of Management and Budget (OMB) and sent out by OPP so that product reregistration can begin. The review by OMB also results in substantial delay because the approval process takes an vii ------- average of nine to ten months. In addition, the format for the justification package has been and continues to be an issue, the needed information is not readily available in a suitable format, and OPP lacks an adequate tracking system for the DCI process. One of the sources of delay in the product re registration process are the registrant responses, which require a lot of time for the registrants to prepare and submit, as well as for EPA to receive, track, review, and respond to (if required). During the course of its reregistration program, EPA has initiated several efforts to increase the quality of data it receives from registrants so that data are not deficient, which requires additional time for the registrant to prepare and submit studies and for EPA to review them. As currently designed, the Special Review and Reregistration Division (SRRD) conducts preliminary label assessments, and the Registration Division (RD) conducts full label reviews. The review by SRRD was intended to focus on mitigation required by the reregistration process, whereas RD focused on label amendments and content more generally. Despite this division of labor, the two reviews are duplicative and RD has not used many of SRRD's label assessments. Efficient information management is an issue for all aspects of the product reregistration process. In 2000, EPA launched the Office of Pesticide Programs Information Network (OPPIN), which was intended to be an integrated, office-wide system. This system, which replaced existing systems to track reregistration on the product and active ingredient levels, failed to meet the needs of OPP with respect to product reregistration. In response, many staff have created one-off tracking systems in order to get their jobs done, making comprehensive, reliable status updates very difficult to retrieve. OPP again requested improvements to OPPIN in November 2006, but requests to modify OPPIN are often not granted due to competing demands and because OPPIN will be retired in September 2008. It is unclear the extent to which the new information management system, PRISM, will address the needs of product reregistration. In its FY2007 reregistration work plan, SRRD allocates eight percent of its resources (full-time equivalent (FTE)) to product reregistration. This allocation is roughly equivalent to past staffing levels and SRRD expects the staffing level to remain fairly constant in the short term. SRRD intends to allocate funds to product reregistration at roughly the same level through FY2013. SRRD has predicted that it will complete product reregistration by the end of the 2012 calendar year. Based on data provided by EPA, Abt Associates developed a conservative estimate as to when it believes OPP might complete product reregistration, assuming that the current level of activity and resource allocation continue. We estimate that product reregistration may not be completed for more than twelve years, or the end of FY2018. This is six years longer than EPA's current prediction, and five years longer than the period for which EPA has budgeted. External Entities or Considerations Two divisions of the Office of Pesticide Programs (SRRD and RD) are generally responsible for reregistering conventional pesticide products. However, other divisions participate in the effort, including the Field and External Affairs Division (FEAD) and the Information Technology and Resource Management Division (ITRMD). Both FEAD and the Office of Prevention, Pesticides, viii ------- and Toxic Substances Regulatory Coordination Staff participate in the preparation of DCI justification packages and facilitate communication with OMB. FEAD recently developed a streamlined template for the package to improve the process. FEAD also provides scientific and technical staff support to SRRD. ITRMD is responsible for information technology and management. ITRMD receives and responds to requests for data systems improvement, such as those to OPPIN. The science divisions also provide some support for product reregistration, as needed. The Office of Management and Budget (OMB) reviews and approves DCI justification packages. This review period varies in length and often results in EPA responding to several rounds of questions and issues raised by OMB. A new OMB desk officer was recently assigned to pesticide DCI approvals, so the timeline and procedures for the review of DCI justification packages may change. As needed, the U.S. Department of Agriculture and other federal agencies consult on product reregistration issues. Finally, the pesticide registrants play a key role in product reregistration and are also a significant source of delay. In response to a DCI, registrants provide both ninety-day and eight- month responses, which include amended labels, waiver requests, and requested studies. In addition to the time provided for response, additional time is required when registrants submit deficient studies that have to be repeated/upgraded. Also, the review of this material and the communication with the registrant consume a significant portion of OPP's time as well. Recommendations to Streamline or Modify Product Reregistration The reregistration program has evolved over time and in response to significant policy changes, including the Food Quality Protection Act, Pesticide Registration Improvement Act, and the public participation program. The pesticide reregistration program is required under the Federal Insecticide, Fungicide, Rodenticide Act, but the process is not codified in regulation. Although this arguably has its down sides, for purposes of this evaluation it means that EPA has the flexibility to modify and improve the process to better meet its desired outcomes. Internally, OPP initiated a dialogue to improve the product reregistration program, including developing a "SWAT Team" approach to expedite product reregistration. In addition, recent management attention has raised the visibility of product reregistration in both RD and SRRD. Based on the results of the evaluation, the following recommendations are presented to further expedite product reregistration and/or implement RED-specified mitigation more quickly: IX ------- Recommendations of the Evaluation Team RED Development Improve the Transition of Chemical Cases from Reregistration Branches to PRB Require More Participation by RD in the Development of Label Tables Implementation of RED-Specified Mitigation Implement Mitigation in an Expedited Manner When Cost-Effective Pursue Additional Regulatory Action When Warranted Further Explore Self-Certified or Electronic Labels DCI Justifications and Preparation Ensure that DCIs Are Prepared According to the Package Template Modify Format of Supporting Data in Risk Assessments Streamlined Data Requirements Conduct Additional Analyses to Determine Value of Product-Specific Data Leverage Related Efforts for Process Improvements Expand Scope of Batching Approaches to Reduce Number of Requested Studies Encourage Use of Self-Certified Product Chemistry Data Registrant Responses Create Incentives for Registrants to Provide Expedited Responses Establish Procedures and Pursue Suspensions Retain Data Review Functions within PRB Label Reviews and the Role of the Registration Division Discontinue Label Assessments within SRRD Improve Transition of Chemical Cases from SRRD to RD Management, Resources, and Staffing Reevaluate Allocation of SRRD Resources Maintain Emphasis on Product Reregistration Pursue SWAT Teams and Other Strategies to Reduce Backlog Obtain Support for DCI Preparation Communication Improve Internal and External Communication about Product Reregistration Performance Management Improve Performance Measures and Strategic Targets Incorporate Product Reregistration into PARS Information Management Continue to Prioritize an Integrated Tracking System Maintain Web Site as a Repository of Reregistration Decisions These recommendations are discussed in detail in the body of the report, including applicable pros and cons for each. ------- 1. Introduction To ensure the safety of older pesticides, the Federal Insecticide, Fungicide, and Rodenticide Act (FIFRA) amendments of 1988 required the U.S. Environmental Protection Agency (EPA) to conduct a comprehensive review of pesticides initially registered before November 1, 1984. Through its pesticide reregistration process, the EPA Office of Pesticide Programs (OPP) ensures that older pesticides meet contemporary health and safety standards and labeling requirements. Reregistration includes approximately 600 active ingredient cases and more than 20,000 pesticide products that contain these active ingredients. The reregistration process is composed of several steps. After the registrant signals its intent to reregister a pesticide, OPP conducts science reviews, develops a risk assessment and publishes it for public comment, and issues a Reregistration Eligibility Decision RED). After OPP publishes a RED, it then must reregister each of the individual pesticide products that contain the active ingredient. This final step in the process - pesticide product reregistration - is the focus of this evaluation. 1.1 Purpose and Evaluation Questions Risk assessments and mitigation requirements are incorporated in Reregistration Eligibility Decision documents (REDs) for each active ingredient; however, the mitigation for that active ingredient is not implemented in the field until the individual product labels have been changed. This is accomplished through the product reregistration process that follows the completion of the RED, a process that often spans several years and thus prolongs the implementation of environmentally protective measures specified in REDs. In addition, the recent signature of the REDs for food-use pesticides will next require OPP to reregister thousands of individual products. For these and other reasons, there is considerable interest within EPA to streamline and expedite the product reregistration process. The purpose of this evaluation is to identify potential opportunities for innovation and streamlining of the product reregistration process in order to: • Ensure timelier implementation of the mitigation measures specified in the RED, and • Make the process as efficient as possible in order to decrease the amount of time needed for product reregistration and use resources in the most effective manner. In order to focus the evaluation and establish a clear goal, Abt Associates and EPA identified several specific questions regarding the product reregistration process that were of particular interest. This evaluation was designed to provide the answers to the following questions: 1. What components of REDs have caused delays in product reregistration? 2. What problems, bottlenecks, or unnecessary duplication of efforts occur in the product reregistration process that are under the control of OPP? 1-1 ------- 3. What innovations or streamlining in process could result in more timely implementation of mitigation specified in the RED and/or more efficient production of outputs? 4. What are the pros and cons of each of the proposed innovations or streamlining measures? 5. What is the optimal allocation of tasks between the Special Review and Reregistration Division and the Registration Division? 6. Are any external entities or considerations impeding the product reregistration process? 1.2 Evaluation Audience The findings, conclusions, and recommendations of this process evaluation will be of interest largely to the individuals responsible for or who participate in the pesticide product reregistration process. Thus, the primary audiences for this report are EPA managers and staff who will use the results of the evaluation as a management tool to identify issues related to the current process, including the extent/nature of the problems and possible modifications to the product reregistration process. The findings may further serve as a catalyst for innovation within the program, which will increase efficiency and reduce the product reregistration backlog, beyond the scope of what is recommended in this report. Please note that due to the nature of the evaluation and the information contained within this report, this report and its supporting documentation is considered internal, EPA deliberative material, and therefore should not be cited, quoted, or distributed outside the Office of Pesticide Programs or the Office of Policy, Economics and Innovation unless otherwise approved by both the management of the Office of Pesticide Programs and the EPA Work Assignment Manager, Yvonne Watson. 1.3 Program Description Product Reregistration for conventional pesticides is largely the responsibility of the EPA Office of Pesticide Programs (OPP) Special Review and Reregistration Division (SRRD), although the final end products - reregistration notices and stamped labels - are dependent upon the Registration Division (RD). In addition to product reregistration, SRRD is also responsible for reregistration eligibility decisions, tolerance reassessments, and special reviews. Reregistration of antimicrobial pesticides or biopesticides is the responsibility of the Antimicrobials Division (AD) and Biopesticides and Pollution Prevention Division (BPPD), respectively. This evaluation focuses only on conventional pesticide products because of the limited time and resources available and because conventional products are most common. 1.3.1 Statutory Framework The Federal Insecticide, Fungicide, and Rodenticide Act, or FIFRA, as amended in 1988, authorized EPA to conduct a comprehensive pesticide reregistration program. Reregistration involves a complete review of the human health and environmental effects of older pesticides 1-2 ------- originally registered before November 1, 1984. The re registration process is finite and will conclude when all pesticides registered prior to November 1, 1984, have been reregistered (or cancelled). The reregistration requirements of FIFRA are not codified by rulemaking. FIFRA specified five stages of reregistration and included provisions for collection of reregistration fees. Product reregistration is considered part of phase five, data review and reregistration (FIFRA section 4(b)). According to FIFRA section 4(g)(2)(b): • Before reregistering a pesticide, EPA shall obtain any needed product-specific data regarding the pesticide and shall review such data within ninety days after its submission. • EPA shall require that the data be submitted not later than eight months after a determination of eligibility has been made for each active ingredient of the pesticide, unless a longer period is required for the generation of the data (no more than two additional years). • After reviewing its active ingredient(s) and product-specific data, EPA shall determine whether to reregister a pesticide. If eligible to be reregistered, EPA shall reregister such pesticide within six months after the submission of the product-specific data. The Pesticide Registration Improvement Act (PRIA) of 2003 established pesticide registration service fees for registration actions. It also included specific deadlines for completion of specific aspects of the reregistration process: • Complete all REDs for food-use pesticides by August 3, 2006 • Complete all REDs for non-food-use pesticides by October 3, 2008 EPA met its deadline to complete the 231 REDs for food-use pesticides, with the exception of aldicarb.1 PRIA did not provide deadlines for completion of product reregistration. Pesticides with food uses must meet the safety standards of the Federal Food, Drug, and Cosmetic Act (FFDCA), as amended by the Food Quality Protection Act (FQPA) of 1996. EPA must determine that pesticide residues remaining in or on food are safe. As amended by FQPA, FFDCA requires the reassessment of all existing tolerances (pesticide residue limits in or on food). FQPA also amended FIFRA to require periodic review of pesticide registrations to ensure that all pesticides continue to meet statutory and policy standards over time. FIFRA section 3(g) specifies that EPA establish procedural regulations for conducting registration review on a fifteen-year cycle. This regulatory scheme, called registration review, was proposed for public comment in July 20052 and the EPA Administrator signed the final action on August 1, 2006.3 1 EPA Press Release, "U.S. Pesticide Safety Highest in the World," August 1, 2006, http://www.epa.gov/newsroom/ 2 40 CFR part 155, Procedural Regulations for Registration Review, Proposed Rule, 70 FR 40251, July 13,2005 1-3 ------- EPA designed the program to address lessons learned from reregistration, including predictable schedules, sound science, transparency and public participation, flexibility, early stakeholder involvement, and using a docket system.4 1.3.2 Product Reregistration Process Pesticides that meet current scientific and regulatory standards may be declared "eligible" for reregistration. To be eligible, an older pesticide must have a substantially complete database, and must not cause unreasonable adverse effects to human health or the environment when used according to EPA-approved label directions and precautions. EPA publishes its reregistration eligibility decision in one of two document types: • REDs, or Reregistration Eligibility Decisions, for pesticides that have sufficient supporting data and whose risks can be successfully mitigated. • IREDs, or Interim Reregistration Eligibility Decisions, for pesticides that are undergoing reregistration, require a reregistration eligibility decision, and also must be included in a cumulative assessment under the Food Quality Protection Act (FQPA) of 1996 because they are part of a group of pesticides that share a common mechanism of toxicity. For pesticides that require tolerance reassessment decisions under FFDCA, but do not require a reregistration eligibility decision, or where the RED was completed prior to the passage of FQPA (1996), EPA publishes a Report on FQPA Tolerance Reassessment Eligibility Decision (TRED). After EPA declares a pesticide reregistration case conditionally eligible for reregistration (the condition being that RED-specified mitigation is incorporated on the label), the individual end- use products that contain the active ingredient must be reregistered. This concluding part of the reregistration process is called "product reregistration." Product reregistration consists of three basic steps (Figure 1-1): 1. After issuing a RED for an active ingredient, SRRD sends registrants a Data Call-In (DCI) notice requesting any product-specific data needed to complete reregistration for each of the individual pesticide products covered by the RED. 2. SRRD receives and evaluates the requested studies from the registrants. It requests additional information, as needed, and conducts a preliminary label assessment. 3. Based on its review of the data and labeling, RD reregisters a product if it was found to meet FIFRA and FFDCA standards. The primary output of this step is a reregistration notice (issued to the registrant) and the stamped pesticide label, which includes any revised mitigation specified in the RED or during the product reregistration process. 3 40 CFR part 155, Procedural Regulations for Registration Review, Final Rule, 71 FR 45719, August 9, 2006 4 "Compare Registration Review to Reregistration," Presentation by Susan Lewis, Special Review and Reregistration Division 1-4 ------- Signed RED(s) Issue Data Call In CDDn/DCD Evaluate Registrant Data CDDn/DDD Reregister Product on Stamped Label i Figure 1-1. Overview of Product Reregistration Process. (Source: OPP Enterprise Architecture Process Description: Special Review and Registration Division Product Registration, SRA) Issue Data Call-in After a RED is signed, EPA collects both product-specific data and confirmatory data on the active ingredient as identified in the RED. EPA requests this information through Data Call-ins (DCIs) that are approved by the Office of Management and Budget (OMB) and then issued by EPA to the pesticide registrants. DCIs may either be generic (for confirmatory data) or product- specific (PDCIs). The Program Support Branch in SRRD is responsible for preparing the DCIs. Evaluate Registrant Data Registrants must respond to a DCI to indicate whether or not they intend to support a product within ninety days of issuance. If the product will not be supported, EPA publishes a cancellation notice in the Federal Register. If a registrant does not respond to the DCI, EPA has the option to initiate a suspension of the registration. Registrants continuing to support a product must submit study data to EPA within eight months of the DCI being issued. The Information Technology and Resource Management Division/Information Services Branch (ITRMD/ISB) reviews the study format, assigns a record number, and sends the studies to the Chemical Review Manager (CRM) in SRRD Product Reregistration Branch (PRB). The SRRD CRM coordinates and tracks all activities and communication with the registrant. Product chemistry and acute toxicology studies are evaluated within PRB. If a study contains efficacy data, RD conducts the evaluation since PRB does not have in-house expertise in that area. If a study contains deficiencies, the CRM notifies the registrant and requests a corrected study. After all data have been reviewed, PRB conducts a label assessment and then sends the required documentation to RD for a label review and reregistration decision. Reregister Product Once RD receives the product reregistration package, the Product Manager (PM) reviews it for completeness and requests any missing data from PRB. In most cases, the label submitted by the registrant with the original reregistration submission is no longer current, so RD requests an updated label from the registrant. Any package inaccuracies are corrected at this time. Once the amended label has been provided and is acceptable, RD develops a reregistration notice. If a product contains multiple active ingredients, EPA instead issues an amendment to the product's registration; a product with multiple active ingredients is not reregistered until the last active ingredient in its formulation is eligible for reregistration and its label has been 1-5 ------- amended. The registrant receives a reregistration notice and a copy of the stamped label. The label is recorded in Pesticide Product Label System (PPLS), which is available on the OPP Web site. This concludes the product reregistration process. For more information on the product reregistration process, please refer to "OPP Enterprise Architecture Process Description: Special Review and Reregistration Division Product Reregistration," SRA International, September 29, 2005. 1.3.3 Roles in the Product Reregistration Process This section provides a brief overview of the key OPP divisions that play a role in product reregistration. Other OPP divisions sometimes contribute to product reregistration, as needed and/or requested. Special Review and Reregistration Division (SRRD) is responsible for pesticide reregistration, tolerance reassessment, and registration review for conventional chemical pesticides. • Reregistration Branches write the REDs, process confirmatory data on an active ingredient that are submitted in response to a DCI, and address post-RED issues. • Program Support Branch (PSB) is responsible for preparing DCI justification packages and issuing DCIs. • Product Reregistration Branch (PRB) tracks ninety-day and eight-month responses to product-specific data call-ins, processes product guidelines and identifies deficiencies, communicates with the registrant, conducts label assessments, and processes packages for RD. Registration Division (RD) is responsible for product registrations, amendments, registrations, tolerances, experimental use permits, and emergency exemptions for conventional chemical pesticides. With respect to product reregistration, RD conducts label reviews, requests additional label changes (as needed), sends reregistration notices, and stamps (approves) labels. Information Technology and Resources Management Division (ITRMD) is responsible for information support, dockets, the OPP Web site, computer support, budget, and personnel. Wth respect to product reregistration, ITRMD receives and processes the ninety-day and eight- month submissions and supports some of the information management databases (e.g., OPPIN). Field and External Affairs Division (FEAD) is responsible for program policies and regulations; legislation and congressional interaction; regional, state, and tribal coordination and assistance; international and field programs; and communication and outreach activities. Wth respect to product reregistration, FEAD reviews the DCI justification package and facilitates communication with OMB and other federal agencies. 1-6 ------- 1.3.4 Product Reregistration Program Logic Model The evaluation questions (see Section 1.1) were considered relative to the logic model for the pesticide product reregistration program (Figure 1-2). A logic model is a visual, systematic way to represent how a program works by illustrating the relationships between a program's resources, activities, outputs, and short-term, intermediate, and long-term outcomes. The model highlights the key connections between program components and outcomes, as well as providing some context in which the program operates. The program's logic model illustrates several key considerations regarding the product reregistration process: • Issuing the RED does not directly result in mitigations appearing on the label. That is, the program cannot achieve its short-term outcome (updated mitigation practices specified on label of products sold to growers/applicators) until the completion of the entire product reregistration process. • Product reregistration relies upon registrant-submitted data and receiving that data in a timely manner. • OPP often has to request additional information from the registrant as it evaluates product-specific data, which results in delays as OPP requests data, the registrant develops the data, and OPP tracks and reviews (or re-reviews) additional submissions. • Seven entities consult or participate in the product reregistration process, which removes aspects from the direct control of OPP. These organizations include other parts of EPA, other federal agencies, and the pesticide registrants (see "Partners that Consult or Participate"). • Several external factors affect program effectiveness, which influence resources, activities, outputs, and outcomes. These factors affect OPP's regulatory responsibilities, its priorities, the timeliness of information provided, and the resources available to complete product reregistration. • Product reregistration has a variety of customers with different interests, concerns, and incentives. 1-7 ------- Figure 1-2. Logic Model: U.S. EPA Office of Pesticide Programs Product Reregistration Mission To improve human and environmental health by ensuring older pesticide products are safe and to effectively manage and mitigate risk based on the best available science. The product reregistration program fulfills this mission by reviewing older pesticide products under the Federal Insecticide, Fungicide, and Rodenticide Act (FIFRA) to ensure they meet current scientific and regulatory standards. Resources Activities Outputs Short-term Intermediate Long-term Special Review and Reregistration Div. • Program Support Branch (1 FTE) • Product Reregistration Branch (16.5 FTE) Registration Div. (6 FTE) OGC OW OAR Chemical databases Contracts ($25 - 40k) v Issue Reregis Eligibility Dec Interim Rerec Decision (IRE .(ration ision (RED) or ist ration D) documents Some of the required mitigations identified Public and environmental groups more aware of risks of active ingredients 1 Issue data ca or IRED to re (OMB approv ll-insfor RED gist rants ed) Evaluate product-specific data submitted Conduct preliminary label assessment and label review Reregister product pesticide \ ^ Voluntary cancellation requests DCI receipts and responses Requests for additional information from registrants, as needed Reregistration notice Stamped pesticide label with updated mitigations Some products voluntarily cancelled by registrants and unavailable to growers/ applicators and consumers (residential use products) Updated mitigation practices specified on label of products sold to growers/applicators Product labels more enforceable by state agencies Consumers can better compare pesticide options Growers/applicators/ consumers may choose safer pesticide product alternatives Applicators use existing pesticide products used in a safer manner based on updated label Consumers have more confidence in safety of food supply and production Reduce exposure to applicators, workers, critical habitats, and the environment Preserve critical beneficial uses of pesticide products 1 Improve human health and the environment Partners that Consult or Participate Office of Management and Budget U.S. Department of Agriculture Regulatory Coordination Staff (EPA OPPTS) Field and External Affairs Division (EPA OPP) Information Technology and Resource Management Division /Information Services Branch Other Federal Agencies (FWS, NMFS, FDA) Pesticide Registrants External Factors Affecting Program Effectiveness Oversight of Office of Management and Budget Responsiveness of Pesticide Registrants Level of budget allocation Implications of new legislation and regulations FIFRA Scientific Advisory Panel recommendations North American Free Trade Agreement requirements European Commission regulatory decisions Customers Pesticide Registrants develop and produce products Growers/Applicators purchase, apply, and use products Agricultural Workers work in areas where products are applied Environmental Groups advocate a position and raise awareness of environmental issues to the public General Public use residential products and consume food and other commodities that are treated with pesticides State Agencies enforce pesticide labels ------- 1.4 Review of Related Evaluations Numerous entities have commented on reregistration and its shortcomings, though none have focused exclusively on product reregistration. Nonetheless, reviews conducted by the Government Accounting Office (now called the Government Accountability Office), the EPA Office of Inspector General, the Office of Management and Budget, and other entities illustrate the depth of the issues explored later in this report, as well as the striking similarities and marked differences between product reregistration and reregistration generally. In addition, OPP itself has also commented publicly on product reregistration, including in the recent rulemaking for its registration review program. 1.4.1 Funding and Accountability In 1996, the Congressional Research Service (CRS) reviewed the Food Quality Protection Act, including reregistration and its related funding issues.5 Reregistration is financed through a combination of appropriated funds and registration "maintenance" fees paid by pesticide registrants. EPA maintains that fee collections have been lower and costs higher than originally anticipated, and as a result maintenance fees have been extended. Pesticide registrants contend that historical funding levels had been adequate, and they questioned whether EPA had managed funds efficiently. One reason for higher than expected costs and reregistration delays has been late and deficient reregistration package submissions, according to EPA, and these problems are being addressed. EPA requires manufacturers applying to register or reregister a pesticide to submit reports of scientific studies on pesticide toxicity and behavior in the environment. EPA requires that studies conducted by industry conform to EPA standards of scientific quality. Studies that do not meet EPA standards are rejected and must be repeated/upgraded and then reevaluated. Rejected studies contribute to the high cost of registration. While pesticide registrants have argued that EPA's scientific standards are excessive, EPA has insisted that registration decisions should be based on the best available science. Historically, EPA rejected approximately 30 percent of studies submitted. A 1991 analysis of factors contributing to late and deficient study submissions prompted a joint EPA-industry project to improve performance. Because of workshops, guidance, and registrant efforts, the study rejection rate in 1996 was half of what it was in 1993 and many submissions are timelier, according to EPA. Some have argued that industries have little incentive to submit timely and adequate applications to maintain registrations of older pesticides; while a decision is pending about the safety of the older pesticides, manufacturers may continue to market them. 1.4.2 Reregistration Policy In 1986, the Natural Resources Defense Council (NRDC) evaluated the reregistration program and related policies.6 The reregistration process has its roots in the 1972 FIFRA amendments 5 CRS Report to Congress: Pesticide Legislation: Food Quality Protection Act of 1996 (P.L. 104-170), 96-759 ENR, September 11,1996, Linda Jo Schierow, available at http://ncseonline.org/nle/crsreports/pesticides/ 6 "Pesticide Reregistration: An Evaluation of EPA's Progress," Lawrie Mott, Natural Resources Defense Council, San Francisco, California, April 3, 1986 1-9 ------- and in its 1986 report NRDC noted, "until recently reregistration was not even a high priority within EPA's pesticide program." Of NRDC's three key findings, one is particularly relevant to the premise of this evaluation: reregistration has not been expeditious. Two of the corresponding recommendations include: • EPA should immediately issue final regulations establishing procedures for reregistration. Further, NRDC noted, "Without final regulations, EPA's reregistration program is operating on an ad hoc basis. Furthermore, absent a regulatory framework, the public cannot readily follow EPA's process." • EPA should institute biannual public reports that identify which pesticides have been reregistered, etc. The public has no simple way to determine which pesticides have been reregistered. Similarly, the Administrative Conference of the United States recommended that EPA adopt, whenever possible, rules setting clear standards for pesticide reregistration data and should communicate those standards to registrants.7 In 2000, the EPA Office of Inspector General (OIG) concluded that EPA did not consider regulation development a high priority since the pesticide statutes are very prescriptive and the program is highly centralized.8 As it developed its registration review program, EPA and industry considered the shortcomings of its reregistration program.9 In response to its proposal, industry commented that EPA should not implement registration review of end-use products until it fixes the problems with the review of end-use products in reregistration. Registration review and reregistration are likely to be similar and registration review might duplicate the effort of reregistration, especially when a product may undergo product-specific review several times. The commenters were concerned that if EPA does not achieve efficiencies in the review of end-use products, the fifteen-year registration review will extend to forty years. In response, EPA stated that it expects reregistration to satisfy most product-specific data requirements and achieve many label improvements for end-use products. Although EPA does not expect it will routinely require product-specific data during registration review, it expects that registration review will be an important vehicle for the continuing update of labels. EPA agreed that the review of end-use product labels could benefit from process improvements, and that registrants and other stakeholders can help develop approaches to make this process more efficient. 1.4.3 Information Management As early as 1980, GAO auditors determined that EPA was behind schedule, lacked a tracking system to identify problems, did not have a formal operating procedure for reregistration, and had not adequately monitored its overall progress in the reregistration program.10 In 1991, GAO reported on the lengthy delays associated with reregistering pesticides and that such delays 7 Recommendations of the Administrative Conference of the United States, 1 CFR part 305, Recommendation 93-5, Procedures for Regulation of Pesticides 8 Pesticides: Follow-up Report on EPA's Pesticide Program, Report No. OOP00011, March 27,2000, EPA Office of Inspector General 9 Pesticides; Procedural Regulations for Registration Review, Final Rule, 71 FR 45719, August 9, 2006 10 Delays and Unresolved Issues Plague New Pesticide Protection Programs, GAO, 1980 1-10 ------- stem, in part, from the inadequate support provided by EPA's information systems for reregistering pesticides.11 In 1992, GAO reported that after having invested $14 million over three years in data systems development, EPA could not easily assemble accurate, reliable, and complete information on chemicals in its reregistration process.12 GAO concluded that these information management problems resulted from inadequate systems planning and poor data management. In addition, OPP employed nine separate data base systems to track or manage information about chemicals pending reregistration. Each of these data systems was designed and developed separately without taking into account a way of using them jointly. EPA staff entered information about pesticide studies numerous times into different systems, and data compilation is labor intensive and time consuming. In 2000, the EPA Office of Inspector General (OIG) published a follow-up report to its 1994 evaluation of the pesticide program.13 OIG found that the OPP Information Network (OPPIN) had been designed to address most of its information management concerns, but some of the original concerns still exist. OIG noted that OPP had not completed actions to improve information systems that contain inaccurate, incomplete, and duplicate data or that are not integrated. 1.4.4 Performance Management In FY2005, the Office of Management and Budget (OMB) evaluated the reregistration program using its Program Assessment Rating Tool (PART).14 The FY2005 Program Assessment indicated that the program was "adequate," and included the following conclusions: • There is no evidence to indicate that a different program design would be more effective or efficient than what is currently used. The 1996 FQPA changes added clarity to science reviews and introduced higher visibility deadlines, which forced increase effectiveness. • To help ensure the program is effectively targeted, statues establish criteria for prioritizing reregistration activities and sets specific deadlines and timelines for completion. • The annual goals are output measures but are acceptable because it is a process- oriented licensing program that results in "products" (i.e., reregistrations). • The annual output goals reflect activity required to meet statutorily required completion dates. The program did have difficulty meeting annual targets in the past, leading to changes in the statutorily required dates. The targets and baselines for the output measures are adequate. 11 Pesticides: EPA's Information Systems Provide Inadequate Support for Reregistration, GAO/T-IMTEC- 92-3, October 30, 1991 12 Pesticides: EPA's Information Systems Provide Inadequate Support for Reregistration, GAO/IMTEC- 92-3, October 30, 1991. Pesticides: Information Systems Improvements Essential for EPA's Reregistration Efforts, GAO/IMTEC-93-5, November 23, 1992. 13 Pesticides: Follow-up Report on EPA's Pesticide Program, Report No. OOP00011, March 27,2000, EPA Office of Inspector General 14 "Program Assessment: Pesticide Reregistration," expectmore.gov, accessed on July 11, 2006. 1-11 ------- • The program uses multiple electronic methods to track information on the progress of reregistration actions and reports on the progress of activities are provided to program management weekly. OPPIN is a central database used to track activity, and it stores history that is easily retrievable. A performance measure for pesticide product reregistrations was not included in PART, nor was product reregistration considered explicitly when evaluating the reregistration program. In August 2006, the EPA Office of Inspector General (OIG) issued a critique of the Food Quality Protection Act.15 OIG commented that although EPA has made progress in implementing the requirements of the FQPA, OPP has primarily measured its success and the impact of FQPA by adherence to its reregistration schedule rather than by reductions in risk to children's health. For FY2005, OPP used the following output measures to assess programs: • Cumulative percentage of REDs completed • Number of product reregistrations OIG commented that the measures used by OPP generally indicate actions taken, instead of environmental or human health outcomes achieved. It concluded that OPP lacks outcome measures to assess the specific impact of those actions on the health of children and others. 1.5 Organization of Report This report is composed of eight main chapters: Chapter 1, Introduction, identifies the purpose of the evaluation and its audience, as well as key questions that will be answered. This section also includes a description of the program and a review of related evaluations. Chapter 2, Methods, summarizes the approach for conducting the evaluation, and is based on the EPA-approved methodology. Chapter 3, Progress on Product Reregistration, assesses the status of product reregistration and summarizes the duration of the processes. Chapter 4, Reregistration Eligibility Decisions, discusses the issues associated with this part of the reregistration process that impact product reregistration. This section also discusses three case studies and alternative strategies used by EPA to implement mitigation. Chapter 5, DCI Justifications and Preparation, addresses the current process for preparation and mail out of the generic and product-specific data call-ins by EPA and approval by the Office of Management and Budget, as well as associated issues and recent changes. Chapter 6, Data Requirements and Review, summarizes some of the issues associated with registrant responses to the DCI, discusses an analysis of product-specific acute toxicity and product chemistry data, identifies strategies for batching data requirements, and discusses communication and management issues. 15 Measuring the Impact of the Food Quality Protection Act: Challenges and Opportunities EPA Office of the Inspector General, Report No. 2006-P-00028, August 1, 2006, http://www.epa.gov/oig/reports/2006/20060801-2006-P-00028.pdf 1-12 ------- Chapter 7, Label Assessments and Reviews, addresses the division of labor between SRRD and RD to revise pesticide product labels, discusses workload and other issues, and summarizes the current strategy to expedite product reregistration. Chapter 8, Suggested Changes to Process Design and Other Recommendations, discusses the project team's recommendations for modifying specific aspects of the product reregistration process based on its findings presented in Chapters 3 through 8. This chapter also identifies specific areas where EPA may wish to modify its current program to better address product reregistration. 1-13 ------- 2. Methods The evaluation of the product reregistration program is a process evaluation, which is defined by the Government Accountability Office (GAO) as one that "assesses the extent to which a program is operating as it was intended. It typically assesses program activities' conformance to statutory and regulatory requirements, program design, and professional standards or customer expectations."16 Therefore, by design, this evaluation does not seek to determine the extent to which OPP achieves its intended outcomes (for instance, reduced exposure to pesticides) but only the activities that contribute to the outcomes. In preliminary discussions, OPP identified a number of issues and concerns regarding product reregistration, including information management, the division of labor between SRRD and RD, issues in REDs, and information management. Abt Associates sought to examine these concerns and determine the extent of issues, as applicable, as well as identify other issues. This chapter summarizes the data collection methods, data collection approach, and analysis plan. For more information on the approach taken for this analysis, please see "Identifying Innovations and Streamlining OPP's Product Reregistration Program: Program Evaluation Methodology," July 24, 2006. 2.1 Data Collection Methods Abt Associates used a variety of methods to collect the information to answer the six evaluation questions. The data collection largely resulted in qualitative data, which we supplemented with quantitative data as needed and as available. Each data collection method used is described below along with the evaluation question(s) it helped answer. Limitations to each approach are identified. The following table summarizes each of the collection methods and the evaluation questions to which they will be applied (Table 2-1). Table 2-1. Summary of Data Collection Methods Evaluation Question What components of REDs have caused delays in product reregistration? What problems, bottlenecks, or unnecessary duplication of efforts occur in the product reregistration process that are under the control of OPP? What innovations or streamlining in process could result in more timely implementation of mitigation specified in the RED and/or more efficient production of outputs? Data Collection Method Interviews • • • Document Review • • • Program Data • Case Studies • • Subject Expert • • • 16 U.S. Government Accountability Office, "Performance Measurement and Evaluation: Definitions and Relationships," GAO-05-739SP, May 2005. 2-1 ------- Evaluation Question What are the pros and cons of each of the proposed innovations or streamlining measures? What is the optimal allocation of tasks between the Special Review and Reregistration Division and the Registration Division? Are any external entities or considerations impeding the product reregistration process? Data Collection Method Interviews • • Document Review Program Data • Case Studies Subject Expert • • • The information collection activities above are governed by requirements under the Paperwork Reduction Act (PRA). Under PRA, EPA's information collection is limited to nine or fewer non- federal individuals or entities. Requests for similar information and/or similar questions must be limited to nine or fewer non-federal respondents. This evaluation was conducted in compliance with the PRA and other OMB rules on information collection requests. Interviews Abt Associates conducted a series of open-ended interviews (i.e., with no pre-determined response options) with numerous EPA staff. These individuals were accessible, have an interest in the results of the evaluation, and have a thorough understanding of the product reregistration process and its issues. In each interview, we characterized an individual's role in the reregistration process and solicited his/her perspective on the process in its entirety. Interviews with management focused more on the overall process, as well as the information flow between OPP divisions. Specific questions were prepared in advance of the interviews to ensure coverage of issues and to manage time (Appendix A). Interview responses and comments are not referenced/attributed to specific individuals in this report or related discussions and presentations. A list of individuals interviewed or consulted is appended to this report (Appendix B). We believe that this approach increased the honesty of the answers and opinions provided in the interviews. All interviews were audio-recorded (with the permission of the interviewee), and the tapes were used to clarify issues and confirm the evaluator's notes. This method of data collection was consistent with the statement of work, and also provided the opportunity to identify issues, solicit explanatory information, and understand the general functioning of the product reregistration program. This was appropriate given the process- improvement focus of the evaluation. Abt Associates sought to supplement the information gained in interviews with reregistration status, performance, and tracking data (where available), published documents, and additional information from OPP staff. Although the perspectives of the registrants and the Office of Management and Budget (OMB) would be a helpful addition to this data collection, we limited our contact to EPA staff because of the limited time and resources available to complete this evaluation. However, in the document review and reregistration program data sections that follow, we identify sources from which we 2-2 ------- obtained both published information on the roles of these two groups and their perspectives on product reregistration. Document Review Published documents available from EPA, the Government Accountability Office (GAO), the Office of Management and Budget (OMB), industry associations, and environmental groups served as another data source. Abt Associates reviewed these documents to determine the documented issues of reregistration, how reregistration is presented to the registrants and the general public, and how other external auditors perceive the program. These data sources were reviewed and cited, as appropriate, in Chapter 1 to summarize how reregistration has been characterized and/or criticized in the past. Other documents informed this evaluation, including program descriptions and procedures. Under contract to EPA, SRA International developed a process flow diagram and accompanying report, which details the product reregistration process and its information management practices.17 These materials summarize the process and its use, identify data sources and applications, describe execution of the process, estimate its duration, and identify potential improvements. The information management issues identified by SRA International were considered relative to other information collected during the evaluation. Abt Associates also reviewed additional documentation provided by EPA, including management briefings, fact sheets, and example tracking reports. These sources provided a further understanding of the process and areas of improvement. Reregistration Program Data Abt Associates used existing program data to characterize progress to date on the number of pesticide products reregistered, to establish the length of time it generally takes to reregister a pesticide product, and to consider the value of proposed data streamlining options. To better define the problem, Abt Associates reviewed available data to determine progress made to date on product reregistration. The background materials developed by SRA International represent educated guesses and ideal conditions of the product reregistration process. For this evaluation, we sought to document in a verifiable manner the timeframe associated with product reregistration. Because of the estimated burden associated with this collection and the lack of a central data source, Abt Associates relied on information available from (1) the quarterly product reregistration briefing for Jim Jones, Director, Office of Pesticide Programs; (2) data pulls from OPP SRRD staff; and (3) Pesticide Reregistration Performance Measures and Goals for FY2005.18 As part of the evaluation, Abt Associates reviewed the draft findings of OPP regarding the added value of acute toxicity and product chemistry reviews on mitigation. EPA initiated this review to determine what mitigation is generally added to a product label during these two reviews compared to that specified in the RED. One possible way to streamline product reregistration would be to eliminate or streamline these two aspects of the process; however, 17 SRA International, Inc., Support Documentation, "OPP Enterprise Architecture Process Description Special Review and Reregistration Division (SRRD) Product Reregistration: Support Documentation," Task 4: Baseline & Target Architecture Refinement, Task Order Number 5: OPPT Target Architecture Support, September 29, 2005, Contract Number EP-W-05-024 18 Pesticide Reregistration Performance Measures and Goals for FY2005, 71 FR 36075, June 23, 2006 2-3 ------- OPP had no analysis upon which to base this decision. For the draft analysis, EPA selected a random sample of pesticide products and determined the changes made to the mitigation statements as a result of the two review procedures. Because the original data are considered Confidential Business Information (CBI) and because of the time required to collect the data, OPP initiated this portion of the evaluation internally. Abt Associates reviewed the sampling technique and data collection and commented on the adequacy of the sample size. Abt Associates then audited a subset of acute toxicity data to confirm EPA's results. Because product chemistry data is considered CBI, Abt Associates did not audit those results. Case Studies EPA requested two types of case studies for evaluation - pesticides for which problems with the RED caused delays in reregistration and pesticides for which re registration was expedited through Memoranda of Agreement (MOAs). These cases allowed Abt Associates to consider selected pesticides in a more in-depth manner to identify issues and possible solutions. This approach would have been far too resource intensive to complete for all active ingredients. However, this data collection method allowed us to highlight and/or validate perceived successes and failures of the product reregistration program. In order to complete the case studies, we relied on other data collection methods identified in this section, including interviews and document reviews. By completing the RED case studies, we determined what problems in the REDs caused delays in product reregistration. With this information, OPP may be better informed and could change its procedures to avoid future issues. For the case studies of active ingredients for which an MOA was signed, these case studies illustrated one way that EPA tried to implement mitigation on the label in a timelier manner. The purpose of these studies was to inform recommendations on streamlining the product reregistration process, if possible, but without going to the effort of completing an MOA for each active ingredient. In addition, we considered products for which reregistration was streamlined, such as 2,4-D, by batching data requirements, to determine if this case could be used as a model. Subject Matter Expert As Abt Associates planned for the evaluation and developed the methodology, SRRD management provided assistance. Management identified background information and materials, answered questions, and clarified issues or concerns. This feedback allowed Abt Associates to understand issues regarding the product reregistration program prior to collecting information, and helped shape the evaluation questions and the development of the logic model. This data source is particularly useful when the individual has a unique skill or professional background related to the issue being evaluated that helps the evaluator to better understand the issue and project participants. It is also useful given the internal, process-related orientation of the program evaluation. To ensure that the biases and opinions of a subject matter expert do not influence the data obtained or the conclusions made, Abt Associates challenged assumptions, collected supporting evidence, and/or identified counter-opinions or views. Similarly, staff from the EPA Office of Policy, Economics, and Innovation served as a resource on evaluation design and implementation, in addition to administering the project. 2-4 ------- 2.2 Data Collection Approach This section summarizes how Abt Associates applied each of the above data sources/collection methods to answer the evaluation questions. The data collection largely relied on interviews with OPP staff and managers, which allowed us to gain a full understanding of the product reregistration process and ways in which it could be improved or streamlined. We identified specific areas on which to focus, based on the evaluation questions, a review of background documents, and preliminary conversations with EPA staff. Problems in REDs (Evaluation Questions 1 and 2) Abt Associates collected and reviewed information for three case studies on REDs that caused delays in product reregistration: dicofol, captan, and the rodenticide cluster. These cases were selected because EPA is aware of issues with the RED that caused delays in product reregistration. Abt Associates could not make this selection independently, as it requires internal program knowledge and judgment. As the step immediately preceding product reregistration, the RED plays an important role in the information available for product reregistration. In the course of the evaluation, Abt Associates determined how often REDs cause issues in product reregistration by interviewing OPP management and chemical review managers. This review provided perspective for the sample selected for the evaluation. Abt Associates reviewed RED documentation to become familiar with its contents and conclusions prior to meeting with OPP staff. Because REDs for food-use active ingredients were completed in August 2006, the extent to which RED-associated issues may be addressed in the future is limited. Thus, this part of the evaluation largely documents historical issues that may influence upcoming project work. Implementation of RED-specified Mitigation (Evaluation Question 3) Abt Associates reviewed information for two Memoranda of Agreement (MOAs) that allowed mitigation specified in the RED to appear on the label prior to the completion of product reregistration: chlorpyrifos and phosmet. These cases were selected because they are two of approximately ten instances in which EPA signed an MOA to expedite revising labels with mitigation. These set the precedent for implementing RED-specified mitigation prior to the completion of product reregistration and may serve as a model for a voluntary program in the future. Further, these two cases were selected because information is available both in the record and by interviewing staff who participated in the process. Both are organophosphate pesticides. Chlorpyrifos posed serious health risks and revised mitigation was placed on the label within a quick timeframe. Phosmet reregistration is ongoing and highlights the complexity of the issues and the considerations of the product reregistration program. Abt Associates reviewed the MOA documentation to become familiar with its contents and conclusions prior to meeting with OPP staff. Abt Associates also considered the profile of each of the cases, the level of mitigation specified by the RED, and the number of products impacted. Similarly, OPP initiated a pilot project that uses the MOA as a model for implementing mitigation (propanil). The goal was to have registrants revise the label with the RED-specified mitigation prior to the completion of product reregistration. Abt Associates reviewed available information on propanil and interviewed staff about the success of the approach. 2-5 ------- Data Requirements: Batching (Evaluation Questions 2, 3, and 4) Abt Associates considered the case of 2,4-D as a model for how products may be further batched. Batching is one potential way to reduce the number of data requirements that the registrant needs to fulfill while still making the information available to EPA, as well as reducing the number of studies that OPP needs to review. We interviewed OPP staff to learn their experience with streamlining acute toxicity data requirements by batching products and using existing information about the products for storage stability. Data Requirements: Acute Toxicity/Product Chemistry (Evaluation Questions 2, 3, and 4) In order to determine the impact of product-specific acute toxicity reviews and product chemistry reviews conducted during product reregistration on the product label and confidential statement of formula (CSF), OPP analyzed the changes in product labels that resulted from these reviews over the period of its product reregistration activities. OPP initiated this review to determine what mitigation is generally added to a product label during these two reviews. Abt Associates verified the sampling procedure, assisted in data analysis, and audited a subset of OPP's results. For more information on the approach for the audit, please see "Results of Audit - Evaluation of Acute Toxicity and Product Chemistry Review Findings," Memorandum to Yvonne Watson and Pete Caulkins, U.S. EPA, from Debra Kemp, Albert Acquaye, and Jason Sacks, Abt Associates Inc., January 30, 2007. Label Reviews (Evaluation Questions 2, 3, 4, and 5) As currently designed, the product reregistration process often includes label assessments/reviews by both SRRD and RD, which is perceived as a duplication of effort by some staff members. We determined why RD often conducts an extensive second review and identified possible alternatives through interviews of relevant staff. In addition, a pilot project was designed to determine if the product reregistration process would be more efficient if SRRD conducted only product chemistry and acute toxicity reviews and if RD alone conducted label reviews. To determine this, both SRRD and RD conducted a label review independently of ziram products and determined if the two were consistent. Ziram was selected for this exercise because its products were in the appropriate stage of product reregistration for this pilot. Relationship between SRRD and RD (Evaluation Question 5) Although the responsibility of SRRD, RD contributes significantly to the product reregistration process by reviewing labels, issuing reregistration notices, and stamping revised labels. However, the two groups use different systems and have different management and unique cultures. Thus, through interviews we identified issues with the current division of labor and existing issues and proposed alternative means to divide the work, allocate resources, and communicate process information. Abt Associates first reviewed the product reregistration process flow diagram and relevant standard operating procedures (SOPs). We then interviewed staff and managers in both divisions to determine the current division of labor and any associated issues. 2-6 ------- DCI Preparation and OMB Approval Process (Evaluation Question 6) The preparation of the DCI is the first step in the product reregistration process. Despite approved SOPs, the SRRD contended that the DCI process is time-consuming and often evaluated by OMB against varying standards. OMB's approval of a DCI package was believed to be a source of delay in the product reregistration program. Thus, in this evaluation, Abt Associates explored the DCI preparation process and any associated issues. Information Management (Evaluation Questions 2, 3, and 4) One of the conclusions of SRA International was that, "EPA and participants of the product reregistration process could very much use an automated method of tracking the numerous products throughout the process. Currently, all tracking is done manually in PRB and only the CRM has direct access to the tracking data." To further support this conclusion, we considered shortcomings in information management, opportunities for improvement, and historical barriers to these improvements. Abt Associates interviewed SRRD, RD, and other OPP staff regarding product-level tracking for reregistration. Management/Budget (Evaluation Questions 2, 3, and 4) Although mandated by statute, OPP historically viewed reregistration (and particularly product reregistration) as less important than registration activities. The need to create SRRD in 1989 to focus specifically on reregistration in part reflects this problem. In addition, pesticide reregistration is a politically sensitive and high profile issue with both industry and environmental groups. Abt Associates interviewed OPP management and staff to identify management priorities, budget issues, and external influences. Timeline for Product Reregistration (Evaluation Question 2) The premise of this program evaluation was that product reregistration is a time-intensive and lengthy process. Abt Associates validated this assumption with the data available from OPP management briefings, annual reports, and internal databases. 2.3 Data Analysis Abt Associates compiled and assessed a variety of information, both qualitative and quantitative in nature. For qualitative information obtained from interviews, Abt Associates referred to its notes and interview tapes to summarize the information provided. When and if a discrepancy was identified, we confirmed the information with a third source or with OPP management. As noted in the preface to this report, the findings are reflective of the information provided to the project team. For quantitative information, Abt Associates used a standard software package and data analysis and presentation techniques to summarize the progress on product reregistration. To the extent that these data sources are limited in utility, we have identified these issues in this report. If data were missing or seemed inconsistent, we confirmed potential data issues with OPP staff. Abt Associates documented its quality assurance procedures in its Quality Assurance Project Plan, which was approved by Abt Associates, Industrial Economics, and EPA in July 2006. 2-7 ------- 3. Progress on Product Reregistration EPA originally estimated that re registration would include approximately 600 active ingredient cases (consisting of more than 1,100 active ingredients) and approximately 20,000 pesticide products. The exact universe changes as REDs are published and estimates are refined. EPA projects that product re registration will not likely be completed before the end of calendar year 2012. 19 3.1 Status of Product Reregistration Since beginning reregistration in the late 1980s, EPA has completed reregistration actions for 7,358 pesticide products. Reregistration actions for 11,948 products (conventional and antimicrobial) were pending as of October 2006. The overall product reregistration universe, both completed and pending, is presented in Figure 3-1. SRRD will also be responsible for product reregistrations that will follow completion of the 54 remaining, non-food use REDs October 2008. 20 by Pending (11,948) 62% Completed (7,358) 38% Figure 3-1. Universe of Pesticide Products at End of FY2006 Of the reregistration actions completed through the end of FY2006, the majority of the actions were cancellations (Table 3-1 and Figure 3-2). 19 20 Pesticide Reregistration Performance Measures and Goals, Notice, 71 FR 36075, June 23, 2006 http://www.epa.gov/oppsrrd1/reregistration/rereg istration_facts.htm 3-1 ------- Table 3-1. Cumulative Completed Reregistration Actions through FY2006 Action Reregistered Amended Cancelled Suspended Total Number of Products 2,070 563 4,695 30 7,358 Suspended (30) 0% Cancelled (4,695) 64% Reregistered (2,070) 28% Amended (563) 8% Figure 3-2. Distribution of Completed Actions through the End of FY2006. Figure 3-3 shows actions (reregistrations, amendments, cancellations) completed from FY2002 through FY2006. (The EPA database was limited to actions completed since 2002, and older data were not readily available.) Note that summing annual actions would result in a greater number of completed actions than reported above since each individual product is potentially subject to multiple actions over time. Figure 3-4 shows actions completed in FY2006. 3-2 ------- 600 500 400 -*- Products Reregistered -•- Products Amended -•-Products Cancelled -•-Total 2002 2003 2004 Fiscal Year 2005 2006 Figure 3-3. Actions Completed from FY2002 through FY2006 500 Reregistered Amended Cancelled Total Target Dec-05 Mar-06 Jun-06 Sep-06 Month Figure 3-4. Actions Completed in FY2006 Compared to Target 3-3 ------- Of the reregistration actions that were pending at the end of FY2006, the products are distributed through all phases of the pesticide reregistration process (Table 3-2). Most of the products (9,088 or 76%) have not yet had the data call-in prepared and/or approved by OMB. This is likely a function of the deadline to complete the REDs for the food-use pesticides by August 3, 2006, which increases the product reregistration backlog. The FY2006 decisions resulted in 6,722 products that will require PDCIs, in addition to remaining decisions from FY2004 and FY2005 that also require PDCIs. Table 3-2. Products with Actions Pending at the End of FY2006 Location of Products in Process Awaiting OMB approval -Antimicrobial pesticides Awaiting OMB approval - Conventional pesticides Awaiting issuance of PDCI -Antimicrobial pesticides Awaiting issuance of PDCI - Conventional pesticides Awaiting resolution of post-RED issues (in PRB) Awaiting registrant response to PDCI In PRB process In AD process In BPPD process In RD for reregistration Total Number of Products 2,229 6,859 17 1,096 143a 318 437 24 53 772 11,948 Includes eight products that are also included under "In PRB Process" The 143 products awaiting resolution of post-RED issues are those for azinphos-methyl and the rodenticide cluster. There are 116 products in PRB and 446 in RD that were awaiting completion of the cumulative risk assessments for the organophosphates and the carbamates. The organophosphate cumulative risk assessment was completed in July 2006. The FY2006 data source for this section was an internal EPA briefing.21 These data will be further refined and audited by the EPA Office of Inspector General before being published in the Federal Register in 2007. By law, EPA must establish and publish in the Federal Register its annual performance measures and goals for pesticide reregistration, tolerance reassessment, and expedited registration. Performance measures and goals were published for FY2005 in the Federal Register on June 23, 2006.22 Data on trends were obtained from OPP Chemical Review Managers. 3.2 Duration of the Product Reregistration Process SRRD maintains a database, referred to as "STATUS," that includes basic tracking data for products in each of the reregistration cases. Although more detailed information is provided in individual "charts and tables" (in Microsoft Word format), these data are not centralized and 21 Product Reregistration Quarterly Review, Briefing for Jim Jones, Associate Director of the EPA Office of Pesticide Programs, October 2006 22 Pesticide Reregistration Performance Measures and Goals, Notice, 71 FR 36075, June 23, 2006 3-4 ------- therefore not available for purposes of this analysis. Using the tracking data available, we determined the duration of the product re registration process. From these data, we can distinguish three points in the reregistration process: (1) when the RED or IRED is issued; (2) when the reregistration package is sent to the product manager (PM) in RD; and (3) when the product is reregistered (decision date). Other milestones, including the date the DCI was sent to OMB, DCI was issued, data were reviewed, etc., are not available in this data source. In the following tables and figures, we consider 124 REDs covering 1,639 products that were designated in the STATUS database as reregistered (reregistration code 22) and unconditionally reregistered with amendment or conditionally reregistered with amendment (reregistration code 17). Tables 3-3 and 3-4 and Figure 3-5 present the results for a combination of these two reregistration codes. Table 3-3 shows that, on average, it took 54 months to reregister a product. An average of 41 months was needed to get the reregistration package to the Product Manager (PM) in RD, and after the reregistration package had been sent to the PM, it took an average of 14 months to complete the reregistration process. With regard to a RED, on average, it took about 47 months to reregister all products covered by a RED. The average maximum time needed for reregistering all products covered by a RED was about 76 months. The average maximum time needed to get the reregistration package to the PM was about 53 months, and on average, once the reregistration package got to the PM, the maximum time to complete the reregistration process was about 33 months. Table 3-3. Mean Duration of Process for All Products and by RED Case Group All Products By RED (case mean) By RED (case maximum) Mean Duration (months) RED Signed to Sent to PM 41 34 53 Sent to PM to Reregistration Decision 14 13 33 RED Signed to Reregistration Decision 54a 47a 76b a Total process duration may not be the sum of the two phases because of rounding. b Total process duration is not the sum of the two phases because we calculated the mean of the maximum length of time in each specific phase and for the entire process. Table 3-4 presents the mean duration to complete all products for REDs by the number of products. On average, it took 36 months to reregister REDs that covered only one product, and 47 months to reregister all products under REDs that covered more than 70 products. REDs that covered between 14 and 26 products took the longest time (57 months) to complete the product reregistration process. Complete reregistration of the products in these cases also took the longest periods during both phases of the process. 3-5 ------- Table 3-4. Mean Duration of Process for RED Case by the Number of Products Number of Products per RED 1 2-5 6-13 14-26 27-35 36-70 More than 70 Mean Duration (months) RED Signed to Sent to PM 25 32 36 38 41 39 40 Sent to PM to Reregistration Decision 12 12 17 18 14 9 7 RED Signed to Reregistration Decision a 36 44 52 57 55 48 47 Total process duration may not be the sum of the two phases because of rounding. A closer examination of the distribution of the duration of re registration of all products shows that the mean does not represent the true picture of the duration of registration. Figure 3-5 depicts the distribution of products by the duration to complete the reregistration process. Figure 3-6 shows the distribution of products by reregistration phase. 1000 3 O 14- o I 800 600 400 200 Signed RED to Decision Date •Mean 7 Years 10 11 12 Figure 3-5. Duration of Product Reregistration Process for All Products (Reregistered and Conditional or Unconditional Reregistered Products) 3-6 ------- 1000 800 600 HI .Q = 400 200 Panel A: RED to Sent to PM •Mean 7 Years 10 11 12 1000 Panel B: Sent to PM to Decision 7 Years 10 11 12 Figure 3-6. Duration of Period from RED Signature to Product Sent to PM (Panel A). Duration of Period from Sent to PM to Decision (Panel B). These graphs include all products (reregistered and conditional or unconditional reregistered products) 3-7 ------- Figure 3-5 and 3-6 show that the average (mean statistic) is skewed by a small number of products. More often than not, the duration of the process was less than the mean. This is most obvious for the time needed to reregister a product after it has been sent to the PM. Of the 1,639 products covered in this analysis, 1,155 products, or 70 percent, were reregistered in less than 14 months (the mean time it took to reregister products) after the registration package was sent to the PM (Figure 3-6, Panel B). As such, we present the median time for each of the phases for all the reregistered products in Table 3-5 and the median time by the number of products per RED in Table 3-6 below. Table 3-5. Median Duration of Process for All Reregistered Products and by RED Case Group All Products By RED (case mean) By RED (case maximum) Median Duration (months) RED Signed to Sent to PM 30 29 46 Sent to PM to Reregistration Decision 7 9 17 RED Signed to Reregistration Decision 41 41 69 a Total process duration may not be the sum of the two phases because of rounding. b Total process duration is not the sum of the two phases because we calculated the mean of the maximum length of time in each specific phase and for the entire process. Table 3-6. Median Duration of Process for RED Case by the Number of Products Number of Products per RED 1 2-5 6-13 14-26 27-35 36-70 More than 70 Median Duration (months) RED Signed to Sent to PM 30 28 30 30 38 30 38 Sent to PM to Reregistration Decision 6 6 10 13 10 8 5 RED Signed to Reregistration Decision 35 39 37 57 55 36 46 For the universe of products that have not yet completed product reregistration, but that have been sent to the PM in RD, the distribution of the time it took to reach this milestone is presented in Figure 3-7. Since being sent to the PM, the products have remained in RD anywhere from less than one month to more than 11 years. RD staff commented in interviews that many products are sent to them when there are still outstanding issues that need to be addressed. 3-8 ------- 300 250 « 200 •S 150 01 100 50 Mean RED to Sent to PM 678 Years 10 11 12 >12 Figure 3-7. Duration of Period from RED Signature to Product Sent to PM for Products that are Not Yet Reregistered The duration of the period from when the RED is signed to when the product is sent to the PM for reregistration includes several steps, not all of which are the responsibility of SRRD or even EPA. Part of this time includes the preparation and approval of the DCI justification package and the DCIs themselves (see Chapter 5). In addition, this period also includes the time for registrant responses (both ninety-day and eight-month), EPA review of the data submitted, and additional communication with the registrant. Thus, the estimates from the time the RED is signed to when the product reregistration package is sent to the Registration Division (RD) is not indicative of the time that SRRD Product Reregistration Branch (PRB) spends working on product reregistration (i.e., the time from the PDCI issued until the product reregistration package is sent to RD). For the 755 products pending in PRB at the end of FY2006, SRRD data indicate that: • 42 percent have been in PRB less than 12 months • 36 percent have been in PRB between 12 and 24 months • 20 percent have been in RPB between 24 and 36 months • 2 percent have been in PRB more than 36 months Table 3-7 presents the number and percentage of products completed for each fiscal year. 3-9 ------- Table 3-7. Product Reregistration Completion Status by Fiscal Year Fiscal Year 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 a 2006 Total REDs/ IREDs Issued 8 20 10 22 34 42 28 13 14 13 9 15 16 17 29 41 331 Associated Products 442 969 853 729 809 1,050 1,360 707 238 195 578 736 1,016 713 1,184 8,693 20,272 Products Completed 422 954 824 717 772 970 1,117 560 188 164 270 516 505 126 0 1 8,106 Products Pending Number 20 15 29 12 37 80 243 147 50 31 308 220 511 587 1,184 8,692 12,166 Percent 5 2 3 2 5 8 18 21 21 16 53 30 50 82 100 100 60 Location RD RD, AD, BPPD AD, RD AD, RD AD, RD AD, RD AD, RD, BPPD, PRB RD RD RD RD RD SRRD PRB SRRD PSB SRRD PSB SRRD PSB - Pollution Prevention Division, PRB = Product = Registration Division, SRRD = Special a The Fluazifop-p-butyl TRED required a PDCI. Key: AD = Antimicrobials Division, BPPD: Biopesticides and Reregistration Branch, PSB = Program Support Branch, RD Review and Reregistration Division Source: "Status of Product Reregistration: Pending Products," December 12, 2006. For purposes of implementing mitigation specified in the RED to reduce risks to human health and the environment, the overall length of the process - from the time EPA signs the RED to the time it stamps the label - is a key metric. However, for purposes of a process evaluation, determining the duration of each individual step becomes critical. Unfortunately, as currently managed, EPA data are of limited value for analyzing the time associated with each step in product reregistration. As explained in later sections, EPA does not track product reregistration data in a centralized database because the main OPP information management system (OPPIN) is not adequate. 3-10 ------- 4. Reregistration Eligibility Decisions Reregistration Eligibility Decision (RED) documents include EPA's evaluation of the database for a chemical, its conclusions about the potential human health and environmental risks of the current product uses, and its decisions and conditions under which these uses and products will be eligible for reregistration. A RED also identifies the data and labeling requirements for products eligible for reregistration, as well as any additional confirmatory data needed on the active ingredient. Almost every RED includes some measures or modifications to reduce risks, e.g., declaring certain uses ineligible for reregistration; restricting use of products to certified applicators; limiting the amount or frequency of use; improving use directions and precautions; adding more protective clothing and equipment requirements; employing ground water, surface water, or other environmental and ecological safeguards; and other measures. The "generic" chemical review managers (CRMs) in the reregistration branches of SRRD develop REDs based on available data and analyses conducted by the OPP science divisions. After a RED is signed, the Program Support Branch (PSB) and the Product Reregistration Branch (PRB) of SRRD initiate product reregistration. The "product" CRMs in PRB provide oversight for product reregistration. As needed, the reregistration branches are responsible for post-RED activities that arise after the RED is published and/or EPA receives product-specific and confirmatory studies. 4.1 Issues with REDs This evaluation included three case studies where issues in the RED were believed to delay product reregistration. In addition to specific issues, several more general issues regarding the RED-development process became apparent. These include workload management, staffing, and division of labor, all of which are discussed in this section. The generic CRMs in the four SRRD reregistration branches are responsible for writing a RED for an active ingredient. This part of the reregistration program faces public scrutiny, has ambitious deadlines, and demands a heavy workload. Over the years, this part of the reregistration program has evolved, particularly with respect to the FQPA requirements, scheduling, public participation, and transparency. However, the goal of this part of the process is to publish a RED by the given deadline. As a result, some REDs were published without addressing some outstanding issues. OPP also commented that virtually every RED likely has an issue or a hole because these may not be apparent until the RED is implemented (i.e., during product reregistration). Thus, REDs are sometimes amended to address outstanding issues or to include data that are submitted after the RED is signed. Sometimes EPA still initiates the data call-ins after the RED is signed, even if there are known outstanding issues. In these cases, the registrants are often contacted by both the reregistration branch and PRB. For those REDs that did not have post-RED issues, generic CRMs indicated that they assumed that product reregistration happened as planned and were unaware of some of the delays and challenges. This is a source of frustration, as years of work to write a RED do not always result in environmental and human health protection as quickly as expected. Post-RED issues were historically not given high priority in work plans and adequate resources within the four reregistration branches, as statutory deadlines required continued focus on 4-1 ------- completing REDs. SRRD often looks to the science divisions for support with post-RED issues. Because there are no deadlines associated with post-RED activities, writing new REDs remain the priority. However, now that the August 2006 deadline to complete food-use REDs has passed, SRRD management has indicated a commitment to addressing post-RED issues (including product reregistration) in FY2007 and beyond. REDs are not considered legally enforceable; EPA can only enforce DCIs and labels. Some registrants are inclined to challenge the contents of a RED to delay implementation of RED- specified mitigation. As EPA developed a more robust public participation process, registrants are more likely to be aware of upcoming eligibility decisions, which might reduce post-RED issues in the future and speed the product reregistration process. Given the length of time from when a RED is published, to when post-RED issues are addressed, to when product reregistration is conducted, the CRM who wrote the RED is often no longer in that position. Typically, after about five years CRMs either are promoted or change positions. As staff leave, REDs that are in process need to be transitioned to other staff. As a result, institutional knowledge is often lost and new staff require additional time to become familiar with the issues. Generic CRMs are responsible for identifying mitigation that needs to be included in revised labels as part of the RED development. Although the CRMs are knowledgeable of the issues of the case, some noted that they are not in the best position to draft label language. CRMs, although trained in writing labeling language, do not perform the task regularly enough to become extremely proficient at it, which sometimes results in problems when developing the label table. Generic CRMs commented that staff members in PRB and/or RD are better suited to determine how the language should read on the RED. Some within OPP believe the most efficient approach to drafting labeling language would consist of the decision-makers - PRB and RD - playing a more active role in the process. 4.2 Case Studies To better understand how Reregistration Eligibility Decisions (REDs) sometimes cause delays in product reregistration, Abt Associates examined three REDs that were believed to delay product reregistration: the rodenticide cluster, captan, and dicofol. Each case study identified issues and challenges that arise throughout the reregistration process and, in particular, as a result of the contents of a RED. 4.2.1 Rodenticide Cluster In July 1998, EPA published the RED for the rodenticide cluster, which included six active ingredients.23 Rodenticides represent EPA's first attempt to cluster active ingredients, an approach that is also being used for fumigants. Since most of the rodenticides share similar use patterns, issuing reregistration decisions for one chemical at a time could shift the rodenticide market, perhaps to chemicals that pose greater risk but may be addressed later in the queue. EPA also intended this approach to maintain a level playing field. Levels of exposure to the varying rodenticides are generally similar, but they differ in toxicities. Thus, EPA expects to 23 Reregistration Eligibility Decision: Rodenticide Cluster, U.S. EPA Office of Prevention, Pesticides, and Toxic Substances, EPA 738-R-98-007, July 1998 4-2 ------- differentiate mitigation measures based on individual toxicities of the chemicals. Although clustering chemicals is more efficient for purposes of analysis, the number of issues and registrants involved complicates actual decisionmaking. In retrospect, EPA commented that it could have published concurrent but separate REDs for each chemical in the cluster and then made decisions for all the cases at the same time. By maintaining separate documents, EPA may have simplified the decision. The rodenticide RED was incomplete and did not represent final regulatory decisions such that EPA could not implement much of what it included. Outstanding issues included human health (particularly accidental exposure to children) and ecological risks, and the RED included a two- phase approach for mitigating risk. The first phase would put into place short-term measures to identify, decrease, and monitor exposures largely through the use of bittering agents, dyes, and other measures. The second phase sought to reduce exposures in the long term by convening a stakeholder workgroup. EPA commented that the program has matured considerably since the rodenticide RED was published, and it is unclear why the RED was published in its final form. Under today's standards, EPA likely would not publish a document that did not provide actual reregistration eligibility decisions. After convening a stakeholder workgroup, EPA changed its position on the requirements for bittering agents and dyes in 2004, which was subsequently challenged in a lawsuit. EPA was asked to reconsider this decision and develop a better record. Also, the rodenticide RED predated EPA's formal public participation process for reregistration. EPA is currently addressing the ecological risks of the rodenticide cluster. In January 2003, EPA released a preliminary ecological risk assessment for public comment; a revised assessment was published in September 2004.24 EPA is formulating a mitigation plan to address these risks that it published for public comment in January 2007.25 Because of these outstanding issues, EPA has not yet completed pesticide reregistration for rodenticide products. After the RED was signed in 1998, EPA sent out DCIs, but they were put on hold in light of the outstanding issues. If EPA were to require bittering agents, this would require new product chemistry and acute toxicity studies, which makes it impractical to submit these data until the issue is resolved. Because of these delays in reregistration, PRB encouraged registrants to voluntarily amend labels to incorporate some of the mitigation specified in the RED in advance of product reregistration. EPA also considered allowing registrants to have a master label that could be used on several different packages. This effort was largely unsuccessful and registrants would not voluntarily amend labels, although some voluntarily added bittering agents. For other reregistration cases, EPA has been successful in having registrants voluntarily amend labels. Once the ecological risks are addressed through the forthcoming mitigation plan, SRRD expects to issue an amendment to the RED for public comment. EPA will then address any outstanding policy issues or regulatory activities. In the meantime, more than eight years have elapsed since the RED was signed without significant changes to the labels for the rodenticide cluster. 24 Rodenticides: Availability of Revised Comparative Ecological Risk Assessment, 69 FR 56756, September 22, 2004 25 Proposed Risk Mitigation Decision for Nine Rodenticides, January 17, 2007, available at http://www.epa.gov/oppsrrd1/reregistration/rodenticides/rodenticid es_mitigation_decision.pdf 4-3 ------- This case study illustrates the challenge of clustering active ingredients that might have similar use patterns, but differ in toxicity and other characteristics. EPA staff noted that publishing separate documents concurrently could be a good alternative. This case cautions against publishing a RED without addressing all outstanding issues and not developing a solid record. Lastly, rodenticides shows that registrants are not always amendable to voluntary label changes. 4.2.2 Captan In November 1999, EPA published the RED for captan, which included a determination that it was a probable human carcinogen based on the properties of a highly reactive but short-lived metabolite.26 The risk assessment, however, indicated that this classification did not warrant additional mitigation. After EPA published the RED, additional data were submitted during the public comment period that led EPA to amend the RED in November 2004. The RED pre-dated the formal reregistration public participation process that is in place now, which meant that early opportunities for public comment were more limited. EPA received additional data after the RED was signed that led EPA to recalculate certain re-entry intervals and margins of exposure for specific uses and applications. These new values were included in the RED amendment. The amendment also addressed a few minor inconsistencies that needed to be clarified (e.g., definition of a berry and seed treatment). Also, after the RED was published in 1999, registrants requested that EPA consider a cancer reclassification for captan, presumably for marketing and other reasons. Because its current cancer classification did not warrant additional mitigation, EPA did not feel it was appropriate to use its limited resources on the analysis. The Captan Task Force, which is composed of captan registrants, voluntarily contracted with an independent body of scientists to review the data to support a mode of action determination for captan. The OPP Health Effects Division (HED) then reviewed this work. Based on the third-party review and subsequent HED review, EPA determined that captan acts through a non-genotoxic threshold mode of action. This determination, however, did not change the risk management conclusions or amend the RED. Overall, it took approximately two years to complete the cancer reclassification. The cancer reclassification and the amendment to the RED were published for public comment in November 2004.27 EPA received a modest number of comments, mostly on the cancer reclassification or issues un-related to the RED amendment. The captan amendment was less complex compared to other cases that have been amended. However, the process took considerable effort and was also not given top priority when compared to writing new REDs. Because of the length of time between completing and subsequently amending the RED, EPA worked with the registrants and the Captan Task Force to amend product labels with RED- specified mitigation as soon as possible. The technical registrants, who were most interested in the cancer reclassification, were able to encourage the product registrants, who were most 26 Reregistration Eligibility Decision: Captan, U.S. EPA Office of Prevention, Pesticides, and Toxic Substances, EPA 738-R-99-015, November 1999 27 Captan; Cancer Reclassification; Amendment of Reregistration Eligibility Decision; Notice of Availability, 69 FR 68357, November 24, 2004 4-4 ------- interested in the RED amendment, to revise their labels in an expedited manner. Registrants were also motivated by good environmental stewardship. The SRRD reregistration branch collected the labels in early 2005, which were then sent to the Product Reregistration Branch (PRB) for assessment. However, this approach resulted in confusion because two branches were in contact with registrants, and communication could have been better coordinated. EPA has since completed the product reregistration process for captan products. Reregistration for captan products took seven years from the time the RED was signed. This case study reiterates that REDs represent the best data and analysis available at the time, and the need to engage registrants in the submission of new data. This case also included a creative solution for a third-party cancer assessment, which saved EPA resources. Lastly, the case illustrates that voluntary label changes can sometimes be successful. 4.2.3 Dicofol In September 1998, EPA signed the dicofol RED and determined that products containing dicofol may be eligible for reregistration (as specified in the RED) contingent upon results of a dermal toxicity study that was due to EPA in December 1998.28 In 2005, EPA published an addendum to the RED to establish re-entry intervals (which were not included in the RED) and solicited public comment.29 OPP maintains a strict, annual schedule for RED development and signature to meet the statutory deadlines in FQPA, and the deadlines are rarely (if ever) postponed or missed. In order to meet OPP's annual goals, these deadlines often correspond to the end of a fiscal year, which explains why a majority of REDs are signed in September. The dicofol RED was signed, although it lacked information on worker exposure, so that EPA could count dicofol tolerances toward the number of tolerances that were reassessed in FY1998. Staff commented, however, that given the significant data gaps, it would be unlikely that the dicofol RED would be published in that form according to current standards. Despite incomplete information on re-entry intervals, EPA mailed out DCIs in 1998 and received responses and amended labels from the registrant, but label review is pending the resolution of outstanding issues. To address EPA's concerns with occupational exposure following the signature of the RED, the registrant submitted a dermal toxicity study and a chemical-specific dislodgeable foliar residue study approximately one year after the RED was signed. Given the use of the pesticide and the nature of the study, these data were submitted in a timely manner. However, the data indicate that a substantially longer restricted entry interval (REI) was warranted compared to the REI on the label at the time (more than 3 months compared to 24 hours). These data triggered the involvement of the OPP Biological and Economic Analysis Division (BEAD), who conducted an impact analysis to examine the current market and viable alternatives and met with the registrant. Other more minor issues in the RED, such as updating calculations to be consistent with a revised definition of "short-term exposure" from the OPP Health Effects Division (HED) were also addressed after the RED was signed. 98 Reregistration Eligibility Decision: Dicofol, U.S. EPA Office of Prevention, Pesticides, and Toxic Substances, EPA 738-R-98-018, November 1998 29 Dicofol; Addendum and Closure of Reregistration Eligibility Decision; Notice of Availability, 70 FR 51794, August 30, 2005 4-5 ------- Over time, interest in the dicofol case diminished, as other activities within OPP were given a higher priority and staff responsibilities were shifted (several generic CRMs have worked on the dicofol case). When dicofol again became a priority, EPA drafted and published the addendum to the RED for public comment. The growers indicated to EPA that the proposed REIs were unacceptable and maintained that dicofol was a much-needed miticide in the industry. EPA planned to release a second addendum to the dicofol RED after the August 3, 2006, FQPA deadline. This was pushed back further when staff became involved in registration review activities. However, in Summer 2006, the registrant announced that it intends to discontinue dicofol because it does not have sufficient market share. Given the discrepancy over REI and the registrant's plans to discontinue the product, the registrant did not voluntarily revise its label to include any of the RED-specified mitigation and the labels remain unchanged. More than eight years have elapsed since the RED was signed without significant changes to the labels for dicofol. The dicofol case study illustrates the issues that result from publishing a RED before it is complete, and that sending DCIs in such situations might not be appropriate. The case also highlights that new data sometimes delay product reregistration and require additional review and consideration. 4.3 Alternative Strategies for Implementing Mitigation This section reviews two cases where EPA pursued implementation of RED-specified mitigation through signing a memorandum of agreement with registrants, as well as a current pilot project to achieving this same objective without the formal agreement. 4.3.1 Memoranda of Agreement - Chlorpyrifos and Phosmet EPA uses Memoranda of Agreement (MOAs) as a mechanism by which registrants amend product labels to include RED-specified mitigation in advance of the product reregistration process and may also agree to provide data or take other action. Although used infrequently, EPA has used MOAs in approximately six to twelve instances, including the chlorpyrifos and phosmet cases. The following two cases highlight some of the successes and shortcomings of MOAs. These case studies provide support to the recommendations made later in this report. In addition to MOAs, EPA has made efforts to amend terms and conditions of registrations to include RED-specified mitigation in a timelier manner. This approach requires fewer resources and does not commit EPA to anything. However, MOAs also provide a mechanism to get data, which is not possible only through amending the terms of conditions of a registration. Chlorpyrifos In June 2000, EPA signed an MOA with the chlorpyrifos registrants after several months of negotiation.30 Under the MOA, registrants requested voluntary cancellation of their existing products and submitted applications for replacement registrations excluding those uses that were canceled (e.g., termite control, residential use). In return, EPA stated that it had no 30 Memorandum of Agreement between the Environmental Protection Agency and Signatory Registrants Regarding the Registration of Pesticide Products Containing Chlorpyrifos, June 2000 4-6 ------- intention to initiate cancellation or suspension proceedings and would act on replacement registrations within ten working days. EPA was particularly concerned about exposures from residential uses of chlorpyrifos, and estimates that a chlorpyrifos product was in one in four households in the United States. As an organophosphate, chlorpyrifos posed acute risks and exposure and incident data indicated regulatory action was appropriate. In addition, a number of environmental groups published reports on risks of pesticides in food and in the home. This level of concern provided some leverage to convince registrants to take action. In negotiations, registrants agreed to cancel residential uses. Both EPA and the registrants agreed that a recall of residential-use products was not necessary. There were approximately 10 million pounds of chlorpyrifos in homes, and a recall would pose logistical and disposal problems, including additional environmental and public health concerns. EPA's key objective was to develop an agreement that ensured that mitigation was placed on the label as soon as possible. Chlorpyrifos is an interesting case because there were originally more than 900 products and extensive mitigation was required. EPA cancelled more than 300 products and amended approximately 100 labels. There are currently about 300 chlorpyrifos products. Because of the complexity of the agreement and the number of labels, EPA developed guidance and communications materials for the regulated community. In order to meet its obligations, EPA assembled a staff of six to eight people from the reregistration branches, PRB, and RD who worked full-time for five to six months on the case to process labels and voluntary cancellations. This work was mostly complete by January 2001, approximately eight months after the MOA was signed. After having dealt with the residential uses, EPA focused its attention on agricultural uses and remaining regulatory issues, such as the Interim Reregistration Eligibility Decision (IRED) that was published in September 2001. Based on product-specific data, labels had to be reviewed and amended for formal product reregistration, but the product universe was considerably smaller because residential uses had been cancelled. Several key aspects of the chlorpyrifos case made an MOA a particularly appropriate and successful tool: the registrant was a willing participant in negotiation, EPA was also committed to activities and deadlines, chlorpyrifos received public attention and required swift action, there were numerous products, and residential uses were of concern. Phosmet In 2001, EPA signed an MOA with Gowan Company, the only registrant of phosmet.31 In 2001, EPA also published the IRED for phosmet. Although it is an organophosphate, phosmet does not exhibit the same risk profile of some of the others. There were some residential uses and some incident reports, and Gowan initiated voluntary cancellations for residential uses. 31 Memorandum of Agreement between the Environmental Protection Agency and Gowan Company Regarding the Registration of Pesticide Products Containing Phosmet, October 2001 4-7 ------- Growers expressed to EPA the necessity of phosmet, so EPA pursued an MOA to ensure that mitigation was put in place and worker protection issues were addressed as soon as possible. The agreement required Gowan to amend all of its phosmet product labels based on the IRED and any modifications EPA considers necessary based on comments received during a sixty- day comment period. After June 30, 2002, products were required to bear labeling approved by EPA in accordance with the agreement. The agreement also required that all registrations of phosmet products labeled for specific crops would include the following terms and conditions: • After October 30, 2006, products shall bear restricted entry intervals (REIs) specified in the MOA unless prior to that date EPA decided that another REI is appropriate. • By October 30, 2005, the registrant would submit biomonitoring data, a feasibility study of gloves suitable for field workers, and data reflecting benefits and use patterns of phosmet. EPA expected to receive revised labels from Gowan in May 2002 so that they could be reviewed and approved in advance of the June 30, 2002, deadline. Because of errors in the submissions, there were several rounds of label reviews and EPA did not approve amended labels until 2005. There were a number of issues that contributed to the delay: SRRD and RD disagreed whether or not the amended labels needed to be complete updates in light of relevant PR notices or if the labels only needed to have the mitigation specified in the IRED included. Note that the MOA stated that "each phosmet product must include on its product label in the Direction for Use section all of the labeling statements identified in the IRED..." SRRD maintained that a complete amendment conflicted with its intent to implement RED-specified mitigation as soon as possible and was beyond the scope of the exercise. Also, due to the substantial number of iterations of labels between OPP and the registrant, it took a long time to finalize the label amendments. There were only a limited number of phosmet labels that were affected by the MOA (ten to twelve) and EPA attempted to prioritize them. Gowan completed the studies per the agreement and EPA reviewed the data. In 2004, phosmet was the subject of a lawsuit by farmworker organizations that challenged occupational exposure risks. EPA expected that the REIs would need to be lengthened, as was proposed in June 2006, which would require additional label amendments. In January 2007, EPA issued its final decision on nine uses of phosmet that will lengthen most REIs and impose additional mitigation measures. Generic and product-specific DCIs were issued on April 9, 2003. As of October 2006, the majority of phosmet products had not been reregistered. Several key aspects of the phosmet case made an MOA a particularly appropriate and successful tool: there was only one registrant and there were additional issues beyond label mitigation to be addressed. This case also illustrates that an MOA does not necessarily guarantee timely implementation of all label changes. 4.3.2 Propanil Pilot Project In an effort to implement the mitigation specified in the RED on the labels in a timelier manner, EPA initiated a pilot project for propanil. EPA published the propanil RED in September 2003 and mailed out DCIs in Spring 2006. SRRD provided the label table to RD at the same time that it issued the PDCI. RD sent a letter to the registrants in May 2006 to request that they 4-8 ------- incorporate RED-specified mitigation while SRRD continues with the product reregistration process. This is similar to the approaches for chlorpyrifos and phosmet (above) but without the negotiation and signature of an MOA. The Propanil Task Force responded to RD's request by questioning why EPA requested the amended label before the registrants responded to the DCI. The Office of General Counsel (OGC) prepared both a specific response to the Propanil Task Force and a generic letter for future use. The letters explained that EPA is working to reduce the amount of time between issuance of the RED and implementation of mitigation required in the RED. Registrants were given ninety days to provide a revised label. In the absence of the required label changes in the RED, EPA stated that the pesticide label does not have sufficient directions for use and/or a precautionary statement to adequately protect health and the environment (and could therefore be considered "misbranded" under Section 2(q) of FIFRA). As of January 2007, of the 43 products: amended labels for 23 products were submitted to EPA and accepted with comments; 3 were pending in label review; 3 provided no response; and 14 products were voluntarily canceled. On average it took 6 months to receive and accept (with comments) amended labels, not including those that did not respond. This pilot project illustrates that it is possible to implement RED-specified mitigation, although it will likely require a change in registrant culture as they become familiar with the new process. Given that half of the labels were not submitted, EPA will need to address the consequences of such actions moving forward. In addition, this approach does increase the burden on SRRD, so EPA will need to focus its activities appropriately. 4-9 ------- 5. DCI Justifications and Preparation After a RED is signed, the preparation of the generic Data Call-In (DCI) or product-specific Data Call-In (PDCI) notice is the first step in the product reregistration process. Before the DCI can be issued to the registrant, EPA must prepare and receive approval of a DCI justification package from Office of Management and Budget (OMB). This DCI justification package lists all of the product-specific studies, as well as any confirmatory data, that the registrant must submit in order to complete reregistration for each of the individual pesticide products covered by the RED. Several EPA offices and other agencies are involved in the preparation of a DCI justification package. The Program Support Branch (PSB) is responsible for preparing the DCI justification package and, once approved by OMB, for sending the DCI to the registrant. Several entities assist PSB in the development and review of the DCI justification package, including: • OPP Field and External Affairs Division (FEAD), • OPP Science Divisions: Environmental Fate and Effects Division (EFED) and Health Effects Division (HED), • Office of Prevention, Pesticides, and Toxic Substances (OPPTS) Regulatory Coordination Staff (RCS), and • SRRD Product Reregistration Branch (PRB). The U.S. Department of Agriculture (USDA) also assists with DCI justification packages, particularly when high-profile chemicals and/or high-cost studies are involved. To ensure the DCI justification package complies with OMB standards, FEAD and RCS review it before submitting it to OMB. 5.1 Preparation of DCI Justification Package Despite approved standard operating procedures (SOPs) for developing the DCI justification package, the process is time-consuming and often evaluated by OMB against varying standards. OPP believed that approval of a DCI justification package was a source of delay in the product reregistration program, and we explore this issue in this section. 5.1.1 Template for DCI Justification Package In an effort to streamline and standardize the DCI justification package based on feedback from OMB on a DCI for the toxics program, RCS initiated changes to the format of the DCI justification packages. Through an iterative process, PSB and RCS re-formulated the template to include "boilerplate" responses for study rationale and intended data use. Despite the intent of streamlining the process, the first package PSB prepared using the template (submitted on May 22, 2006) was much lengthier than previous DCI packages because PSB included both the boilerplate language and standard elements from the old format. The lengths for the most recent packages are: One year ago: 30 pages long for 26 chemicals Most recent package: 80 pages long for 21 chemicals 5-1 ------- In August 2006, OMB presented EPA with ten questions, which were mostly about process and therefore relatively easy to address (e.g., why is OPP requesting acute toxicity data from the registrant?). OMB approved that particular DCI package in October 2006, five months after it was submitted. It is unclear at this time whether the template changes will help expedite the review and approval of DCI justification packages by OMB. 5.1.2 Supporting Data A lack of supporting data can lead to several delays in assembling the DCI justification package. First, the manner in which the OPP science divisions write the risk assessments (RAs) is viewed as problematic by several PSB staff. Currently, neither the RAs nor the REDs summarize or clearly identify upfront the rationale for new studies. Often, PSB staff need to review the entire RA to locate necessary information or contact the science divisions to help develop the rationale, both of which can be time consuming. Second, in conducting the RA, the science divisions may conclude that the registrant needs to conduct "special studies" in order to generate sufficient confirmatory data for product reregistration. In practice, the science divisions delineate the basic parameters of these special studies but do not provide PSB with cost burden estimates. Since special studies fall outside of standard test cost estimates, PSB is responsible for estimating the cost burden for the DCI justification package, despite not being as familiar or knowledgeable as the science divisions about study components. 5.1.3 Tracking Tracking, as it relates to the DCI preparation process, has several shortcomings. Due to the lack of an integrated tracking system and the multiple players involved in the DCI process, there are at least four tracking systems used by staff to meet different needs: the Office of Pesticide Programs Information Network (OPPIN), a Microsoft Excel-based tracking system, and several Microsoft Word-based tracking systems. As one of the first steps in the DCI-related tracking process, the generic CRM or product- specific reregistration CRM generates the DCI or PDCI, respectively, in OPPIN. (In practice, PSB, not the generic CRM, typically generates the DCI.) OPPIN is not well suited, however, for detailed tracking of the DCI process because it does not include the needed data fields and reporting functions. Consequently, PSB uses a Word-based system to track the review periods of DCI justification packages by different EPA divisions (i.e., FEAD and RCS) and OMB. It then uses another system to track the return of green cards from registrants. Once PSB processes the product-specific green cards, it forwards them to the product reregistration CRM in PRB who tracks the ninety-day response for the PDCI in Charts and Tables. If the DCI also required generic, confirmatory data, PRB forwards a copy of the green cards to the generic CRM for tracking. The tracking system used for ninety-day and eight-month responses varies among CRMs on the active ingredient level - some use OPPIN; others use separate systems. OPPIN, which is about five years old, was an attempt at creating a centralized, integrated information management system that would meet the needs of and be accessible to all OPP divisions. Multiple staff expressed dissatisfaction with OPPIN, citing it is not user-friendly, data are not current or complete, and lack of a "report-card" function (guideline status report) to 5-2 ------- easily check the status of any given chemical in the post-RED process. CRMS, the predecessor of OPPIN for tracking re registration of active ingredients, had this functionality, allowing the user to determine where an active ingredient is in the process (e.g., to check the status of submitted studies from a given registrant). Due to its design, CRMS also provided a level of staff accountability that OPPIN does not offer. A new system called PRISM is currently under development and intended to take over the functionality of OPPIN to address currently unmet needs. It is unclear at this time whether PRISM will have the "report card" function or something similar to it. 5.2 Resources and Staff Time At this time, inadequate staffing in PSB contributes to bottlenecks and delays in the preparation of the DCI justification package. Currently, there are no senior scientists or senior science writers on PSB's staff roster. PSB currently relies on FEAD staff for preliminary reviews of supporting data and documentation. It is not uncommon for FEAD staff members to spend approximately ten percent to twenty percent of their time on DCI preparation and review. Due to the statutory deadlines for reregistration, generic CRMs begin work on new chemical(s) after the RED is signed. By the time PSB commences the development of the DCI justification package, the CRMs are likely focusing on new chemicals. Consequently, answers to product- specific questions may be difficult to obtain due to the lapse of time between the RED signature and DCI preparation, as well as competing priorities among the CRMs. Moreover, since there are twenty-one CRMs at this time, PSB often must track down the right people to get information. 5.3 Approval of the DCI Justification Package Since 2003, the total length of time for preparing a DCI (including OMB's review approval) has decreased from an average of 18 to 24 months to an average of 9 to 10 months; the shortest length of time being four months as OPP improved its procedures and developed its relationship with the previous OMB desk officer. A consistent source of delay in the DCI preparation process is OMB's review and approval, which can often span several months. Staff expressed the importance of building a relationship with the OMB officer, so both parties have a mutual understanding of the process. However, the turnover in OMB officers is relatively high: many officers serve for only two to three years. 5-3 ------- 6. Data Requirements and Review Key aspects of the product reregistration process are the ninety-day and eight-month responses by the registrant, as well as the review of these data by EPA. Several issues are important to consider relative to the delays and issues with product reregistration, including data management, communication, management priorities, and staffing. 6.1 Data Management of Registrant Responses Given the number of data guidelines, communications, and other pieces of information that correspond to each product, information management is key to the product reregistration process. Tracking of information is critical for DCI preparation and mail out, ninety-day responses, eight-month responses, data review, label assessment and review, and reregistration decisions. Overall, there are approximately forty-four discrete data elements that must be tracked for each product (i.e., six toxicity studies, twenty-eight product chemistry studies, efficacy studies (if required), waiver requests, study deficiencies, time extensions, and suspensions). Products that are combinations of active ingredients, which may or may not be conducted at the same time, further complicate tracking. In 2005, SRA International developed a report that described and illustrated the product reregistration process and commented on the adequacy of its tracking systems.32 SRA concluded, "EPA and participants of the product reregistration process could very much use an automated method of tracking the numerous products throughout the process. Currently, all tracking is done manually in PRB and only the CRM has direct access to the tracking data." Thus, for this evaluation, Abt Associates interviewed several OPP staff members to identify information management issues. The Office of Pesticide Programs Information Network (OPPIN) was intended to be a centralized system to address the needs of all OPP programs. However, OPPIN is inadequate for purposes of product reregistration because it does not provide the required data fields or reporting functions. It also does not provide PRB the necessary reports to verify the data contained within OPPIN against other data sources, which is critical given the number of tracking systems used for product reregistration. Staff also noted that the concerns with OPPIN extend beyond those of reregistration. SRRD staff have requested modifications to OPPIN to address its shortcomings in tracking reregistration for both active ingredients and end-use products. Generally, requests related to the reregistration of active ingredients have been made more frequently, as many staff believed that those requests were more likely to be granted than those on the product level. OPP staff noted that information management needs for registration review are being addressed to their satisfaction. In addition, staff commented that PRIA actions accounted for most of the OPPIN maintenance budget. In November 2006, SRRD management again requested several revisions from ITRMD, which reiterated SRRD's priorities from June 2004.33 These revisions follow in priority order: 32 OPP Enterprise Architecture Process Description: Special Review and Reregistration Division Product Reregistration," SRA International, September 29, 2005. 33 Based on an e-mail message from Pete Caulkins, Associate Director, SRRD, to ITRMD, "Product Reregistration IT Development Projects," Septembers, 2006 6-1 ------- • RED Outcome Report at the Product Level, which would track by case name and chemical each product, the PDCI issuance date, ninety-day response date, eight-month response date, data review status, date sent to RD, and fields that track RD's interaction with the registrant. • RED Outcome Summary Report that tracks the total number of products cancelled, reregistered, and amended. A key aspect to this report would be the ability to aggregate these data by chemical, branch, PM, etc. • Guideline Status Report to track generic studies required by the RED. These three features were promised to SRRD by ITRMD as part of the next revision to OPPIN. The first report, RED Outcome Report at the Product Level, was available in the precursor system to OPPIN, which was called PRATS. PRATS was disabled in 2003 after OPPIN was launched. PRATS data are available in read-only format, but PRATS is no longer available for data entry. PRATS included specific fields for tracking product-specific studies (receipt, acceptability, review status, etc.), which is not available in OPPIN. As a result, EPA has been forced to track outside the centralized system, which is counter to the intent of developing OPPIN. To track product-specific reregistration information, SRRD developed "charts and tables." Charts and tables are a Microsoft Word template that CRMs use to record product reregistration information. They include background information, such as RED date, case, code, PM contact, and number of products, as well as the status of responses in review, products suspended, products canceled, products in label review, products sent to RD, and letters out.34 For each product, the document includes blowback requested/received, product chemistry data status, toxicity data status, due date for data, date sent to label review, and date sent to RD. It also summarizes contact with the registrant by product and identifies action items. Each CRM has some flexibility to modify the template according to his/her own style, and each file is not available to other CRMs or management because CRMs generally save these files on his/her personal drive. In addition, some CRMs are timelier than others in maintaining their charts and tables. To provide tracking information to management, SRRD maintains two external databases in either Microsoft Access or Word: (1) STATUS includes information from the "bean sheet," which is a summary report submitted to RD with each reregistration package, and (2) REDS includes the chemical, CRM assignment, number of products, and how many products are reregistered, amended, or cancelled. These databases are only accessible to one SRRD PRB staff member, and serve as the data source for management reports and SRRD's annual performance report. Despite its disadvantages, OPPIN allows SRRD to track RD activities with respect to product reregistration. This helps SRRD maintain its STATUS database. Although there are some similarities between OPPIN and STATUS, OPPIN does not provide the proper reporting features such that PRB can access the needed information in a usable manner. The third report that was requested, the Guideline Status Report (often referred to as a "report card") has been requested several times by SRRD.35 This revision would largely benefit the 34 Based on charts and tables forTrifluralin, September 15, 2005, provided by Pete Caulkins, Associate Director, SRRD. 35 "OPPIN Generic Data Management Functionality Assessment," Patrick Dobak, May 2, 2005 6-2 ------- reregistration branches that are responsible for tracking confirmatory data for active ingredients, as well as tracking DCI responses. Whereas PRB worked outside the system to develop charts and tables, the effort on the active ingredient side was not as coordinated. As a result, SRRD reregistration branches do not know where confirmatory data are in review nor if the guideline has been satisfied. RD also pursued the development of a database external to OPPIN to track generic data for registration. Also, on the active ingredient level, staff noted that OPPIN was not well suited for tracking "special studies," which are those that are not included as standard guidelines. Similarly, PRB noted that it does not have a way to track voluntary letters, and Certitrack might be useful for this purpose. Certitrack is a database to track correspondence that was used by some PRB CRMs, but it is a DOS-based program that requires a dedicated printer. OPPIN also does not provide the proper capabilities for data management, as many of the corrections need to be made by a database administrator. SRRD staff noted that improvements to OPPIN do not seem to be a priority given that OPP is developing PRISM, which will replace OPPIN in September 2008. PRISM, while still in the planning and acquisition phase, intends to use the basic table structures of OPPIN. PRISM, however, will supplement those tables with new and redesigned data structures as it is developed. The primary intention of PRISM is to provide OPP staff and management with an improved presentation layer, integrate currently missing applications and other improved software features, and provide new functional applications. Ultimately PRISM is intended to provide a more stable environment for the entire pesticide industry and, coupled with new technologies (Documentum, CDX, and J2EE driven applications), will enhance EPA's ability to meet its strategic goals.36 Staff noted that OPP has not directly addressed how product reregistration will be addressed in PRISM. Several staff members expressed that the ultimate success of PRISM hinges upon improved communication between management and staff. In particular, they currently play a mostly responsive role in maintaining and improving OPP tracking needs, e.g., they attend meetings when asked, or provide management with information when requested. These staff members expressed that they would be better able to anticipate and respond to tracking issues if open lines of communication between all staff are maintained. Several staff commented that ITRMD's visibility and involvement in programmatic activities is limited. Because ITRMD has taken a compartmentalized approach when developing both OPPIN and PRISM, staff noted a need to bridge communication within the office. One potential avenue is through the Information Management Council, which is comprised of all OPP division directors and provides a forum to advance IT needs. As a result of the shortcomings of OPPIN and the current approach to data management, EPA unintentionally created a window of time for which data are not properly tracked because they are not available electronically or not available in a centralized format. The current approach means that PRB is unable to monitor progress in an effective and efficient manner, which wastes a lot of time and things are more likely to fall through the cracks. 36 http://www.epa.gov/oamhpod1/admin_placement/06101137qa1.doc 6-3 ------- 6.2 Acute Toxicity and Product Chemistry Analysis SRRD conducted an assessment of the impact of product-specific acute toxicity and product chemistry reviews on label mitigation. The SRRD assessment sought to determine the impact of these reviews on revisions made to the product label during reregistration beyond what would be required by the Reregistration Eligibility Decision (RED). SRRD's preliminary analysis indicated that product-specific data had a significant impact on label mitigation. To confirm their findings, Abt Associates conducted an audit of the acute toxicity portion and assessed its utility for the evaluation of the product reregistration program. This section provides background on the data and guidelines and discusses the design of EPA's analysis and our conclusions regarding SRRD's analysis. For more information on the approach and specific results of the audit, please see "Results of Audit- Evaluation of Acute Toxicity and Product Chemistry Review Findings," Memorandum to Yvonne Watson and Caulkins, U.S. EPA from Debra Kemp, Albert Acquaye, and Jason Sacks, Abt Associates Inc., January 30, 2007. 6.2.1 Background on Acute Toxicity and Product Chemistry Guidelines The acute toxicity data required on end-use products for product reregistration include the acute oral, acute dermal, and acute inhalation studies, which evaluate systemic toxicity resulting from short-term exposure via the designated route. The remaining acute studies are the primary eye irritation, primary skin irritation, and the dermal sensitization studies. The eye and skin irritation studies assess potential irritation or corrosion from a single exposure, while the dermal sensitization study evaluates allergic contact dermatitis resulting from multiple exposures. These acute studies identify routes of concern, as each study is categorized based on degree of effect (categories 1 through 4), with Category 1 indicating the most severe effect and Category 4 representing the least severe effect. In addition, each category corresponds with specific label statements or requirements necessary to reduce exposure and protect against acute health effects. The resulting label statements/requirements vary significantly based on product- specific factors such as the formulation type and whether the use pattern is agricultural, occupational/industrial, or residential. Furthermore, label statements for agricultural and occupational use products may vary based on whether the product is subject to the Worker- Protection Standard (WPS). Acute studies result in hazard communication directly to the user and/or medical professionals through the label sections and/or product classifications listed below. 1. Restricted-Use Pesticide (RUP) Classification 2. Signal Word/Skull and Crossbones Symbol 3. First Aid Statements 4. Note to Physician 5. Hazards to Humans and Domestic Animals (HHDA) 6. Personal Protective Equipment 7. Child-resistant Packaging The product chemistry data required for product reregistration can be grouped into two categories: (1) product identity, composition, and analysis, and (2) physical and chemical properties. Product identity, composition, and analysis allow EPA to clearly define the product 6-4 ------- formulation and identify any inert components of concern. The physical and chemical properties assess potential hazards posed by the formulation (e.g., flammability, corrosivity, and storage stability). Identification of these hazards allows the implementation of preventative measures. Some of the more basic physical and chemical properties evaluated allow EPA to respond to emergency requests for identification of unlabeled pesticides. 6.2.2 Design of Analysis At the completion of FY2005, SRRD randomly selected a sample of 120 products (7 percent of reregistered products) of the 1,730 products had been reregistered. The sample size of 120 results in one product per RED listed on the OPP Web site with available batching tables at the time this assessment was performed. Abt Associates believes that a larger sample size would be better suited for this analysis, but understands the limited time and resources available to SRRD. SRRD noted that crosschecking labels with the results of the acute toxicity and product chemistry reviews was a lengthy process. Based on its description of how it identified a specific product from each of the 120 REDs, Abt Associates believes that the selection procedure SRRD described was objective and unbiased. Although Abt Associates confirmed its sampling procedure, we believe that SRRD could have better designed its study and in turn provided a better answer to the issues at hand. For example, we would have suggested that EPA select randomly from among the entire universe of products for which product reregistration was completed or for which labels had been amended. This would have allowed SRRD to confirm that recommendations based on acute toxicity reviews were indeed placed on the final label. In addition, we would have suggested that EPA not constrain itself from sampling one product from each RED given how the number of products vary. Also, Abt Associates did not believe that EPA's results were presented in a detailed enough manner such that the reader was left with a clear idea of what a "revised statement" means. By establishing criteria for each category or at least providing examples, the reader might have had a clearer idea of how substantive the revisions could be. Similarly, EPA could have made its categories more specific, including multiple categories for signal words (e.g., added, increased, decreased), first aid statements (skin/clothing, eyes, swallowed, inhaled), and individual categories for mitigation statements that appear most frequently and may therefore skew the results (e.g., having container available when calling poison control center, notes about cholinesterase inhibition, etc.). Finally, the analysis did not provide a comparison of extent of mitigation identified by product- specific data as compared to extent of mitigation identified in the RED. We understand that RED-specified mitigation is generally more substantial. That said, some OPP staff members commented that the product-specific mitigation was negligible. Abt Associates believes that an analysis that identifies the mitigation required by the RED, as well as that specified by product- specific data would be informative. 6.2.3 Audit Conclusions Although Abt Associates was generally able to confirm the majority of EPA's findings for each of the twelve products included in the audit, the audit revealed several discrepancies and other issues of concern. These discrepancies were identified in the above-referenced memorandum 6-5 ------- to EPA. In addition, EPA seemed to be inconsistent in how it characterized Personal Protective Equipment (PPE) in its results. Generally, EPA included the discussion of PPE requirements in the Hazard to Humans and Domestic Animals (HHDA) section of its acute toxicity review memo; however, for purposes of its results sometimes these changes were considered revisions to PPE and sometimes revisions to HHDA. Often, mitigation specified by the acute toxicity review did not appear on an amended product label. Note, however, that not all products have been reregistered. Similarly, amended labels often included additional mitigation beyond that recommended in the review memo or the label table from the RED. The source (e.g., registrant or RD) of such mitigation is unclear, as well as if mitigation specified by acute toxicity reviews may have otherwise been included on the label (e.g., updates to first aid statements based on current label review standards). For these reasons as well as the shortcomings identified in the study design, Abt Associates did not feel it was appropriate to include EPA's analysis in its report. 6.3 2,4-D Streamlined Data Requirements Through batching and citing existing data, OPP can substantially reduce the number of sets of product-specific acute toxicity data to be reviewed for each active ingredient, thus reducing the time required to re-register products. It may be possible to reduce the time required for acute toxicity reviews even further, if the batching process is streamlined. One such example of streamlining may be found in the case of 2,4-D. 2,4-D is an ingredient in more than 600 agricultural and home use products. It comes in multiple chemical forms, and is found in numerous products intended for use in a wide range of uses. The Industry Task Force II on 2,4- D Research Data worked with OPP to reduce product-specific acute toxicity data requirements by using existing data and streamlining the batching process. The Task Force included almost all registrants affected by the 2,4-D reregistration, including every company that had technical registrations for 2,4-D. Batching allows registrants to use or cite acute toxicity data from a group of similar products to satisfy data requirements. Batching tables are included in the RED and group product formulations that, from an acute toxicity perspective, allow one set of acute data to be used to support the reviews of all products within the batch. Once batching tables are published in the RED, it is the responsibility of registrants to act upon them and submit data to OPP. For instance, after product A submits the required data to EPA, registrants of products B, C, and D that belong to the same batch as product A and want to use (cite) data for product A in support of their products, may pay or offer to pay the registrant of product A to cite its data. Depending on the chemical and the formulations, OPP may not be able to batch all the acute toxicity data, instead requiring all registrants to submit individual acute toxicity data. This is usually the case for fertilizer products, which may result in individual eye irritation data being required and other acute toxicity data being batched. In many instances, registrants choose not to take advantage of the batches and rather chose to submit their own data, which EPA is obliged to review. Many registrants do not take advantage of the batching because the data already exist, they would prefer to submit their own data, or they do not want to pay data compensation fees. OPP estimates that typically between 20 and 30 percent of registrants take advantage of batching. 6-6 ------- 6.3.1 2,4-D Batching Approach The level of success of batching varies from chemical to chemical, since formulations may be quite different. In the case of 2,4-D, a preliminary attempt at batching one of the formulations with the majority of 2,4-D products yielded about 50 to 60 batches. The Industry Task Force II on 2,4-D Research Data submitted a proposed batching scheme, although it was of limited value because it did not include information on inert ingredients, which is confidential business information. The acute data provided by the Task Force, however, were very useful in satisfying the data requirements for individual products and product batches, even though organizing and evaluating such a large volume of data was very time consuming. This approach did, however, allow PRB to use the existing acute data provided by the Task Force to satisfy some or all data requirements for most of the product batches. This negated the need for a registrant to submit a waiver to cite what was already submitted to EPA. The formation of a task force specifically to address product-specific data requirements will likely result in greater participation in the batching groups by registrants. Also, because Task Force data were available during the batching process, they were used to determine product grouping. In some cases, this allowed for products with a larger range of active ingredient to be grouped together. As a result, EPA asked for only 1,027 acute toxicity studies out of a possible 3,618 studies, which will decrease the burden on the registrants, EPA, and OMB. 6.3.2 2,4-D Storage Stability Requirements The Industry Task Force II on 2,4-D Research Data approached EPA with information and data to show that different formulations using the chemical are extremely stable under various conditions. For this reason, it was possible to eliminate the storage stability data requirements that are the most expensive ones for registrants and the longest for OPP staff to review. Registrants had over time submitted almost ninety storage stability studies to support registrations or in enforcement cases, all of which indicated that regardless of time, the product remains stable with up to five to seven years of shelf life. As a result, OPP waived the need for any more storage stability studies. 6.3.3 Pros and Cons of this Approach In general, this approach will save time in reviewing data by identifying good studies that have been conducted properly to support the registration of large groups of products. This batching approach resulted in a 72 percent reduction in the amount of data required compared to getting a six-pack for each of the 603 products.37 A six-pack for each of these products would have resulted in 3,618 individual studies required, while EPA is asking for 1,027 studies through the current approach. Typically with batching, however, many products use existing data (either from another company within the same batch, or previously generated product-specific data) to support product reregistration. Even if one-third of the 603 products used existing data, this approach would have resulted in a 57 percent reduction in the amount of acute data required. This approach required registrant participation to determine the studies that may be used to support the reregistration of various product groups. The larger the number of registrants involved in a task force, the greater the degree of participation in batching since the formation of the task force provides an organizational structure to facilitate data sharing and minimize 37 2,4-D Batching Project Briefing, provided by Pete Caulkins, February 13, 2007. 6-7 ------- registrant costs. Because all 2,4-D registrants were members of the Task Force, they were likely to participate. Typically OPP would issue the data requirements and shift the responsibility to the registrant. By working with the Task Force, they were able to determine what they needed. OPP has learned from its 2,4-D experience. PRB developed a revised process for working with task forces that does not place as great a burden on its staff. OPP has targeted permethrin (1,185 products), MGK-264 (706 products), and PBO (1,704 products) as candidates for a revised, streamlined approach. This approach appears to be best suited for situations where a task force exists, which can provide the necessary infrastructure to coordinate responses among the various end-use product registrants, ensure their participation, and address data compensation issues. 6.4 Communication Several entities are involved in product reregistration, including the SRRD reregistration branches following the publication of the RED and the Registration Division after data review is complete. Data collected through interviews indicate that there is a breakdown in communication at the transition of products to and from PRB. Staff in the reregistration branches often operated on the assumption that the signature of the RED essentially concludes reregistration and that mitigation is implemented in a timely manner. Staff noted that the public and environmental and public health organizations often share this perception. Staff of the SRRD reregistration branches and the Registration Division admitted that they are not as familiar with the process or issues associated with product reregistration as perhaps is warranted. Further, they recognize that communication with the registrant is not always productive because the registrants lack an incentive for product reregistration. Recently, SRRD has pursued avenues to prevent delays in registrant submissions, which often resulted from submitting comments or inadequate data later in the process. OPP staff also noted that the "stick" associated with product reregistration - suspension - has not been applied recently. SRRD is currently in discussion to reestablish the procedures for that process now that the EPA Office of Compliance is no longer involved in suspension actions. At the end of each month, SRRD sends a status report to RD that identifies which products are currently with RD for reregistration. This is based on the STATUS tracking database that SRRD maintains external to OPPIN. Several RD staff noted that these reports could provide additional information to make them more useful, and some noted that they did not actively use the report for management purposes. Whereas reregistration of conventional pesticide products is the responsibility of SRRD, other OPP divisions are responsible for reregistering products under their area of focus. SRRD staff noted the Biopesticides and Pollution Prevention Division (BPPD) has also commented on the inadequacy of OPPIN for product reregistration. However, SRRD staff noted that they were not familiar with the product-specific data tracking procedures within other OPP divisions (BPPD and AD). 6-8 ------- 6.5 Management and Staffing As part of the overall reregistration process, product reregistration is only one of the priorities within either SRRD or RD. Historically, writing and publishing REDs was the priority for SRRD and registrations (particularly PRIA actions) were the priority for RD. Recent attention, however, is being focused on product reregistration through pilot projects, quarterly briefings for OPP Director Jim Jones, and regular SRRD/RD meetings on product reregistration. Most recently, the RD Director designed an approach for product reregistration moving forward (see Section 7.5 of this report). OPP management and staff are dedicated to seeing the RED-specified mitigation implemented on product labels, as well as addressing the vulnerability associated with the delays in product reregistration. Despite attempts within FIFRA to establish deadlines for product reregistration (see Section 1.3.1 of this report), product reregistration has never been pushed and management focused on the front-end of the process. In addition to the impacts on OPP's backlog, a registrant also does not know when it will receive a reregistration decision after submitting an eight-month response. OPP has improved the process by which registrants submit data, including standard formats. OPP staff and management noted that product reregistration is one of the most inefficient processes in OPP, though that is not a result of the people, but the design of the system. To help address performance, SRRD sets goals for product reregistration annually, and these goals are met (see Figure 3-4). SRRD staff noted that because of end of fiscal year deadlines for REDs and other activities, product reregistration gets the most attention in October to January. In its FY2007 reregistration work plan, SRRD allocates its FTE resources as follows:38 • 40 percent to completing non-food-use REDs • 41 percent to post-RED issues • 8 percent to product reregistration, which covers both SRRD PRB and RD • 11 percent to registration review Over time, a greater percentage of resources will be allocated to registration review. After FY2008, SRRD expects that funds will no longer be allocated for completing REDs, though it will continue to budget for post-RED issues. Funds are allocated for product reregistration through FY2013. The eight percent FTE allocation is roughly equivalent to past staffing levels and SRRD expects the staffing level to remain fairly constant in the short term. Some staff members commented on the decrease in PRB staffing over time as a result of attrition and retirement. They maintain that it is a challenge for PRB to keep up in light of the workload and reductions in staff. PRB did recently hire a new product chemistry reviewer and a new CRM. Training for new staff is conducted on an ad hoc basis, and written procedures for product reregistration are not available. on Personal communication with Pete Caulkins, January 2007 6-9 ------- 7. Label Assessments and Reviews SRRD PRB and RD conduct label assessments and label reviews, respectively. SRRD's preliminary label assessment focuses on comparing the amended label to the label table in the RED to ensure that the label adequately captures the required mitigation. After SRRD's preliminary label assessment, RD reviews the label in its entirety and is responsible for stamping the final, approved version. A brief overview of the reregistration process as it relates to the label review process is provided below: • Registrants send OPP a revised label as part of the 90-day response to the DCI to incorporate mitigation on the RED; • Registrants send OPP product-specific data and/or confirmatory (generic) data over the eight-month response period; • SRRD evaluates the product-specific data, requests additional information as needed, and determines if additional mitigation is needed; • After all study reviews are complete, the CRM assembles a label review package for the PRB Label Review Team; • PRB Label Review Team develops a preliminary label assessment (see Section 7.1); • The CRM assembles final review package ("bean sheet," all applicable science reviews, the preliminary label assessment, and the draft amended product label) and delivers to Product Manager (PM) in RD; and • The PM in RD conducts final review of label (see Section 7.2) and requests additional revisions from the registrant, if required. Once approved, the PM stamps the final label and issues a reregistration notice. 7.1 Label Assessment - Special Review and Reregistration Division The primary purpose of SRRD's preliminary label assessment is to determine whether the draft labels submitted in connection with product reregistration comply with amended labeling language specified in the RED/IRED.39 To avoid duplication of effort between SRRD's and RD's label reviews, the preliminary label assessment does not comment on other aspects of the label, such as labeling requirements specified in 40 CFR part 156.10, Pesticide Regulation Notices (PRNs), and Criteria and Policy Notices. To assemble the preliminary label assessment and to maintain consistency, SRRD uses a template with the following sections: a scope statement, background, summary of findings (including recommended label changes), and an appendix with a checklist of whether the label changes made by registrants are acceptable or unacceptable. The preliminary label assessment occurs once the CRM submits the label review package to the SRRD PRB Label Review Team. The label review package consists of the draft label 39 PRB Preliminary Label Assessment. Memorandum provided to Abt Associates by Larry Schnaubelt, PRB. 7-1 ------- submitted by the registrant, SRRD's review of the product-specific data, and the label table, which assists SRRD in comparing the label to the mitigation specified in the RED. The label included in the label review package is the most recent, hardcopy version submitted by the registrant as part of the eight-month response to the DCI. Over this same time period, however, the same registrant may have submitted drafts of amended labels to RD (e.g., to add a new use), and SRRD may be unaware of these label changes. Consequently, the label reviewed by SRRD as part of its preliminary label assessment may not be the most recent version. This problem is magnified by the long timeframes in which label reviews occur, as documented in Chapter 3 of this report. Once completed, the preliminary label assessment is submitted back to the CRM, who then assembles the final review package and delivers it to the appropriate PM in RD. 7.2 Label Review - Registration Division After receiving the final review package from SRRD, the PM conducts the final label review and stamps the label. It is the responsibility of the PM to identify and address any outstanding labeling issues, including any remaining RED-specific issues, and to obtain the necessary label changes required for final product registration. To do so, the PM typically composes a letter to the registrant specifying necessary labeling revisions. RD commonly finds issues with the labels that require additional revisions by the registrant (e.g., labels are not compliant with acute toxicity data) or prompt RD to re-conduct the label assessment performed by SRRD. For example, the preliminary label assessments commonly identify labeling issues but do not contain recommended solutions, requiring the PM to duplicate the part of the review related to RED mitigation. Another contributing factor is poor version control of labels between SRRD and RD. As mentioned previously, it is common for PMs to receive old labels as part of the final review package from SRRD, due to the fact that the PRB Label Review Team assesses the amended label submitted by registrants as part of the eight- month response. In these instances, PMs often conduct an entire label review from scratch, since the preliminary label assessment is based on an outdated label. The OPP Label Review Manual was created as a way to help maintain consistency in RD's label reviews. Despite these guidelines, RD's label reviews are not always conducted in a consistent manner. For example, in instances where a registrant requests the addition of a new use to the label, and the product is still somewhere in the re registration process, some (but not all) PMs will require that the registrant implement the mitigation stated in the RED at the same time as adding the new use to the label. These PMs will not stamp the new label until the mitigation stated in the RED is incorporated on the label. Similarly, PMs vary in the way they use SRRD's preliminary label assessment. Several RD Branch Chiefs noted that the label assessments are especially beneficial to new PMs who are not experienced in conducting label reviews or who do not have an extensive knowledge of the product and its regulatory history. The majority of PMs, however, noted that they either entirely disregard the label assessments or only use them as a way to ground-truth their own label reviews. 7-2 ------- 7.3 Ziram Pilot Project In Spring 2006, EPA initiated a pilot project using the ziram case where RD and SRRD conducted concurrent, independent label reviews for each of the products to determine how the two divisions assessed label changes. In March 2006, reviews were conducted for three products. There were no differences in the label reviews conducted by the divisions, except that RD had two, minor non-substantive additions that were a result of pesticide notices.40 Note that two of the products were manufacturing-use products that typically do not require many label changes as a result of the RED. Also in Spring 2006, SRRD and RD conducted label reviews for sodium acifluorfen using its standard process (i.e., a label assessment in SRRD and a label review in RD). Reviews indicated that the registrant had included a new use on the label, which was caught by both SRRD and RD reviewers. Although these two reviews indicate the similarities in reviews between the two divisions, our preliminary conclusion is that two pilots are not an adequate sample from which to draw a conclusion. Further, we would have recommended that the reviewers not be told of the pilot project to better represent typical review conditions. 7.4 Workload Management and Other Issues In some RD branches, products are assigned to PMs and their staffs based on chemical ownership. In other branches, one or two staff members are designated to conduct label reviews on a full-time basis. Many PMs and their staffs are currently juggling label reviews for product reregistration with PRIA and other registration work. Other personnel issues include frequent staff turnover and the likelihood of several PMs retiring in the near future. With regard to managing workload, the number of review packages delivered by SRRD to RD is highly variable. Branch Chiefs and PMs in RD often do not receive a "heads-up" from SRRD about when to expect review packages. PMs may receive one hundred review packages at a time, or as few as one or two review package every few weeks to a month. The product reregistration backlog is also highly variably among the RD branches. For example, two branches have no backlog while the remaining branches have backlogs of one hundred or more products. Several PMs expressed preference for receiving all product labels pertaining to one chemical at one time. This is advantageous because it allows the review teams to meet and discuss any issues, thus leading to greater consistency in the label reviews. The downside of batching is that SRRD may hold back a large number of completed packages while completing the remaining products, which delays implementation of mitigation and potentially results in outdated assessments for a significant number of products. Several staff noted that there is very little collaboration or communication between SRRD and RD on the label assessments and reviews. For example, the PRB Label Review Team rarely 40 Product Reregistration Quarterly Review, Briefing for Jim Jones, Associate Director of the EPA Office of Pesticide Programs, July 2006 7-3 ------- receives feedback nor is asked questions by RD on the preliminary label assessment. Similarly, it is common for there to be little to no interaction between the SRRD CRM and the PM when the final review package is delivered to RD. To facilitate the handoff of packages between SRRD and RD, OPP recently developed new standard operating procedures (SOPs) to provide RD with streamlined label review packages from PRB.41 By providing only the critical documents used in PRB's label assessment, OPP expects that RD staff will be able to proceed with reregistering the product with less effort and in a shorter time period. A streamlined package would entail sending RD only the final acceptable review from each discipline (e.g., acute toxicity, product chemistry with acceptable confidential statement of formula, and efficacy), the label assessment, and one copy of the latest draft label (used in the label assessment). Previously, each CRM assembled packages differently and often provided more information than RD required. Both of these issues required RD to spend a significant amount of time reviewing and sorting materials in the package before conducting its label review. 7.5 Current Strategy to Expedite Product Reregistration Recognizing the backlog in product reregistration, upper management in RD has placed an increased emphasis on product reregistration recently. In Fall 2006, the RD Director developed a plan to expedite product reregistration by forming "SWAT teams," which would include staff from both RD and SRRD and would focus on reducing product reregistration backlog. This is a promising approach because it bridges the divide between RD and SRRD, which will help to facilitate communication between the divisions. Four categories of products were identified: (1) Products in RD for which the PM has communicated with the registrant but has not yet received a label that is in compliance with the RED, (2) Products in RD for which the PM has not yet taken any action, (3) Products in SRRD PRB for which the DCIs have been issued, and (4) Products in SRRD PRB for which the DCI has not yet been mailed.42 Products in Categories 1 and 2 will be addressed by RD staff exclusively. During our interviews, we found that some RD branches had taken the initiative to reduce its product reregistration backlog (as of September 2006), whereas others had not yet addressed products in their branch. Categories 3 and 4 will be addressed by SWAT teams (SRRD and RD). To address Category 1 products, the PM will send a letter that outlines a registrant's obligations and allow a given amount of time to incorporate these changes before EPA takes action. To address Category 2 products, the PM will send a letter to the registrant requesting label changes as stated in the RED. The registrant must also send a letter that certifies that the only changes on the label were those required by the REDs. In early October, SWAT teams were established to expedite product registration for Categories 3 and 4. Each team consists of about five SRRD and RD staff, each dedicating full-time, or close to full-time, to product reregistration over the next few months. The SWAT teams will 41 SOP for Reregistration Packages sent to RD, provided to Abt Associates by Venus Eagle, September 2006 42 Categories for Products in the SRRD-RD Pipeline, August 2, 2006 7-4 ------- conduct label reviews, send letters to registrants about required label revisions, and initiate regulatory action when a registrant does not comply. Each SWAT team will be assigned about one to three active ingredient cases, covering about 100 products in total.43 RD predicted that the SWAT teams would work for a period of two months. The SWAT team approach is unique for several reasons: • It includes ambitious internal deadlines for completing product reregistration • Product reregistration was made a priority within RD (particularly with respect to products in Categories 1 and 2) • RD will provide support to SRRD with products that have not yet completed the SRRD portion of the reregistration process. • It includes strict deadlines for registrant responses, including 30 days for registrants to submit amended labels (Categories 1 and 2). OPP is also considering requiring registrants to amend labels with RED-specified mitigation in advance of product reregistration (Categories 3 and 4). Preliminary information on the SWAT team approach indicates that each of the RD branches is implementing the approach differently. In any event, the management attention placed on product reregistration will ensure that product reregistration happens in a timelier manner. As the approach is further implemented, EPA will need to assess if the 30-day deadlines are being met, what the role for either division was, and compare number of actions completed in FY2007 to previous years. 43 Details of Reregistration Process Categories (Draft), provided to Abt Associates by Pete Caulkins, SRRD, September 8, 2006 7-5 ------- 8. Suggested Changes to Process Design and Other Recommendations Based on the findings and analysis presented in Chapters 3 through 7 of this report, this chapter presents our recommendations for improving the product reregistration process. As appropriate, we also present pros and cons for each recommendation. 8.1 RED Development In August 2006, EPA completed the REDs for food-use pesticides as required by the Pesticide Registration Improvement Act. At that time, EPA only had 54 REDs to complete (9 percent). Thus, there are still opportunities to improve non-food-use REDs and to direct more attention to post-RED activities. Based on the case studies discussed in Chapter 4, Abt Associates identified the following issues or problems with REDs that contribute to delays in product reregistration: • REDs were often published before they are completed or before all outstanding issues were properly addressed. • The documents represent a "snapshot in time" of the data available to EPA, and registrants often provide additional data that warrant amending the RED. • Some REDs did not represent reregistration decisions or included provisions for additional studies, such that product reregistration could not be effectively implemented after the RED was published. • REDs sometimes contained small errors, most of which were straightforward and easy to address. • The label tables often contained language that RD or PRB felt could be improved or that was not consistent with labeling for other products. • Staff from the reregistration branches were often unavailable to assist with post-RED issues. • When a case is transitioned to PRB, staff are often unfamiliar with the RED contents and issues. • The implementation of REDs was often influenced by other issues, which may not have been directly related to the RED itself (e.g., the cancer reclassification for captan, the registrant's decision to discontinue dicofol, legal challenges, etc.). With these findings in mind, Abt Associates provides the following recommendations regarding RED development. 8.1.1 Improve Transition of Cases from Reregistration Branches to PRB The transition of a chemical case from the SRRD reregistration branches to PRB could be improved. One potential way to accomplish this would be to have a "hand-off" meeting that would be attended by the generic CRM, his/her branch chief, the PRB branch chief, and the product CRM. This would be an opportunity for the reregistration branches to brief PRB on the issues, particularly those that are outstanding, and improve the relationship and coordination 8-1 ------- within SRRD. This would address the concerns of PRB that reregistration branches do not actively participate in many post-RED issues and also the concerns of the reregistration branches that product reregistration lacks visibility. A meeting would also help delineate roles and responsibilities, and signal a clear transition from one branch to another. Until this meeting occurs, the chemical case would remain the responsibility of the reregistration branches and help encourage them to address post-RED issues. 8.1.2 Require More Participation by RD in the Development of Label Tables Based on our conversations with both RD and SRRD (reregistration branches and PRB), we believe that the development of the label table in the RED should be improved. This recommendation is based on comments from the reregistration branches that they do not have adequate expertise in labeling. Similarly, both the PRB Label Review Team and the RD PMs noted that label tables often include language that is written in a way that is not suitable for a label or that is inconsistent with other products containing the active ingredient. RD noted that PMs are invited to attend the meetings, but RD does not generally play an active role in the development of the label table. RD Branch Chiefs should ensure that PMs are invited to and attend these meetings. The involvement of both the PM and the RD Team Leader in the RED process will help ensure the quality and thoroughness of the label review as it relates to RED- specified mitigation. In addition, RD should be required to review and approve label tables before they are published to ensure consistency and appropriateness. Note that because of our recommendation to eliminate label assessments within PRB (below), the development and review of the label table would not be a role for PRB. 8.2 Implementation of RED-Specified Mitigation Based on its review of Memoranda of Agreement (MOAs), pilot projects, and RD's SWAT team approach, Abt Associates identified the following issues or problems related to implementation of RED-specified mitigation: • Because of the length of the product reregistration process, as well as the delays that often occur, the mitigation identified in the RED is often not implemented for several years. This delay is particularly troublesome given that the universe of pesticides products to be reregistered includes those that were registered prior to November 1, 1984. • Even with regulatory action as a possible consequence of non-response, several registrants did not submit amended propanil labels to include RED-specified mitigation. • In the case of phosmet, amended labels were not submitted in an expedited manner as specified in the MOA. With these findings in mind, Abt Associates provides the following recommendations regarding the implementation of RED-specified mitigation. 8.2.1 Implement Mitigation in an Expedited Manner When Cost-Effective With the goal of implementing RED-specified mitigation as soon as possible, OPP is considering requiring registrants to amend product labels after a RED is signed to include the required labeling changes. OPP is considering using this approach for all products because OPP 8-2 ------- believes that identifying a subset of products would not maintain a level playing field among the registrants. By potentially adding an additional step into the product reregistration process, OPP needs to consider the additional staff time and resources this would require. Not only would OPP need to conduct an additional round of label review, but it would also need to track responses and maintain communication with the registrant. Although we understand EPA's rationale for applying this policy to the entire universe of end- use products, OPP would have several options available to it if adequate staff and resources were unavailable: • Identify subset based on risk characteristics based on the attributes of the product (e.g., market share, use patterns) or the level of mitigation required by the RED • Select REDs that are likely to have issues that might delay product reregistration, including related regulatory activities, etc. Any rationale for differentiating policies would have to be defensible and be consistent with applicable laws and regulations. In addition, during the course of product reregistration, both RD and SRRD would be in contact with the registrant. RD would request a label amended with RED-specified mitigation, whereas SRRD would request ninety-day and eight-month responses. OPP would need to ensure that these efforts are consistent and coordinated to reduce confusion on the part of the registrant. Members of the regulated community, particularly smaller companies, are likely to miss the distinction between the two divisions and only focus on the Agency level. Note that this issue arose during the captan reregistration, where both the SRRD reregistration branch and PRB were in contact with the registrants at the same time. Moving forward with the proposed approach, OPP would need to establish better communication and coordination between the RD PM and the SRRD PRB CRM. Alternatively, although it prolongs implementation of RED-specified mitigation, EPA could require the amended label with the ninety-day response, but instead of holding onto it until the product is ready for label review, PRB could immediately send the label to RD for review. This assumes, however, that the DCI is sent out in a timely manner because RD is considering having a PM send letters to the registrants independently of the DCI. As a benefit, issuing the letters prior to the DCI may allow OPP to identify products that would be cancelled before it goes to the effort of preparing and mailing a DCI. 8.2.2 Pursue Additional Regulatory Action When Warranted As demonstrated in the cases of propanil and phosmet, several registrants did not submit amended labels despite the consequence of regulatory action or the conditions of the MOA. To ensure that mitigation is consistently implemented and that registrants are aware of the implications of noncompliance, EPA needs to be prepared to pursue the "additional regulatory action" to which it refers in its letters to the registrant. Without this aspect, the success of implementing RED-specified mitigation is limited. 8-3 ------- 8.2.3 Further Explore Self-Certified or Electronic Labels As part of its approach to implement RED-specified mitigation sooner, EPA would require registrants to submit a letter that certifies that the only changes that were made to the label were those specified by the RED. Although this issue is outside the scope of this evaluation, Abt Associates suggests that EPA consider requiring a registrant to identify and certify the nature of label changes for all label amendments. This step would increase the transparency, and also reduce the burden on the PM for identifying label changes that may or may not be appropriate. Similarly, several staff noted that OPP has discussed but is not yet actively pursuing an electronic labeling system that would allow EPA to compare label amendments electronically (i.e., in a manner similar to document comparison features in word-processing programs). These two changes to program design would decrease label review burden generally and provide RD with significantly more time to address other issues, including product reregistration. 8.3 DCI Justifications and Preparation Based on our findings in Chapter 5, Abt Associates identified the following issues or problems associated with developing Data Call-in (DCI) justification packages and mailing out DCIs that contribute to delays in product reregistration: • The format for the DCI justification package has been and continues to be an issue. Based on the direction provided by the Field and External Affairs Division (FEAD), SRRD used a new streamlined template for the justification package, but it also supplemented the template with a substantial amount of information. • Risk assessments and REDs often do not provide the necessary information to create the DCI justification package, which requires PSB to spend a significant amount of time collecting additional information. • As with other parts of the product reregistration process, SRRD does not have the adequate tracking systems available to them and has been forced to develop external systems on an ad hoc basis. With these findings in mind, Abt Associates provides the following recommendations regarding the preparation of DCI justification packages and DCIs generally. 8.3.1 Ensure that DCIs Are Prepared According to the Package Template PSB should use the template for the DCI justification package to prepare the DCI package more effectively and efficiently. While it is important to anticipate the needs and questions of OMB, PSB should ensure that the DCI packages provide the essential information, not try to anticipate all of the information that OMB could (but may never) require at a later time. In turn, the DCI justification package template should be revised according to the comments and lessons learned from OMB on an ongoing basis. 8.3.2 Modify Format of Supporting Data in Risk Assessments The RAs should contain an up-front description of the data gaps and the rationale for new studies so that PSB staff do not have to search for or re-create this information. As part of the 8-4 ------- description, the science divisions should include cost burden estimates for "special studies," since they are in the best position to project the requirements and costs of special studies. As a next step, PSB and the science divisions should work together to identify what PSB routinely needs from RAs or REDs in order to construct the DCI justification package, and then how that information can best be presented and summarized going forward. 8.4 Streamlined Data Requirements Based on EPA's analysis discussed in Section 6.2 of this report, Abt Associates expected to make recommendations for streamlining acute toxicity or product chemistry data requirements based on characteristics of end-use products. However, as described in that section of this report, Abt Associates concluded that the analysis was not designed in a manner that yielded results appropriate for this purpose. Without adequate data on which to base recommendations, Abt Associates is unable to make recommendations for streamlined data requirements. However, based on its research, Abt Associates provides the following recommendations regarding the product-specific data requirements. 8.4.1 Conduct Additional Analyses to Determine Value of Product-Specific Data In order to provide data to inform an approach for streamlined data requirements, OPP could consider undertaking additional analyses that would be more informative and detailed than the one provided to support this evaluation. Such an analysis would involve randomly selecting from the entire universe of products for which product reregistration was completed or for which labels had been amended. This analysis would also not be limited to sampling one product from each RED. To increase the utility of the results, EPA should identify mitigation resulting from product-specific data in a more detailed manner and record these results in either Microsoft Excel or Access to facilitate analysis. We also believe that a comparison of RED- specified mitigation to that warranted by product-specific data would be informative. 8.4.2 Leverage Related Efforts for Process Improvements In June 2006, the Pesticide Program Dialogue Committee (PPDC) PRIA Process Improvement Workgroup met to discuss issues with product chemistry studies.44 The workgroup was formed in reaction to a provision in PRIA on process improvement. The workgroup includes members from EPA and industry, including the director of the Registration Division. Both EPA and registrants have noted that product chemistry studies are often provided as the rationale for extending decisions on registration actions under PRIA. Staff from SRRD participated in the workgroup discussion of product chemistry. Given the common interest in product chemistry studies, Abt Associates recommends that SRRD maintain its participation is these discussions and take full advantage of any procedures, guidance, or calculations that result from this related improvement process. This is also an opportunity for RD and SRRD management to leverage ideas and approaches that are applicable to product reregistration. 8.4.3 Expand Batching Approaches to Reduce Number of Requested Studies For the case of 2,4-D, EPA worked with the Industry Task Force to identify storage stability studies and to further batch acute toxicity data based on existing studies. For this approach to 44 http://www.epa.gov/oppfead1/cb/ppdc/pria/june06/june06-minutes.pdf 8-5 ------- succeed, all (or almost all) registrants need to be involved. In addition, the number of 2,4-D products also justified the approach. Due to the unwieldy amount of data received from the Task Force, OPP has decided that future efforts to reduce acute toxicity data requirements will not consider existing data during the batching process. Rather, PRB will provide the Task Force with the batching and allow them to identify acute data that support product batches, after which PRB will evaluate the data for acceptability. The acute toxicity profile and MRIDs for the studies available to support each batch will be identified in the final batching document. EPA should explore ways to engage the registrants early on in the batching process, perhaps by identifying windows of opportunity in the public participation process. This may help to address batching issues in a timelier manner. EPA is currently considering ways in which product-specific acute toxicity and product chemistry data requirements could be further batched or streamlined for other cases, including PBO (1,704 products), pyrethrins (1,490 products), MGK-264 (706 products), and permethrin (1,185 products). 8.4.4 Encourage Use of Self-Certified Product Chemistry Data In 1998 OPP issued Pesticide Registration (PR) Notice 98-1, Notice to Manufacturers, Producers, Formulators, and Registrants of Pesticide Products, which allows a "self- certification" program for certain product chemistry data for manufacturing-use products and end-use products. Applicants are allowed to submit a one-page summary of the products physical and chemical properties, but are no longer required to submit the studies upon which the summary is based. Registrants must submit the studies if requested by OPP. Based on our conversations with OPP staff, few registrants take advantage of this option for the purposes of product reregistration. If they did, OPP would likely request the supporting studies, particularly for storage stability. Thus, the benefit of this policy to registrants is not clear because they still need to complete the studies, prepare a summary (that imposes additional burden), and then respond to OPP inquiries. As such, this attempt at streamlining data requirements and submissions does not appear to be an effective one, and EPA should consider if it can provide an incentive for registrants to submit self-certified data or provide guidance that would yield storage stability studies that would not require OPP review. 8.5 Registrant Responses One of the sources of delay in the product reregistration process is the registrant responses, which require a lot of time for the registrants to prepare and submit, as well as for EPA to receive, track, review, and respond to (if required). During the course of its reregistration program, EPA has initiated several efforts to increase the quality of data it receives from registrants. To ensure that registrants submit responses in a timely manner, or perhaps encourage registrants to submit responses more quickly than required, Abt Associates provides the following recommendations. 8.5.1 Create Incentives for Registrants to Provide Expedited Responses As appropriate and permissible under applicable laws and regulations, EPA should consider if it could create incentives for registrants to submit data early or signal their intent to cancel a product. One potential approach would be to reduce registration maintenance fees or allow 8-6 ------- additional flexibility. EPA would need to consider if these approaches would provide an adequate benefit to OPP relative to the cost (either in dollars or effort). This recommendation is based on the finding that registrants are often unwilling to voluntarily provide data and amend labels. This finding runs counter to the situation in RD where registrants want OPP to process registrations as soon as possible and registrants willingly submit information in a timely manner. 8.5.2 Establish Procedures and Pursue Suspensions Recently, OPP has not initiated suspensions of product registrations because the procedures are under review. OPP also noted that suspensions require a significant amount of paperwork such that EPA often enters into negotiations instead. It is also difficult to lift a suspension. Because registrants lack an incentive for product reregistration to occur, as they often lose uses or must add additional mitigation to the label, EPA must make an aggressive effort to receive registrant responses. EPA is currently reviewing its procedures and signature authority for suspensions, and should consider suspending registrations of products for which the registrant is not submitting the required information. Despite the effort, this practice will send a clear message to the regulated community. 8.5.3 Retain Data Review Functions within PRB Until 1989, product reregistration was the responsibility of the Registration Division. SRRD, and PRB specifically, was created specifically to address reregistration because it was not a priority within RD. Some have suggested that given the similarities between the two programs that product reregistration should again be the purview of RD. Although Abt Associates suggests in the next section that the label assessment in PRB should be discontinued, we believe that requesting, managing, and reviewing registrant submissions should remain the responsibility of PRB and be organizationally separate from registration. If these functions were moved to RD, they could be lost when combined with the competing priorities of registration. We believe there is a significant benefit to having dedicated product reregistration reviewers in PRB. 8.6 Label Reviews and the Role of the Registration Division Based on our findings in Chapter 7, Abt Associates identified the following issues or problems associated with label reviews and assessments that contribute to delays in product reregistration: • The label assessments are used by some of the registration branches, whereas others do not even consult the documents. Some product mangers commented that PRB information was out of date or inconsistent with related products containing that active ingredient. • The goal of the PRB label assessment was to consistently implement product reregistration on product labels, but the consistency goal was subsumed by a broader effort for labeling consistency (e.g., Label Review Manual). • The ziram pilot project did not provide enough information from which to draw conclusions. • The procedures for the transition between SRRD PRB and RD have helped to streamline the package. 8-7 ------- • SRRD and RD staffs generally do not communicate with each other and are generally unaware of the issues and procedures in either division. With these findings in mind, Abt Associates provides the following recommendations regarding label reviews and the role of RD. 8.6.1 Discontinue Label Assessments within SRRD While an effort was made to clearly divide roles and responsibilities between RD and SRRD, the preliminary label assessments and label reviews remain duplicative. As such, we recommend that that label review responsibility should reside within RD. This recommendation is based in large part on the finding that many PMs do not consult the preliminary label assessments because they are outdated (i.e., based on an outdated version of the label) or because the PMs regard them as unreliable or incomplete. Given their product-specific knowledge and familiarity with the label review process, PMs are arguably the best-qualified individuals to conduct the label reviews. While a label assessment in SRRD and a full label review in RD ensures that at least two individuals have reviewed the label, we believe that the efforts are redundant. In addition, PRB sometimes defers to RD on labeling decisions anyway (e.g., restricted-use pesticide classifications). Note that this recommendation does not preclude the participation of SRRD staff in the SWAT team approach developed by RD management. 8.6.2 Improve Transition of Cases from SRRD to RD Better communication and collaboration are needed when SRRD delivers the final review packages to RD. Currently, many CRMs deliver final review packages to PMs without notifying them beforehand or clearly summarizing outstanding issues. We recommend that CRMs and PMs have "hand-off meetings" at this time so any unresolved issues can be flagged and discussed. The scheduling of hand-off meetings will also help PMs to better predict and manage their workloads. 8.7 Management, Resources, and Staffing Abt Associates drew the following conclusions regarding management, resources, and staffing: • The resource allocation has remained relatively stable and SRRD expects that will continue. • The backlog of product reregistration actions to be completed increased after the completion of the food-use REDs in August 2006. • Recent management attention has raised the visibility of product reregistration in both RD and SRRD. • The SWAT team approach developed by RD management is a promising approach to accomplishing product reregistration. With these findings in mind, Abt Associates provides the following recommendations regarding management, resources, and staffing. 8-8 ------- 8.7.1 Reevaluate Allocation of SRRD Resources Despite the number of products yet to be completed, particularly following the completion of the food-use REDs in August 2006, Abt Associates believes OPP should reconsider its allocation of resources in FY2007 and in the future. In its FY2007 reregistration work plan, SRRD allocates eight percent of its resource allocation to product reregistration. The eight percent FTE allocation is roughly equivalent to past staffing levels and SRRD expects the staffing level to remain fairly constant in the short term. Funds are allocated to product reregistration at roughly the same level through FY 2013. EPA has predicted that it will complete product reregistration in 2012. Based on the data presented in Chapter 3, we considered the work that SRRD has yet to complete with respect to product reregistration. In FY2006, EPA completed 545 actions, with 11,948 actions pending. Several active ingredients represent a large number of products: PBO (1,704 products), pyrethrins (1,490 products), MGK-264 (706 products), and permethrin (1,185 products). For purposes of the following calculation, these active ingredients were removed because we expect that EPA will develop unique approaches for these cases such that they may not follow the traditional reregistration process. Thus, we expect that approximately 6,903 actions remain exclusive of these chemical cases. We are working on the assumption that EPA completes 545 actions for FY2007 and beyond, based on stable resource allocation and the potential increased burden that would be associated with implementing RED-specified mitigation in advance of product reregistration. When considering 6,903 products and completing 545 actions per year, we predict that product reregistration may not be completed for more than twelve years, or the end of FY2018. This is six years longer than EPA's current prediction, and five years longer than the period for which EPA has budgeted. We understand that this calculation is rough and that there will also be FTE resources dedicated to the four major active ingredients identified above; however, given this workload and the necessity to complete product reregistration in a timely manner, EPA needs to reconsider its resource allocation. 8.7.2 Maintain Emphasis on Product Reregistration The attention and emphasis placed on product reregistration by both SRRD and RD management have been critical to the recent improvements. It is important that this emphasis and attention be maintained, particularly as the office has competing priorities (e.g., registration review). In addition, OPP should use all opportunities to elevate issues related to product reregistration to OPP upper management, particularly when it comes to issues of staffing, resources, and policy concerns. Because SRRD and RD both share responsibility for product reregistration, upper management can help align the divisions and establish priorities. This continued emphasis on product reregistration is also important in the event that senior management in either division changes before product reregistration is completed. 8.7.3 Pursue SWAT Teams and Other Strategies to Reduce Backlog As discussed in Chapter 7, the SWAT team approach developed by RD management is a promising avenue to reduce the product reregistration backlog. After reviewing the materials, Abt Associates believes that the SWAT team approach will be particularly effective at addressing products within Categories I and 2 because the approach requires action by both the PM and the registrant. The changes in process design that correspond to products in 8-9 ------- Categories 3 and 4 are more dramatic and longer term. Moving forward, OPP should be mindful of the workload that corresponds to the SWAT team approach, the follow-up required, and the coordination between and roles of SRRD and RD. Over the long-term, OPP should consider alternative strategies to reduce the product reregistration backlog over the next several years, including a performance-based contract for short-term staff support to assist EPA in the completion of product reregistration actions. The disadvantage of such an approach is that product reregistration requires a lot of internal communication and relies on institutional knowledge. However, some RD staff noted that newer staff or Senior Environmental Employment (SEE) employees are often assigned and successfully complete product reregistration tasks. 8.7.4 Obtain Support for DCI Preparation The SRRD Program Support Branch (PSB) needs a senior scientist or senior science writer on staff. Although FEAD is a policy-oriented, not science-oriented group, PSB is relying on FEAD expertise in this area to assist in the development of the DCI justification package. This new hire would not only relieve FEAD's time commitment, but would also help expedite the development of the DCI justification package and provide needed scientific expertise. Alternatively, SRRD could shift existing staff to provide additional support in this area, particularly given the number of FY2006 decisions that will require DCIs in the short-term. 8.8 Communication Based on its research, Abt Associates believes that communication regarding product reregistration could be improved both internally and externally. Elsewhere in this report, we note that the reregistration branches, PRB, and RD are unclear on each other's roles. In addition, PRB used to be physically separated from the rest of SRRD and the new office space seems to have helped facilitate communication. There are, however, opportunities for additional improvements by way of trainings, meetings, and brownbag presentations. With respect to external communication, product reregistration is not mentioned in many OPP reports, such as the office's annual report.45 In a recent addition to the EPA Pesticides Web page, "Pesticide Reregistration Facts,"46 EPA highlighted and acknowledged product reregistration in its summary of the pesticide reregistration process and status. This discussion does not mention product-specific data and leads the reader to assume that product reregistration is a check to confirm that RED-specified mitigation appears on a label. It also notes that EPA "plans to complete the last product reregistration decisions several years after the last REDs are signed." In contrast, there was very little (if any) discussion on the EPA Pesticides Web page previously, and this information was included only within the REDs and Federal Register notices. Abt Associates believes that EPA could increase the transparency of the program by explicitly mentioning and addressing product reregistration. For example, to be more explicit and help the regulated community plan better, EPA could add reference to pesticide product reregistration in the "Status of Pesticide Reregistration" Web page along with schedules for REDs and registration review. 45 http://www.epa.gov/oppfead1/annual/2005/05annualrpt.pdf 46 www.epa.gov/oppsrrd1/reregistration/rereg istration_facts.htm 8-10 ------- 8.9 Performance Management Based on the measures reported under the Government Performance and Results Act (GPRA), Abt Associates believes there are opportunities to make these measures more meaningful for both internal and external stakeholders. Similarly, to address competing priorities within RD, we suggest that OPP incorporate individual performance goals for product reregistration. 8.9.1 Improve Performance Measures and Strategic Targets As discussed in Section 1.4 of this report, for purposes of GPRA, EPA reports on the number of product reregistration actions completed. However, this type of output measure is not informative because it does not provide a measure of progress relative to the entire universe. Abt Associates recommends that OPP revise this performance measure to use a percentage, which would be more informative. We understand that the universe of pesticide products subject to reregistration is constantly in flux; however, a percentage measure might be more informative for internal purposes. In addition, Abt Associates would suggest that EPA examine its targets for the number of pesticide reregistration actions. Although the targets have increased annually, the targets might not be realistic or ambitious enough to ensure completion of product reregistration within EPA's desired timeframe. 8.9.2 Incorporate Product Reregistration into PARS In order for the SWAT team approach and other product reregistration process improvements to be most effective, RD should place a continued emphasis on product reregistration. Currently, PMs have to manage their work based on the competing priorities of pesticide registration and reregistration. Until recently, however, RD management has not placed a high priority on product reregistration; for example, PMs have concrete job performance goals related to registration but not to product reregistration. To ensure that RD accomplishes product registration in an efficient, timely manner going forward, RD management should include product reregistration-specific goals in each staff member's Performance Appraisal and Recognition System (PARS). In turn, management should periodically review each PM's workload to make sure that workload is manageable and appropriately distributed among individuals. 8.10 Information Management Abt Associates drew the following conclusions regarding information management with respect to product reregistration: • Even though OPPIN was intended to be an integrated system, it has failed to meet the tracking needs of different components of the product reregistration process. • Many staff have created one-off tracking systems in order to get their jobs done, making reliable status updates very difficult to retrieve. • The current approach to information management not only contributes to inefficient and inadequate tracking, but also potentially makes EPA vulnerable. • Information management is an issue in each of the product reregistration sub-processes. 8-11 ------- With these findings in mind, Abt Associates provides the following recommendations regarding information management. 8.10.1 Continue to Prioritize an Integrated Tracking System SRRD should continue to prioritize the development of an integrated tracking system that manages all of the data and information related to the DCI process. For example, the fact that the current tracking system does not adequately track the status of submitted studies and confirmatory data from registrants is a potential liability to EPA. Assuming that PRISM is the predecessor of OPPIN, SRRD should ensure that PRISM has the necessary data fields and functionality for tracking all components of the DCI process because future programs (e.g., registration review) will use OPP's DCI authority. As an alternative to PRISM, it may be more practical and cost effective to develop a relatively simple tracking system in Access that staff can use for DCI-related tracking. This Access database would track, at a minimum, the following elements of the DCI process: (1) the submission and approval dates of the DCI justification by EPA (FEAD and RCS), (2) submission to and approval by OMB, (3) the outcome of the ninety-day response period whereby registrants specify their intent to comply, seek a waiver, or cancel their product, and (4) the status of submitted studies over the eight month response period. (Item #4, for example, would negate the need for the current "charts and tables" document that is maintained in Word for each PDCI.) Additionally, in developing the DCI tracking system, OPP should consult other EPA offices (e.g. Office of Pollution Prevention and Toxics) that issue DCIs to determine what tracking systems they use, if any, and share lessons learned. Ideally, OPP would already have in place an integrated, centralized database that would track all remaining aspects of the registration process. Given that product re registration is a finite process (anticipated completion being 2012), it may not be an effective use of OPP's time and resources to build a sophisticated system such as PRISM for the purposes of product reregistration. Depending on how far along PRISM is in its development phase, we recommend that OPP revisit its tracking needs to determine whether the potential benefits of PRISM will outweigh the negatives (e.g., cost, staff time, limited lifespan), and whether the work already done on PRISM can be transferred towards the creation of a simple, effective Access database. Although the utility of PRISM from strictly a product reregistration standpoint is questionable, PRISM will presumably benefit SRRD's upcoming registration review, which will continue past the complete of product reregistration. The development of any tracking system (whether it be PRISM or an Access database) should involve all relevant staff. CRMs, FEAD, management, and PSB (among others) all have different needs for tracking, and in turn, all groups need the opportunity to provide input on the final system. Since all OPP staff may not be familiar with Access, the database should be created with a user-friendly interface that makes data entry and analysis straightforward. 8.10.2 Maintain Web Site as a Repository of Reregistration Decisions Both SRRD and RD staff rely on the OPP web site (www.epa.gov/pesticides) as a historical repository of reregistration documentation, including risk assessments, the RED and associated amendments, label tables, and other Federal Register notices. This reliance on the web site is an issue because OPP does not use a docket system for reregistration, nor does OPP publish REDs in hard copy anymore. Because several staff noted that amendments are not often 8-12 ------- posted in a timely manner, it is essential that OPP remain attentive to its web site. This type of information is not available in OPPIN, but might be available in the Jacket. The Jackets, however, are not yet available electronically. These records will be critical for registration review. 8-13 ------- Appendix A Interview Guide The following interview guide was used for each of the interviews with OPP staff, including introductions, general questions, issue-specific questions, and conclusions. As appropriate, we also asked questions that arose during the course of the meeting or that related to comments made by the interviewer. Introductions "Good morning. I am (introduce self). This interview is being conducted to get your input about the implementation of the product reregistration program that you have been conducting/involved in. I am especially interested in any problems you have faced or are aware of and recommendations you have." "If it is okay with you, I will be tape recording our conversation. The purpose of this is so that I can get all the details but at the same time be able to carry on an attentive conversation with you. I assure you that all your comments will remain confidential. I will be compiling a report that will contain a synthesis of all staff comments without any reference to individuals. If you agree to this interview and the tape recording, please sign this consent form." "I'd like to start by having you briefly describe your responsibilities and involvement thus far with the product reregistration." (Note to interviewer: You may need to probe to gather the information you need, including length of time individual has worked in the program). General Questions "I'm now going to ask you some questions that I would like you to answer to the best of your ability. If you do not know the answer, please say so." • In your opinion, what are the biggest challenges faced by product reregistration? How do these challenges influence your role in the process? • What do you think are the main factors the influence the length of time that product reregistration takes? Which parts of the program are affected? • How has the program changed over the time you have been here? • Given your role, what would help you do your job better with respect to product reregistration? • Which parts of product reregistration do you find the most time consuming? What are your suggestions for streamlining these portions? • In what ways do you think product reregistration could be improved? • What do you estimate would be a reasonable amount of time for reregistering a specific product after the RED is signed? Problems in REDs • We have been told that the RED for caused delays in product reregistration. Do you agree with this assessment? • What characteristics of the RED resulted in issues? For example, were parts incomplete, incorrect? ------- • If appropriate, in what ways was the RED incomplete? Incorrect? • Did the RED contain any contradictory language? • Were there any circumstances after the publishing of the RED that delayed product reregistration, for example, data made available, a risk assessment revised? • How did these factors impact product reregistration? Were all products affected? • Why do you think that this RED had these issues? • Is this a high-profile case or of particular interest to the registrant or an environmental group? • How did you address each of the issues with the RED? • Who was responsible? What is the estimate of increased burden? • What was the impact to the registrant? • Are there ways that the problems with the RED could have been avoided or decreased? • What needs to change to eliminate the problem? • How could these changes be accomplished? • Have you had (or heard of) similar experiences with other REDs? If so, which ones? How often? • When does this occur (close to a statutory deadline, etc.)? Implementation of RED-specified Mitigation • How/why were the cases selected for MOAs? How many MOAs have been signed regarding product reregistration? Do they vary in scope? • How quickly did mitigation appear on the product label? • Please characterize communication with the registrant. • What additional work did this approach require? Can you estimate the additional time? • How do EPA, environmental groups, and the registrant perceive the case? • In addition to the MOA, what other factors may be unique to this active ingredient? • How did this MOA compare to others on which you have worked or about which you have heard? • How or do you think that this approach could be modified to streamline product reregistration generally? • What type of products (cases) may lend themselves to such an approach? Propanil Pilot • Why were the pilot cases selected? • How did you approach the registrant? What was his/her reaction? • What are the legal issues? How are they being overcome? • Please describe the approach for categorizing products and the rationale for the approach? • To which categories will EPA apply this option? • How will these products be considered for product reregistration? Is there any benefit to the registrant for implementing mitigation on the label sooner? ------- • What is the estimated burden to EPA for this pilot? For the approach generally? What about to the registrant? • What is the estimate for developing the option? The time required for registrants to respond? To complete the process? 2,4-D Batching • Who initiated the batching alternative - EPA or the registrants? • What role did EPA play in the alternative? • What characteristics of 2,4-D made this alternative appropriate (number of products, etc.)? • What documentation exists on this case? • What was required of the registrants collectively? • How were legal concerns or CBI issues addressed? • How do registrants view the alternative? Would they characterize it as a positive experience? • What is the estimated burden savings to EPA or the registrants? • What are the biggest obstacles to implementing this alternative for other cases? • In what circumstances would it be appropriate in order to result in the most burden savings? Label Reviews • What is the division of labor between SRRD and RD with respect to label reviews? • How do SRRD and RD approach the task? • What is the average time a label review takes? Is there a range? • Knowing that RD stamps the label, what resources are available to RD that might not be available to SRRD as they review the label? • How useful is the information provided by SRRD? • What do SRRD and RD look for in the label tables? Could these reviews be reconciled? Ziram Pilot Project • Why was the pilot case selected? Were all the ziram products completed or just one? • What information was given to both divisions? Were they aware that is was for a pilot? • In your opinion, was this label review treated differently than the average case? • What differences appeared on each label? How significant are they? • As an individual, are you comfortable with this streamlining option? Why or why not? • Do you think this option is a valid approach to streamline reregistration? • How long did the review take? Is that a typical amount of time? Relationship between SRRD and RD • How different are the cultures within the two divisions? • How is workload and communication coordinated? ------- • What procedures exist to govern product reregistration? • What are the priorities for either division? Are they in conflict? • In what ways could SRRD work better with RD? Vice versa? • How effective is the SOP for handoff to RD? Pros/Cons? • What RD resources are available to SRRD - are they coordinated/consistent? DCI Preparation and OMB Approval Process • How much time does it take to prepare the DCI? Receive approval? • Do data exist to support this conclusion? • Historically, how many DCIs (and DCI packages) are prepared annually? How many active ingredients? Products? • What issues arise to slow the process? • What are the issues with OMB? What efforts have been undertaken to address them? • What tracking issues arise in this part of the product reregistration process? • In what ways could this part of the process be streamlined? • To what extent is OPP constrained by OMB in this part of the process? • How effective are the SOPs in establishing roles and responsibilities for both EPA and OMB? • When were the SOPs written and how current are they? • Are there any parts of the process that are not covered by SOPs that should be? Information Management • On several occasions, GAO commented on the lack of infrastructure to manage reregistration data. What improvements have been made over the past 10-15 years generally? For products specifically? • What tracking systems exist for product reregistration? • Are there shortcomings in the way SRRD tracks product reregistration? • What are the obstacles to improving this? • Which data management needs are most important? • What is the history of requests to improve tracking? • How is tracking handled in the registration division? • What is the functionality of OPPIN for product reregistration versus Als? • What changes are planned for OPPIN? Will they impact product reregistration? • On what occasions are data pulls needed? How labor intensive is the process? • Who needs access to the information? • What tracking systems are maintained internally? How functional are they? How could it be improved • What other information management tools have been developed? For what purpose? How could they be improved? ------- Management/Budget • How have you seen priorities change within OPP and within the product reregistration program generally over time? How has funding for both OPP and product reregistration changed over time? • From your perspective, how is product reregistration viewed within OPP? Within the Agency? By the registrants? Environmental and public health groups? • How and to what extent does political pressure or media attention affect product reregistration? • Which types of products receive increased scrutiny? Why? • Are there aspects of product reregistration that receive less attention? • What types of project planning exercises are completed for product reregistration (e.g., a work plan)? Is there a forecast for completing product reregistration? Conclusion • Is there anything else today that I have not directly asked that you think is important for us to consider in our evaluation? • Is there anyone else that you think we should talk to about these or other issues? Thank you for your time. We appreciate your thoughts and experiences with product reregistration. Over the coming weeks, we will be compiling responses. If necessary, would it be possible to contact you, if needed, for additional information or clarification? ------- Appendix B Individuals Interviewed or Consulted Peter Caulkins Pat Dobak Venus Eagle Keenan Garvey Richard Gebken Cynthia Giles-Parker Mike Goodis Katie Hall John Hebert Mika Hunter Marion Johnson Karen Jones Dan Kenny George LaRocca Meredith Laws Susan Lewis Marianne Lewis Joanne Miller Tom Myers Gary Mullins Cathryn O'Connell Mark Perry Maria Piansay Linda Propst Margaret Rice Larry Schnaubelt Kelly Sherman Cameo Smoot Jim Tompkins Mary Waller OPP Special Review and Reregistration Division OPP Special Review and Reregistration Division OPP Registration Division, Insecticide-Rodenticide Branch (on detail from SRRD) OPP Special Review and Reregistration Division OPP Registration Division, Insecticide Branch OPP Registration Division, Fungicide Branch OPP Special Review and Reregistration Division, Reregistration Branch 3 OPP Special Review and Reregistration Division, Reregistration Branch OPP Registration Division, Insecticide-Rodenticide Branch OPP Biopesticides and Pollution Prevention Division OPP Registration Division, Insecticide Branch OPP Special Review and Reregistration Division, Product Reregistration Branch OPP Registration Division, Herbicide Branch OPP Registration Division, Insecticide Branch OPP Registration Division, Insecticide-Rodenticide Branch OPP Special Review and Reregistration Division, Reregistration Branch 1 OPP Special Review and Reregistration Division, Product Reregistration Branch OPP Registration Division, Herbicide Branch OPP Special Review and Reregistration Division, Reregistration Branch 2 OPP Special Review and Reregistration Division, Program Support Branch OPP Special Review and Reregistration Division, Reregistration Branch 2 OPP Special Review and Reregistration Division, Product Reregistration Branch OPP Special Review and Reregistration Division, Product Reregistration Branch OPP Special Review and Reregistration Division, Product Reregistration Branch OPP Special Review and Reregistration Division, Reregistration Branch 2 OPP Special Review and Reregistration Division, Product Reregistration Branch OPP Special Review and Reregistration Division, Reregistration Branch 2 OPP Field and External Affairs Division OPP Registration Division, Herbicide Branch OPP Registration Division, Fungicide Branch ------- |