October 26, 2009 EPA-HSRB-09-02 Kevin P. Teichman, PhD Acting Science Advisor Office of the Science Advisor 1200 Pennsylvania Avenue, NW Washington, DC 20460 Subject: June 24-25, 2009 EPA Human Studies Review Board Meeting Report Dear Dr. Teichman: The United States Environmental Protection Agency (EPA or Agency) requested the Human Studies Review Board (HSRB) to review three completed studies involving intentional human exposure to the organophosphate pesticide chlorpyrifos. The Agency proposes 'to rely on these three studies, conducted prior to publication of the EPA's expanded final rule for protection of subjects in human research (40 CFR 26) on February 6, 2006 (71 Federal Register 24, 6137), in actions under the pesticide laws. The Agency asked the HSRB to advise the Agency on a range of scientific and ethics issues regarding how the studies should be assessed against the provisions in 40 CFR sections 26.1701 - 26.1704 of the final human studies rule. The Agency also requested the HSRB to provide scientific and ethical reviews of one completed and two proposed human studies: a completed ICR, Inc., (ICR) insect repellent efficacy study (ICR A382); a proposed Carroll-Loye Biological Research, Inc. (CLBR) insect repellent efficacy study (LNX-002); and a proposed Agricultural Handler Exposure Task Force, LLC (AHETF) water-soluble packing mixing and loading scenario and protocol (AHE-120). The enclosed report provides the Board's response to EPA charge questions presented at the June 24-25, 2009 meeting. Assessment of Completed Research Study MRID 124144: Nolan et al. (1982) Chlorovrifos: Pharmacokinetics in Human Volunteers Following Single Oral and Dermal Doses. Science The Board concluded that data measuring chlorpyrifos at the limit of detection in blood and urine are not useful. The measurements of 3,5,6-trichloro-2-pyridinol (TCP) in urine are generally reliable. It is unclear if the measurement of TCP in blood is useful because of concerns about the ability of the methods used to detect the appropriate TCP conjugate. The Board expressed concern over the variability of the erythrocyte cholinesterase activity data and the lack of a control group, but concluded that measurements of cholinesterase activity/inhibition from Nolan et al. (1982) were likely to be reliable. Page 1 of 40 ------- • The Board concluded that the data are reliable but suggested that the Agency be cautious in its use of the erythrocyte cholinesterase data. Since only a single dose level was evaluated, for example, no dose-response data are available from this study. Ethics • The Board concurred with the Agency’s assessment that there was neither clear and convincing evidence that the study was fundamentally unethical, nor clear and convincing evidence that the study was significantly deficient relative to the ethical standards prevailing at the time the Nolan eta!. (1982) study was conducted. Assessment of Completed Research Study MRID 42062701: Honeycutt and DeGeare ( 1993) Worker Reentry Exposure to Chlorpyrifos in Citrus Treated with Lorsban* 4E Insecticide. Science • The Board concluded that the blood and urine measurements of chiorpyrifos and/or TCP from Honeycutt and DeGeare (1993) are likely reliable but of limited value. Board members expressed concerns about: 1) the small sample size; 2) the background chiorpyrifos exposure not being properly accounted for; 3) the likely incompleteness of urine collection; and 4) the high degree of variation seen in the daily measurements. • The Board concluded that the measurements of cholinesterase activity/inhibition are likely accurate and reliable but raised concerns about their utility. Some of the Board’s concerns included: 1) the lack of an untreated control; 2) the reliance on a single post- exposure time point; 3) the small sample size; and 4) the dose received by the subjects varied and was only estimated from dermal dosimetry. Ethics • The Board concurred with the Agency’s assessment that there neither was clear and convincing evidence that the study was fundamentally unethical, nor clear and convincing evidence that the study was significantly deficient relative to the ethical standards prevailing at the time the Honeycutt and DeGeare (1993) study was conducted. Assessment of Completed Research Study MRID 44811002: Kisicki eta!. (1999 A Rising Dose Toxicology Study to Determine the No-Observable Effect-Levels (NOEL) For Ervthrocvtes Acetyicholinesterase (AChE) Inhibition and Choliner ic Signs and Symptoms of Chiorpyrifos at Three Dose Levels . Page 2 of 40 ------- Science • The Board raised concerns about the analytic procedures’ potential inability to control for the glucuronide-conjugated TCP, and apparent discrepancies in the absorption data when compared with the data from Nolan et al. (1982). Thus, the Board questioned the reliability and utility of the blood and urine measurements of chiorpyrifos and/or TCP from Kisicki et al. (1999) for risk assessment purposes. • The Board concluded that these measurements of cholinesterase activity/inhibition likely represent a reliable set of data, but cautioned the Agency about relying on data from the incomplete profile for the one responder at the highest dose level. • The Board cautioned against relying on the statistical analyses as presented in the report, recommending that these analyses be replicated prior to applying these results to any risk assessment or model development. • The Board concluded that, in the absence of additional information about the analytic methods used and the accuracy of the TCP measurements, the TCP data is of questionable reliability. If the level of exposure cannot be confirmed as reliable, then by default the erythrocyte data should not be used. The Board thus suggested that the Agency be cautious in its use of the erythrocyte data in light of the variability and analytical concerns raised. Ethics • The Board concluded that there neither was clear and convincing evidence that the study was fundamentally unethical, nor clear and convincing evidence that the study was significantly deficient relative to the ethical standards prevailing at the time the Kisicki et a!. (1999) study was conducted. Assessment of Completed Research Study MRID 47732701: ICR Inc. Study A382 — Evaluation of the Efficacy of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% S rav) Against Stable Flies in the Laboratory. Science • The Board concurred with the Agency’s assessment that this study provides scientifically valid results to assess the repellent efficacy against stable flies of the formulations tested. • The Board recommended correcting several of the statistical analyses present in the report. For example, the standard error for mean protection time and resulting confidence interval needs to be corrected to use the estimated standard error, not the planned standard error. The report should also be corrected to indicate that the data presented are for product failure times and not complete protection times. Ethics Page 3 of 40 ------- • The Board concurred with the Agency’s assessment that the study submitted for review was conducted in substantial compliance with subparts K and L of 40 CFR 26. Assessment of Proposed Carroll-Love Biolo2ical Research Study LNX-002: Efficacy Test of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% S rav) with Bitin2 Flies Under Field Conditions. Science • The Board concurred with the Agency’s assessment that this protocol, if modified according to HSRB recommendations and conducted accordingly, will provide scientifically valid results on the efficacy of these two picaridin-based insect repellent formulations against biting flies. • The Board recommended that the protocol be revised to address the following concerns: 1) the standard of biting used may be insufficiently high to yield valid results and could lead to inappropriately right censored data; 2) the change from the previously-used paradigm of one minute exposure of treated limbs out of each 15 minute period to five minutes in each 30 minute period was not explained or justified; 3) the varied behaviors and aggressiveness of four different species of biting flies to be examined; and 4) accurate calculation of mean complete protection time. Ethics • The Board concluded that the protocol submitted for review, if modified in accordance with Agency and HSRB recommendations and conducted accordingly, is likely to meet the applicable requirements of 40 CFR 26, subparts K and L. Assessment of Proposed AHETF Scenario and Protocol AHE-120: Water-Soluble Packin2 Mixing and Loadin2. Science • Given the lack of existent reliable and sound data in this area, the Board concurred with the Agency’s assessment that this protocol will generate data that are scientifically valid. These data may be useful for assessing the exposure of handlers who mix and load soluble or wettable powder pesticides in water-soluble packaging. • The Board cautioned that these data are likely to be useful for creating distributions of worker exposure only if worker exposure is found to be proportional to the amount of active ingredient handled (AaiH). Page 4 of 40 ------- The Board recommended that the AHETF and the Agency acknowledge the limitations of the study design and add appropriate statistical methods or data management approaches to ensure that, once these data are inside the AHED database, the limitations of the original study design are not forgotten and the data used inappropriately by end-users to generate typical statistical distributions. Ethics • The Board concluded that the protocol submitted for review, if modified in accordance with Agency and HSRB recommendations and conducted accordingly, is likely to meet the applicable requirements of 40 CFR 26, subparts K and L. In particular, the Board recommended that the AHETF implement the proposed protocol changes designed to address issues of representativeness language in the informed consent and related documents. • The Board recommended that the AHETF release individual exposure data only once the study is complete, except in those instances where data collected from individuals suggest an unusually high level of exposure and thus a clear need to mitigate exposure risks. Sincerely, ç s Sean Philpott, PhD, MSBioethics - Chair EPA Human Studies Review Board Page 5 of 40 ------- NOTICE This report has been written as part of the activities of the EPA Human Studies Review Board, a Federal advisory committee providing advice, information and recommendations on issues related to scientific and ethical aspects of human subjects research. This report has not been reviewed for approval by the Agency and, hence, the contents of this report do not .necessarily represent the view and policies of the Environmental Protection Agency, nor of other agencies in the Executive Branch of the Federal government, nor does the mention of trade names or commercial products constitute a recommendation for use. Further information about the EPA Human Studies Review Board can be obtained from its website at http://www.epa.gov/osalhsrb/. Interested persons are invited to contact Paul Lewis, Designated Federal Officer, via e-mail at lewis.paul epa.gov. In preparing this document, the Board carefully considered all information provided and presented by the Agency presenters, as well as information presented by public commenters. This document addresses the information provided and presented within the structure of the charge by the Agency. Page 6 of 40 ------- US ENVIRONMENTAL PROTECTION AGENCY HUMAN STUDIES REVIEW BOARD Chair Sean Philpott, PhD, MS Bioethics, Science and Ethics Officer, Global Campaign for Microbiocides, PATH, Washington, DC Vice Chair Rebecca Parkin, PhD, MPH, Associate Dean for Research and Public Health Practice, School of Public Health and Human Services, The George Washington University, Washington, DC Members Janice Chambers, PhD, DABT, William L. Giles Distinguished Professor, Director, Center for Environmental Health Sciences, College of Veterinary Medicine, Mississippi State University, Mississippi State, MS Suzanne C. Fitzpatrick, PhD, DABT, Senior Science Policy Analyst, Office of the Commissioner, Office of Science and Health Coordination, US Food and Drug Administration, Rockville, MD * Dallas E. Johnson, PhD, Professor Emeritus, Department of Statistics, Kansas State University, Manhattan, KS Michael D. Lebowitz, PhD, FCCP, Retired Professor of Public Health & Medicine, University of Arizona, Tucson, AZ Lois D. Lehman-Mckeeman, PhD, Distinguished Research Fellow, Discovery Toxicology, Bristol-Myers Squibb Company, Princeton, NJ Jerry A. Menikoff, MD, JD, Director, Office of Human Subjects Research, Office of the Director, National Institutes of Health, Bethesda, MD Ernest D. Prentice, PhD, Associate Vice Chancellor for Academic Affairs, University of Nebraska Medical Center, Omaha, NE * Linda J. Young, PhD, Professor, Department of Statistics, Institute of Food and Agricultural Sciences, University of Florida, Gainesville, FL Consultants to the Human Studies Review Board Sidney Green, Jr., PhD, Fellow, ATS, Professor, Department of Pharmacology, Howard University College of Medicine, Washington, DC Page 7 of 40 ------- Alan Meisel, JD, Dickie, McCamey and Chilcote Professor of Bioethics, Professor of Law and Psychiatry, University of Pittsburgh School of Law, Pittsburgh, PA Martin A. Philbert, PhD, Director, Center for Risk Science and Communications, University of Michigan School of Public Health, Ann Arbor, MI William Popendorf, PhD,MPH, Professor, Department of Biology, Utah State University, Logan, UT Lianne (Elizabeth A.) Sheppard, PhD, Professor, Department of Biostatistics, University of Washington, Seattle, WA Human Studies Review Board Staff Paul I. Lewis, PhD, Executive Director, Human Studies Review Board Staff, Office of the Science Advisor, United States Environmental Protection Agency, Washington, DC * Not in attendance at June 24-25, 2009 Public Meeting Page 8 of 40 ------- INTRODUCTION From June 24-25, 2009, the United States Environmental Protection Agency’s (EPA or Agency) Human Studies Review Board (HSRB) met to address scientific and ethical issues concerning: three completed human toxicity studies involving one pesticide active ingredient — chiorpyrifos — conducted prior to publication of the EPA’s expanded final rule for protection of subjects in human research; and one completed study involving one insect repellent active ingredient — picaridin — conducted after promulgation of the EPA’s expanded final human studies rule. In accordance with 40 CFR 26.1602, EPA sought HSRB review of these completed studies. Each of these studies is discussed more frilly below. In addition, the Agency submitted two protocols for conducting new research involving human participants: one study measuring the efficacy of two registered insect repellents containing picaridin against biting flies under field conditions; and one study measuring levels of exposure received by agricultural handlers when mixing and loading pesticides using water- soluble packing under various conditions. In accordance with 40 CFR 26.1601, EPA sought HSRB review of these proposed protocols. Each of these studies are also is discussed more fully below. REVIEW PROCESS On June 24-25, 2009, the Board had a public face-to-face meeting in Arlington, Virginia. Advance notice of the meeting was published in the Federal Register as “Human Studies Review Board; Notice of Public Meeting” (74 Federal Register 106, 26861). During the public meeting, following welcoming remarks from Agency officials, the Board heard presentations from the Agency on the following topics: three completed studies involving intentional human exposure to the organophosphate pesticide chiorpyrifos (Nolan et al. (1982), Honeycutt and DeGeare (1993), and Kisicki eta!. (1999)); a completed ICR, Inc., (ICR) insect repellent efficacy study (ICR A382); a proposed Carroll-Loye Biological Research, Inc. (CLBR) insect repellent efficacy study (LNX-002); and a proposed Agricultural Handler Exposure Task Force, LLC (AHETF) water-soluble packing mixing and loading scenario and protocol (AHE- 120). The Board also asked clarifying questions of several study sponsors andlor research investigators, including: Dr. Craig Barrow, Consultant to Dow AgroSciences Dr. Victor Canez, Technical Chair, Agricultural Handler Exposure Task Force Dr. Scott Carroll, Principal, Carroll-Loye Biological Research Dr. Richard H. Collier, Administrative Committee Chair, Agricultural Handler Exposure Task Force Mr. Bill Gaynor, Staff Member, ICR Mr. Shawn King, Director of Operations, Carroll-Loye Biological Research Dr. Ralph Piedmont, Consultant to ICR Page 9 of 40 ------- Dr. Ken Racke, Regulatory Specialist, Dow AgroSciences Dr. Ghona Sangha, Toxicology and Regulatory Consultant, LANXESS Corp. Oral comments were provided by: Dr. Ghona Sangha, Toxicology and Regulatory Consultant, LANXESS Corp. No written public comments were provided. For their deliberations, the Board considered the materials presented at the meeting, oral comments, and Agency background documents (e.g., published literature, sponsor and investigator research reports, study protocols, data evaluation records, and Agency science and ethics reviews of proposed protocols and completed studies). A comprehensive list of background documents is available online at http://www.regulations.gov. CHARGE TO TILE BOARD AND BOARD RESPONSE Assessment of Completed Research Study MRID 124144: Nolan et al. (1982’ Chiorpyrifos: Pharmacokinetics in Human Volunteers Followina Sin2le Oral and Dermal Doses . Overview of the Study The HSRB reviewed Nolan et al. (1982) as part of a package of three studies involving human volunteers exposed to chlorpyrifos that were proposed for use by EPA to characterize and help interpret epidemiological and bio-monitoring data for this pesticide. In addition, the data from human participants might be used for setting bounding estimates and developing physiologically based pharmacokinetic (PBPK) models for chiorpyrifos. Nolan eta!. (1982) summarize the results of a single dose level study that was designed to compare the fate of chlorpyrifos when administered orally or dermally to humans. Chiorpyrifos is a highly lipophilic compound that is rapidly metabolized to 3,5,6-trichloro-2- pyridinol (TCP) and diethyithiophosphate. TCP is excreted in urine predominantly as a glucuronide conjugate. Blood and urine levels of chiorpyrifos and TCP (unconjugated) were determined after oral (0.5 mg/kg) or dermal (5 mg/kg) administration of chiorpyrifos. There were a total of six participants in the Nolan eta!. (1982) study, with one participant (“subject A’) included in the evaluation of the fate of chiorpyrifos after oral dosing. However, this participant received dernial dosages of chlorpyrifos at 0.5 mg/kg in a preliminary evaluation and was not used in the final analyses of the dermal fate of chlorpyrifos (n =5 for the dermal study). Based on the urinary excretion of TCP, it was estimated that approximately 70% of the orally administered dose of chiorpyrifos was absorbed, whereas less than 3% of the dose was absorbed after dermal application. Science Page lOof4O ------- Although presented separately, the same scientific criteria were used to assess the reliability of the data from all three chiorpyrifos studies. These criteria are: 1. Verification that the administered dose of chiorpyrifos was confirmed in the study; 2. Assurance that sample collection (blood and urine) was reliable and complete; 3. Validation and appropriateness of the analytical methods for quantification of chlorpyrifos and TCP in blood and urine; and 4. Evaluation of the cholinesterase inhibition data (plasma and/or RBC cholinesterase) for sensitivity, accuracy, reproducibility, timing of sample collection and proper sample handling for analysis. Along with other relevant study issues, an assessment of how the Nolan et al. (1982), as well as the other two chlorpyrifos studies presented, met these general criteria along with other relevant study issues are summarized in responses to the Agency’s charge questions below. Charge to the Board Are the blood and urine measurements of chlorpyrifos and/or TCP from the Nolan et al. (1982) oral and dermal studies reliable? Board Response to the Charge HSRB Recommendation The Board concluded that data measuring chlorpyrifos at the limit of detection in blood and urine are not useful. The measurements of TCP in urine are generally reliable. It is unclear if the measurement of TCP in blood is useful because of concerns about the ability of the methods used to detect the appropriate TCP conjugate. HSRB Detailed Recommendations and Rationale Since blood and urinary concentrations of chlorpyrifos were essentially non-detectable, there is little confidence in these data. However, urinary levels of TCP, determined after hydrolysis of the glucuronide conjugate, were well above the limit of detection. Additionally, the data suggest relatively high absorption of chlorpyrifos from oral dosing and considerably less exposure from the dermal route, a pattern that is biologically plausible. It is not clear whether the blood levels of TCP are accurate because the extent to which the glucuronide conjugate of TCP circulates in the blood and the extent to which the glucuronide conjugate may be detected in blood. Confirmation of how the blood samples were handled for analysis may help to increase the confidence in the reported blood concentrations of TCP. Charge to the Board Page 11 of4O ------- Are the measurements of cholinesterase activity/inhibition from the Nolan eta!. (1982) oral and dermal studies reliable? Board Response to the Charge HSRB Recommendation The HSRB expressed some concern over the variability of the erythrocyte cholinesterase activity data and the lack of a control group, but concluded that measurements of cholinesterase activity/inhibition from Nolan eta!. (1982) were likely to be reliable. HSRB Detailed Recommendations and Rationale A major issue with determination of cholinesterase activity is the inter-day and inter- assay variability (typically 10-15%) that may be observed. In the Nolan eta!. (1982) study, plasma cholinesterase showed marked inhibition (up to approximately 85%) after oral administration of chlorpyrifos, whereas less plasma cholinesterase inhibition was noted after dermal application (up to about 25%). In contrast, no inhibition of erythrocyte cholinesterase was observed with either route of administration. The HSRB considered the following limitations or weaknesses of the cholinesterase measurements in Nolan et al. (1982): 1. There was no untreated group to control for inter-day laboratory variations; the subject’s response was based only on a change from their own pretest samples. 2. The inter-day variability for each subject was high, particularly for the erythrocyte cholinesterase activity, thereby limiting the interpretation of the results. 3. Although the method used to measure cholinesterase activity (the micro-Michel method) is an older method, it was probably the most reliable at the time. 4. Since only a single dose level was evaluated, no dose-response data are available from this study. Nevertheless, the results demonstrated that oral administration of chlorpyrifos caused greater inhibition of plasma cholinesterase than that observed after dermal application, a result that is consistent with higher absorption of chlorpyrifos following oral dosing. Ethics Charge to the Board Is there clear and convincing evidence that the conduct of the Nolan eta!. (1982) study was ftrndamentally unethical, or significantly deficient relative to the standards of ethical research conduct prevailing when it was conducted? Page 12 of4O ------- Board Response to the Charge HSRB Recommendation The Board concurred with the Agency’s assessment (Carley 2009a) that there neither was clear and convincing evidence that the study was fundamentally unethical, nor clear and convincing evidence that the study was significantly deficient relative to the ethical standards prevailing at the time the research was conducted. HSRB Detailed Recommendations and Rationale Given that the Nolan et al. study was conducted in 1981 and 1982, the Board concurred with the Agency’s assessment that the applicable regulatory standard at that time was FIFRA §12(a)(2)(P). In response to questions from the Agency, the study sponsor indicated that participants signed a one-page consent form that gave few details about the study but affirmed that they had read the study protocol (Dow AgroSciences 2009a). There had been two ethical reviews of this protocol, one by the Dow Human Health Research Committee, and a second by the University of Michigan Ethical Review Committee (The Committee to Review Grants for Clinical Research and Investigation Involving Human Beings). 1. The Board concurred with the conclusions and factual observations of the ethical strengths and weaknesses of the study, as detailed in the Agency’s Ethics Review (Carley 2009a). 2. The Board concluded that this study met all applicable ethical requirements for such research involving human participants, in accordance with the following criteria: a. Not fundamentally unethical. With regard to determining whether or not a study is fundamentally unethical, the Board’s standard is to decide if the research was intended to seriously harm participants, or if it failed to obtain informed consent, or if it was fundamentally unethical for other reasons. The study was not intended to seriously harm participants. Voluntary informed consent of participants was obtained. Given that there does not appear to be clear and convincing evidence that for any other reasons it might have been fundamentally unethical, the Board concludes that it was not fundamentally unethical. b. Not sign flcantly deficient. With regard to determining whether a study was significantly deficient relative to the ethical standards prevailing at the time the research was conducted, the Board’s standard is to determine whether or not any ethical deficiencies identified could have resulted in serious harm based on knowledge available to researchers at the time the study was conducted, or whether the information provided to study participants could seriously impair informed consent. • Based on toxicological data that was available at the time for chlorpyrifos, study participants were unlikely to be at risk for serious side effects given the exposure dose used in this study. Page 13 of4O ------- • The Board did not have a copy of the protocol that was given to the prospective participants when obtaining their informed consent, so the HSRB did not know exactly what information the participants received. Given that the study was reviewed by two ethics review boards, however, the Board concluded that there was no clear and convincing evidence that the information provided to participants could seriously impair informed consent. With regard to studies that were conducted prior to the effective date of the Agency’s regulations, the Board does wish to convey to the Agency the importance of obtaining as much information about such studies as is reasonably possible. It would have been desirable for the Board to have had access to the actual study protocol. Assessment of Completed Research Study MilD 42062701: Honeycutt and DeGeare ( 1993) Worker Reentry Exposure to Chiorpyrifos in Citrus Treated with Lorsban* 4E Insecticide . Overview of the Study The study reported by Honeycutt and DeGeare (1993) was a biological monitoring study to determine potential exposure to chiorpyrifos in individuals who reenter a citrus grove after agricultural use of chlorpyrifos. There were 15 participants in the study, representing five citrus pickers and ten citrus pruners (five each in wet and dry conditions, respectively). Pickers entered the test site 43 days after application of chlorpyrifos, whereas pruners re-entered two days after the application of chlorpyrifos. The exposure period was 5-6 hours, and the assessment of chlorpyrifos exposure was achieved with whole body dosimeters, air sampling, leaf punches and quantification of urinary excretion of TCP. The results from Nolan et all (1982) justify monitoring urinary TCP to estimate chlorpyrifos exposure. The report included considerable emphasis on the handling of all samples in the field and a comprehensive summary of all analytical conditions and methods used in determining ch lorpyrifos in all study matrices. Both chiorpyrifos and TCP were analyzed with negative ion-chemical ionization gas chromatography with mass selective detection (GCIMS) and urinary TCP was quantified after acid hydrolysis employing concentrated hydrochloric acid with heating for 1-2 hr followed by derivitization with N-methy1-(N-tertbutyldimethyL ilyl)-trifloroacetamide. Analytical recoveries were reported, and the limit of detection was defined as three-times higher than the signal to noise ratio. No limit of quantitation (LOQ) was provided. Science Charge to the Board Are the blood and urine measurements of chiorpyrifos and/or TCP from the Honeycutt and DeGeare (1993) worker biomonitoring study reliable? Board Response to the Charge Page 14 of 40 ------- HSRB Recommendation The Board concluded that the data from Honeycutt and DeGeare (1993) are likely reliable but of limited value. Board members expressed concerns about: 1) the small sample size; 2) the background chiorpyrifos exposure not being properly accounted for; 3) the likely incompleteness of urine collection; and 4) the high degree of variation seen in the daily measurements. HSRB Detailed Recommendations and Rationale Relevant weaknesses or limitations concerning study conduct and data reported by Honeycutt and DeGeare (1993) were assessed as follows: 1. The strength of this study is that it provides data on real-world exposures to chiorpyrifos. However, the critical element regarding confirmation of the dosage was not achieved in this study because the purpose of this study was to actually determine the dosage. 2. Urine samples were collected for 24 hrs prior to reentry and across 12-hr time intervals for up to five days after completion of the 5-6 hr work period. However, there is evidence to suggest that urine collections were not complete. This conclusion was based on variability in total urinary creatinine excretion along with several instances in which incomplete sample collection was noted. In total, five of 15 participants had total urinary creatinine levels that were significantly below normal daily reference range for creatinine excretion. In addition, for nine of 15 study participants the coefficient of variability exceeded reported urinary creatinine levels by up to four-fold, suggesting that urine collection was inconsistent at best. In light of these discrepancies, efforts were made to normalize urinary excretion data to a population average for creatinine excretion, but the accuracy and validity of this calculation is unknown, as discussed further below. 3. The control of the participants both prior to and after completion of the exposure was inadequate. One worker (Pruner 9) showed maximum urinary TCP levels on day three of the study suggesting additional exposure to chiorpyrifos after the test exposure period. More importantly, several workers showed detectable levels of urinary TCP in pretest samples, which was suggested to represent a steady state level of TCP resulting from occupational exposure. However, the validity of this conclusion is unknown, and the possibility that the observed levels may have resulted from a more recent exposure to chlorpyrifos was not considered. 4. In light of the uncertainties regarding urine sample collection and subject control, urinary TCP, and hence exposure to chiorpyrifos, were determined using six different methods including no corrections, correction for background TCP excretion, correction for creatinine excretion and combinations of corrections for background and creatinine levels. Across the six different methods used, the range of urinary TCP concentrations was about two-fold for pickers and four-fold for pruners. In Page 15 of4O ------- addition to the range of urinary TCP concentrations and the uncertainty regarding which method is most accurate, the small sample size (n = 5 participants per scenario) decreases the confidence of the final reported values. Thus, although this study provides the potential for assessing chiorpyrifos exposure from a relevant occupational exposure, the uncertainty resulting from incomplete urine sample collection, background exposure to chiorpyrifos, the small sample size, inter-individual and inter-day variability and the use of six different calculations to estimate chiorpyrifos exposure undermine confidence in the reliability of the data. Charge to the Board Are the measurements of cholinesterase activity/inhibition from the Honeycutt and DeGeare (1993) worker biomonitoring study reliable? Board Response to the Charge HSRB Recommendation The Board concluded that the laboratory data are likely accurate and reliable but raised concerns about their utility. Some of the Board’s concerns included: 1) the lack of an untreated control group; 2) the reliance on a single post-exposure time point; 3) the small sample size; and 4) the dose received by the subjects varied and was only estimated from dermal dosimetry. HSRB Detailed Recommendations and Rationale Plasma and blood cholinesterase activities were determined pre-exposure (typically 2 occasions prior to exposure) and 24 hr after working in the citrus grove. The modified Eliman procedure was used to determine cholinesterase activities. Overall, no significant changes in plasma or erythrocyte cholinesterase activities were observed. The following limitations concerning plasma and erythrocyte cholinesterase activities reported by Honeycutt and DeGeare (1993) were identified: 1. Only one post-exposure sample was collected for analysis (24 hr). Additional sampling would have been helpful, as it is not clear whether the 24 hr time point was most appropriate for analysis. 2. Considerable variability was noted across the samples. In six of the workers, the two pre-dose measurements were not within 15% of each other, thereby confounding the accuracy of the baseline activities, and in three of the pruners, post-exposure erythrocyte cholinesterase levels were actually increased by more than 20% over baseline values. Collectively, there is considerable uncertainty in the baseline data. 3. No data from an unexposed group of control subjects was used to control for inter- day variability in the assay. It was noted that the practice of including laboratory controls for intra-assay variability is published, standard practice for this assay. Page 16 of 40 ------- 4. The small group size further confounds the interpretation of the highly variable results. Thus, the HSRB concluded that the experimental evidence suggesting that plasma and erythrocyte cholinesterase activities were not significantly altered in the pickers and pruners exposed to chiorpyrifos in this study were likely to be accurate. However, the Board also cautioned that the reliability of the data was limited because of the issues noted above including analysis at only a single time point after exposure, the small sample size, the high degree of intra- and inter-subject variability and the lack of an untreated control. Ethics Charge to the Board is there clear and convincing evidence that the conduct of the Honeycutt and DeGeare (1993) study was fundamentally unethical, or significantly deficient relative to the standards of ethical research conduct prevailing when it was conducted? Board Response to the Charge HSRB Recommendation The Board concurred with the Agency’s assessment (Carley 2009b) that there neither was clear and convincing evidence that the study was fundamentally unethical, nor clear and convincing evidence that the study was significantly deficient relative to the ethical standards prevailing at the time the research was conducted. HSRB Detailed Recommendations and Rationale This study was initiated in 1991 in California. As a result, it was subject to the California Code of Regulations, Title 3, Section 6710, as amended September 26, 1988, which required pre-approval of the study by the Director of the California Department of Pesticide Registration, and by an Institutional Review Board approved by the US Department of Health and Human Services. It was also subject to FIFRA § 12(a)(2)(P). The study was reviewed and approved by the Committee on Human Subjects Research at the University of California, San Francisco. 1. The Board concurred with the conclusions and factual observations of the ethical strengths and weaknesses of the study, as detailed in the EPA’s Ethics Review (Carley 2009b). 2. The Board concluded that this study met all applicable ethical requirements for such research involving human participants, in accordance to the following criteria: a. Not fundamentally unethical. With regard to determining whether or not a study is fundamentally unethical, the Board’s standard is to decide if the research was intended to Page 17of40 ------- seriously harm participants, or if it failed to obtain informed consent, or if it was fundamentally unethical for other reasons. The study was not intended to seriously harm participants. Voluntary informed consent of participants was obtained. Given that there does not appear to be clear and convincing evidence that for any other reasons it might have been fundamentally unethical, the Board concludes that it was not fundamentally unethical. b. Not sign j/Icantly deficient. With regard to determining whether a study was significantly deficient relative to the ethical standards prevailing at the time the research was conducted, the Board’s standard is to determine whether or not any ethical deficiencies identified could have resulted in serious harm based on knowledge available to researchers at the time the study was conducted, or whether the information provided to study participants could seriously impair informed consent. • Based on toxicological data that was available at the time for chlorpyrifos, study participants were unlikely to be at risk for serious side effects given the exposure dose used in this study. • Exposure took place while participants were performing activities that were the same as those they regularly performed as part of their usual employment as citrus workers. Accordingly, it does not appear that there were ethical deficiencies that could have resulted in serious harm. • The volunteers were briefed about the design of the study and the risks relating to participation, and they signed consent forms containing that information. As the Agency noted (Carley 2009b), there was misleading information in some of the forms, such as comments that the residue from the spraying of the pesticide would have disappeared by the time they entered the groves. That misinformation was certainly inappropriate but does not, in and of itself, provide clear and convincing evidence that the informed consent process was seriously impaired. • The study participants were employed by Mr. Gary Austin of Leffingwell Ag Sales Co., and he recruited them himself. It is unclear to what extent these participants might therefore have been vulnerable to his influence in deciding to enter the study. Nonetheless, this type of arrangement does not appear to be unusual at that time. • The privacy of participants was compromised by the fact that their full names and Social Security numbers were included in an appendix to the study report. This is inappropriate, but would not appear to constitute clear and convincing evidence of an ethical deficiency that resulted in serious harm to these participants. Assessment of Comr,leted Research Study MRID 44811002: Kisicki Ct a!. (1999) A Rising Dose Toxicolo2v Study to Determine the No-Observable Effect-Levels (NOEL) For Page 18 of4O ------- Erythrocytes Acetvlcholinesterase ( AChE) Inhibition and Cholineraic Signs and Symptoms of Chiorpyrifos at Three Dose Levels . Overview of the Study This study was a double blind, randomized and placebo-controlled rising dose study designed to determine the no-observable effect level (NOEL) for inhibition of erythrocyte acetyicholinesterase in human volunteers. The dosages used in the study were 0.5, 1 and 2 mg/kg, with the starting dose of 0.5 mg/kg based on the results of Nolan eta!. (1982) discussed previously. In addition to assessing cholinesterase activity, blood and urine were collected and analyzed for chlorpyrifos and TCP to help define the pharmacokinetic properties in humans. Finally, paraoxonase status of each subject was determined (but will not be discussed here). Chlorpyrifos was administered orally in a gelatin capsule with 0 (lactose), 0.5 and I mg chlorpyrifos/kg administered in Phase I of the study followed by a second phase that include 0 (control) and 2 mg/kg dosages. There were six male and six female participants for each dose level. Subjects were confined to the testing facility overnight prior to treatment through the first 48 hr after dosing. Additional samples were collected thereafter at 24 hr intervals through 168 hr (one week) post dosing. Blood, collected pre-dose (-10 and 0 hr) and at 2, 4, 8, 24, 36, 48, 72, 96, 120, 144 and 168 hr post treatment, was used for determining erythrocyte acetyicholinesterase activity and chiorpyrifos and TCP levels. Voided urine was collected at 12 hr intervals starting 48 hr prior to dosing and through the 168 hr dosing period (with the exception that immediately after dosing urine was collected at 0-6 and 6-12 hr). Science Charge to the Board Are the blood and urine measurements of chiorpyrifos and/or TCP from the Kisicki eta!. (1999) oral study reliable and appropriate for use in characterizing the results of epidemiological studies with chiorpyrifos? Board Response to the Charge HSRB Recommendation Because of concerns about the analytic procedures’ potential inability to control for the glucuronide-conjugated TCP, and apparent discrepancies in the absorption data when compared with the data from Nolan eta!. (1982), the Board questioned the reliability and utility of the blood and urine measurements of chlorpyrifos and/or TCP from Kisicki eta!. (1999) for risk assessment purposes. HSRB Detailed Recommendations and Rationale With respect to the general elements considered in the evaluation of the scientific reliability of the chiorpyrifos exposure data, this study provided clear documentation of the Page 19 of 40 ------- administered dose. Chiorpyrifos was added to a gelatin capsule normalized with lactose powder and the weight of the filled capsule was determined. There was one noted discrepancy that one participants in the 2 mg/kg dose group may have received a lower dose (1.63 mg/kg) based on conflicting data on body weight and administered dose data, but overall the documentation of the administered dose was satisfactory. There was also generally good reliability with respect to sample collections. Participants remained in the testing facility for the first 48 hrs after dosing and 48 of the 60 subjects provided all periodic urine samples. - Urine collections were judged to be complete based on creatinine excretion for 19 of the 60 subjects. One participant in the 2-mg/kg-dose group failed to return for sample collection and clinical monitoring after the initial 48 hr post-dosing period. Chlorpyrifos and TCP were measured in blood and urine with GCIMS detection, and TCP was derivatized with N-methyl-(N-tertbutyldimethylsilyl)-trifloroacetamide. In general, these methods were similar to those described by Honeycutt and DeGeare with the exception that stable labels of chiorpyrifos and TCP (13C and/or 15N-labeled) were used as internal standards in the present analyses. In reviewing this study, the HSRB identified several limitations or issues that may impact the overall reliability of the data. These included: 1. The amount of chiorpyrifos absorbed after oral administration in the present study was markedly lower than that reported by Nolan et al. (1982). A dose of 0.5 mg/kg was common to both studies, with Nolan et al. reporting approximately 70%, and Kisicki et a!. reporting approximately 35% absorbed. The rationale provided by the authors for this large difference was that chlorpyrifos was administered using lactose tablets and gelatin capsules in the Nolan et al. and Kisicki et a!. studies, respectively. Kisicki et al. suggested that oral absorption is slowed by the dissolution of the gelatin capsule with a concurrent reduction in the total amount absorbed. Although the Board agreed that absorption of chlorpyrifos from the gelatin capsule might be slower than that from a lactose tablet, there was some skepticism that the difference in dosage form would yield the large discrepancy in total percent absorbed in the two studies. 2. In the methodological details provided for the analysis of urinary levels of TCP, there was no indication that urine samples were subjected to acid hydrolysis required to liberate the glucuronide conjugate of TCP, which is the major urinary metabolite of chlorpyrifos. This is an important distinction, as both Nolan et al. (1982) and Honeycutt and DeGeare (1993) indicated that urine samples were treated with concentrated sulfuric or hydrochloric acid and heated in order to hydrolyze the glucuronide conjugate and liberate TCP which is then derivatized (in the methods used by Honeycutt and DeGeare and Kisicki et a!.). In the analytical portion of the Kisicki et a!. study (Brzak 2000), there is a clear designation that blood samples were treated with concentrated hydrochloric acid prior to extraction, but no similar details are provided for the analysis of the urine samples. Although it seems unlikely that this important (and necessary) step was omitted, the lack of explicit indication of this Page 20 of 40 ------- critical analytical step raises some doubt that it was done. If urine samples were not properly hydrolyzed prior to analysis, then the validity and reliability of these data are uncertain. Furthermore, since urinary TCP is used to estimate oral absorption of chloipyrifos, it is possible that differences in sample handling may explain or at least contribute to the lower percent absorption reported by Kisicki et a!. 3. The total mass balance (total recovery of the administered chlorpyrifos) was not determined. Inclusion of total recovery could increase the confidence in the estimated percent of absorption in the study and possibly clarify whether there was an issue with the TCP analysis conducted by Kisicki et a!. 4. There were several questions regarding the designation and use of alternate participants in the study. The basis for participant replacement and verification of body weight and dose administered to the alternate participants were not adequately provided. Because of concerns about the analytic procedures’ potential inability to control for the glucuronide-conjugated TCP, and apparent discrepancies in the absorption data when compared with the data from Nolan et al. (1982), the Board thus questioned the reliability and utility of the blood and urine measurements of chlorpyrifos and/or TCP from Kisicki eta!. (1999) for risk assessment purposes. Charge to the Board Are the measurements of cholinesterase activity/inhibition from the Kisicki et al. (1999) oral study reliable? Board Response to the Charge HSRB Recommendation The Board concluded that these measurements likely represent a reliable set of data, but cautioned the Agency about relying on data from the incomplete profile for the one responder at the highest dose level. The Board also cautioned against relying on the statistical analyses as presented in the report. HSRB Detailed Recommendations and Rationale In this study, erythrocyte acetylcholinesterase activities were determined pre-dose (2 samples) and 2,4, 8, 12, 24, 36, 48, 72, 96, 120, 144 and 168 after dosing (Ellman method). Plasma cholinesterase activity was not measured. The results showed a relatively high degree of variability, and samples collected at 96 hr (Phase I; 0, 0.5 and 1 mg/kg) were judged to be low relative to all other treatment times. One participant in the 1-mg/kg dose group showed a 24.5% decrease in activity at the 96 hr time point. However, given the decreased activity observed in the entire group of samples collected at 96 hr along with the fact that peak inhibition would be Page 21 of4O ------- expected to occur before 96 hr, this result was not considered to be a real finding. Only one participant in the 2-mg/kg-dose group showed a reduction in erythrocyte cholinesterase activity in the study, with a nadir (72% of her baseline level) observed 12 hr after treatment. However, this volunteer did not return for blood collections after the initial 48 hr period, resulting in an incomplete profile. This participant did not appear to show adverse clinical signs associated with cholinesterase inhibition. Based on the reduction in erythrocyte cholinesterase activity in this subject, the NOEL for enzyme inhibition was considered to be 1 mg/kg. In reviewing this study, the Board identified several limitations or issues that may impact the overall reliability of the data. These included: 1. There was generally poor documentation provided for the grouping or batch processing of the blood samples. Given the recognized inter-day and inter-assay variability associated with the Eliman method, this is a critical weakness. The study records were noted to be insufficient to confirm that samples were batched correctly to allow the proper utilization of the unexposed control data to correct for day-to-day or batch-to-batch variations in the mean lab results. This limitation is particularly important to detect or to quantify accurately small changes within an exposed population. 2. The interpretation of the results is centered on the single individual who showed more than a 25% inhibition of erythrocyte cholinesterase activity at the 2-mg/kg-dose level. The conclusions regarding both the duration and magnitude of inhibition depend upon the inclusion of this participant, and the lack of follow-up in this participant beyond 48 hr thereby limits the interpretation of the results. 3. The reported statistical analyses of these data are highly problematic, and the results in Appendix 3 were judged to be clearly wrong. Specifically, it was noted that a univariate repeated measures ANOVA was performed (Kisicki eta!. 1999, 25), and Appendix 3 summarizes the results of such analyses (Kisicki et a!. 1999, 151-158, 184-188, 206-2 1 1). Although it is not possible to replicate these analyses, the report suggests that the variable being analyzed is the Normalized Percent of Baseline (Kisicki et a!. 1999, 24). The report indicates that the Group Mean Square (Kisicki et a!. 1999, 157) is 19.1207 while the Error Mean Square is 52,835,395,914.644. It is virtually impossible that these two values can be this different for real data. Furthermore, the corresponding Individual Hour Error Mean Squares from the corresponding mixed model analysis range from about 14.39 to 48.26. These are much more reasonable values. The report (Kisicki et a!. 1999, 25) also indicates that mixed effects models were used where gender and treatment were considered to be fixed factors, and that time was considered to be a random continuous covariate. According to the mixed model analyses reported in Appendix 3, time is treated as a continuous covariate, but not as a random continuous covariate. Overall, the Board concluded that the statistical analyses are likely incorrect, and there should be some effort to perform correct analyses before relying on these data. Page 22 of 40 ------- 4. Plasma cholinesterase activity was not determined in the study. It is recognized that the erythrocyte cholinesterase activity is more biologically relevant for assessing potential adverse effect of chiorpyrifos, and as such, the lack of data on plasma cholinesterase is not a serious limitation. However, given the issues raised concerning sample handling, batch processing and statistical evaluations, inclusion of plasma cholinesterase may have helped to assess the overall reliability of the data. The Board thus concluded that the measurements of erythrocyte acetylcholinesterase activities were generally reliable. However, Board members cautioned that the incomplete profile obtained from the only subject who showed inhibition at the 2 rn/kg dose level limited the utility of the data. Moreover, the Board recommended that, although the data might be reliable, the statistical analyses in general and particularly for the data in Appendix 3 should be replicated prior to applying these results to any risk assessment or model development. Ethics Charge to the Board Is there clear and convincing evidence that the conduct of the Kisicki eta!. (1999) study was fundamentally unethical, or significantly deficient relative to the standards of ethical research conduct prevailing when it was conducted? Board Response to the Charge HSRB Recommendation The Board concluded that there neither was clear and convincing evidence that the study was fundamentally unethical, nor clear and convincing evidence that the study was significantly deficient relative to the ethical standards prevailing at the time the research was conducted. HSRB Detailed Recommendations and Rationale According to documents supplied by the sponsor (Juberg and Mattsson 2009a, Juberg and Mattsson 2009b), the study was conducted in accordance with US Food and Drug Administration rules relating to the protection of human subjects, as codified at 21 CFR parts 50 and 56, and in accordance with the International Guidelines for Human Testing promulgated in the Declaration of Helsinki (as amended in 1996). In addition, the study was subject to FIFRA § 12(a)(2)(P). The protocol and related study documents were reviewed and approved by the MDS Harris Institutional Review Board. The consent of all participants was obtained and documented through the use of a consent form approved by that IRB. 1. The Board concurred with most of the conclusions and factual observations of the ethical strengths and weaknesses of the study, as detailed in the EPA’s initial Ethics Review (Carley 2009c). The Board disagreed, however, with the Agency’s initial conclusion that the study was significantly deficient relative to the ethical standards prevailing at the time the research was conducted. After considering additional supplementary information provided to the Page 23 of 40 ------- Agency on June 23, 2009 and described in detail below (Kisicki 2009), the Board found no clear and convincing evidence that the study was fundamentally unethical or significantly deficient in its design and conduct. Following the public meeting, additional supplementary material (including copies of MDS Harris Laboratories screening and consent logs) was submitted to the Agency for review. Although the Board shares the Agency’s concerns that these supplementary documents still raise concerns about the recruitment and consent process (Carley 2009e), the information contained therein do not meet the evidentiary standard of clear and convincing evidence that the study was fundamentally unethical or significantly deficient relative to the ethical standards prevailing at the time. It is possible, for example, that the deficiencies noted in the logs are the result of sloppy record keeping rather than a serious impaired participant recruitment, consent and screening process. 2. The Board concluded that this study met all applicable ethical requirements for such research involving human participants, in accordance to the following criteria: a. Not fundamentally unethical. With regard to determining whether or not a study is fundamentally unethical, the Board’s standard is to decide if the research was intended to seriously harm participants, or if it failed’to obtain informed consent, or if it was fundamentally unethical for other reasons. The study was not intended to seriously harm participants. Voluntary informed consent of participants was obtained. Given that there does not appear to be clear and convincing evidence that for any other reasons it might have been fundamentally unethical, the Board concludes that it was not fundamentally unethical. b. Not sign j/Icantly deficient. With regard to determining whether a study was significantly deficient relative to the ethical standards prevailing at the time the research was - conducted, the Board’s standard is to determine whether or not any ethical deficiencies identified could have resulted in serious harm based on knowledge available to researchers at the time the study was conducted, or whether the information provided to study participants could seriously impair informed consent. • Based on toxicological data that was available at the time for chlorpyrifos, study participants were unlikely to be at risk for serious side effects given the exposure dose used in this study. • Participants underwent some screening tests (urine and blood sampling) prior to signing the written consent form. According to materials provided to the EPA and made public on the day of the Board’s discussion of this study (Kisicki 2009), volunteers were given a copy of the approved consent form and required to listen to an audiotape about the study before they agreed to undergo the screening procedures. Later documents submitted to the Agency (Radke 2009), however, raise questions as to whether all potential study participants or alternates underwent voluntary informed consent prior to screening. Although the failure to have potential participants and alternates sign an informed consent form prior to screening could be a violation of Page 24 of 40 ------- applicable FDA regulations, given these circumstances it does not appear that the informed consent process was serious impaired. • There were various sentences in the informed consent form that appear inappropriate, such as characterizing the study compound as one that improves performance on tests of mental functioning. In addition, portions of that form were written at an inappropriately high reading level. Taken as a whole, however, the informed consent document does appear to have provided prospective subjects with an accurate and understandable picture of the likely risks from participation — which were very low. Thus, it does not appear that the form, as written, seriously impaired the informed consent process. Assessment of Completed Research Study MRID 47732701: ICR . Inc. Study A382 — Evaluation of the Efficacy of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% S rav) Against Stable Flies in the Laboratory . Overview of the Study A382 was a laboratory study conducted by ICR to assess the efficacy of two formulations containing the repellent picaridin against laboratory-reared stable flies. The study followed the protocol previously reviewed by the HSRB and recommended for acceptance with some suggested modifications. The study used a dosimetry phase for dose determination. The initial study had to be aborted because the stable flies did not show sufficient biting pressure for a valid repellency test. Adjustments were subsequently made in the husbandry of the flies to insure that they were sufficiently hungry to bite the test subjects in the testing period, and the data from the second test, along with the dosimetry results, were presented. Complete protection times were calculated. Science Charge to the Board Is the ICR study A382 sufficiently sound, from a scientific perspective, to be used to assess the repellent efficacy of the tested formulations against stable flies in the laboratory? Board Response to the Charge HSRB Recommendation The Board concurred with the Agency’s assessment (Sweeney 2009) that this study provides scientifically valid results to assess the repellent efficacy against stable flies of the formulations tested. However, some of the data presentation requires revision. Page 25 of 40 ------- HSRB Detailed Recommendations and Rationale ICR was responsive to Board concerns and recommendations of the previous Board review (EPA HSRB 2008). These responses included the use of a dosimetry phase for dose determination and the inclusion of individuals from racial minorities in the test population. The study also used the time to first bite as the criterion, and not the time to first confirmed bite, which was also a Board recommendation for participant protection. The study included 12 participants (seven females and five males). One female participant served as an untreated control to verify landing pressure. The total number of study participants is higher than the EPA guidelines recommend. Study documents (Gaynor 2009, Gaynor et al. 2009) indicated that, according to ICR’s database, landings underestimate bites. Thus, bites were selected as the endpoint despite earlier Board recommendations concerning participant safety (EPA HSRB 2008). Nevertheless, in order to obtain scientifically valid data useful for regulatory purposes, the use of first bite, unconfirmed by a subsequent bite, is acceptable. The Margins of Exposure (MoEs) were adequate for protection of participants from the potential toxicity of the repellent. Statistical analyses were generally appropriate. However, the standard error for mean protection time and resulting confidence interval need to be corrected to use the estimated standard error, not the planned standard error. It would also be helpful to present the range of values observed in the data. For study planning, basing sample size calculations on an estimated standard deviation from stable fly data would have been more appropriate than using a published estimate from mosquito data. Lastly, Table 4 in the submitted report should be corrected to indicate that the data presented are for product failure times and not complete protection times. Ethics Charge to the Board Does available information support a determination that study ICR A382 was conducted in substantial compliance with subparts K and L 40 CFR Part 26? Board response to the Charge HSRB recommendation The Board concurred with the Agency’s assessment (Carley 2009d) that the study submitted for review was conducted in substantial compliance with subparts K and L of 40 CFR 26. HSRB Detailed Recommendations and Rationale The documents provided by ICR (Gaynor 2009, Gaynor et al. 2009) state that each study was conducted in compliance the requirements of the US EPA Good Laboratory Practice (GLP) Regulations for Pesticide Programs (40 CFR 160). Additional regulations —40 CFR 26 subparts K and L; and FIFRA § 12(a)(2)(P — are also applicable. The study was reviewed and approved Page 26 of 40 ------- by a commercial human subjects review committee, Essex Institutional Review Board, Inc. (EIRB, Inc.) of Lebanon, NJ. 1. The Board concurred with the conclusions and factual observations of the ethical strengths and weaknesses of the study, as detailed in the EPA’s Ethics Review (Carley 2009d). The completed study met all applicable ethical requirements for research involving human participants, in accordance with the following criteria as developed by the Board: a. Acceptable risk-benefit ratio. The risks to study participants were minimized appropriately and were justified by the potential societal benefits, particularly data on the efficacy of these new formations as personal insect repellents. • Minor and pregnant or lactating women were excluded from participation, with pregnancy either confirmed by over-the-counter pregnancy testing on the day of study or by opt-out. The potential stigma resulting from study exclusion due to pregnancy was also appropriately minimized. • Based on toxicological data currently available for picaridin, coupled with appropriate exclusion criteria, study participants were unlikely to be at risk of adverse side effects with exposure. • Clear stopping rules and medical management procedures were in place, with no adverse events related to product exposure reported. • The study uses first bite as an endpoint. Stable fly bites, however, usually cause only minor symptoms and are readily treated with over-the-counter antipruritic lotions. • The study was conducted with laboratory-raised flies free of known pathogens. This latter point, in particular, resulted in the one notable change to the protocol. At its initial review, the HSRB recommended that the stable flies be raised on 10% sucrose rather than bovine blood meals, thus minimizing the risk of potential zoonoses (EPA HSRB 2008). As a result, the first planned test of picaridin as a repellent for stable flies failed. Specifically, the trial had to be aborted due to insufficient landing pressure. Upon consulting with an entomologist, ICR researchers concluded that the stable flies “ [ overfed] on the 10% sucrose solution, which then interfered with their normal inclination to land and take a blood meal” (Gaynor et al. 2009). This was addressed by: 1) changing the feeding regimen to dry sugar cubes; 2) increasing the numbers of stable flies used per cage; and 3) increasing the length of participant exposure to stable flies to determine attractiveness. These changes were submitted to EIRB, Inc. as protocol amendments and approved prior to implementation. This protocol change was unlikely to have increased the risk of study participants or compromised the informed consent process. b. Voluntary and informed consent of all participants Page 27 of 40 ------- • The study protocol included several mechanisms designed to minimized coercive recruitment and enrollment. • Monetary compensation was not so high as to unduly influence participants. c. Equitable study participant selection and recruitment • In response to HSRB concerns, ICR modified their recruitment strategy to identify study participants more representative of the racial and ethnic distribution of likely repellent users. 2. The Board also recommended that, for future intentional dosing studies, the sponsor work with the 1RB of record to address some of the gaps of submitted information noted in the EPA ’s Ethics Review (Carley 2009d). a. Several Board members raised concerns about the quality of IRB review and the qualifications of IRB members to review insect repellent protocols, given the failure of EIRB, Inc. to provide the sponsor or the Agency with a description of IRB member qualifications and detailed meeting minutes that offer a description of IRB deliberations and debate of intentional exposure protocols. It is unlikely that these deficiencies placed study participants at risk or compromised The informed consent process, but they do represent a deviation from the expectations of 40 CFR 26. b. The sponsor and IRB of record should ensure that all telephone scripts and other recruitment materials, and informed consent documents be reviewed prior to study initiation to ensure that the information contained in each is accurate. For example, the telephone script submitted to the IRB for review and approval failed to note two significant changes to the study design: the change on the duration of attractiveness testing; and the change to pregnancy screening protocol that allowed women who are physically incapable of having children (i.e., post-menopausal or surgically sterilized) to opt-out of over-the-counter pregnancy testing. This deviation, however, was unlikely to have compromised the informed consent process as potential study participants were informed of these protocol changes later when formally consented at the ICR facility. Assessment of Proposed Carroll-Love Biological Research Study LNX-002: Efficacy Test of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% Spray) with Biting Flies Under Field Conditions . Overview of the Study The protocol describes a study to test the efficacy of two formulations (lotion and spray) of 20% picaridin in the field against at least one of 4 species of biting flies. Dosimetry data recently accumulated in a previous study (LNX-00l) would be used for dose selection. One habitat is proposed. Ten test subjects and two untreated controls would be tested in a suitable environment that had adequate biting pressure of biting flies but relatively few mosquitoes. Page 28 of 40 ------- Repellent-treated skin would be exposed for 5 minutes in each 30-minute interval until repellent failure. The endpoint would be the “Lite with Intent to Bite” (LIBe), and the criterion for data to calculate complete protection time would be first confirmed LIBe. Science Charge to the Board If the proposed field repellency study protocol LNX-002 is revised as suggested in EPA’s review and if the research is performed as described: Is the research likely to generate scientifically reliable data, useful for assessing the efficacy of the tested materials in repelling biting flies in the field? Board Response to the Charge HSRB Recommendation The Board concurred with the Agency’s assessment (Carley and Sweeney 2009) that this protocol will provide scientifically valid results on the efficacy of two picaridin formulations against biting flies, with modification as noted below. Additional Board review of the protocol is not required prior to study implementation. HSRB Detailed Recommendations and Rationale The protocol submitted for review had many similarities to previously reviewed CLBR protocols and completed studies involving mosquitoes. The format of the protocol description was revised to provide greater clarity. The study protocol and associated documents incorporated many of the Board’s previous comments and recommendations. The endpoint was LIBe, which the Board has previously expressed preference for because of the lesser risk to study participants than bites. Agency reviewers identified two concerns: 1) the standard of biting of one LIBe in five minutes was not well justified and may be insufficiently high to yield valid results and could lead to inappropriately right censored data; and 2) a change of the previously-used paradigm of one minute exposure of treated limbs to insects out of each 15 minute period to five minutes in each 30 minute period was not explained or justified (Carley and Sweeney 2009). The Board concurred with both of these concerns, and recommended that they be addressed in the revised protocol as possible. Additional Board recommendations concerned two issues: 1) the particular species on which data would be accumulated; and 2) the calculation of complete protection time. With respect to the species tested, although four types of biting flies were proposed as possible insects to be monitored, it was pointed out that these four species display varied behaviors and aggressiveness. When questioned, the Agency indicated that it already had some useful data on some species of biting flies — such as stable flies — accumulated in the laboratory. Page 29 of 40 ------- The Agency thus expressed interest in obtaining data from other species that cannot be readily studied in laboratory tests. The Board thus recommended that the study be conducted only if black flies (preferably) and/or biting midges were present in sufficient numbers at the field site. Accumulated data should be acquired on one or both of these species, as well as any other species of biting flies that may also be present. If black flies or biting midges are not available in sufficient numbers and with sufficient biting pressure at the field site, other types of biting flies should not be considered acceptable substitutes. Echoing earlier concerns about the types of calculations and statistical analyses that will be conducted on these insect repellency data, the Board recommended that the protocol be amended to explain better how mean complete protection time will be calculated accurately using the appropriate types of statistical analyses. Mean protection time versus the duration of the study should be clarified, particularly as it affects the prevalence of censored data. The study’s duration should be sufficiently long to ensure that the repellent will fail for a substantial portion of study participants, thereby limiting the occurrence of right-censored data. The protocol should also be revised to clarify how the analysis will proceed in the presence of censored data (using Maximum-likelihood or Kaplan-Meier methods). In the context of this and other insect repellency studies, the Agency is again urged to update its guidance to sponsors so that they can conduct tests and analyze the resultant data in a useful and accurate manner. Ethics Charge to the Board If the proposed field repellency study protocol LNX-002 is revised as suggested in EPA’s review and if the research is performed as described: Is the research likely to meet the applicable requirements of 40 CFR part 26, subparts K and L? Board response to the Charge HSRB recommendation The Board concluded that the protocol submitted for review, if modified in accordance with EPA (Carley and Sweeney 2009) and HSRB recommendations, is likely to meet the applicable requirements of 40 CFR 26, subparts K and L. HSRB Detailed Recommendations and Rationale The submitted documents assert that the study will be conducted in accordance with the ethical and regulatory standards of 40 CFR 26, Subparts K and L, as well as the requirements the US EPA’s GLP Standards described at 40 CFR 160, and the California State EPA Department of Pesticide Regulation study monitoring (California Code of Regulations Title 3, Section 6710) (Carroll 2009). The requirements of FIFRA § I 2(a)(2)(P) also apply. The protocol was reviewed Page 30 of 40 ------- and approved by an independent human subjects review committee, Independent Investigational Review Board, Inc. (IIRB, Inc.), of Plantation, FL prior to submission. 1. The Board concurred with the conclusions and factual observations of the ethical strengths and weaknesses of the study, as detailed in the EPA’s Ethics Review (Carley and Sweeney 2009). The proposed study is likely to meet the applicable ethical requirements for research involving human participants, in accordance with the following criteria: a. Acceptable risk-benefit ratio. The risks as noted in the study protocol are fiverfold: 1) allergic reaction to test materials themselves; 2) exposure to biting artbropods; 3) possible exposure to arthropod-bome diseases; 4) physical stress from the test conditions; and 5) psychological stress and/or breach of confidentiality for pregnancy test results. These risks are minimized appropriately and are justified by the potential societal benefits, particularly data on the efficacy of these new formations as personal insect repellents. • Based on toxicological data currently available for picaridin, coupled with appropriate exclusion criteria, study participants are unlikely to be at risk of adverse side effects with exposure. • The study is designed to minimize the likelihood of biting fly and mosquito bites, through the use of: LIBes rather than actual confirmed bites as a study endpoint; pre- bite removal and joint observation; clear stopping rules; limited exposure periods. Study participants will be trained in proper insect observation and handling techniques. • Biting fly and mosquito bites, should they occur, are usually mild and easily treated with over-the-counter steroidal creams. The study will also exclude participants who have a history of severe skin reactions to such bites. • To minimize the risk that study participants will be exposed to pathogens like West Nile Virus — not transmitted by the biting flies in question but via other arthropods that may be present at the field sites — the study will be conducted only in areas where known vector-borne diseases have not been detected by county and state health or vector/mosquito control agencies for at least two weeks. The study is also planned for a location where mosquitoes are not abundant and at a time of year in which most arthropod-bome pathogens are not usually detected. Finally, mosquitoes that land with the intent to bite will be collected and subjected to multiplex RT-PCR assays for several known arthropod-bome pathogens—including West Nile Virus, Western Equine Encephalitis Virus, and St. Louis Encephalitis Virus—with clear plans to contact study participants and alert them if a transmissible pathogen is detected. • The potential risks to participants from environmental stress are minimized by the provision of a climate controlled rest area, food, water and medical supplies, and by careful monitoring for signs of dehydration, heat stress and hypothermia. Appropriate stopping rules and medical management procedures are in place. Page 31 of4O ------- • Minor and pregnant or lactating women are excluded from participation, with pregnancy either confirmed by over-the-counter pregnancy testing on the day of study or by opt-out. The potential stigma resulting from study exclusion due to pregnancy is also appropriately minimized. b. Voluntary and informed consent of all participants • The study protocol includes several mechanisms designed to minimize coercive recruitment and enrollment. • Monetary compensation is not so high as to unduly influence participants. c. Equitable selection of study participants • The majority of research participants will be recruited from the University of California at Davis student population. Study participants are likely to represent the appropriate ethnic and racial diversity of individuals in and around the University, but the use of this convenience sample may limit the broad applicability of the study results to the general population. The investigators in the protocol have noted this fact. 2. The Board recommended that the study protocol be modified to address the few concerns noted in the EPA’s Ethics Review (Carley and Sweene y 2009). In addition, the Board recommended that the investigators clarif ’ of what 3 r party” medical coverage means, as listed in the current informed consent document. Assessment of Proposed AHETF Scenario and Protocol AHE-120: Water-Soluble Packing Mixina and Loading . Overview of the Study This proposal presents an agricultural handler exposure scenario involving mixing/loading of pesticides enclosed in water-soluble packets (WSP). The protocol calls for study participants to mix and load one of two WSP-enclosed surrogate pesticides (acephate and carbaryl) into a variety of tanks containing water in a variety of agricultural spraying operations. A total of 25 participants (described in the protocol as “Monitoring Units” [ MUs]) will be observed; 5 volunteers each from five different growing regions will be enrolled using a purposive sampling method. Dermal exposure will be measured by a whole body dosimeter (WBD) worn beneath the subject’s outer clothing. Hand wash and face/neck wipe samples will also be collected prior to, during, and after completion of pesticide loading and mixing procedures. Airborne concentrations of the surrogate will be monitored in the participant’s breathing zone using an 051-IA Versatile Sampler (OVS) tube sample collector connected to a personal sampling pump. Additional measures will also record environmental conditions at the time of monitoring, and observers will make field notes, photographs and videos of participant activity throughout the Page 32 of 40 ------- monitoring event. The results of sample analysis under the mixing/loading of water-soluble packets scenario, will be posted to the AHED® database, where they will be available to the EPA and other regulatory agencies for statistical analysis. The proposed documentation will report a confidence-interval-based approach to determine the relative accuracy for the arithmetic mean and 95 th percentile of unit exposures. The Agency proposes to use these data to estimate daily dermal and inhalation exposures of agricultural handlers who are mixing/loading pesticides in water-soluble packets under a variety of mixing and loading scenarios. Science Charge to the Board If the proposed mix/load WSP field study protocol AIFIEI2O is revised as suggested in EPA’ s review and if the research is performed as described: Is the research likely to generate scientifically reliable data, useful for assessing the exposure of handlers who mix and load soluble or wettable powder pesticides in water-soluble packaging? Board Response to the Charge HSRB Recommendation Given the lack of existent reliable and sound data in this area, the Board concurred with the Agency’s assessment (Evans and Sherman 2009) that this protocol will generate data that are scientifically valid and that may be useful for assessing the exposure of handlers who mix and load soluble or wettable powder pesticides in water-soluble packaging. The Board cautioned that these data are likely to be useful for creating distributions of worker exposure only if worker exposure is found to be proportional to the amount of active ingredient handled (AaiH). The Board also recommended a number of protocol modifications, as listed below. Additional Board review of the protocol is not required prior to study implementation. HSRB Detailed Recommendations and Rationale The Board concluded that the proposed monitoring and quality assurance and control methods appear adequate, particularly in the supplemental SOPs provided by the AHETF in response to the Agency’s initial science and ethics review (Collier 2009b; Evans and Sherman 2009). The protocol and supplemental SOPs adequately address a number of key scientific issues, including: the scientific objective, the quantification of the test materials, the data collection and compilation methods and summary of test results, the justification for selection of the test substances, and the QAIQC requirements. The Board also commended the AI-IETF and the Agency for taking the time to plan, test, and revise different scenarios and approaches, and for pilot testing some aspects of these and related protocols. The protocol presented to the Board was well thought out and written as a result. Page 33 of 40 ------- The Board did raise a number of concerns, however, about the perceived inadequacies in the study design, including issues of sample size and the use of inappropriate statistical analyses. The Board raised many of these issues previously when it reviewed earlier AHETF protocols. Both the AFIETF and the Agency will need to acknowledge the limitations of the study design that occur in the AI-IETF handling scenarios and either change their goals accordingly, or add appropriate statistical methods or data management approaches to extrapolate from the data obtained from these limited scenarios to the wider regulatory purposes that these data will be used for. Some Board members expressed the concern, for example, once these data are inside the AI-IED database, some users may overlook the limitations of the original study design and use the data to generate the typical statistical distributions in error. Illustrating this point, the Board raised concerns about the types of statistical analyses proposed for the water-soluble packing scenario presented here. The proposed study will rely on a purposive sampling strategy, for example, but the researchers propose to treat the monitoring data as if “it were collected as a two-stage random sample from an infinite population” (Collier 2009a). The Board questioned the validity of this approach, noting that the data will be collected from a non-random non-population based sample. There is no statistical theory that can be applied to non-random samples of this type. Thus, the statistical analyses proposed, including mixed model approaches, are not valid. The Board also raised concerns about the key objective of the study — namely, to determine the relationship between measured worker exposure and AaiH. In particular, the Board disagreed with the Agency’s assessment that “past studies have shown that AaiH is strongly associated with exposure and is a meta-factor associated with differences in equipment and spraying practices” (Evans and Sherman 2009). To expect a linear relationship between AaiH and worker exposure seems logical; one should expect that a consistently small fraction of the amount of pesticide that a worker handles would be deposited onto their skin. Data previously presented by the AFIETF to the Agency’s FIFRA Scientific Advisory Panel (SAP), however, did not demonstrate a linear relationship between worker exposures of the amount of active ingredient handled. There are a number of factors that may explain why there is not a clear linear relationship between measured worker exposure and AaiH, including ecological, engineering, and statistical factors. As submitted, the AHETF protocol will not be able to distinguish between these different factors nor allow researchers to determine the true relationship between exposure and AaiH. For example, there are a number of uncontrolled ecological variables that may influence worker exposure, including: environmental conditions, the types of equipment used, the types of crops treated, grower preferences, etc. Indeed, some workers will likely experience mixing and loading conditions that are atypical for normal use of the active ingredient being monitored. Myriad sources of natural variation are likely to have a marked impact on worker exposure. Given the relatively small sample size of each monitoring cluster in this exposure scenario, these sources of natural variation will likely introduce considerable estimation bias into the final data. - Finally, current consensus is that estimates of the geometric mean, the arithmetic mean, and the 95th percentile need to be accurate within three-fold of the actual population value. The current protocol includes no methods to validate the actual population data and determine whether the resulting estimates fall within this necessary range. Page 34 of 40 ------- Ethics Charge to the Board If the proposed mixlload WSP field study protocol AHE 120 is revised as suggested in EPA’s review and if the research is performed as described: Is the research likely to meet the applicable requirements of 40 CFR part 26, subparts K and L? Board response to the Charge HSRB recommendation The Board concluded that the protocol submitted for review, if modified in accordance with EPA (Evans and Sherman 2009) and HSRB recommendations, is likely to meet the applicable requirements of 40 CFR 26, subparts K and L. HSRB Detailed Recommendations and Rationale The submitted documents assert that the study will be conducted in accordance with the ethical and regulatory standards of 40 CFR 26, Subparts K and L, as well as the requirements the US EPA’s GLP Standards described at 40 CFR 160 (Collier 2009a). The requirements of FIFRA § 1 2(a)(2)(P) and, where applicable, the California State EPA Department of Pesticide Regulation study monitoring (California Code of Regulations Title 3, Section 6710) also apply. The protocol was reviewed and approved by an independent human subjects review committee, IIRB, Inc. of Plantation, FL prior to submission. 1. The Board concurred with the conclusions and factual observations of the ethical strengths and weaknesses of the study, as detailed in the EPA’s Ethics Review (Evans and Sherman 2009). The proposed study is likely to meet the applicable ethical requirements for research involving human participants, in accordance with the following criteria: a. Acceptable risk-benefit ratio. The risks as noted in the study protocol are five-fold: 1) heat-related illness; 2) accidental exposure to the surrogate chemicals; 3) injury associated with scripted field activities; 4) allergic reaction to surfactants using for hand washing; and 5) psychological stress and/or breach of confidentiality for pregnancy test results. These risks are minimized appropriately and are justified by the potential societal benefits, particularly data on occupational exposure of agricultural workers to pesticides during mixing and loading activities. • The greatest risk to participants is that of heat-related illness, given that the participants will be required to wear two layers of clothing during the scenario activities. This risk is lessened but not eliminated by the application of appropriate stopping rules (including cessation of all monitoring activities when the ambient heat- index exceeds 105°F) and frequent monitoring of participants. Participants will be Page 35 of 40 ------- given frequent breaks, access to ample amounts of water or sports drinks, and educated about the dangers and symptoms of heat-related illness. Appropriate medical management procedures are also in place. • The surrogate materials consist of two common pesticides, acephate and carbaryl, both of which have been e tensively tested. The participants will only be exposed to concentrations of the surrogate compound at accepted exposure thresholds. • Participants will be selected from volunteers with experience handling these or similar compounds in WSP mixing and loading scenarios. Thus, all of the participants will have extensive experience in using these or similar products, and thus unlikely to misuse them in a way that might increase their likelihood of being accidentally exposed. • Participants will be reminded about safe handling practices and procedures, wear appropriate PPE, and will be monitored for any accidental or unintended product exposure. • Allergic reactions to the surfactants used in hand washing are usually mild and easily treated with over-the-counter steroidal creams. The study will exclude participants who have a history of severe skin reactions to such detergents. • Minor and pregnant or lactating women are excluded from participation, with pregnancy either confirmed by over-the-counter pregnancy testing on the day of study or by opt-out. The potential stigma resulting from study exclusion due to pregnancy is also appropriately minimized. b. Voluntary and informed consent of all participants • There is the possibility that the participants in this study might represent particularly vulnerable populations, susceptible to coercion and undue influence. The study protocol, however, includes several mechanisms designed to minimize coercive recruitment and enrollment. • Monetary compensation is not so high as to unduly influence participants. • Spanish translations of the informed consent documents, informational packets, and recruitment flyers were provided. Researchers will be working with local Spanish- speaking community members to ensure that the appropriate regional dialect of Spanish is used. c. Equitable selection of study participants • The study is designed to recruit an appropriately diverse population of participants who represent skilled agricultural workers in the 5 study locations. Page 36 of 40 ------- • Community representatives and advocates are appropriately involved in the recruitment and enrollment of study participants. 2. The Board recommended that the study protocol be modified to address the few concerns noted in the EPA’s Ethics Review (Evans and Sherman 2009). In addition, the Board also addressed three concerns of the Agency and the sponsors (Collier 2009c) with respect to representativeness, language, and release of individual exposure data. • The Board recommended that the AHETF implement the proposed protocol changes designed to address issues of representativeness. • As noted above, the Board concluded that the proposed protocol changes designed to address concerns of language in the informed consent and related documents are likely to yield translations that are written in the appropriate regional dialect of Spanish. • The Board commended the Task Force for wanting to release individual exposure data to participants promptly but recommended that these data only be released once the study is complete, except in those instances where data collected from individuals suggest an unusually high level of exposure and thus a clear need to mitigate exposure risks. Page 37 of 40 ------- REFERENCES Borges HT, Young RA, Ross RH, Slusher K. 2009. Data Evaluation Record — Supplemental. Chiorpynfos. Non-Guideline Study Type: OrallDermal Pharmacokinetic — Human. MRID 001241444. Dated May 26, 2009. Unpublished study protocol prepared for the Office of Pesticide Programs, United States Environmental Protection Agency by the Toxicology and Hazard Assessment Group, Life Sciences Division, Oak Ridge National Laboratory. Brazk KA. 2000. A Rising Dose Toxicological Study to Determine the No-Observable-Effect- Levels (NOEL) For Erythrocyte Acetylcholinesterase (AChE) Inhibition and Cholinergic Signs and Symptoms of Chlorpyrifos at Three Dose Levels — Part B. Dated May 24, 2000. Unpublished study prepared by Dow Agrisciences under Study ID 981176. 76p. M1RID 45144101. Britton W. 2009. Chlorpyrifos: Data Evaluation Record Prepared for the June 2009 Human Studies Review Board Meeting for the Study “Worker Reentry Exposure to Chiorpyrifos In Citrus Treated with Lorsban* 4E Insecticide.” Dated May 22, 2009. Unpublished study protocol prepared by the Office of Pesticide Programs, United States Environmental Protection Agency. Carroll S. 2009. Efficacy Test of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% Spray) with Biting Flies Under Field Conditions. Dated March 23, 2009. Unpublished study protocol prepared by Carroll-Loye Biological Research. 216 p. Carley 3M. 2009a. Ethics Review of Chiorpyrifos Pharmacokinetics Study. Dated May 29, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Carley JM. 2009b. Ethics Review of Chiorpyrifos Worker Exposure Study. Dated May 29, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Carley 3M. 2009c. Ethics Review of Chiorpyrifos Human Toxicity Study. Dated May 29, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Carley JM. 2009d. Ethics Review of Study of Stable Fly Repellent Performance. Dated May 22, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Carley JM. 2009e. Supplemental Ethics Review of Chlorpyrifos Pharmacokinetics Study by Kisicki, et al. Dated August 7, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Page 38 of 40 ------- Carley JM, Sweeney KJ. 2009. Science and Ethics Review of Protocol LNX-002 for a Human Study of Biting-Fly Repellent Performance. Dated May 18, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Collier RH. 2009a. AHETF Scenario Design and Protocol AHE 120 for Exposure Monitoring of Workers during Mixing and Loading of Pesticide Products in Water Soluble Packets in Five Regions of the United States. Dated January 16, 2009. Unpublished study protocol prepared by AHETF. 552 p. Collier RH. 2009a. Supplemental Standard Operating Procedures (SOPs) for the AHETF Scenario Design and Protocol AHE 120 for Exposure Monitoring of Workers during Mixing and Loading of Pesticide Products in Water Soluble Packets in Five Regions of the United States. Dated February 24, 2009. Unpublished document prepared by AHETF. 78 p. Collier RH. 2009c. AFIETF Response to EPA Science and Ethics Review (4/8/2009) of AHETF Scenario Design and Protocol AHE12O for Exposure Monitoring of Workers during Mixing and Loading of Pesticide Products in Water Soluble Packets in Five Regions of the United States. Dated May 12, 2009. Unpublished document prepared by AHETF. 13 p. Doherty J, Taylor L. 2009. Data Evaluation Record. Chlorpyrifos. Special Non-Guideline Assessment for RBC Cholinesterase in Humans. Dated May 27, 2009. Unpublished study protocol prepared by the Office of Pesticide Programs, United States Environmental Protection Agency. Dow AgroSciences. 2009a. Supplemental Documentation of Ethical Conduct of Nolan et al. Study. E-mail correspondence April 29 through May 8, 2009, between Kenneth Racke and Tom Myers, with attachments. 22 p. Dow AgroSciences. 2009b. Supplemental Documentation of Ethical Conduct of Honeycutt and DeGeare Study. E-mail submission of May 22, 2009 from Kenneth Racke to Tom Myers. 27 p. EPA HSRB. 2008. April 9-10, 2007 EPA Human Studies Review Board Meeting Report. Evans J, Sherman K. 2009. Science and Ethics Review of AHETF Scenario Design and Protocol AHE12O for Exposure Monitoring of Workers during Mixing and Loading of Pesticide Products in Water Soluble Packets in Five Regions of the United States. Dated April 8, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Gaynor Wi. 2009. Chronology of LANXESS Stable Fly Repellent Protocol Approvals by the Essex Institutional Review Board. A Supplemental Report to the Study: Evaluation of the Efficacy of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% Spray) Against Stable Flies in the Laboratory. Undated and unpublished report prepared by ICR, Inc., under Protocol No. G4330108001A382 and Project No. 0108-433-0161. 132 p. MRID 47734901. Page 39 of 40 ------- Gaynor WJ, Cornell C, Foard T, et al. 2009. Evaluation of the Efficacy of KBR 3023 (Picaridin; Icaridin) - Based Personal Insect Repellents (20% Cream and 20% Spray) Against Stable Flies in the Laboratory. Dated April 2, 2009. Unpublished report prepared by ICR, Inc., under Protocol No. G4330108001A382 and Project No. 0:108-433-0161 268 p. MMD 47732701. Honeycuu R, DeGeare M. 1993. Worker Reentry Exposure to Chlorpyrifos in Citrus Treated with Lorsban 4E Insecticide. Dated December 8-10, 21993. Unpublished study prepared by H.E.R.A.C., Inc. under study numbers 91-IO2HE and DECO-HEH2.2-l-182(125)B. 950 p. MRID 43062701. Juberg D, Mattsson J. 2008a. Dow AgroSciences Response to EPA Query Regarding Two Toxicology Reports. Dated May 14, 2009. Unpublished document prepared by Dow AgroSciences LLC under Study ID DRJO5 142008. 20p. MRID 47429401. Juberg D, Mattsson J. 2008b. Updated Dow AgroSciences Response to EPA Query Regarding Two Toxicology Reports. Dated May 28, 209. Unpublished document prepared by Dow AgroSciences LLC under Study ID DRJ05282008. 27 p. MRID 47436401. Kisicki J, Seip C, Combs M. 1999. A Rising Dose Toxicological Study to Determine the No- Observable-Effect-Levels (NOEL) For Erythrocyte Acetylcholinesterase (AChE) Inhibition and Cholinergic Signs and Symptoms of Chiorpyrifos at Three Dose Levels. Dated April 15-19, 1999. Unpublished study prepared by MDS Harris Laboratories under Project No. 21438 and Dow AgroSciences Study No. DR K-0044793-284. 578 p. MRID 44811002. Kisicki J. 2009. Letter to Dr. Kenneth D. Racke, Dow AgroSciences in Response to the US EPA’s Ethics Review of the Chiorpyrifos Human Toxicity Study Report. Dated June 23, 2009. Unpublished letter prepared by MDS Pharma Services. Nolan Ri, Rick DL, Freshour RL, Saunders iN. 1982. Chlorpyrifos: Pharmacokinetics in Human Volunteers Following Single Oral and Dermal Doses. Dated August 1982. Unpublished study prepared by the Dow Chemical Company under Protocol HEB-DR-0043-4946-4. 28p. MRID 124144. Racke KD. 2009. Additional Information to Support HSRB Review of Chiorpyrifos Studies. Dated July 1, 2009. Unpublished document prepared by Dow AgroSciences LLC. 18 p. MRID 448110022 Sweeney KJ. 2009. Science Review of Human Study of Stable Fly Repellent Performance Dated May 29, 2009. Unpublished document prepared by Office of Pesticide Programs, United States Environmental Protection Agency. Page 40 of 40 ------- |