United States Environmental Protection Agency An Accomplishments Report Highlighting the Successes of State and Tribal Assistance Grants (STAG) ------- Grant Innovations at Work: An Accomplishments Report Highlighting the Successes of State and Tribal Assistance Grants (STAG) OECA/Office of Compliance U.S. Environmental Protection Agency EPA 300-R-04-004 January 6, 2005 ------- Contents List of Acronyms iii I. Introduction 1 II. Funding Areas 3 Grant Period 1999-2000 3 Grant Period 2000-2001 6 Grant Period FY2002 9 Grant Period FY2003 13 III. Results 16 Michigan: Business Needs Assessment and Measurement of Work Product Effectiveness .... 16 Mississippi: Capacity Building Grants - Enforcement and Compliance Assurance 20 Missouri: Measuring Performance from Enforcement and Compliance Assurance 22 NESCAUM: Development of a Universal Interface for the Aerometric Information Retrieval System Facility Subsystem 26 New Hampshire: Measuring the Effectiveness of Partial Inspections, Risk-Based Facility Targeting and Compliance Activities 29 Texas: Development of Enhanced Performance Measures for Enforcement and Compliance Assurance Programs 32 Washington: Analysis of Change in Generator Compliance Using Regulatory Compliance Indicators 34 IV. Institutional Change and Transferability of Results 37 Colorado: Comprehensive Enforcement Compliance and Measurement System Project 37 Indiana: Prototype for Sector-based Outcome Measurement (Auto Salvage Facility Sector Project) 40 Kentucky: Public Access to Compliance and Enforcement Milestone Events 42 NESCAUM: Development of a Universal Interface for the Aerometric Information Retrieval System Facility Subsystem 44 New Hampshire: Measuring the Effectiveness of Partial Inspection, Risk-Based Facility Targeting, and Compliance Activities 46 New Mexico: Class V Underground Injection Control - Compliance Assistance 48 South Carolina: Measurement of Effectiveness of On-Site Inspection with Nonregulatory Follow- up by Industry Sectors 50 Washington: Analysis of Change in Generator Compliance Using Regulatory Compliance Indicators 51 Appendix: Abstracts of All Funded Projects 53 Grant Innovations at Work -i- January 2005 ------- The material in this document has been obtained from reports and interviews with grantee organizations. The information has been subject to Agency technical and policy review, and approved for publication as an EPA report. The views expressed by individual authors, however, are their own, and do not necessarily reflect those of the U.S. Environmental Protection Agency. Grant Innovations at Work -ii- January 2005 ------- List of Acronyms AFS Air Facility System AIRS Aerometric Information Retrieval System CAAP Clean Air Assistance Program (Michigan) CAFO Concentrated Animal Feeding Operations CDPHE Colorado Department of Public Health and Environment CEI Compliance Evaluation Inspection CEP Center for Environmental Protection CESQG Conditionally Exempt Small Quantity Generator GET Consultation, Education, and Training (Michigan) CMS Compliance Monitoring Strategy COMET Comprehensive Measurement Tool (Colorado) COMPASS Environment Comprehensive Enforcement Compliance and Measurement System (Colorado) CPE Comprehensive Performance Evaluation DEP Department of Environmental Protection (Maine) DEQ Department of Environmental Quality DES Department of Environmental Services (New Hampshire) DNR Department of Natural Resources (Missouri) ECOS Environmental Council of the States EJP2 Environmental Justice Through Pollution Prevention (South Carolina) EMS Environmental Management System EPM Enforcement Performance Measures (Missouri) EPTDD Enforcement, Planning, Targeting & Data Division (of EPA) ESSD Environmental Science and Services Division (of the Michigan Department of Environmental Quality) ETS Enforcement Tracking System (Missouri) FOIA Freedom of Information Act FQG Full Quantity Generator GPRA Government Performance and Results Act HWTR Hazardous Waste and Toxics Reduction IDEM Indiana Department of Environmental Management IGC Increased Generator Contact IPM Integrated Pest Management KDWM Kentucky Division of Waste Management LCSTLF Large Capacity Septic Tank/Leach Field LQG Large Quantity Generator MADEP Massachusetts Department of Environmental Protection MDEQ Michigan Department of Environmental Quality; Mississippi Department of Environmental Quality MQG Medium Quantity Generator MRW Moderate Risk Waste Grant Innovations at Work -ill- January 2005 ------- NESCAUM Northeast States for Coordinated Air Use Management NEWMOA Northeast Waste Management Officials Organization NHADA New Hampshire Auto Dealers Association NHDES New Hampshire Department of Environmental Services NMED New Mexico Environment Department NPDES National Pollutant Discharge Elimination System NPMS National Performance Measures Strategy PACE-ME Public Access to Compliance and Enforcement Milestone Events P2 Pollution Prevention PCS Permit Compliance System PDA Personal Digital Assistant PLF Performance Limiting Factor PPA Performance Partnership Agreement RCI Regulatory Compliance Indicator RCRA Resource Conservation and Recovery Act RCRAInfo Resource Conservation and Recovery Act Information System (formerly called RCRIS) SCDHEC South Carolina Department of Health and Environmental Control SDWA Safe Drinking Water Act SIC Standard Industrial Classification SME Subj ect Matter Expert SNC Significant Noncomplier SQG Small Quantity Generator STAG State and Tribal Assistance Grants UI Universal Interface UIC Underground Injection Control WPS Worker Protection Standards WQCD Water Quality Control Division Grant Innovations at Work -IV- January 2005 ------- Grant Innovations at Work: An Accomplishments Report Highlighting the Successes of State and Tribal Assistance Grants I. Introduction The U.S. Environmental Protection Agency's Office of Enforcement and Compliance Assurance (OECA) has a fundamental commitment to work cooperatively with states and federally recognized tribes to maintain or improve compliance with federal environmental laws and regulations. Reinforcing its commitment of cooperating with states and tribes, OECA makes grant funds available to regulatory partners to strengthen their ability to address environmental and public health threats, while furthering the art and science of environmental compliance. The State and Tribal Assistance Grants (STAG) program funds projects developed by states, tribes, multistate organizations and intertribal consortia. Grants are competitively awarded, and individual projects are selected based on their potential to build capacity, demonstrate innovate compliance assurance techniques and assess program performance. The program has funded 69 projects, covering eight project areas, to date. Grant recipients include 34 states, one tribe, and seven multi-jurisdictional state agencies and organizations. By helping environmental regulatory agencies determine which activities can achieve the best outcomes, the STAG program reinforces the strong performance results focus of EPA. This focus is reflected in a new EPA Order titled "Environmental Results Under EPA Assistance Agreements," which includes grants and cooperative agreements. EPA recognizes the importance of linking assistance agreements, cooperative agreements and grants to the Agency's performance goals and includes specific objectives to ensure that project grants, cooperative agreements, solicitations, work plans and decision memoranda discuss anticipated environmental results and how they will be measured. To publicize the lessons learned from the STAG-funded activities, this report provides an abstract of each project to date, along with the results achieved from those that are further along in their grant cycle. The report specifically highlights projects with innovative results and potential transferability to other organizations, and projects that have created institutional change within the grantee's organization. These highlighted projects demonstrate how information sharing fostered by OECA can drive innovation. For those interested in more comprehensive information about all of OECA's STAG- funded projects, please visit http://www.epa.gov/compliance/planning/state/grants/stag/index.html. The Web site provides a "one-stop" portal for current grantees, prospective grantees and other interested parties to access grant-related information quickly and easily. The Web site displays the following information: Grant Innovations at Work -1- January 2005 ------- List of all grant projects (69 projects to date) Abstracts and results for each project Current Federal Register Notice Commonly used STAG terms and definitions Grant Conference proceedings for 2003 and 2004 STAG fact sheet and STAG schedule Tutorial on applying for a grant. The following chart shows the number of "hits" on the various pages of the STAG Web site (i.e., the number of times each page has been accessed by a user). The trend shows a spike in usership in May 2003, after the site was launched and demonstrated at the 2003 Grant Conference, and again in March 2004 preceding the 2004 Conference. Number of Hits to STAG Web site 900 800 Web Page Homepage List of STAGs Abstracts & Results Terms & Definitions 2003 Conference Apr-03 May-03 Jun-03 Jul-03 Aug-03 Sep-03 Oct-03 Nov-03 Dec-03 Jan-04 Feb-04 Mar-04 It is the express hope of those involved with the STAG program that these projects can serve as resources to help states and tribes experiment, evaluate and share results with each other as they work to protect public health and the environment by ensuring compliance. Grant Innovations at Work -2- January 2005 ------- II. Funding Areas For each funding cycle, OECA regional and headquarter offices select focus area(s) defined as high- priority categories (e.g., Environmental Enforcement Training). The high-priority categories are identified by the regional offices and headquarters as a perceived need in the Enforcement and Compliance Program. The high-priority categories are also linked to the Agency's strategic plan. The selection criteria are clearly defined in the Federal Register Notice. Potential grantees develop a pre-proposal or a proposal that addresses the focus area. The following chart shows the breakdown of grant dollars awarded by funding area. Performance Measurement/Program Planning 7% Grant Dollars by Funding Area Improving Linkages between AFS Public Access Outcome Measurement (Yr2) 18% Outcome Measurement (Yr1) 18% Data Management Data Quality and Public Access Environmental Enforcement Training 9% Inspector Training Grant Period 1999-2000 The amount of funds awarded in 1999-2000 was $1.6 million. The funding area for this grant cycle is described below. 35- 30- 25- 20- is- le- s' o- Number of Pre-proposals D Number of pre- proposals received Number of grantees selected Funding Area n Outcome Measurement I 100% Grant Innovations at Work -3- January 2005 ------- Outcome Measurement For many years, EPA and states have used enforcement outputs such as inspections conducted, cases settled, or penalties assessed as the primary performance measures for their enforcement and compliance assurance programs. While these output measures provide important information about the enforcement presence among regulated facilities and industries, they do not measure outcomes or results achieved. Specifically, traditional output measures do not characterize the state of compliance in regulated facilities, describe the environmental results achieved through enforcement and compliance assurance activities, assess the extent to which important objectives and problems are being addressed, or include other approaches to increasing compliance such as incentives for self-policing and programs to deliver compliance assistance. Through its National Performance Measures Strategy (NPMS), OECA began in February 1997 to develop enhanced performance measures for the federal enforcement and compliance assurance program. These measures (see Box 1) were phased in over a three-year period (1996-1999), and they were used in the FY2000 Annual Performance Plan required by the Government Performance and Results Act (GPRA). OECA also worked with state environmental agencies to develop accountability measures for enforcement and compliance assurance programs. These measures were used in FY2000 Performance Partnership Agreements (PPAs) between states and EPA Regional Offices. The measures being implemented as part of the OECA Strategy and those selected for the PPAs retain important output measures, but put increased emphasis on outcome measurement. Measurement of outcomes is generally very challenging due to the difficulty of defining final outcomes, lack of supporting data, and the complexity of developing measures that are valid and representative of populations being measured. Projects were funded to facilitate the development and implementation of performance outcome Output Measures Total number of inspections conducted at major facilities, and the percentage of the total universe of regulated sources inspected in negotiated priority areas (e.g., industry sectors, geographic areas). Enforcement activity (e.g., case referrals, orders, notices) undertaken, by medium. Number of facilities or entities reached through each type of compliance assistance activity. Outcome Measures Environmental or public health benefits achieved through concluded enforce- ment activities (e.g., case settlements, injunctive relief). Rates of significant noncompliance for selected regulated populations. Percentage of significant noncompliers (SNCs) that have been returned to compliance or otherwise addressed. Results of using state alternative compliance approaches (e.g., audit laws or policies, small business compliance programs, Excellence in Leadership projects) and compliance assistance. Box1 Grant Innovations at Work -4- January 2005 ------- measures in state enforcement and compliance programs. By funding these projects, EPA accomplished the following: Encouraged states to move toward outcome measurement for enforcement and compliance assurance programs. Shared with states the tools and lessons learned from OECA's efforts to develop outcome-based performance measures. Improved communication between OECA and the states about development and implementation of enhanced performance measures. Preference was given to projects developing and implementing outcome measures included in the NPMS or the accountability measures developed by EPA and the Environmental Council of the States (ECOS) for the PPAs. Pre-proposals were evaluated based on whether suggested performance measures fulfilled the criteria specified in Box 2. Criteria for Performance Measures Projects 1. Measures must have relevancy with regard to important goals and objectives of enforcement and compliance assurance programs. 2. Measures must be transparent and comprehensible to important users and audiences. 3. Measures must be credible and be based on accurate and timely supporting data. 4. Measures must be feasible to implement without costs disproportionate to their value. 5. Measures must be functional and promote good performance by regulated entities and agency personnel. Box 2 Grant Innovations at Work -5- January 2005 ------- Grant Period 2000-2001 In this cycle, OECA funded projects in three areas: data quality, public access and measurement of compliance assistance outcomes. The amount of funds awarded was $3.82 million. 120 100 80 60 40 20 0 2000-2001 Number of Pre-proposals and Selected Grants D Number of pre- proposals received Number of grantees selected 2000-2001 Funding Areas D Outcome Measurement 46% Data Quality 43% D Public Access 11 % Data Quality The goal of this funding area was to improve the data in the compliance and enforcement data systems of EPA and of state partners. States are responsible for more than 90 percent of the data that are entered or transferred to EPA's compliance and enforcement data systems. The information in the national data systems is only as good as the data that states input, and EPA is aware that funding constraints make it difficult for many states to implement system improvements and cure known problems. Consequently, OECA made these funds available to assist states in developing systems and approaches to managing data that will maximize the quality of the data provided to the national systems and minimize reporting burdens. Projects were funded to improve the quality of environmental enforcement and compliance data and included the following tasks: Correcting erroneous data Ensuring completeness of data Adding new data to fill existing information gaps Developing state and EPA translators Providing universe identification for economic sectors and sub-sectors. Box 3 describes the criteria used for approving projects in this funding area. 2. Criteria for Data Quality Projects Projects must support a permanent solution to a data quality problem or lead to a permanent solution to identified data quality problems and not just a temporary or current year problem. Projects must address problems or provide improvements to data used by the state and by EPA. Box 3 Grant Innovations at Work -6- January 2005 ------- Public Access Providing access to compliance information ensures that the public can obtain information on the environmental health of their communities and neighborhoods. Increased public scrutiny of enforcement and compliance information also has the secondary effect of improving data quality, as the states and EPA increase their data quality efforts so that the public is accessing data that are timely and accurate. Box 4 describes the criteria used for approving projects in this funding area. Criteria for Public Access Projects 1. Proj ects must provide a permanent enhancement or an innovative way to provide public access. 2. Proj ects must complement existing EPA public access efforts (e.g., Sector Facility Indexing Project). Measurement of Compliance Assistance Outcomes In the 2000-2001 grant period, OECA continued its funding of projects to develop outcome measures. In this grant period the funding area differed from the previous year in that it focused on the development and implementation of outcome measures for state compliance assistance activities (see Box 5). Outcome measurement from compliance assistance presents unique challenges compared to other activities such as enforcement where the results are mandated and can be tracked more easily. Examples of compliance assistance measures are presented in Box 6. Criteria for approval in this funding area can be found in Box 7. Box 4 Types of Compliance Assistance Activities Site visits 1 Workshops 1 Mailed tools or outreach materials Hotlines Phone calls Meetings Training Box 5 Grant Innovations at Work -7- January 2005 ------- Examples of Outcome Measures from Compliance Assistance Areas Changes in awareness or understanding of regulations or compliance: Number of facilities whose understanding of environmental regulations has improved as measured by pre- and post-tests at workshops. Number of facilities whose understanding of environmental regulations has improved as a result of the compliance assistance received, as indicated by verbal or written responses to surveys. Behavioral changes (regulatory andnonregulatory environmental management changes): Number of facilities that have taken at least one action to comply with environmental regulations because of the compliance assistance received. Number of facilities that have improved the quality of self-reported information or begun reporting this information for the first time. Number of facilities adopting nonregulatory process changes or best management practices as a result of compliance assistance received. Number of facilities making environmental management changes (e.g., improved training, self- audits, development of an environmental management system) because of the compliance assistance received. Number of facilities demonstrating improved compliance rates, measured through direct observation. Environmental or human health improvements: Number of facilities that reduce emissions or other pollutants. Amount of emissions, pollutants, or risk reduced. Box 6 Criteria for Compliance Assistance Outcome Measurement Projects 1. Suggested performance measures must meet the criteria in Box 2. 2. Information and data must be relevant to, and shared with, other states and EPA. Box? Grant Innovations at Work -8- January 2005 ------- Grant Period FY2002 In FY2002, OECA continued the emphasis on data quality and performance measurement, and expanded funding areas to include inspector training and program planning. The three funding areastribal and state inspector training, program planning and performance measurement, and data managementare described below. The amount of funds awarded was $2.1 million. Number of Pre-proposals 250i 200 1ST 100' 50 0 d Number of pre- proposals received Number of grantees selected Funding Areas d Data Management 38% I Inspector Training 31% D Performance Measurement/ Program Planning 31% Tribal and State Inspector Training The goal of this funding area was to build tribal and state inspector capability. EPA maintains discretionary authority to ask tribes and states to conduct civil inspections on behalf of the Agency under each federal environmental statute. It is essential that tribal and state inspectors are trained to safely and properly conduct federal civil inspections. In this grant cycle, OECA considered projects for basic inspector training, media-specific inspector training, and health and safety training courses. Projects to build partnerships between states or tribes through regional inspector workshops were also solicited (see Box 8). Workshops could be designed for state, tribal or local inspectors within a region, and could cover a variety of topics designed to build inspector capability to conduct compliance monitoring inspections under federal authority. A requirement of the workshops was that selected host states or tribes would fund the travel, course materials and contractor costs through grant funds. Criteria for Inspector Training Projects Projects must demonstrate an explicit intent to collaborate and partner with other states and tribes within an EPA region to host or participate in an inspector workshop. The course outline and content must be consistent with EPA federal guidelines and are supportive of an authorized program (e.g., training that provides information on federal inspection law and policy). Course content may also provide information on inspection issues that arise under state and tribal laws. Box 8 Grant Innovations at Work -9- January 2005 ------- Program Planning and Performance Measurement In this funding area, EPA funded projects to develop or implement performance measurement outcomes or improved program planning, as described below. Enhancing Results Through Improved Regional, State and Tribal Planning Projects were funded to support state or tribal efforts to collaboratively carry out joint priority setting and work planning and included the following components: State or tribal plans to perform efficient enforcement and compliance work planning with EPA regional offices. A process to produce a surrogate, risk-based ranking of all identified enforcement and compliance assurance problems facing a state or tribe. Outcome Measures for Enforcement and Compliance Assurance Initiatives Projects were funded to help states and tribes develop and test outcome measures for compliance assurance and enforcement activities in FY2002. In the FY2002 grant cycle, EPA clarified the scope of outcome measurement projects to quantify the environmental results from state compliance assistance efforts. This was intended to promote and further the regulated communities' understanding of their environmental obligations and to quantify the same efforts undertaken by compliance assistance providers. Whereas the compliance assistance outcome projects in FY2000/2001 sought to measure behavioral changes at regulated facilities, the FY2002 projects sought to measure the changes in environmental compliance rates as a result of the behavioral changes by regulated facilities. Development of Performance Measures for Concentrated Animal Feeding Operations (CAFOs) and Worker Protection Standards (WPS) Funding was available in this area for states and tribes to develop and field test outcome measures that would gauge the effectiveness of assistance, incentives, monitoring and enforcement on CAFO and WPS compliance. See Box 9 for examples of outcome measures for enforcement and compliance assurance initiatives. Grant Innovations at Work -10- January 2005 ------- Examples of Outcome Measures for Enforcement and Compliance Assurance Initiatives Statistically valid noncompliance rates: Development or implementation of a methodology for statistically valid noncompliance rates. Improvements resulting from enforcement actions and initiatives: Number or percentage of concluded enforcement actions identifying pollutant reductions. Amount of emissions, pollutants or risk reduced from enforcement actions. Number or percentage of enforcement actions that result in improvements in the use or handling of pollutants, such as changes in industrial processes or storage and disposal practices to achieve emission and discharge reduction. Number or percentage of enforcement actions that result in improvements in facility management practices and information. Improvements resulting from compliance assistance activities and initiatives: See Box 5 for examples of compliance assistance activities. Improvements resulting from integrated initiatives: Environmental or human health improvements or behavioral changes from initiatives that include more than one tool (e.g., enforcement and compliance assistance). Improvements resulting from self-policing efforts and use of compliance incentive policies: Compliance incentive policies encourage the regulated community to voluntarily discover, disclose, and correct violations before they are identified by regulatory agencies for enforcement investigation or response. Examples of outcome measures from enforcement activities are: Number or percentage of concluded self-disclosed actions identifying pollutant reductions. Amount of emissions, pollutants or risk reduced from self-disclosed actions. Number or percentage of self-disclosed actions that result in improvements in the use or handling of pollutants. Number or percentage of self-disclosed actions that result in improvements in facility management practices and information. Box 9 Grant Innovations at Work -11- January 2005 ------- Data Management The goal of this funding area was to enhance states' and tribes' ability to provide better integration of data (e.g., on enforcement and compliance) and to improve state and tribal multimedia targeting, reporting and compliance assurance capabilities (see Box 10 for the selection criteria). It is critical that a state or tribal system be capable of reporting data to EPA that are consistent with EPA and state data standards, and in line with new requirements of modernized data systems (e.g., the Permit Compliance System [PCS]) or current requirements of legacy media systems. OECA is interested in maximizing the quality of the data provided to the national systems while minimizing reporting burdens, especially for states and tribes with numerous independent data systems. This funding area also supported projects to assist states and tribes with reporting of consistent, streamlined environmental and compliance data to EPA, including PCS Modernization and the Universal Interface of the Air Facility System (AFS-UI). Support was available to upgrade current state systems and incorporate the use of the AFS-UI software to improve system interfaces, data linkages and data cleanup. Criteria for Data Management Projects Projects must support or provide a solution to consistent, streamlined reporting of data across the various independent media systems or lead to identifying problems and issues associ- ated with the reporting of environmental data to EPA, with recommendations for solving the problem. Projects must address problems and provide recommendations for improving data reporting to EPA by states and tribes. Projects must support implementation of EPA and state data standards, modernization efforts and data clean-up efforts that promote better integration of data across EPA systems. Box 10 Grant Innovations at Work -12- January 2005 ------- Grant Period FY2003 In FY2003, OECA solicited proposals in two areas: environmental enforcement training and improved linkages between EPA and state and tribal data systems. A points system was used to relate the relative importance of each funding area's selection criteria (which are outlined in Box 11 and Box 12). In addition, EPA looked at past performance of grantees under this grant program (e.g., timely and complete quarterly and semiannual reports, results and outcomes that are apparent during the project, timely and complete final reports). The amount of funds awarded was $1.8 million. Number of Pre-proposals Number of pre- proposals received Number of grantees selected Funding Areas D Environmental Enforcement Training 50% Improving Linkages for AFS and PCS 50% Grant Innovations at Work -13- January 2005 ------- Environmental Enforcement Training The goal of this funding area was to continue funding projects to build capacity among state and tribal personnel in the area of environmental enforcement training. States, tribes or organizations were to host training workshops or sponsor state and tribal personnel attendance at existing training programs (e.g., for inspectors and case developers). Strengthening enforcement skills for states and tribes conducting inspections on behalf of the Agency is important. To ensure that these responsibilities are performed appropriately, OECA considered proposals to train: Inspectors with a focus on single-medium media inspections, multimedia inspections or criminal investigations. Law personnel with a focus on single- medium media and multimedia enforcement case development. The selection criteria are outlined in Box 11. Criteria for Environmental Enforcement Training Projects Projects must clearly identify the type of training to be conducted and the targeted audience. Projects must explicitly state and describe the training and verify that the training can accom- modate the number of participants specified in the pre-proposal. Description of course outline and content must show consistency with EPA federal guidelines and be supportive of an authorized program (e.g., training provides information on federal inspection law and policy); course content may also provide information on inspection issues that arise under state and tribal laws. Projects that include development of new training must show evidence that existing course materials will be used (e.g., materials for the Basic Inspector Training Course of the EPA National Enforcement Training Institute-West); funding should be used to revise and adapt existing training as much as possible and not be used to duplicate training that is readily available from other sources. All training funding projects must include payment of full travel and lodging costs for state and tribal training participants. Projects must address sharing results: describe how you will share training materials and products (e.g., archive training materials on CD-ROM, make available on Web site, distribute training materials at conferences). Projects must identify output and outcome measures (i.e., identify number and type of personnel to be trained as well as describe how training will improve skillfulness or job performance); describe how success will be measured (e.g., use of questionnaires and surveys before and after training). Box 11 Grant Innovations at Work -14- January 2005 ------- Supporting Improved Linkages Between EPA and State and Tribal Data Systems The goal of this funding area was to continue supporting projects to improve the data management capabilities of states and tribes (see Box 12 for the selection criteria). OECA funded projects to support the enhancement of quality data to EPA from states and tribes as well as projects that assist states and tribes with reporting of consistent, streamlined compliance data. Funding was available for PCS modernization and the AFS-UI. Funding was also provided to build state and tribal capability to implement Air Compliance Monitoring Strategy (CMS) data reporting. States and tribes need to make sure that their systems are compatible with EPA's systems and that they can accurately transmit data to EPA. The funds allowed states and tribes to procure the expertise they needed for this purpose. Permit Compliance System Modernization Grant funding would support state efforts to procure technical assistance and technical expertise for state system modifications to ensure the continued flow of nationally required National Pollutant Discharge Elimination System (NPDES) data from state systems to the PCS. Examples of covered state activities included: Enhancement or modification to existing state system interfaces or development of state system interfaces to the new modernized system format. Enhancement of state systems to incorporate new data requirements for new NPDES programs (e.g., CAFO, Storm Water). Data clean-up and data migration efforts. Air Facility System Criteria for Projects Supporting Linkages Between EPA and State and Tribal Data Systems Projects must describe briefly the existing state and tribal system. Projects must describe briefly the technical aspects of how data are cur- rently exchanged with EPA. Projects must clearly identify the states' and tribes' development efforts to allow for increased data integration and reporting linkages to meet EPA's modernized system(s) and new data requirements. Box 12 Universal Interface: Grant funding assisted states and tribes with incorporating the AFS-UI software into their current systems to provide improved system interfaces, data linkages, and data cleanup. Capability of state and tribal facility systems to implement Air CMS data reporting: Grant funding assisted state and tribes with methods to modify their state systems to streamline the capture and transmission of nationally required air compliance and enforcement data with special emphasis on reporting of the following: stack tests and results; dates that compliance certification was due, received and reviewed; and information on compliance certification deviations and certification review results. Grant Innovations at Work -15- January 2005 ------- III. Results This section summarizes the results (i.e., outputs, outcomes) of grants that were awarded in previous years based on grantees' final reports. All grants with final reports submitted before December 31, 2003, are included. The results information has been garnered from the following sources: (1) final reports, (2) grantee conference presentations, and (3) phone interviews with the grantee. Results information is characterized as outputs (e.g., compliance assistance materials) and as outcomes (e.g., behavior changes as a result of compliance assistance). In some instances, grantee results are neither outputs nor outcomes, but intermediate outcomes, which are expected to lead to the ends desired but are not themselves ends. Business Needs Assessment and Measurement of Work Product Effectiveness Michigan Department of Environmental Quality (MDEQ) Grant period:2000-2001 Funding area: Outcome Measurement Grant amount: $40,000 Objectives This project gauged the usefulness of one of the products of Michigan's Clean Air Assistance Program (CAAP) for small businesses. Under this project Michigan sought to accomplish the following objectives: Query the compliance needs of statewide small and medium-sized businesses. Measure the effectiveness of the current level of technical assistance provided by focusing on the effectiveness of one type of program product (a multimedia guidebook) and one type of outreach effort (a compliance assistance workshop) for this particular guidebook. Better promote the services of the state's Small Business Technical and Ombudsman program within the business community. The CAAP program product whose effectiveness Michigan sought to measure was the Michigan Manufacturers' Guide to Environmental, Safety, and Health Regulations1 In 2000, MDEQ developed this program product, its fourth industry-specific technical assistance guidebook that explains in plain English how to comply with the multitude of state and federal environmental, health, and safety regulations in the workplace. The guidebook was presented at a series of statewide workshops to more than 600 environmental, safety and health professionals. Never had such a comprehensive and coordinated effort been made by a multitude of state agencies to address the general environmental, safety and health needs of Michigan's manufacturing industry. Grant activities measured limited aspects of the CAAP by examining the effectiveness of the program's outreach efforts as a technical assistance 'The guidebook is currently available at http://www.michigan.gOV/deq/0,1607,7-13547596,00.html. Grant Innovations at Work -16- January 2005 ------- resource for the state's business and industry. Additional aspects of the grant provided ways in which the CAAP can improve its methods of outreach to better serve its customers. Findings2 To accomplish the work product assessment, a consulting firm administered two surveys and two focus group sessions. The first survey was administered to 1,800 program customers who received a copy of the environmental, safety and health guide. The second survey was delivered to a random pool of 3,000 statewide noncustomers to determine what needs still existed within the environmental community and how the program could best meet those needs in the future. The research findings from the surveys and focus group sessions effectively demonstrated the great value that the state's businesses have placed on the multimedia guidebook, the Michigan Manufacturers' Guide to Environmental, Safety, and Health Regulations. Most businesses found it to be a thorough, economical and useful resource for environmental, safety and health issues. The research, which also measured the use of and need for other outreach services delivered by MDEQ, Environmental Science and Services Division (ESSD), and CAAP, showcased the important role that these services play in helping business and industry achieve and maintain environmental, safety, and health compliance. It also demonstrated the high satisfactory rating that businesses awarded to services currently rendered by MDEQ, ESSD and CAAP. Although current work products and services received high marks under this project, some common themes emerged from the responses of the focus groups, customer survey, and noncustomer survey. These recommendations offered MDEQ, ESSD and CAAP some constructive models for change. MDEQ has an ongoing commitment to improve its compliance assistance efforts and will use this information to make enhancements to its environmental outreach programs. One theme derived from the project's research focused on the improvement of promotional activities of MDEQ, ESSD and CAAP. Although CAAP and ESSD have existed since 1994, each still seems to suffer from a lack of name recognition and the underutilization of available services. One explanation could be the traditional approach to advertising and marketing MDEQ's products and services. MDEQ has made regulatory and compliance information available through its agency calendars, newsletters, mailings and Web site, leaving it up to business and industry to seek out the information in order to meet their compliance requirements. Consequently, research participants' responses showed some lack of awareness of the range of products and services offered by the ESSD or CAAP. Research participants encouraged MDEQ to more clearly distinguish its sponsorship and ownership of specific events and work products. 2 A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2001/stag01-mi-busneeds-final.pdf Grant Innovations at Work -17- January 2005 ------- Another theme revolved around ways in which MDEQ, ESSD and CAAP could improve their compliance assistance efforts. Respondents who have used work products such as the Michigan Manufacturers' Guide to Environmental, Safety, and Health Regulations seemed quite pleased overall with the content and format of the guidebook, and with the two state agencies' efforts to combine their program expertise to produce a multimedia work product. In fact, participants encouraged additional efforts to combine environmental media requirements such as merging various program reporting requirements into one form or report, and using more tables, checklists and flow diagrams to quickly outline compliance requirements. Research participants also wanted to see MDEQ bridge the gap between what is expected during an inspection and the compliance assistance information that is provided through consultation or training sessions, so that the information provided is applied consistently from region to region and between headquarters and the district offices. The findings also pointed out businesses' need for industry-specific information that makes it clear what regulations are applicable, what resources are available, and which staff person to contact when questions arise. Expanding the methods for the delivery of work products and services was another theme that arose from the research findings. This meant looking at new or easier ways to provide information to business and industry. Often mentioned was the use of electronic media such as the Web, delivery of environmental compliance information on CD-ROM, and the use of email service for updates. Even though MDEQ considers its Web site a convenient and nonthreatening method for information delivery, very few research participants seemed to use the site, making it an underused resource for compliance assistance. Most found the Web site difficult to navigate or had difficulty in downloading information. Finally, the research found that those currently using the services of MDEQ, ESSD and CAAP usually sought help to clarify or interpret a regulation or requirement. Additionally, when asked, research participants overwhelmingly agreed that environmental regulations were important to Michigan's quality of life. Many respondents indicated their willingness to do the right thing when it came to environmental, safety, and health compliance, but were always seeking the most economical means to accomplish this mission. As MDEQ, ESSD and CAAP continue to evolve and develop new tools for business and industry to use, it will be important that the focus for outreach remain balanced among usefulness, need, cost and access to a specific work product or service. The research recommendations provided by this project are the starting point for MDEQ, ESSD and CAAP to begin the necessary, subtle programmatic changes that will continue to provide substance and value for future compliance assistance efforts. Results The following are work product and service enhancements that MDEQ, ESSD and CAAP are implementing as a result of these research findings: Guidebook Improvement: Improve the Facility Assessment Survey located at the front of the guidebook. Grant Innovations at Work -18- January 2005 ------- Provide a direct hyperlink, in the electronic copy (CD-ROM version) of the guidebook, for Web site references. Include more tables, checklists, flow diagrams and graphics. Develop an environmental reporting Calendar of Events. Workshop Improvement: Develop an annual schedule of standard workshops and training opportunities that MDEQ will offer during the fiscal year. Service Improvement: Provide a greater awareness of, or establish a brand name for, products and services by expanding existing advertisement and marketing activities. As a result of the two focus group sessions and two surveys, MDEQ has determined the following intermediate outcomes of this project: 1. The small business community should be able to prepare better and more complete permit applications. In the end, this will save time and resources for MDEQ. 2. MDEQ will revamp its multimedia workshops and offer sessions that specifically educate small businesses in answering the how and what of complying with federal regulations. The small business community is interested in understanding the regulations so that they can remain in compliance or get into compliance quickly. 3. For MDEQ and its internal customers, the improved workshops and training guides will enable MDEQ to deliver a better product that reaches a wider audience. MDEQ wants to deliver a product that is pertinent, interesting and readable to a wide audience. Grant Innovations at Work -19- January 2005 ------- Capacity Building Grants - Enforcement and Compliance Assurance Mississippi Department of Environmental Quality (MDEQ) Grant period: 2000-2001 Funding area: Data Quality Grant amount: $56,346 Objectives The objectives of this grant project were to: Develop a methodology (based on a joint plan developed by MDEQ and EPA) to identify all incorrect, erroneous, duplicated and missing data contained in the Air Facility System (AFS), the Permit Compliance System (PCS) and RCRAInfo. Perform facility file and Federal database reviews to identify any missing or incorrect data as it pertains to compliance and enforcement activities. Enter all missing data, correct all erroneous data and delete any duplicate facility data as it applies to compliance and enforcement activities. Develop a comprehensive training document for transferring compliance and enforcement data to the appropriate database manager for entry into AFS, PCS and RCRAInfo on a timely and consistent basis. Provide EPA or other states with any processes and procedures used to identify erroneous or missing data to reconcile federal and state-specific databases. Review, correct and input locational data for the applicable federal and state-specific databases during the facility file review. Findings3 MDEQ conducted a facility and database review of the state's AFS, PCS and RCRAInfo programs to identify erroneous and incomplete data. MDEQ rectified any incomplete, erroneous or missing compliance and enforcement data in the appropriate federal databases using the methodology developed with EPA. In addition, MDEQ performed a monthly reconciliation of the federal databases and their state-specific database, while noting discrepancies and correcting them on a timely basis. MDEQ also developed a training program for its permitting, compliance and enforcement staff to ensure that future data would be complete and correct. MDEQ will schedule the training annually for 3A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2001/stag01-ms-dataclean-final.pdf. Grant Innovations at Work -20- January 2005 ------- the three federal databases and will provide additional training to staff as programmatic changes to the federal databases occur and as new staff members are hired. Results By performing a comprehensive facility file and database review and making the appropriate corrections, MDEQ can assure EPA, regulated facilities and the public that information contained in the federal and state-specific databases is both current and accurate. The intermediate outcomes of this project are: 1. Having accurate and accessible compliance and enforcement data allows MDEQ and EPA to make informed decisions on the state of the environment. 2. Accurate and reliable data enable MDEQ and EPA to make inferences about environmental and human health improvements. Accurate data will enable MDEQ and EPA to measure the number of facilities that reduced emissions or other pollutants and quantifiable environmental improvements. Grant Innovations at Work -21- January 2005 ------- Measuring Performance from Enforcement and Compliance Assurance in Missouri Missouri Department of Natural Resources (DNR) Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: $37,500 Objectives This project's goals included the following: Incorporate data processes into DNR's data systems to facilitate information sharing with EPA. Identify the business rules needed to collect environmental performance measures. Build on the concepts used in EPA's Case Conclusion Data Sheets. Require no more than five minutes of staff time to collect the additional information. Map the new environmental performance measures in the Enforcement Tracking System (ETS) to EPA's case conclusion data. Collect both quantitative and qualitative environmental performance data. Minimize the need for additional staff training on collecting the new performance measures. Update ETS to include data entry information, sample reports and coding tables. The Environmental Performance Measures (EPM) subsystem of the Missouri DNR's ETS has been in service since March 1, 2002. A total of 1,307 resolved enforcement cases have been entered into the system to date from the Air Pollution Control Program, the Public Drinking Water Program, the Solid Waste Management Program, the Land Reclamation Program and the Hazardous Waste Program. Of those, performance measures have been entered for 739 cases (56 percent). ETS operates in conjunction with the Permit Actions Management System and the Production Tracking System (inspections and complaints) as the only agencywide regulatory tracking database. There were some difficulties early on regarding duplicate facility records, response time, business process definitions and programming quirks. Lack of system confidence promoted continued use and expansion of local databases, undermining the correction and refinement of ETS. Aside from the lack of water pollution data and continuing refinement of facility and site records, ETS is now fully functional as originally designed. ETS will soon undergo further revisions to effectively couple it to the Production Tracking System dealing with inspections and complaints. ETS is designed to allow flexibility to the central program offices in entering data. Data entry in ETS is easy and quick enough so that either the enforcement technical staff or the clerical staff can enter data. Grant Innovations at Work -22- January 2005 ------- With the addition of the EPM subsystem, the ETS users (those who access ETS on their computers) will find no change in methods to add data except that once a case is resolved, the system will require that the environmental data of the case be entered. Most of the background data required in EPA's Case Conclusion Data Sheet will have been entered prior to entering the performance measures. The EPM data add a significant amount of data entry to the overall ETS, even though a primary goal was to keep data development and entry to less than five minutes per resolved enforcement case. ETS has always provided a data entry screen that lists and labels enforcement milestones date fields. In ETS/EPM, when the case resolved date on this screen is entered, the user is now asked whether there are environmental performance measures associated with the case. By selecting no, the user returns to the case record, requiring no further action on EPM. If the user selects yes, ETS/EPM shifts to a separate series of screens containing the EPM fields. The fields are: Pollutant name or category Medium (air, land, water, multimedia) Reduction actions required (direct, indirect) Environmental benefits Health concerns Counts or measures Each screen must be completed before the user is returned to the case record. Most fields to be filled in provide a drop-down list of potential selections. New selections may be added by making a request to the system maintainer and obtaining approval by the enforcement committee. If the user does not have the required information, he or she is allowed to return to the case record without saving EPM data. In that case, the "case resolved date" field must be left blank to ensure that the user can return to the record to complete the EPM data. A new ETS/EPM users' manual and a new data entry form have been developed to aid data entry. In addition, two training sessions have been provided to the programs on the EPM system. Individual programs have received program-specific training as well. Grant Innovations at Work -23- January 2005 ------- Findings4 Assessment of ETS Goal: Incorporate features that facilitate information sharing with EPA. Status: Data tables contain EPA crosswalk information to facilitate potential data transfers. Goal: Identify the business rules needed to collect environmental performance measures. Status: In place, but continuing to be refined. Goal: Build on the concepts used in EPA's Case Conclusion Data Sheets. Status: Finished. Goal: Require no more than five minutes of staff time to collect the additional ETS information. Status: Staff experienced with ETS/EPM can approach this goal. Goal: Map the new ETS environmental performance measures to EPA's case conclusion data. Status: Data tables contain EPA crosswalk information to facilitate potential data transfers. Goal: Collect both quantitative and qualitative environmental performance data. Status: EPM collects qualitative and quantitative data. Box 13 Because ETS/EPM serves seven offices in two divisions within Missouri DNR, identifying all meaningful data points and standardizing data parameters and definitions was difficult. As the revised system is still relatively new, problems with definitions or omitted fields continue to emerge. Of particular interest since the implementation of the module has been an issue associated with the Health Concern data field. Typically, health concerns are not specifically identified in enforcement cases. Evidence is almost always associated with illegal releases, which are much simpler to prove than harm to health or environment. Often, association of a violation or enforcement case with specific health issues goes beyond what the state has proved and should not be included. Another concern has been the inability to enter environmental performance measures until the case is resolved. Often, a violation is corrected long before a case is resolved. In the ETS/EPM system, staff cannot enter the measures taken until all litigation, penalty payment, and Supplemental Environmental Project (used as part of or in lieu of a penalty dollar amount) work is carried out. 4A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2000/stagOO-mo-msrperf-final.pdf. Grant Innovations at Work -24- January 2005 ------- Staff are working to allow EPM data entry at the Actions Complete milestone, a field that indicates the enforcement case work is almost complete and the remaining activities are left to the defendant or the Attorney General's Office. And finally, the count of occurrence is a field that causes confusion among the users. It is a unitless count and difficult to explain to both user and public. It is possible that this field will need to be removed. Results Many of the goals set for the ETS/EPM system have been reached or are within reach. The intermediate outcomes of this project are: 1. Data collection has improved as the system has stabilized and people are trained in its use, and staff are preparing for a thorough evaluation of the EPM data to report results for FY2004. 2. The Missouri DNR is hopeful that the data collected will aid as an effective means to communicate enforcement and compliance assistance successes. As an agency, Missouri DNR is committed to providing meaningful environmental data about its enforcement activities to all who are interested, and will continue to use and refine the EPM system to help meet this commitment. Grant Innovations at Work -25- January 2005 ------- Development of a Universal Interface for the Aerometric Information Retrieval System Facility Subsystem Northeast States for Coordinated Air Use Management (NESCAUM)5 Grant period: 2000-2001 Funding area: Data Quality Grant amount: $100,000 Objectives The purpose of this project was to upgrade the existing Universal Interface (UI), which uploads air facility compliance and enforcement facility and activity data from state databases to the Aerometric Information Retrieval System Facility Subsystem (AIRS/AFS).6 The UI was developed in response to the need of state and local agencies with independent data systems to report mandatory compliance and enforcement requirements to EPA. Prior experience showed that development and maintenance of individual agency software could put an undue burden onto the state. Before the undertaking of this project, the original UI software was failing consistently on new computers, and only two states (Oklahoma and Nebraska) were using the original UI. Therefore, EPA provided funds to NESCAUM to update the UI. The goal of this update was to: 1. Build an updated version of the UI that will take advantage of today's software technology. 2. Incorporate new data elements to further define data and increase accuracy. Agencies Using the Upgraded UI Alaska Arizona Connecticut Hawaii Jefferson County, Kentucky Louisiana Maine Michigan Mississippi Nebraska New Hampshire North Dakota Oklahoma Puget Sound, Washington Box 15 5NESCAUM is an interstate association of air quality control divisions in the Northeastern states. The eight member states are the six New England States (VT, NH, CN, ME, RI, MA), as well as New York and New Jersey. NESCAUM's purpose is to exchange technical information and to promote cooperation and coordination of technical and policy issues regarding air quality control among the member states. To accomplish this, NESCAUM sponsors air quality training programs, participates in national debates, assists in exchange of information and promotes research initiatives. 6AFS contains compliance and permit data for stationary sources regulated by EPA and state and local air pollution agencies. AFS was once a part of AIRS; hence, the historical use of that term may be incorporated within referenced documentation. Grant Innovations at Work -26- January 2005 ------- Findings7 The current UI user manual was updated to include all features developed by this project. In addition, the new UI has incorporated the user manual into the software so that the manual can be accessed by using the software. The primary purpose in upgrading the UI was to increase its functionality. Benefits expressed by agencies using the new UI include: Reduction in the effort needed to report federally required data. Significant reduction in workloads due to the elimination of duplicate entry into data systems. Enhancement of data transfers done in batch j obs. Institution of a highly efficient quality assurance process that provides EPA with more complete and accurate data. Transfer of critical data elements to AFS. A graphical drag-and-drop interface that lets agencies quickly and easily connect new related state actions to high priority violations. Reduction in development and maintenance costs. Simpler transaction formats. Identification of weaknesses in the data stream. Immediate validation of data equivalent to that performed in AFS, shortcutting the need to transfer data to the EPA system and submit overnight reports. Timely identification and correction. Elimination of errors caused by manual entry. Easy-to-use browser that creates a familiar, user-friendly environment. Results Better compliance assistance data translate directly into accurate compliance rates for each of the eight member stateseach of these states will be putting better data into their state systems. The intermediate outcomes of this project are: 1. Burden reduction for the eight member states: the project has helped the states with their data entry requirements and will help to prevent manual data entry errors. States will now be able to use resources more efficiently because duplicate entry into data systems has been eliminated. 7A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2001/stag01-nescaum-afsui-final.pdf Grant Innovations at Work -27- January 2005 ------- 2. Improved data quality: AFS has the same information as the state systems. 3. Improved timeliness of reporting for the member states. Highlight One of the project partners, the Maine Department of Environmental Protection (DEP), has calcu- lated some of the initial benefits of implementing the upgraded UI. Prior to using the UI, Maine DEP was a direct user of AFS. Maine's nine compliance inspectors would spend a minimum of one hour each month entering data into AFS. In addition, the compliance manager would spend a minimum of four hours each month generating and reviewing AFS reports (equivalent to the time required to inspect 15 synthetic minor sources). This calculates to a minimum of 156 hours (20 days a year) spent solely on reporting data to AFS. This time was in addition to the time that Maine spent maintaining its own compliance data system. In addition, under the old system Maine DEP had no quality control built into its data reporting. This commonly led to the reporting of erroneous information to AFS, such as double entry of facilities, failure to enter Air Program Pollutant Compliance Status, and creative entries for Action Codes. Upon implementing the UI, Maine DEP created a data system that is multifunctional. Inspection staff accomplish more than one task when entering data, including standardizing use of codes and quality control of data when input. Since use of the upgraded UI began, the nine compliance inspectors spend no time entering data into AFS. The compliance manager spends no more than four hours each month generating UI transactions and reviewing AFS reports. This translates into only 48 hours annually spent on providing data to AFS, a 70 percent reduction in the resources required to provide compliance and enforcement data to EPA. The compliance manager reports that while using the UI has reduced the reporting burden, the quality of Maine's data in AFS has increased significantly. Box 17 Grant Innovations at Work -28- January 2005 ------- Measuring the Effectiveness of Partial Inspections, Risk-Based Facility Targeting and Compliance Activities New Hampshire Department of Environmental Services (NHDES) Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: Total EPA Grant Award to NHDES = $185,000: $100,000 for the Outcome Measurement component of the project, and $85,000 subcontracted to NEWMOA for related work on a regional hazardous waste compliance measures project and continued development of the pollution prevention metrics database Objectives Historically, environmental regulatory agencies have relied on output (activity-based) measures to assess compliance. Such measures fail to capture the full range of an agency's compliance assurance activities and reflect little about the effectiveness of such efforts or rates of compliance in the regulated community. To address this problem, NHDES applied for a grant from EPA's Office of Enforcement and Compliance Assurance (OECA) to develop program-specific outcome measures that provide a more complete picture of compliance rates and agency performance. The project that OECA funded for the outcome measurement component of the project had two phases. In Phase I, EPA Region I in Boston contracted with Tetra Tech EMI to review existing data in RCRIS (now called RCRAInfo) to determine whether it could be analyzed to develop compliance rates and trends. Also in Phase I, the results of education and outreach efforts associated with an automotive industry sector project were evaluated. It was determined that in both instances, the information gathered was not sufficiently specific or statistically valid to support compliance rate determinations or to determine the efficacy of outreach efforts. However, in Phase n, NHDES developed a compliance indicator survey for hazardous waste generators that would overcome the previously-identified data obstacles and allow NHDES to target actual inspections to facilities that were most likely to need full inspections. The survey has been implemented using summer interns to establish a baseline and will be repeated in future years to measure changes that result from specific NHDES interventions. Findings8 The major findings based upon analysis of the data include the following: Eighteen percent of the generators in the NHDES database were inactive. Five percent of the New Hampshire small quantity generators (SQGs, equivalent to federal conditionally exempt SQGs) visited generated wastes at higher levels than notified. The overall compliance rate for the state is 65 percent. 8A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2000/stagOO-nh-rcrainsp-final.pdf. Grant Innovations at Work -29- January 2005 ------- The highest compliance rates are for aisle space and waste characterization. The lowest compliance rates are for training and emergency postings. There were significant differences in behavior between New Hampshire full quantity generators (FQGs) and small quantity generators (SQGs). Key measures include inspections, waste characterization and periodic assessments. Other significant benefits of the project include: NHDES worked with the New Hampshire Auto Dealers Association (NHADA) to develop outreach targeted at automobile dealerships; NHADA realized the importance of environmental compliance and hired a full-time staff person to work with members. NHDES was able to identify facilities that needed a full CEI, thereby making more effective use of limited inspector resources. NHDES reached approximately 1,000 facilities in two years and delivered information to assist them with compliance. This is significantly more than the number of facilities reached in the prior 10 years. An automated system now exists to capture all inspection information, and NHDES is moving towards using personal digital assistants to facilitate data collection and processing. Results One of the most significant results of the effort to revamp the CEI checklists and develop the database is the increased efficiency in conducting inspections and preparing reports. Approximately 32.5 work-hours per inspection and 40 work-hours per program summary report will be saved due to the ability to pre-populate inspection forms, use only the applicable modules for an inspection, use personal digital assistants for container inventories and generate reports from the database using programmed violation tables. It is anticipated that because of the increased efficiency, NHDES staff will be able to inspect a larger percentage of the regulated universe. An additional benefit of the project is that data on generator behavior have been collected using a statistically-valid method. All future data collection will thus complement the existing database and will be able to support future statistical analyses. NHDES considers this project to be a success, and has shared the results of the project with several states. As a result, Connecticut, Oregon and Maine are now interested in pursuing similar processes in their Resource Conservation and Recovery Act (RCRA) and underground storage tank programs. The goal is to use the same core questions (for the RCRA surveys), working out language that will be applicable to all states. Implementing the same compliance survey in many states will allow better analysis of compliance across states and will help identify comparative strengths; for example, if a state has a high compliance rate in one area, others can look at that state's approach as a model and apply it themselves. Some states are also interested in using the surveys to find facilities that have the most compliance issues for targeted full inspections, since most states currently have no reconnaissance or screening inspections to identify facilities that need full inspections. Grant Innovations at Work -30- January 2005 ------- So far, the survey approach has not been applied to other (non-RCRA) programs at NHDES. The survey approach works best for programs with a large number of facilities, a small staff, and objective criteria that can be applied in the form of a brief checklist - attributes not currently found in other NHDES programs. Grant Innovations at Work -31- January 2005 ------- Development of Enhanced Performance Measures for Enforcement and Compliance Assurance Programs Texas Commission on Environmental Quality Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: $75,000 Objectives This program involved one-to-one personalized technical assistance for small businesses in Texas. For this assistance, an independent environmental consultant determined compliance with all applicable federal and state air, water and waste regulations by using a compliance checklist specific to that industry. The consultant also provided technical assistance in determining compliance and recommending solutions to identified environmental problems. In addition, the consultant identified opportunities for pollution prevention measures the businesses could implement to reduce waste and save money. A follow-up site visit provided compliance data to compare against baseline data and thus determine increases in compliance and changes in behavior. Findings9 The contractor made 49 initial site visits to determine small business compliance and pollution prevention and 28 follow-up site visits at participating businesses where noncompliance with any state or federal regulation was documented. Data were collected and management of pollution prevention case studies was used to monitor and track the types of improvements resulting from the site visits. The contractor noted and addressed several common issues during the technical assistance visits to small businesses. These common issues included: The site had not submitted applications for required air permits and was thus not in compliance with air permitting rules. The site had not conducted a waste assessment to determine which, if any, of their wastes were hazardous. The site did not keep required records related to waste generation rates or waste management (e.g., storage schedules). The site had not submitted proper forms to obtain a storm water permit. The site was releasing process wastewater into a local sewer system without properly notifying the system operator. 9A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2000/stagOO-tx-msroutcomes-final.pdf. Grant Innovations at Work -32- January 2005 ------- Results The EPA grant provided partial funding for the site visits conducted in 1999 and 2000. Through the site visit program, estimates of compliance rates before and after the consultant's visit were created based on how the site rated on a sector-specific checklist. Overall, compliance increased from approximately 50 percent before the visit to approximately 90 percent after the visit. In addition, during this period, 18 businesses corrected all compliance issues noted during the site visit and became eligible for the Compliance Commitment Partnership, a program that offers a one-year exemption from scheduled investigations for sites in full compliance with environmental rules. Since the program's inception, its recognition has expanded. Along with the Texas Commission on Environmental Quality, EPA and numerous local environmental enforcement authorities in Texas recognize the one-year exemption from scheduled investigations at sites that demonstrate complete compliance via a site visit. Also, these enforcement authorities have informed the small business program which sectors are likely to be the subject of upcoming investigations so that those groups can be encouraged to achieve compliance via a site visit. These partnerships between the compliance assistance and enforcement units have resulted in significant improvements in compliance rates among small businesses and more efficient use of state resources. The outcomes of this project are: 1. Compliance rates increased from approximately 50 percent before the visit to approximately 90 percent after the visit. 2. In addition, during this same period, 18 businesses corrected all compliance issues noted during the site visit and became eligible for the Compliance Commitment Partnership, a program that offers a one-year exemption from scheduled investigation for sites in full compliance with environmental rules. Grant Innovations at Work -33- January 2005 ------- Analysis of Change in Generator Compliance Using Regulatory Compliance Indicators (RCIs) Washington State Department of Ecology Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: $215,270 Objectives The Washington Department of Ecology's Hazardous Waste and Toxics Reduction (HWTR) program developed a project with STAG funding to test the relationship between inspections and compliance over time. Given all the factors (e.g., cultural and economic) that influence how a company manages its hazardous wastes, HWTR wanted to test whether a correlation could be established between compliance inspections (and technical assistance visits) and regulatory compliance over time. The following three project goals were designed to compare site inspections, both technical and compliance assistance, with generator regulatory compliance over time: 1. Establish a baseline quantitative measure of statewide environmental compliance supported by specific regulatory violation categories that best represent actual or potential environmental threats. 2. Determine if a relationship exists between formal compliance enforcement inspections and regulatory compliance by regulated facilities and, if so, how the relationship changes over time. 3. Determine if there is a relationship between technical assistance visits and good environmental management rates among small quantity generators (SQGs). This goal specifically focused on technical assistance visits in the form of increased generator contact (IGC) visits, conducted primarily at SQGs. Findings10 Following is a summary of the major conclusions reached and suggestions for further action: There is a correlation between generator status and overall environmental compliance, with Large Quantity Generators (LQGs) showing poorer compliance than Medium Quantity Generators (MQGs). HWTR found that the strongest predictor of environmental compliance is generator status. Therefore, since LQGs have significantly more compliance problems than MQGs, the HWTR program should continue making frequent inspections and compliance follow-up of LQGs a priority, and EPA should continue to emphasize inspections of LQGs in its Performance Partnership Agreements (PPAs) with the states. 10A copy of the final report submitted to EPA upon completion of this grant's project can be downloaded at http://www.epa.gov/compliance/resources/reports/stag/fy2000/stagOO-wa-generator-final.pdf Grant Innovations at Work -34- January 2005 ------- For both the LQG and MQG universes, the category with the least violations was the Spills category. In fact, for LQGs there were no spill violations in the sampled facilities and only one violation among sampled MQGs. For both for LQGs and MQGs, the category having the most violations was the Designation category; Container Management violations were also significant for both LQGs and MQGs. Therefore, it is suggested that HWTR make an effort to pinpoint the aspects of designation that are causing the most problems for generators, and then focus educational efforts on those areas; Container Management also needs added attention. Hazardous waste inspections of facilities positively affect compliance with hazardous waste regulations (and thus contribute to protecting the environment). The positive effects of compliance inspections tend to wear off over time, although the deterioration in compliance is minimal for the first few years after an inspection. After about five years, however, the deterioration in hazardous waste compliance becomes more pronounced. Therefore, as resources allow, HWTR should make an effort to reinspect both LQGs and MQGs every five or six years. The best approach to deciding what baseline RCI index to use for any given analysis is to keep in mind the way different baseline indexes are created, and then decide which baseline index is best, given specific knowledge of the facilities to which it will be applied. For all three summary RCI indexes (Yes/No, Categorical, and Absolute), the weighted baseline scores are better than for any of the time-stratified data. This seems to be an anomalous result, since the average date of last inspection for the weighted baseline universe is certainly substantially less recent than 1998; one would expect that the 1998 RCI indexes (and possibly the 1996/97 indexes) would be better than the baseline average. The most obvious explanation is that there is systematic bias in the time-stratified data, the bias being a tendency to target facilities that may have compliance problems. Such systematic bias means that the time-stratified data can be accurately compared between time-stratified groups, but that time-stratified data cannot be accurately compared to data groups not sharing the bias, such as the LQG and MQG baselines; the LQG, MQG, and weighted baselines can be used for comparison to data groups having no systematic bias. For facilities generating relatively small amounts of hazardous waste, compliance technical assistance visits (specifically, Increased Generator Contact visits) appear to be as effective as formal compliance evaluation inspections in maintaining regulatory compliance. Therefore, for relatively small generators, HWTR should continue to put program resources into technical assistance visits for regulatory compliance. Technical assistance visits require fewer resources per visit, and at times, more results can be achieved with the same investment of resources (as compared to formal inspections). Now that HWTR has established statewide baselines or average RCI indexes for regulated hazardous waste generators in the state, many different types of analyses of regulated facilities are possible as a way to target field inspections and enforcement resources more efficiently. For example, HWTR could compare facilities in different geographical regions of the state against the baseline indexes to determine if certain regions need proportionally more resources allocated to field work. Likewise, comparisons of certain types of industries (i.e., specific Standard Industrial Grant Innovations at Work -35- January 2005 ------- Classification codes or groups of codes) with the baseline indices might help focus resources on particular industries. Results The intermediate outcomes of this project are: 1. LQGs have more serious environmental compliance problems than MQGs or SQGs. This new knowledge will allow Washington State to better use its inspection resources by making LQG inspections a priority. 2. Inspection duration: project findings highlighted that approximately every five years is the right frequency for reinspections. This new knowledge will assist Washington State in making reinspection decisions on LQGs and MQGs and may help other states with their own inspection/reinspection resource issues and decisions. Grant Innovations at Work -36- January 2005 ------- IV. Institutional Change and Transferability of Results The previous section of this report described the achievements of grants that have reached completion. Distinct from these achievements, certain grant projects have had far-reaching, systemic effects on the grantees' organization or have produced outputs that other organizations can use. This section of the report examines such effects on institutional change and transfers of outputs to others. Some of the projects highlighted in this section are not complete, but all have been identified by the appropriate subject matter experts and project officers as good examples of either institutional change or transferability of results (i.e., the projects' results or outcomes are likely to have an impact). The project impacts described in this section are based on telephone interviews with the grantees, as well as examination of written materials. The projects are shown below in alphabetical order by grantee. Further details on completed projects can be found in the Results section of this report, and the full final report is available on the STAG Web site. Comprehensive Enforcement Compliance and Measurement System Project Colorado Department of Public Health and Environment (CDPHE) Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: $522,940 Contact: Joe Schieffelin, (303) 692-3356, Phyllis Woodford, (303) 692-3477 CDPHE received STAG funding in 1999 for the Comprehensive Enforcement Compliance and Measurement System (COMPASS) project. The COMPASS project assesses the department's enforcement and compliance assistance activities and is comprised of six individual pilot projects being conducted across media. The pilot projects focus on different business and industrial sectors and measure the results of various approaches to compliance assurance. The goal of the COMPASS project is the statistically valid measurement of the results and effectiveness of each approach. Ultimately, the project will result in the creation of a database and a final report. CDPHE originally developed this project as a multimedia experiment on various aspects of compliance assurance. The Air Division undertook asphalt and chrome sector projects, the Water Division completed a drinking water supply project, and the Hazardous Waste Division implemented a RCRA Small Quantity Generator (SQG) project and a data collection project. CDPHE also used the grant for the design of software that would query all media databases and generate reports that were activity- specific rather than facility-specific. The most ambitious project was in the asphalt sector, where CDPHE's Air Division worked with the Colorado Asphalt Paving Association and set aside that sector from enforcement during the pilot. Forty companies with a total of more than 60 facilities participated. For this project, the Air Division carried out a preliminary multimedia compliance assessment, worked with the companies to attain compliance, Grant Innovations at Work -37- January 2005 ------- and performed a follow-up assessment a year later. This approach was resource-intensive, but highly successful. For the SQG pilot, the Hazardous Waste Division used 60 facilities divided into three groupsone set to serve as a control, one set to receive notification that they would be inspected, and one set to receive guidance documents along with the notification of inspection. The Hazardous Waste Division perceived a small improvement in compliance between the control group and the group that was notified of an upcoming inspection. However, the Division saw no difference between the group that was notified of an upcoming inspection and the group that was notified and provided with compliance assistance materials. Therefore, the Division concluded that passive delivery of compliance assistance added no benefit to compliance rates compared to simply notifying a facility of an upcoming inspection. This finding is important because it will enable the Division to focus time and resources on other compliance assistance efforts that have better results. For the water pilot, the Water Quality Control Division (WQCD) hired a contractor to conduct comprehensive performance evaluations (CPEs) at 28 surface water treatment plants to identify performance limiting factors (PLFs). PLFs are any direct or indirect aspects of a surface water treatment plant operation that can negatively affect the performance of the plant operation, and as a result, the treated water quality. For example, one PLF that the contractor found at several facilities was the lack of disinfection to handle the peak or design flow for the treatment plant. The result of the pilot was an analysis of the number and type of PLFs identified and the percentage of the facilities that took action to eliminate those PLFs based on compliance assistance efforts (e.g., telephone interviews with the facilities about two years after the CPE). WQCD plans to continue this pilot by visiting each of the surface water treatment plants to verify the information gathered in the follow-up telephone calls. The Division also plans to extend the pilot to 41 other surface water treatment plants in Colorado. The other pilot in the Hazardous Waste Division (which is a possible example of institutional change) is the data collection pilot. The division staff had been gathering data on violations in seven categories that they needed to report each year to EPA, but they realized that those data were not very informative because the categories were too broad. The division staff have changed the way they categorize the same data and now collect data on approximately 50 groupings. Inspectors now check for violations on each specific requirement. The change in number of categories is permanent and works very well. The expanded data groupings provide more precise information about violations so that the division can now target compliance assistance more precisely. Another example of institutional change is the asphalt pilot project. CDPHE is interested in replicating the concept to other sectors: focusing on a sector and trying to bring it into compliance through initial assessments and then ongoing monitoring. The format and concept can be applied to any regulated program and to any sector. The Water Division will try this concept next, and the CDPHE is considering it for agencywide use. The other component of the COMPASS project is the development of a database query capability across media. Rather than being facility-based (i.e., designed to pull up information on a facility), this Grant Innovations at Work -38- January 2005 ------- cross-media query capability is activity-based (e.g., queries based on types of violations or number of inspections). Although CDPHE staff are still learning how to fully exploit this query capability, it already allows CDPHE to determine what the activities are and what their effects are. The query software's design is Internet-based and very transferrable, and is considered excellent. Other states will want to use the database query capability simply because it is a useful tool to pull cross-media data that can illustrate progress on environmental outputs, outcomes and conditions. Grant Innovations at Work -39- January 2005 ------- Prototype for Sector-based Outcome Measurement (Auto Salvage Facility Sector Project) Indiana Department of Environmental Management (IDEM) Grant period: 2000-2001 Funding area: Outcome Measurement Grant amount: $190,000 Contact: Pam O'Rourke, (317) 232-4464 IDEM received STAG funding to develop a sector-specific model for outcome-based performance measures. The auto salvage facility sector was selected for this project because this sector has considerable compliance issues. The performance measurement tools used in this project include both output and outcome measures. The output measures are: Number of compliance assistance manuals distributed Number of workshops offered and number of people trained Number of "hits" on the proj ect Web site Number of presentations made to external stakeholders and interested parties Number of on-site audits requested and number of multimedia inspections conducted Number of enforcement actions issued Number of facilities invoking use of IDEM's Self-Audit Policy Number of referrals made to other local, state, and federal agencies Number of criminal referrals made Some of the outcome measures used for this project are: Behavioral changes (e.g., was the facility recycling certain materials prior to the workshop; if so, what were they recycling, and did they anticipate making changes to their recycling efforts?). To measure these changes and determine the effectiveness of the workshops, the results of pre- and post-workshop surveys will be compiled. The change in storm water compliance rates, determined by comparing the number of facilities submitting their Notice of Intent prior to the compliance assistance activities and after. The amount of contaminated soils remediated as a result of enforcement actions taken. Department staff have gathered facility location information and entered it into a project database; created compliance assistance tools in the form of a multimedia inspection checklist, manual, workshops and Web site; and conducted 11 compliance assistance workshops throughout the state. At Grant Innovations at Work -40- January 2005 ------- the conclusion of the compliance assistance phase, IDEM conducted the inspection phase, consisting of a minimum of 50 multimedia targeted inspections. As the final stage, IDEM will take enforcement actions where appropriate. IDEM expects that results of the project will be a marked increase in the compliance rates of the auto salvage facility sector, accomplished through the project's compliance assistance, inspection and enforcement efforts. Most, if not all, of the project results will be easily transferable to other states, tribes, and EPA regional offices (depending upon available resources). The phased approach upon which the project is based (compliance assistance, compliance monitoring, and enforcement) is very transferable because most states, tribes, and EPA regional offices include each of these components in their organizational structures. The multimedia approach used for this project can also be easily replicated, depending upon the statutory authorities available in tribes and states. The multimedia inspection checklist generated as part of this project is also transferable, but would need revision to reflect specific tribal or state authorities and rule citations. The software packages used for development of the database, compliance assistance materials, and inspection targeting are widely available. The comprehensive final report that IDEM will prepare at the conclusion of this grant will serve as a useful reference for states, tribes, and EPA regional offices in replicating this project. In the final report, IDEM will also discuss the efficacy of using the auto salvage facility sector as the prototype model to address compliance issues associated with other sectors. Grant Innovations at Work -41- January 2005 ------- Public Access to Compliance and Enforcement Milestone Events Kentucky Division of Waste Management (KDWM) Grant period: 2000-2001 Funding area: Public Access Grant amount: $200,000 Contact: Barbara Cornett, (502) 564-6716, barbara.cornett@ky.gov KDWM received STAG funding to make RCRA information more accessible to the public and to states, regions and tribes. The RCRA Information System (RCRAInfo), operated and maintained by EPA, houses information on facilities and their compliance with the hazardous waste program. Currently, RCRAInfo has very few compliance and enforcement reports available for users; the reports that are available have limited selection functionality, making it impossible for a user to focus on a particular facility or company. In addition, RCRAInfo contains sensitive enforcement information. Reports developed for agency use are not suitable for distribution to the public under the Freedom of Information Act (FOIA); however, there is a need to provide valuable information that is currently maintained in the Compliance and Enforcement Module of RCRAInfo to the public in a format that protects confidentiality. The project was designed to provide valuable enforcement and compliance assurance information to the public. The activities of the Public Access to Compliance and Enforcement Milestone Events (PACE-ME) project, were to: Identify data quality issues in the compliance and enforcement data by developing data assessment reports. Identify all significant noncompliers (SNCs) in the state and ensure that all data are accurately reported in RCRAInfo. Identify compliance and enforcement information stored in RCRAInfo that should be accessible to the public because it is not considered sensitive. Develop standard reports that can be used in any state, for any region or nationwide to report the compliance and enforcement history of either a specific hazardous waste generator, transporter, recycler, burner/blender or facility or all entities operating nationwide under a specific company name. Develop standard reports that can be used in any state, for any region or nationwide to report the compliance history of all facilities meeting the criteria selected. Make these reports available on the Internet. The aim of PACE-ME is to share certain information with the public and to develop reports drawing information from RCRAInfo that could be used in any state, regional or national program. Under PACE-ME, KDWM staff will pull information from RCRAInfo every quarter and post it on Kentucky's Web site. This will allow the public to view compliance and enforcement data concerning Grant Innovations at Work -42- January 2005 ------- local facilities 24 hours a day, seven days a week. The reports from RCRAInfo give KDWM much- needed standard reporting capability and flexibility to pull compliance and enforcement information based on specific requests. As a result of PACE-ME, KDWM will be able to respond more promptly to requests for compliance and enforcement data that are stored in RCRAInfo. The public reports are the: Enforcement action report List of SNCs (without subsequent formal enforcement action) Violations and enforcement actions Violations out of compliance report Facilities not inspected report Compliance summary report Timely and appropriate report The division also completed some data quality reports on the front end to ensure that the correct data are reported before extracting data for the public. These will be extremely useful for reviewing data within RCRAInfo to verify that what is posted for public viewing is accurate. These data quality reports are primarily for state purposes, but can also be used by other states, regions, tribes or EPA headquarters. The data quality reports are the: Violation of compliance schedule Potential recalcitrant violations Penalty/payment verification Violation data verification KDWM will share the results of PACE-ME. The reports created by the project will be available within RCRAInfo for registered users of that database. The reports will be available to the public via an EPA public Web site. In May 2004, EPA posted the reports on RCRAInfo and the public Web site. RCRAInfo users will be able to locate the reports on the Shared Reports page of RCRAInfo. The selection criteria developed will enable states, regions, tribes and headquarters to generate reports that are specific to their needs. Due to the reports' flexibility, citizens across the nation will be able to access information about facilities in their area or nationwide to view specific compliance and enforcement data. Grant Innovations at Work -43- January 2005 ------- Development of a Universal Interface for the Aerometric Information Retrieval System Facility Subsystem Northeast States for Coordinated Air Use Management (NESCAUM) Grant period: 2000-2001 Funding area: Data Quality Grant amount: $100,000 Contact: Lisa Rector, (802) 899-5306 Final Report Available at http://www. epa.gov/compliance/resources/reports/stag/fy2001/stag01- nescaum-afsui-final.pdf The goal of this project was to construct an easy-to-use data translator for the Air Facility System (AFS). This data translator, known as the Universal Interface (UI), allows for the seamless transfer of compliance and enforcement data from state systems to the federal database, AFS. Benefits of this system include the following: (1) eliminates the need to perform duplicate data entry; (2) reduces time and resources spent on the mainframe related to the AFS batch job cycle of upload, submit, review, correct; (3) increases quality and breadth of data reported; (4) allows timely identification and correction by the agency; (5) uses a browser as an interface, which provides a user-friendly environment and makes data sharing easy. This project worked with the outdated UI that EPA had developed in 1996. NESCAUM converted the system into the Web-based, user-friendly, and more robust UI. The UI not only simplifies transfer of data coming from states to EPA systems, but also includes validation checks to ensure quality and makes the data easier to use. Although EPA still owns the database, NESCAUM is making continual upgrades to it and is receiving additional STAG funding to expand the UI's capabilities and support users. NESCAUM's software contractor supports the implementation of the system in states. Benefits of this system are that it: (1) eliminates the need to perform duplicate data entry; (2) reduces time and resources spent on the mainframe related to the AFS batch job cycle of upload, submit, review, correct; (3) increases quality and breadth of data reported; (4) allows timely identification and correction by the agency; and (5) uses a browser as an interface, which is a user-friendly familiar environment and makes data sharing easy. States are not required to use the UI, but it is to their benefit if they maintain their own data systems that need to feed into AFS. If they do not use the UI, state agencies need to re-enter data into the EPA's system. This duplicate data entry presents data quality issues, among other problems. States that use Tempo software are not currently able to use UI, but most others can. Louisiana is actively working toward integration with its Tempo system, and it is hoped that what Louisiana learns will be transferable to other states that use Tempo. There are 200 local air pollution control programs that need to report into AFS. The elimination of double data entry for the agencies that use the UI is an example of a major institutional change. These agencies re-examined how they managed their data and saved a significant Grant Innovations at Work -44- January 2005 ------- amount of resources. The benefits of using the UI are significant, but its use does require an up-front investment in time to ensure that the agency's data system has the minimum data required for federal reporting and that these data can be extracted as needed. NESCAUM has shared the results of this project by making the UI available to all agencies that submit data to AFS. This project has increased the quality of data transferred from states to EPA, and has reduced the amount of time it takes states to get data to EPA. Grant Innovations at Work -45- January 2005 ------- Measuring the Effectiveness of Partial Inspection, Risk-Based Facility Targeting, and Compliance Activities New Hampshire Department of Environmental Services (NHDES) Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: Total EPA Grant Award to NHDES = $185,000: $100,000 for the Outcome Measurement component of the project, and $85,000 subcontracted to NEWMOA for related work on a regional hazardous waste compliance measures project and continued development of the pollution prevention metrics database Contact: Gretchen Rule Hamel, (603) 271-3137 Final Report Available at http://www. epa.gov/compliance/resources/reports/stag/fy2000/stagOO- nh-rcrainsp-final.pdf NHDES has made substantial progress in its Compliance Measures Project. (NHDES has contracted with NEWMOA to perform this grant.) In the current phase, NHDES is developing a compliance indicator survey that can be used to establish a baseline compliance rate for hazardous waste generators, and in future years to measure changes as a result of specific NHDES interventions. The compliance indicator survey is a set often questions covering compliance, pollution prevention and beyond-compliance areas. The compliance questions relate only to hazardous waste management, and were selected as indicators of compliance in the regulatory areas of waste determinations, inspections, labeling, container management, preparedness and prevention, and training. The collected data will be inputted into an Oracleฎ database that is being developed as part of the project. The database will allow the collected data to be analyzed based on a variety of parameters, such as generator size, generator location (by municipality, county and whether it is in a wellhead protection area), date of the facility's last Resource Conservation and Recovery Act (RCRA) inspection and responses to individual questions. New Hampshire has shared the results of this project, and several states (Connecticut, Oregon and Maine) are now implementing similar processes in their RCRA programs. They will use the same core questions, working out language that will be applicable to all states. Implementing the same compliance survey in many states will allow better analysis of compliance across states and will help identify comparative strengths; for example, if a state has a high compliance rate in one area, others can look at that state's approach as a model and apply it themselves. NHDES is currently using this survey to establish baseline compliance rates and trends resulting from new programs, but the survey also has potential for use as a screening tool. Most states have no reconnaissance or screening inspections to screen out facilities that do not need full inspections, and some states are interested in using the "scout with surveys" method to target full inspections to facilities that have the most compliance issues. Currently, the surveys do not result in any enforcement actions. These types of compliance evaluations (the "scout with surveys" method) can allow states to reach many more facilities than they otherwise would. Grant Innovations at Work -46- January 2005 ------- So far, the institutional change resulting from the survey approach has not permeated any other (non-RCRA) programs at NHDES. The survey approach only works well for sectors with a large number of facilities, programs with a small staff, and programs with a number of objective criteria that can be applied in the form of a brief checklist - attributes not currently found in other NHDES programs. Grant Innovations at Work -47- January 2005 ------- Class V Underground Injection Control - Compliance Assistance New Mexico Environment Department (NMED), Ground Water Quality Bureau Grant period: 2000-2001 Funding area: Outcome Measurement Grant amount: $145,364 Contact: Maura Hanning, (505) 827-2945, maura hanning@nmenv. state.nm.us NMED received STAG funding to perform compliance assistance and implement outcome measurements for large capacity septic tank/leach fields (LCSTLFs), which receive more than 2,000 gallons a day of domestic wastewater and are classified as Class V wells under the Safe Drinking Water Act's Underground Injection Control (UIC) program. Under the UIC program, a ground water protection permit is required for each Class V septic system. At the start of this project, there were approximately 130 permitted LCSTLFs, approximately 58 percent of which were out of compliance with respect to operational, monitoring or ground water standards required in their permits. Even though the population of LCSTLFs is small, the data collected do support the premise that compliance assistance actions are successful in bringing sites into compliance. Over the period of the study, compliance activities taken by staff resulted in a 50 percent reduction of sites characterized as out of compliance. A single compliance assistance action in writing has been successful in bringing most permit holders into substantial compliance. The action-specific performance measures that NMED is tracking for this grant project require significant manual counting and evaluation, which will not be feasible to undertake when measuring compliance assistance outcomes for the 805 ground water protection permits that NMED issues and oversees. In addition, compliance tracking of the facilities is difficult due to their tendency to go in and out of compliance even during a single calendar quarter. The STAG-funded project has helped NMED manage resources more wisely by helping the agency make better permitting decisions. As a result, NMED will know when it can allow a septic tank leach field. Some of the compliance assistance outcome measures used were as follows: Changes in awareness or understanding of regulations or compliance: Qualitative improvements such as improved owner cooperation and reduction in complaints from neighbors, determined by surveying NMED staff. Behavioral changes: Number of facilities that have taken at least one action to comply with the regulations. Percentage increase of facilities in compliance with operating, monitoring and reporting requirements. Number of facilities added to the Class V UIC Inventory. Grant Innovations at Work -48- January 2005 ------- Number of unpermitted facilities that receive ground water protection permits. Decrease in the number of days needed to issue ground water protection permits to Class V septic systems. Environmental or human health improvements: Number of facilities making system upgrades due to compliance assistance that result in a decrease of ground water contamination. Number of facilities where improved monitoring and reporting due to compliance assistance results in identification of ground water contamination. NMED has made definite and permanent institutional changes as a result of this project. Although NMED has not yet tallied the data to determine which compliance methods seemed most and least successful, preliminary findings appear to indicate that writing compliance letters is more effective than making phone calls or discussing compliance face-to-face during inspections. As a result of the preliminary findings, NMED has taken many more written compliance actions for various site types that it regulates, not just the LCSTLFs. In addition, NMED has found that other factors, such as the type of violation, style of the reviewer, and economic or educational level of the permit holder, may be better indicators of the likelihood of success than the type of action taken. NMED has also distributed educational outreach pamphlets that give permit holders step-by-step instructions for sampling monitoring wells. Permit holders for septic tank leach fields are now doing more sampling, and compliance with the sampling and monitoring requirements has noticeably improved. However, violations of permits and the regulations remain a concern at sites with septic tank leach fields. Also, the compliance rate for sites with ground water contamination has declined due to the increased identification of sites with known ground water contamination. Permit holders for such sites are required to take corrective action to prevent ongoing ground water contamination by connecting to municipal sewer systems or changing to on-site advanced treatment units. To expand this approach to other sectors, NMED will add a public relations professional to its staff to find information that other states have developed for their ground water protection programs and to create some new outreach materials targeted to problem sectors. The UIC program staff feel that outreach and public relations efforts would be especially helpful to this program because they deal with many unsophisticated permit holders, who generally cannot afford to hire consultants. Grant Innovations at Work -49- January 2005 ------- Measurement of Effectiveness of On-Site Inspection with Nonregulatory Follow-up by Industry Sectors South Carolina Industrial Ecology Program at the University of South Carolina, School of the Environment Grant period: 2000-2001 Funding area: Public Access Grant amount: $74,729 Contact: LeAnn Herren (803) 777-9061, herren@environ.sc.edu The University of South Carolina Center for Environmental Policy (CEP), through the Trident District Office of the South Carolina Department of Health and Environmental Control (SCDHEC), began the first sector-based, targeted compliance assistance program under a grant from the EPA regional office's Environmental Justice Through Pollution Prevention (EJP2) Program. Originally, the project only targeted small auto body shops located in the North Charleston area. The success of the original project led SCDHEC to expand the compliance assistance program to trucking companies and private transportation firms with STAG funding. This program consisted of five steps: 1. Trident SCDHEC employees performed an on-site compliance inspection of a facility. 2. Trident SCDHEC sent a letter of noncompliance status to the facility with referral to CEP's compliance assistance program. (In-compliance firms were referred to the state pollution prevention program for beyond-compliance work.) 3. CEP supplied free, nonregulatory assistance to noncompliant companies to help them attain compliance within the 45-day window for attainment. 4. Trident SCDHEC employees performed a follow-up compliance inspection. 5. Trident SCDHEC sent a letter of compliance or noncompliance to the facility. Early data indicate that of the 52 firms inspected, 32 were found to be out of compliance with SCDHEC regulations. At this time, approximately 90 percent of the firms have attained compliance, with work ongoing at the remaining firms. Following on the Trident District's success, SCDHEC is reorganizing to create a statewide compliance assistance program that will include a telephone number that facilities can call for advice without confrontation. The state agency's pollution prevention (P2) unit used to be an entirely separate group, which only assisted facilities that were already in compliance. Now SCDHEC staff will receive cross- training in compliance issues and P2, as well as other media programs. The agency is also considering training all the regulatory staff on P2 as well. The P2 program is thus becoming a compliance assistance program, which is a significant positive development. Partly as a result of the STAG project, the state agency staff have learned that they can provide useful help to a facility that is not in compliance with P2 and other measures, and that it is therefore important to integrate these functions. Grant Innovations at Work -50- January 2005 ------- Analysis of Change in Generator Compliance Using Regulatory Compliance Indicators Washington State Department of Ecology Grant period: 1999-2000 Funding area: Outcome Measurement Grant amount: $215,270 Contact: Elliot Zimmerman, (425) 649-7072, ezim461@ecy.wa.gov Final Report Available at http://www. epa.gov/compliance/resources/reports/stag/fy2000/stagOO- wa-generator-final.pdf This project compared technical assistance and compliance site inspections with regulatory compliance of generators by: (1) establishing a statewide measure of environmental compliance supported by specific regulatory violations that best represent actual or potential environmental threats; (2) determining if a relationship exists between formal Compliance Enforcement Inspections and regulatory compliance by regulated facilities and, if so, how the relationship changes over time; and (3) determining if there is a relationship between technical assistance visits and compliance visits and if so, its effect on the compliance rate of small quantity generators (SQGs). The results of the project indicate that the Hazardous Waste and Toxics Reduction (HWTR) staff can use inspection and compliance data to measure industry performance over time and to target technical assistance and regulatory compliance efforts. The data presented show that reliable baseline quantitative measures of hazardous waste compliance have been established, and that a relationship appears to exist between compliance enforcement inspections and regulatory compliance (Project Goals One and Two). Specifically, data strongly suggest that noncompliance rates increase over time since the last inspection. As for Project Goal Three, the data show that SQGs appear to have a higher rate of compliance than medium or large generators of waste (MQG or LQG facilities). Though the SQG compliance rate is relatively high, a relationship of the effectiveness of the IGC visits compared to the effectiveness of compliance inspections has not been clearly shown. A number of factors, including different levels of involvement by Moderate Risk Waste (MRW) programs and their localized impact on SQG compliance rates, may need to be taken into consideration when evaluating the effectiveness of technical assistance compliance visits by the Washington State Department of Ecology. It is worthwhile to continue coordinating future SQG technical assistance efforts, including IGCs, with regional MRW programs. The most substantial institutional change resulting from this STAG project is that the HWTR staff has begun to use five years as the benchmark for reinspection because after this time the data indicate a substantial falloff in compliance. Previously, there was no benchmark. The establishment of a benchmark is intended to target fieldwork and better allocate the HWTR program's resources. The project has also assisted HWTR in targeting resources by revealing that certain sectors have more violations; for example, LQGs are now known to present a more significant compliance problem than MQGs, which was not what HWTR staff had previously assumed. This finding has led them to continue allocating resources to LQGs, rather than focusing resources on MQGs. Grant Innovations at Work -51- January 2005 ------- HWTR also uses the more traditional regulatory compliance indicators to search for specific violations (spills, container management and two others) and reviews them periodically. Grant Innovations at Work -52- January 2005 ------- Appendix: Abstracts of All Funded Projects ------- Grant Innovations at Work Capacity-building STAGs: 1999-2002 Funding Area: Data Management Grantee Arizona Department of Environmental Quality Grant Title Streamlined Enforcement and Compliance Reporting Grant Cycle FY2002 Grant Amoun $150,000 Abstract The Arizona Department of Environmental Quality (ADEQ) proposes to streamline its environmental enforcement and compliance reporting to the Permit Compliance System (PCS) and to the Air Facility System Universal Interface (AFS-UI). To accomplish this, ADEQ will enhance the agency's enterprise database, AZURITE, to output files that are compliant with PCS and AFS-UI file formats. Currently most of the information is entered twice into AZURITE and again into EPA's systems. Grantee Hawaii Department of Health Grant Title Establishing the Compliance Database and Air Facility Subsystem-Universal Interface (AFS-UI) for Hawaii Grant Amoun $95,000 Grant Cycle FY2002 Abstract The project goal is to establish an electronic data management system to assist the Hawaii Department of Health Clean Air Branch (CAB) in managing compliance and enforcement data and to fully integrate and utilize the Air Facility Subsystem (AFS) B Universal Interface (Ul). This will allow CAB to efficiently manage the compliance and enforcement data in an electronic format, automatically upload the data to the Aerometric Information Retrieval System (AIRS) via the AFS-UI, and quickly locate and extract requested data. Grantee Kansas Department of Health and the Environment Grant Title Regular Transfer of Data from Kansas Department of Health and Environment Data Base to EPA's Permit Compliance System Grant Cycle FY2002 Grant Amoun $92,500 Abstract The Kansas Department of Health and Environment (KDHE) administers the National Pollutant Discharge Elimination System (NPDES) program in the state of Kansas. KDHE maintains a number of databases to manage this program. These databases contain the working files for KDHE and are updated daily to keep the information current. Because of limited manpower and the difficulties of communicating with the Permit Compliance System (PCS) database, only a small portion of the data in KDHE database is routinely uploaded to PCS. The project goal is to routinely upload new and changed data from the KDHE databases to the PCS database to keep it current. The primary project component will be a computer program which will query the KDHE databases and manipulate the data in such a way that it can be loaded into PCS. Page A-1 ------- Funding Area: Data Management Grantee Montana Department of Environmental Quality Grant Title Database Integration Grant Cycle FY2002 Grant Amoun $175,000 Abstract The Montana Department of Environmental Quality (MDEQ) database integration project is a continuation of MDEQ's efforts to integrate and develop the necessary databases to provide environmental information to decision makers and the public in a manner that allows a comprehensive view of environmental impacts, compliance status and regulatory actions across media lines. Beginning in 2000, MDEQ began developing an Oracle-based enterprise-wide database system to integrate the agency's existing disparate environmental data systems. The enterprise system is based on the EPA Facility Identification Template for States (FITS) data model which will be used to link permits, inspection reports, and enforcement actions between facilities and sites. This integration of multimedia compliance and enforcement data will improve MDEQ's multimedia targeting, reporting, and compliance assurance capabilities. Grantee San Joaquin Valley Air Pollution Control District Grant Title Compliance Data System Modernization Project Grant Amoun $104,000 Grant Cycle FY2002 Abstract The Compliance Data System Modernization Project will develop new compatible data management tools and software that will create standard AFS batch format data to upload data to AIRS. Region IX has provided samples of the batch format and will be serving as advisor for this part of the project. Additional data management capability will also be developed to track Title V deviations, reports of required monitoring, and annual compliance certifications. Facility level data is currently stored in PAS and will continue to be maintained in AIRS. Grantee Virginia Department of Environmental Quality Grant Title Transfer of Water Permit Data to EPA's Permit Compliance System Grant Amoun $70,080 Grant Cycle FY2002 Abstract Virginia Department of Environmental Quality's (VADEQ) goals are to achieve a reduction in the resources required to manage data while maintaining or improving the quality of the data transferred by: 1) Reducing common data entry errors; 2) Reducing manual overrides in PCS; 3) Reducing the time necessary to research and correct rejected data; 4) Generating as good or better data quality; 5) Increasing accuracy of reports; and 6) Increasing knowledge of PCS among regional staff. Page A-2 ------- Funding Area: Data Quality Grantee Arizona Department of Environmental Quality Grant Title Arizona Unified Repository for Informational Tracking of the Environment (AZURITE) Grant Cycle 2000-2001 Grant Amoun $135,000 Abstract The Arizona Department of Environmental Quality developed a compliance assistance module for the agency's integrated Inspections, Compliance and Enforcement Database. Furthermore, the agency also created an electronic reporting pilot aimed at transferring the discharge monitoring report data electronically from the State's Azurite Database to EPA's PCS Database. Grantee Bay Area Air Quality Management District Grant Title (Bay Area) Development of a Data Translator Grant Amoun $50,000 Grant Cycle 2000-2001 Abstract The objective of this project is to facilitate restoration of monthly/daily HPV data transfer to AIRS/AFS. This transfer was halted when the Bay Area Quality Management District realized Bay Area's unit-by-unit tracking needed to be converted to facility-based reporting with monthly-grouped HPVs for better national consistency in AIRS, IDEA, SFIP, RECAP and NPMS. Bay Area HPV data will be loaded from diverse databases into a Microsoft Access model. The model will sort and group the data with dependency relationships based on date and plant information. The data will then be formatted for AIRS batch update and submitted to AIRS/AFS. Grantee Louisiana Department of Environmental Quality Grant Title Development of EPA/State Interfaces Grant Cycle 2000-2001 Grant Amoun $200,000 Abstract The Louisiana Department of Environmental Quality (LDEQ) is proposing to design and implement "Tools for Environmental Management and Protection Organizations" (TEMPO) software system. TEMPO is an integral part of the Integrated Data Management System (IDMS) being implemented at LDEQ. This system is used to track facilities, people, and organizations of interest to the department, and to track tasks such as permitting, surveillance, and enforcement activities with LDEQ. This grant will be used to fund the AIRS state/EPA interface that will be directly transferable to any state that has TEMPO or a data system built along TEMPO'S data structure. Lastly, by developing this interface, the department and EPA will be able to share "lessons learned" among all fifty states. Page A -3 ------- Funding Area: Data Quality Grantee Maine Department of Environmental Protection, Bureau of Land and Water Quality Grant Title Computerized Wastewater Discharge Data Collection and Analysis System (E-DMR) Grant Cycle 2000-2001 Grant Amoun $180,000 Abstract The operators of Maine's wastewater treatment facilities collect and report a complete set of data regarding the actual discharge of pollutants to state waters. Only a fraction of the data collected is actually stored in EPA's Permit Compliance System (PCS) database. In addition, the data entered into the PCS system are prone to errors. A single piece of data may be transferred between forms several times and then entered into a database system with no real-time error-trapping capability. The limited use of this data constrains day-to-day regulatory decision-making, the effectiveness of compliance monitoring, and the ability to perform program planning based on discharge trends or the efficacy of our regulatory programs. The Maine Department of Environmental Protection (MeDEP), with cooperation from the Maine Bureau of Information Services, is developing a web-based data entry system with an underlying database management system that will do the following: 1) Provide a user-friendly interface for the direct entry of discharge monitoring data by wastewater facility operators; 2) Provide a system that will increase data integrity by significantly automating Quality Assurance/Quality Control functions; 3) Provide regulators with a complete set of discharge parameter and facility process data; 4) Insure that data filed by the operators are complete or that the appropriate No Data Indicator (NODI) codes have been entered; and 5) Provide an automatic transfer of data from the MeDEP database to EPA's PCS database. Grantee Mississippi Department of Environmental Quality Grant Title Enforcement and Compliance Assurance Assistance Agreement Grant Amoun $56,346 Grant Cycle 2000-2001 Abstract The Mississippi Department of Environmental Quality (MDEQ) is proposing to perform a facility and database review of its systems and identify any erroneous or incomplete data. MDEQ will correct the compliance and enforcement data and input it into the appropriate federal database. MDEQ will synchronize the federal and state-specific databases on a monthly basis: discrepancies will be noted and corrected. Also, MDEQ will develop a training program for its Permitting and Compliance and Enforcement staff to ensure that future data is as complete and correct as possible. This training will be conducted on an annual basis. Grantee Mississippi Department of Environmental Quality Grant Title Exchange of Permit Compliance System Data from Mississippi's System to EPA Grant Amoun $200,000 Grant Cycle 2000-2001 Abstract It is the goal of MDEQ to share more accurate and more comprehensive enforcement and compliance data with EPA by providing information from its internal integrated information management system (enSite) to EPA for its regulatory program needs. In support of this, MDEQ proposes to develop necessary enhancements and modifications to support MDEQ's compliance assurance processes for its water program. In full support of IDEF, MDEQ will develop a state conversion program from MDEQ's enSite System to IDEF/PCS. Page A-4 ------- Funding Area: Data Quality Grantee Missouri Department of Natural Resources Grant Title Hazardous Waste Enforcement Data Quality Improvement Project Grant Cycle 2000-2001 Grant Amoun $53,261 Abstract The principal objective of this project is to improve the inspection and enforcement data in the computer systems used by the Hazardous Waste Enforcement Section of the Missouri Department of Natural Resources (i.e., RCRAInfo, Enforcement Tracking System, and the Hazardous Waste Program's Inspection and Enforcement database). We will document alterations made, identify areas for more efficient and accurate data entry and reporting, and produce a findings report to share with state and EPA enforcement staff and managers. Grantee NESCAUM: Northeast States for Coordinated Air Use Management Grant Title Development of a Universal AIRS/AFS Interface Grant Amoun $100,000 Grant Cycle 2000-2001 Abstract The goal of this project is to construct a modern, easy-to-use, data translator for the Aerometric Information System Facility Subsystem (AIRS/AFS). This data translator, known as the Universal Interface (Ul) allows for the seamless transfer of compliance and enforcement data from state systems to the federal database AFS. Benefits of this system include the following: 1) Eliminates need to perform duplicate data entry; 2) Reduces time and resources spent on the mainframe related to AFS batch job cycle of upload, submit, review, correct; 3) Increases quality and breadth of data reported; 4) Allows timely identification and correction by the agency; 5) Uses a browser as an interface which is an user-friendly famili environment and makes data sharing very easy. Grantee New Jersey Department of Environmental Protection Grant Title Interim Data Exchange Format (IDEF) Translator Grant Cycle 2000-2001 Grant Amoun $150,000 Abstract USEPA and the state of New Jersey have agreed to participate in the joint development of an Interim Data Exchange Format (IDEF) through which the State could provide New Jersey Pollutant Discharge Elimination System (NJPDES) permit and compliance data to the current federal wastewater Permit Compliance System (PCS) database. The money requested in this grant would be used to fund New Jersey portion of this project. Since New Jersey has developed a new permit and compliance information management system, the ability to export data to older EPA databases has been adversely impacted. New Jersey's old NJPDES system had the ability to export data and related fields to the old PCS system but DEP's mainframe system will no longer be used once our new client sever system has been completed. EPA is also planning to modernize its PCS system. This further complicates the data exchange problem, as the designated format for exchange between the state and federal systems is a moving target until the modernization effort is complete. The purpose of IDEF is to enable states to submit their NPDES data to PCS without considering the idiosyncrasies in PCS's data and functional architectures and without making a large investment in an interface that may soon be obsolete. Once the format for IDEF is completed, states will develop programs to extract data from their databases and convert that data to the IDEF format. The EPA will then be able to pull the data out of IDEF and into the existing PCS. It is anticipated that with minor modifications the IDEF will work with the soon-to-be modernized PCS database as well. Page A -5 ------- Funding Area: Data Quality and Public Access Grantee Colorado Department of Public Health and the Environment Grant Title Electronic Reporting of Environmental Information Contained in the Discharge Monitoring Reports (DMRs) Grant Cycle 2000-2001 Grant Amoun $123,600 Abstract The goal of this project is to implement electronic reporting of data contained in the Discharge Monitoring Reports (DMRs) from entities permitted under the National Pollutant Discharge Elimination System (NPDES) to the Water Quality Control Division of the Colorado Department of Public Health and Environment. This will be accomplished by creating an electronic reporting repository to enable process water permittees and/or laboratories to submit data over the internet using a web form, or directly from their automated system using electronic data interchange. Grantee Delaware Department of Natural Resources and Environmental Control Grant Title Integrated Environmental Information System for Enforcement and Compliance Assurance Assistance Agreement for Data Quality and Public Access Grant Cycle 2000-2001 Grant Amoun $215,000 Abstract This grant was intended to accomplish the following tasks: (1) Verify manually the compliance, enforcement, and permit data in RCRIS (Resource Conservation and Recovery Act Information System) with paper records to clean up the existing data; (2) Create modules in the integrated Delaware Environmental Information System (EIS) for storing RCRA (Resource and Recovery Act) permit, compliance, and enforcement data; (3) Create modules for importing underground tank permits and enforcement and compliance data into EIS; and (4) Create a converter for the automatic export of data from EIS to the Permit Compliance System (PCS) and RCRIS. In addition, Delaware Department of Natural Resources and Environmental Control (DNREC) has already developed its integrated Environmental Management System (EMS), an Internet-based interactive Geographic Information Systems (CIS) application that allows the public to access information about most sites of interest to DNREC. Information in this website includes location, basic site description, monitoring activity summary, contact information, web links to related information, and ratings of each site's propensity to contaminate by media and contaminant class. Grantee Kentucky Division of Waste Management Grant Title Public Access to Compliance and Enforcement Milestone Events (PACE-ME) Grant Cycle 2000-2001 Grant Amoun $200,000 Abstract Currently the Resource Conservation and Recovery Act Information System (RCRAInfo) has very few compliance and enforcement reports available for users; the reports that are available have limited selection functionality. In addition, this database contains sensitive enforcement information; reports developed for agency use are not suitable for distribution to the public under the Freedom of Information Act (FOIA). However, there is a need to provide information that is currently maintained in the Compliance and Enforcement Module of RCRAInfo to the public in a format that protects confidentiality. The project goals are the following: (1) To identify data quality issues in the compliance and enforcement data by developing data assessment reports; (2) To identify all Significant Non-Compliers (SNCs) in the state and ensure that all data are accurately reported in RCRAInfo; (3) To identify compliance and enforcement information stored in the RCRAInfo repository that should be accessible to the public because it is not considered enforcement sensitive; (4) To develop standard reports that can be used in any state, for any region, or nationwide to report the compliance and enforcement history of either a specific hazardous waste generator, transporter, recycler, burner/blender or facility or all entities operating nationwide undi a specific company name; and (5) To make these reports available on the Internet. Page A -6 ------- Funding Area: Data Quality and Public Access Grantee Nebraska Department of Environmental Quality Grant Title Improved Public Access to Compliance and Enforcement Milestone Events Grant Cycle 2000-2001 Grant Amoun $150,000 Abstract NDEQ has developed a system to manage and track Agency complaints and all notifications (i.e. fish kills, chemical spills, etc.) and to make NDEQ's enforcement information available on the web. This project will also enable NDEQ to characterize the state of compliance at regulated facilities, and develop a Standard Operating Procedure (SOP) for the Agency complaint process. Grantee NESCAUM: Northeast States for Coordinated Air Use Management Grant Title Air Compliance/Enforcement Data Quality Improvement Project Grant Amoun $250,000 Grant Cycle 2000-2001 Abstract Interest is extremely high in the states developing methods to assure completeness and accuracy of this data, to improve the efficiency of data transfer from state to national databases, and to expand the universe of data. NESCAUM is working on a multi-state effort to tackle these problems. The following items outline the major goals for this proposed project: 1)Assure that accurate and timely enforcement data for air programs are held in national and state data systems 2) Improve the efficiency of transferring state air data to national database systems 3) Simplify submission and tracking of HPV information to AFS through action linking 4) Maintain accurate facility level information 5) Increase public access to accurate and timely compliance/enforcement information 6) Measure compliance and enforcement activities against national performance measures. The following is an overview of the major project components. Section III of the proposal contains details for each of these components: 1) Upgrade the Ul for action linking and implement its use in a minimum of four states 2) Train state staff on effective data management techniques 3) Develop Quality Assurance Plans (QAPs) to create methods to assure data quality before entered into AFS and once entered into AFS - essentially a closed-loop system for assuring data quality 4) Create Internet-based tools for the public access to this information 5) Create tools that states can use to reconcile facility data Page A- 7 ------- Funding Area: Environmental Enforcement Training Grantee Florida Department of Environmental Protection Grant Title Environmental Enforcement and Compliance Cross-Training in Priority Sectors Grant Cycle FY2003 Grant Amoun $125,000 Abstract Florida Department of Environmental Protection is looking to improve its ability to carry out its enforcement and compliance assurance responsibilities by enhancing the capabilities of its inspectors. The specific area for enhancement is training in new and emerging processes and technologies in priority sectors, with a cross- or multimedia emphasis. Grantee Indiana Department of Environmental Management Grant Title Environmental Sampling Training for Illegal Discharges Grant Amoun $60,000 Grant Cycle FY2003 Abstract One of the primary issues identified during the development of the Sampling Protocol was the necessity of cross-media staff, available after hours, who are trained in the collection and documentation of enforcement cases. Indiana Department of Environmental Management (IDEM) is proposing to expand existing sampling training to address coordination of sampling from industrial discharges, influent and effluent from Publicly Owned Treatment Works (POTWs), point and non-point sources, and the receiving stream. Grantee Institute for Tribal Environmental Professionals at Northern Arizona University Grant Title Tribal Environmental Compliance Inspector Training Program-Part II Grant Amoun $160,000 Grant Cycle FY2003 Abstract During FY2003, the Institute for Tribal Environmental Professionals (ITEP) proposes to continue the development and delivery of comprehensive training to tribal civil environmental compliance inspectors. The goal of this project is to expand and continue to provide the tribal environmental inspector training throughout Indian Country. Grantee Metro 4, Inc. Grant Title Training Fundamentals of Environmental Compliance and Enforcement Grant Cycle FY2003 Grant Amoun $150,000 Abstract Metro 4, Inc. proposes to train local and state air pollution control agencies in the southeast region of the United States. Training will target inspectors, enforcement specialists, and other compliance support personnel in the 24 agencies in this region. Two hundred and twenty (220) students will be trained during a 3 year period. Page A-8 ------- Funding Area: Environmental Enforcement Training Grantee NAAG: National Association of Attorneys General Grant Title Environmental Enforcement Training on Federal Environmental Statutes for the Offices of the State Attorneys General Grant Cycle FY2003 Grant Amoun $150,000 Abstract The National Association of Attorneys General (NAAG) proposes to hold two workshops, each targeted toward attorney case developers, utilizing the expertise of state and federal government environmental attorneys, inspectors, and program administrators as faculty. One course will be a basic course (2 days) covering three of the four major federal environmenta statutes; a second more advanced workshop will focus on particularly challenging compliance and enforcement issues under RCRA, CERCLA, the CAA, and CWA. Training will enhance the attendees understanding of the underlying environmental statutes and improve their ability to identify issues and develop cases. Grantee New Jersey Department of Environmental Protection Grant Title Regulated Underground Storage Tank Facility Inspector Training Grant Cycle FY2003 Grant Amoun $50,000 Abstract New Jersey Department of Environmental Protection (NJDEP) is planning to establish a training program that will support three objectives: 1) The creation of a NJDEP-managed inspection force for regulated Underground Storage Tank (UST) facilities; 2) Provide initial and continuing training of county inspectors who are inspecting regulated UST facilities; and 3) Design and implement a continuing education element that will result in enhanced training on a quarterly basis for both state and county inspectors. Page A-9 ------- Funding Area: Improving Linkages between AFS and PCS Grantee California Water Resources Board Grant Title Integrated Data for Environmental Assessment Grant Cycle FY2003 Grant Amoun $200,000 Abstract This project will help make California Environmental Protection Agency (CalEPA) a National Environmental Information Exchange Network exchange partner and will play a significant role in rectifying one specific major data management issue between EPA and CalEPA-the State's provision of wastewater permit and discharge monitoring data in an electronic form that will ultimately be presented in EPA's data system, Permit Compliance System (PCS). Grantee Michigan Department of Environmental Quality Grant Title Electronic Tracking and Reporting of Michigan Air Compliance and Enforcement Data: Linking MACES to the Universal Interface (Ul) with Direct Upload to AFS Grant Cycle FY2003 Grant Amoun $180,000 Abstract Michigan Department of Environmental Quality proposes to create a modern, centralized database and data entry system, accessible to all Air Quality Division staff, for all air and enforcement data. This database and supporting interface, Michigan Air Compliance and Enforcement System (MACES), will be designed to capture all of the required Compliance Monitoring Strategy (CMS) data and more, and link to the Universal Interface (Ul) so that data can be directly uploaded into AFS. Mississippi Department of Environmental Quality Develop Data Flow between Mississippi Department of Environmental Quality's Integrated "enSite" System and AFS Utilizing the AFS Universal Interface (Ul) Grant Amoun $170,000 Grantee Grant Title Grant Cycle FY2003 Abstract Mississippi Department of Environmental Quality (MDEQ) proposes to make the necessary modifications to the air module to support the AFS data and Compliance Monitoring Strategy (CMS) data reporting requirements. MDEQ will develop the data flow from enSite to AFS utilizing the AFS Ul. Grantee NESCAUM: Northeast States for Coordinated Air Use Management Grant Title Universal Interface (Ul) Improvement and Dissemination Project for NESCAUM Grant Cycle FY2003 Grant Amoun $306,500 Abstract This project will accomplish the following: (1) Update the Ul data model and program specifications, while expanding Ul capabilities to report permit, stack testing and Title V certification data; (2) Insure that data quality is maintained by simplifying the process of transmitting the data thus reducing errors; (3) Provide technical support and develop tools to assist states wishing to implement the Ul; and (4) Create mechanisms to support Ul users and coordinate Ul activities. Page A -10 ------- Funding Area: Improving Linkages between AFS and PCS Grantee New York State Department of Environmental Conservation Grant Title Universal Interface (Ul) Improvement and Dissemination Project in New York Grant Cycle FY2003 Grant Amoun $73,500 Abstract This project will accomplish the following: (1) Update the Ul data model and program specifications, while expanding Ul capabilities to report permit, stack testing and Title V certification data; (2) Insure that data quality is maintained by simplifying the process of transmitting the data thus reducing errors; (3) Provide technical support and develop tools to assist states wishing to implement the Ul; and (4) Create mechanisms to support Ul users and coordinate Ul activities. Grantee Oklahoma Department of Agriculture, Food, and Forestry Grant Title Universal Interface (Ul) Improvement and Dissemination Project for Oklahoma Grant Amoun $35,000 Grant Cycle FY2003 Abstract This project will accomplish the following: (1) Update the Ul data model and program specifications, while expanding Ul capabilities to report permit, stack testing and Title V certification data; (2) Insure that data quality is maintained by simplifying the process of transmitting the data thus reducing errors; (3) Provide technical support and develop tools to assist states wishing to implement the Ul; and (4) Create mechanisms to support Ul users and coordinate Ul activities. Page A-11 ------- Funding Area: Inspector Training Grantee Institute for Tribal Environmental Professionals at Northern Arizona University Grant Title Tribal Environmental Compliance Inspector Training Program Grant Cycle FY2002 Grant Amoun $198,338 Abstract The goal of this project is to develop tribal environmental inspector training throughout Indian Country beginning in FY2002. These are the following objectives: 1) ITEP will assemble a training review committee consisting of representatives from USEPA, National Enforcement Training Institute (NETI), tribal and state experts, and ITEP staff. The committee will be responsible for reviewing training materials, identifying instructors and providing instruction for specific topics of the inspector training. 2) ITEP will expand and further develop Tribal Basic Inspector Training and offer the course at three locations in Oneida, NY; Kansas City, KS; and Seattle, WA. These locations optimize the opportunity of greater tribal participant nationwide. ITEP will collaborate with tribes in each training region to cosponsorthe training courses. 3) ITEP will develop two mediaspecific inspector training courses that cover the Clean Water Act (CWA) and the Federal Insecticide, Fungicide, and Rodentcide Act (FIFRA). These courses will be offered in Mesa, AZ and Kansas City, KS. 4) ITEP will partner with tribes to develop inspector compliance resources through direct onsite training, mentoring, and professional exchanges. Grantee New England Interstate Water Pollution Control Commission Grant Title State Wetland Inspector Training Grant Amoun $147,600 Grant Cycle FY2002 Abstract The New England Interstate Water Pollution Control Commission (NEIWPCC) proposes to develop and provide training workshops for state wetlands inspectors in the New England region. The goal of this program is to train wetland inspectors in order to improve compliance with state and federal regulations, which will result in enhanced protection of wetlands. Specifically, the training is intended to: 1) increase inspectors' understanding of the various federal and state regulations related to wetlands protection, including (but not limited to) Sections 401 and 404 of the Clean Water Act and storm water permitting for construction sites; 2) increase inspectors' skill in applying the USACOE 1987 wetlands delineation manual, including delineation methods for challenging environments; and 3) increase inspectors' knowledge of compliance tools (including enforcement actions, management practices to recommend, etc.) and skill in choosing the right tool(s) for each situation. Grantee Oklahoma Department of Agriculture, Food, and Forestry Grant Title Concentrated Animal Feeding Operation (CAFO) Inspector Training in Region 6 Grant Cycle FY2002 Grant Amoun $50,000 Abstract Working in conjunction with EPA, the Region 6 states of Oklahoma, Arkansas, Texas, Louisiana and New Mexico can more directly protect the environment by assisting inspectors through sharing state program ideas and understanding national anc state environmental issues. As part of a multi-state outreach program, Oklahoma Department of Agriculture, Food, and Forestry (ODAFF) is taking an integral role in developing, sponsoring, and sharing resources for a Concentrated Animal Feeding Operation (CAFO) Regional Inspector workshop, to be held on an annual basis and rotating throughout the states within the region. The primary program objective is to provide training to CAFO inspectors by keeping them informed of new developments in the federal CAFO program, as well as providing information on the highlights of state inspection and enforcement issues on a regular, yearly basis. Since the new CAFO rules were finalized in December 2002, general knowledge of the rules by the regulated community may be limited. Facilities may face a change in financial, operational, and maintenance resources in order to comply with the new CAFO regulations. Inspectors can help ease the transition from the old CAFO rules to the newly approved rules through updating their education. Page A-12 ------- Funding Area: Inspector Training Grantee Oregon Department of Environmental Quality Grant Title Erosion and Sediment Control Inspector Training for Construction Activities Regulated by the National Pollution Discharge Elimination System (NPDES) Water Program Grant Cycle FY2002 Grant Amoun $157,000 Abstract This project is designed to develop inspector training materials and to conduct training that will support the implementation of the National Pollutant Discharge Elimination System (NPDES) Phase II storm water program in Oregon. Specifically, the project will accomplish the following: (1) Develop a statewide erosion prevention and sediment control manual for construction site operators; (2) Develop an inspector training manual and related materials; (3) Create guidance for local governments on storm water management program development; (4) Conduct five inspector training classes and five local government assistance workshops around the state, and (5) Train at least 200 tribal, state and local government employees Grantee Suquamish Tribe Grant Title Suquamish Tribal Environmental Inspector Training and Program Enhancement Grant Cycle FY2002 Grant Amoun $197,341 Abstract The Suquamish Tribe proposes to address the EPA's focus area of Tribal Inspector Training. Although tribes generally have the authority to regulate and enforce environmental issues on their respective reservations, education and training are needed before this can occur effectively. While many states and local agencies have long-standing environmental programs that involve enforcement, this aspect of governance is not yet fully customary for many tribes. Having the ability to participate in enforcement activities will help increase a tribe's knowledge of environmental issues and maintain tribal sovereignty. The overall goal of the project is to ensure that tribal participants have working knowledge of regulatory requirements, inspection methodology, and health and safety measures associated with environmental compliance inspections, in accordance with EPA Order 3500.01. This overall goal will aid participating Tribal Governments in the protection and assertion of Tribal rights, sovereignty, jurisdiction that impacts the livelihood and culture of Tribal lands and Tribal membership through the assertion of regulatory compliance. Page A-13 ------- Funding Area: Outcome Measurement (Year 1) Grantee California Air Resources Board Grant Title Air Toxics Compliance Monitoring Grant Cycle 1999-2000 Grant Amoun $225,000 Abstract The objective of this study is to develop and implement enhanced performance measures for state enforcement and compliance assurance programs. In addition, we want to elevate compliance of inspected facilities and determine the effect of assistance and outreach on compliance. This study focused on the chrome plating industry. All the inspected facilities are located in the South Coast Air Basin in California. The chrome plating industry was selected because their compliance rates have historically been lower than desired and their concentration in low-income areas are an environmental justice concern Unless compliance rates are improved for this rule category, Low Income Communities situated near these toxic emitters may continue to be disproportionately impacted. This type of study is resource intensive, requires coordination, and is not suitable for source categories with very small populations. This model is well suited for area sources such as gasoline dispensing facilities and dry cleaners. Grantee Colorado Department of Public Health and the Environment Grant Title Comprehensive Enforcement and Compliance Measurement System: the COMPASS project Grant Cycle 1999-2000 Grant Amoun $522,940 Abstract Colorado's Comprehensive Enforcement Compliance and Measurement System (COMPASS) project is a department-wide effort to assess status of and trends related to compliance and environmental improvements resulting from the Department's enforcement and compliance assistance activities. The project includes six individual pilot projects being conducted across media. The pilot projects focus on different sectors and each measure the results of various approaches to compliance assurance. The goal of the project is the statistically valid measurement of the results and effectiveness of each approach. Ultimately, the COMPASS project will result in the creation of a database and a final report. Grantee Connecticut Department of Environmental Protection Grant Title Developing a Compliance Measurement and Management Strategy for Connecticut's General Permit Program Grant Cycle 1999-2000 Grant Amoun $100,000 Abstract With grant funding provided by EPA, the Department objectively assessed industry compliance with a number of its general permits. As part of its analysis, the Department determined a baseline compliance rate, identified root causes of noncompliance with the most significant terms and conditions of the general permits, and developed and employed compliance assistance and enforcement strategies designed to raise compliance rates. The first project focused on the general permit for the Discharge of Minor Tumbling or Cleaning of Parts Wastewater ("tumbling general permit"). All facilities covered under the tumbling or cleaning wastewater general permit were provided compliance assistance materials. The Department took enforcement action against the sixteen non-compliant companies. Fifteen registrants signed administrative consent orders with penalties totaling nearly $103,000. The Department referred the sixteenth company to the Office of the Attorney General for the filing of a civil action. Phase II of the project focuses on the general permit for the Discharge of Minor Printing and Publishing Wastewater ("printing general permit"). The objective of Phase II is to increase registrations under the printing general permit. At the time this initiative began, the Department had record of less than 60 registrants. Current Department records indicate 180 registrants under the printing general permit with an additional 72 pending approval. The Department will conduct site inspections during 2003 for a portion of those printers that failed to register for the printing general permit during the correction period and enforcement action will be taken against sites found to be discharging printing and publishing wastewater without a permit. In the third phase of the project, a Department contractor conducted random audits of facilities registered under the Air Bureau's General Permit to Limit Potential to Emit (GPLPE). The audit results reflected high compliance with emission limits and lower compliance with respect to the general permit's record keeping requirements. Record keeping and reporting requirements were carefully assessed, and, where appropriate made less burdensome in a March 2001 revision to the general permit. Page A-14 ------- Funding Area: Outcome Measurement (Year 1) Grantee Indiana Department of Environmental Management Grant Title Prototype for Sector-based Outcome Measurement (Auto Salvage Facility Sector Project) Grant Cycle 1999-2000 Abstract Grant Amoun $200,000 The project is broken into four main components: (1) Startup (including gathering facility location information and developing a project database); (2) Compliance assistance (comprised of a manual and workshops); (3) Targeted inspections; and (4) Enforcement (where appropriate). Planned results are a marked increase in the compliance rates of this sector, accomplished through the compliance assistance, inspection and enforcement efforts that comprise the project. Outcomes include conducting a minimum of 10 compliance assistance workshops throughout the state, and conducting a minimum of 50 targeted inspections. Grantee Missouri Department of Natural Resources Grant Title Measuring Performance from Enforcement and Compliance Assurance in Missouri Grant Cycle 1999-2000 Grant Amoun $37,500 Abstract Missouri's Department of Natural Resources' (DNR) automated Enforcement Tracking System (ETS) dates back more than ten years. It has evolved from an extremely simple DOS based database to a more sophisticated one based on Microsoft's Access platform. Data is entered by six media enforcement or lab based offices in Jefferson City. No water pollution environmental performance measure (EPM) data is available yet in ETS. This project's goals are to do the following: (1) Incorporate features that facilitate information sharing with EPA; (2) Identify the business rules needed to collect EPMs; (3) Build upon the concepts used in EPA's Case Conclusion Data Sheets; (4) Require no more than five minutes of staff time to collect the additional ETS information; (5) Map the new ETS environmental performance measures to EPA's case conclusion data; (6) Collect both quantitative and qualitative environmental performance data; minimize the need for additional staff training in how to collect the new performance measures; and (7) Update ETS to include data entry information, sample reports, and coding tables. Grantee New Hampshire Department of Environmental Services Grant Title Measuring the Effectiveness of Partial RCRA Inspection, Risk-based Facility Targeting and Compliance Activities Grant Cycle 1999-2000 Grant Amoun $45,000 Abstract The New Hampshire Department of Environmental Services (NHDES) has made substantial progress in Phase II of its Compliance Measures Project. (NHDES has contracted with NEWMOA to perform this grant.) In Phase II, NHDES is developing a compliance indicator survey that can be used to establish a baseline compliance rate for hazardous waste generators, and in future years to measure changes as a result of specific NHDES interventions. The compliance indicator survey is a set often questions covering an array of compliance, pollution prevention, and beyond-compliance issues. The compliance questions relate only to hazardous waste management, and were selected as indicators of compliance in the regulatory areas of waste determinations, inspections, labeling, container management, preparedness and prevention, and training. The collected data will be inputted into an Oracleฎ database that is being developed as part of the project. The database will allow the collected data to be analyzed based on a variety of parameters, such as generator size, generator location (by municipality, county, and/or whether it is in a wellhead protection area), date of their last Resource Conservatioi and Recovery Act (RCRA) inspection, and responses to individual questions. Page A-15 ------- Funding Area: Outcome Measurement (Year 1) Grantee NEWMOA: Northeast Waste Management Officials Organization Grant Title Compliance Assistance Metrics Software Grant Cycle 1999-2000 Grant Amoun $55,000 Abstract Under contract to the New Hampshire Department of Environmental Services, NEWMOA is developing Pollution Prevention (P2) and Compliance Assistance Metrics Software to help state P2 and compliance assistance programs manage their data. NEWMOA facilitated the development of a menu of multi-state environmental assistance and pollution prevention metrics during FY1999. The menu includes both activity and outcome metrics. To facilitate the use of the menu and to effectively share data in the future, states need a common software program. NEWMOA has established a P2 and Compliance Assistance Metrics Workgroup to oversee the development of the Microsoft Access-based software that can be used to input data for program activities in five areas: client projects (including onsite assistance), workshops and conferences, production of educational material, grants for P2 projects, and responding to information requests. The database will also have areas to input data on the behavior and environmental outcomes of these activities. Grantee NEWMOA: Northeast Waste Management Officials Organization Grant Title Defining and Measuring Environmental and Regulatory Compliance in the NEWMOA States: RCRA "C" Prevention Strategies Grant Cycle 1999-2000 Grant Amoun $30,000 Abstract Under contract to the New Hampshire Department of Environmental Services, NEWMOA is undertaking a Resources Conservation and Recovery Act (RCRA) Performance Measures project to enhance the ability of state RCRA "C" programs to measure the effectiveness of their compliance and enforcement activities. The states recognize that RCRA performance and generator compliance rates help with the following: (1) Understanding where to focus hteir limited inspection and enforcement resources; (2) Determining the impacts of their compliance assistance and enforcement activities; (3) Assessing the program's impact on deterring potentially dangerous situations involving hazardous waste management; and (4) Communicating the value of the program in preventing environmental hazards. A RCRA Measures Workshop has been established. NEWMOA will identify critical elements of RCRA program performance. Available data from EPA and the states related to the workgroup's priority measures are being used to draft a report on hazardous waste generation and complianc and enforcement activities in the region. Page A-16 ------- Funding Area: Outcome Measurement (Year 1) Grantee Oregon Department of Environmental Quality Grant Title Measuring Deterrence Created through the Enforcement of Environmental Laws Grant Cycle 1999-2000 Grant Amoun $119,060 Abstract The EPA's National Performance Measures Strategy (NPMS) addresses current trends in government that obligate agencies to (1) Manage resources with results-based strategies and (2) Demonstrate that agency resources are used efficiently. The NPMS tracks outcomes of the various alternative regulatory "tools" and is to be used in deciding to which tools the agencies should allocate resources to achieve the best environmental return. However, by considering only the specific deterrence created at the target facility, without considering the general deterrence created in the regulated public as a whole, the NPMS undervalues enforcement and interferes with the two important reasons for using the NPMS: 1) It reduces the utility of the NPMS as a resource-management tool because we do not know whether the best environmental investment is in more enforcement or in assistance initiatives; and 2) It obscures the meaning of the performance measures in providing accountability because we cannot know if the newer assistance initiatives are more efficient than traditional enforcement in improving the environment. The primary objective of the study was to determine what aspects of inspections penalties and other enforcement actions are most important in creating general deterrence. We accomplished the study through the use of two telephone surveys. In the first, questions were asked to assess the general public's knowledge abo pollution management in Oregon (I.e., where they would go for environmental information, their beliefs and assessments of environmental enforcement in Oregon). The second survey was designed to measure perceptions of the regulated community and the public about penalties and inspections and determine whether enforcement actions are effective in stimulating compliance. A random selection of 450 companies, regulated by at least one of the major programs (air, water, hazardous waste) was targeted. Grantee Texas Commission on Environmental Quality Grant Title Measuring Outcomes from Compliance Assistance Grant Amoun $75,000 Grant Cycle 1999-2000 Abstract The Texas Commission on Environmental Quality funded forty-nine initial small business compliance/pollution prevention site visits and twenty-eight follow-up site visits. Follow-up visits were conducted at businesses where noncompliance with any state or federal regulation was documented. Data collection and management of pollution prevention case studies were used to monitor and track the types of improvements resulting from the site visits. Grantee Washington State Department of Ecology Grant Title Analysis of Change in Generator Compliance Using Ecology's Regulatory Indicator Grant Cycle 1999-2000 Grant Amoun $215,270 Abstract The following three project goals were designed to compare site inspections, both technical assistance and compliance, wit generator regulatory compliance overtime: 1) Establish a statewide baseline quantitative measure of environmental compliance supported by specific regulatory violation categories that best represent actual or potential environmental threats; 2) Determine if a relationship exists between formal Compliance Enforcement Inspections and regulatory compliance by regulated facilities and, if so, how it changes overtime; 3) Determine if there is a relationship between technical assistance visits and compliance visits on the compliance rate of small quantity generators (SQGs). This goal specifically focused on technical assistance visits in the form of increased generator contact (IGC) visits, conducted primarily at SQGs. Page A-17 ------- Funding Area: Outcome Measurement (Year 2) Grantee Colorado Department of Public Health and the Environment Grant Title Development of Comprehensive Measurement Tool Template for the Asphalt Sector: the COMET project Grant Cycle 2000-2001 Grant Amoun $75,000 Abstract The main objective of this project is to support the activities of the Colorado Department of Public Health and Environment (CDPHE) in developing statistically valid outcome-based performance measures. Specifically, CDPHE will develop the Comprehensive Measurement Tool (COMET) template that will be used to measure performance-based outcome measures, pollution prevention measures, and environmental indicators for the asphalt sector. This measurement template will be developed and used for asphalt facilities throughout the United States. The work undertaken by this assistance agreement will complement the performance measurement work already being undertaken by CDPHE in other sectors in Colorado under the COMPASS Project. The performance measures developed under COMET will become part of the Performance Partnership Agreement with EPA Region 8. Grantee Connecticut Department of Environmental Protection Grant Title Developing Performance-based Measures Grant Amoun $75,000 Grant Cycle 2000-2001 Abstract The main objective of the project is to further improve the performance-based outcome measures on compliance rate analysis. Another project objective is to use a problem-solving approach to select an environmental problem to be resolved. Connecticut Department of Environmental Protection (CTDEP) will then develop and implement performance measures to measure the results. Moreover, CTDEP will incorporate this work on performance measures into the Performance Partnership Agreement (PPA) with EPA Region I. Grantee Iowa Department of Natural Resources Grant Title Pollution Prevention in the Food Processing Industry Grant Amoun $100,000 Grant Cycle 2000-2001 Abstract This project will promote Environmental Management System (EMS) awareness. Iowa Department of Natural Resources (IDNR) will assist facilities that choose to implement an EMS and help to identify pollution prevention opportunities. The objectives are to improve compliance and pollution prevention. The Department cosponsored an EMS workshop and follow up activities for meat processors which lead to 5 facilities implementing EMSs. Checklists, fact sheets and tools to help industry are also being developed. The second objective is to promote awareness of EMSs and develop a public policy workgroup of government, industry and public entities. The objective is to formulate a statewide EMS policy. The third objective is to develop an Iowa P2 Intern Program to provide facilities with qualified college attending interns who can conduct P2 or related projects during the summer. Page A-18 ------- Funding Area: Outcome Measurement (Year 2) Grantee Maryland Department of Environment Grant Title Consolidated Park Heights Performance Partnership Grant Grant Cycle 2000-2001 Grant Amoun $211,000 Abstract The project encourages automotive mechanical repair and auto body shops to review their environmental business practice with the help of a straightforward plain English workbook. Shops that wish to participate in the project are encouraged to complete a form that discloses how their business processes compare to environmental regulations. In exchange for their disclosure, shops that participate in the project will have a grace period during which the Maryland Department of the Environment (MDE) will provide them with compliance assistance rather than take enforcement actions. Shops needing help in meeting regulatory requirements are provided opportunities to seek financial assistance, if appropriate, as well as technical support and training. The project results will be carefully monitored to determine how effectively the compliance assistance approach affected the environmental impact of the auto body and repair shops within the neighborhood. Also, any practice that presents an imminent danger to public health, public welfare or the environment will be addressed. Shops that do not participate in the project or that fail to make a good faith effort to correct violations by the end of the project may be subject to enforcement actions. Grantee Massachusetts Department of Environmental Protection Grant Title EPA Cooperative Agreement for Massachusetts Department of Environmental Protection Environmental Results Program Grant Cycle 2000-2001 Grant Amoun $131,000 Abstract The main objective of this project is to further develop outcome measures of performance based on the Environmental Business Practice Indicators (EBPIs) under the Environmental Results Program (ERP) for three sectors: dry cleaners, photo processors, and printers. Other project objectives are to share data on program performance with the public and to assess the root cause of problems found by the EBPIs. Moreover, Massachusetts Department of Environmental Protection (MADEP) will leverage its work on ERP into the current State/Regional planning process and begin to make ERP and the performance measures (i.e., EBPIs) a part of the biennial Performance Partnership Agreement (PPA) with EPA Region I. Grantee Massachusetts Department of Environmental Protection Grant Title Municipal Environmental Compliance Stewardship and Measures of Success Grant Cycle 2000-2001 Grant Amoun $200,000 Abstract Under the direction of the Massachusetts Department of Environmental Protection (MADEP), the University of Massachusetts and GETF is conducting a series of workshops to train grant participants and mentors in using Environmental Management Systems (EMS) techniques to identify problematic issues and address, measure, and sustain performance improvement. A key component of the Municipal Environmental Stewardship Program is the incorporation of a mentor support system. The mentor will assist its grant participant to obtain the tools and information necessary to develop the EMS, but will not write the grant themselves. To facilitate the development of their respective EMS projects, each grant participant was requested to hold a "Kickoff Meeting" to bring their municipal EMS team together, identify and clarify their EMS "Fenceline," create an EMS Policy Statement, develop an EMS Strategy, and to select a "Core Team" of individuals responsible for the development of the EMS. Page A-19 ------- Funding Area: Outcome Measurement (Year 2) Grantee Massachusetts Department of Food and Agriculture Grant Title Development and Evaluation of Integrated Pest Management (IPM) in Schools, Daycare Centers and Childcare Programs Grant Cycle 2000-2001 Grant Amoun $200,000 Abstract This project supported compliance assistance and outreach programs to assure implementation of a major new Massachusetts state initiative entitled the "Act to Protect the Health of Children and Families from Harmful Pesticides". This Act affects all private and public schools, day care centers, and school age children child-care locales in Massachusetts. This Act is many faceted, and mandates Integrated Pest Management (IPM) be practiced as the sole pest management program employed within the schools, the development of IPM plans for schools, as well as a number of other requirements The STAG grant supported: 1) development of a generic IPM plan for schools and daycare centers; 2) statewide training of school personnel and pest management professionals in the principles of school IPM and its legal status in Massachusetts; 3) and development of curricula and training materials to inform and instruct Massachusetts school personnel in the principals of IPM and the laws pertaining to the implementation of IPM in schools. Grantee Michigan Department of Environmental Quality Grant Title Business Needs Assessment and Measurement of Work Product Effectiveness Grant Cycle 2000-2001 Grant Amoun $40,000 Abstract In July of 2000, the (Small Business) Clean Air Assistance Program (CAAP), Environmental Science and Services Division of the Michigan Department of Environmental Quality received a multi-media State and Tribal Assistance Grant (STAG) from EPA's Office of Compliance and Enforcement Assurance (OECA). The grant project, entitled "Business Needs Assessment and Measure of Work Product Effectiveness," gauges the usefulness of a CAAP work product, the "Michigan Manufacturers' Guide to Environmental, Safety and Health." Grant activities are also expected to measure limited aspects of CAAP by examining the effectiveness of their outreach efforts as a technical assistance resource for the state's business and industry. Additional aspects of the grant will provide ways in which the CAAP can improve its methods of outreach in order to better serve a greater proportion of its customer base. Grantee Missouri Department of Natural Resources with Bridging the Gap Grant Title Small Business Mentoring for Compliance Assistance Outcome Measurement Grant Cycle 2000-2001 Grant Amoun $190,642 Abstract Through a detailed marketing plan, Bridging the Gap will recruit fifteen small businesses each year of the project and match their environmental needs to sources of assistance, either through existing local, state, and federal programs or through volunteer mentors. This project will provide both quantitative and qualitative results where resources are conserved, pollution is reduced, and small businesses are empowered to have proactive environmental management strategies. Page A -20 ------- Funding Area: Outcome Measurement (Year 2) Grantee New Mexico Environment Department Grant Title Class V Underground Injection Control (UIC) Compliance Assistance Grant Cycle 2000-2001 Grant Amoun $145,364 Abstract The New Mexico Environment Department (NMED) will perform compliance assistance and implement outcome measurements for large capacity septic tank/leach fields (LCSTLF) which are classified as Class V wells under the Safe Drinking Water Act (SDWA) Underground Injection Control (UIC) program. Under the UIC program, a ground water protection permit is required for each Class V septic system. At the start of this project, there were approximately 130 permitted LCSTLFs, approximately 58% of which were out of compliance with respect to operational, monitoring, or ground water standards requirements in their permits. Concurrent with implementation of this project, the NMED has been moving onto a new database which has complicated retrieval of performance measurement data. Despite tracking a smaller population of sites, the data collected does support the premise that compliance assistance actions are successful in bringing sites into compliance. A single written compliance assistance action is successful in bringing most permit holders into substantial compliance. Constantly changing compliance rates seem to present the greatest challenge to quantifying outcome measures because the specific outcome for a specific action at a specific site must be tracked. The action-specifii performance measures we are tracking for this grant project require a lot of manual counting and evaluation that will not be realistic to apply when measuring compliance assistance outcomes for the 805 ground water protection permits NMED issues and oversees. Grantee New York State Department of Environmental Conservation Grant Title Measuring Compliance Assistance Outcomes in New York State Grant Cycle 2000-2001 Grant Amoun $94,485 Abstract The P2 Unit has designed and implemented output and outcome measures and a supporting information system for two P2 Unit activity areas: the Compliance Assistance/P2 Workshops and Manuals and the M2P2, or Multi-Media Pollution Prevention Program. With regards to the Compliance/P2 Technical Assistance Workshop and Manuals Analysis part of the project, output/outcome measures have been developed for the P2 Unit's compliance and technical assistance workshops. Between 15 and 20 workshops are conducted by the P2 unit each year to educate clients in selected industrial sectors and to distribute sector-specific compliance and technical assistance manuals that are developed by the P2 Unit. The P2 Unit provides workshop attendees with an Evaluation Form it has designed which has been filled at the end of a workshop and which asks the attendee questions about the workshop. Results have been tabulated, summarized, and analyzed. A 6- Month Followup Survey form and a 12-Month Followup Survey form (following the date of the workshop) have been designed and distributed to find out if the manual was useful, ask for Manual improvement suggestions, determine if any additional improvement initiatives have been identified, discover if any improvement initiatives are planned or being implemented, and obtain information on actual/ projected environmental or financial outcomes. With regards to the M2P2 Program Analysis part of the project, the Department's M2P2 Program is an integrated inspection program, in which teams of Department of Environmental Conservation (DEC) regional staff from different media programs work together at one point in time to conduct a comprehensive compliance and P2 assessment at a regulated facility. So far almost 200 facilities have participated in this program. Page A-21 ------- Funding Area: Outcome Measurement (Year 2) Grantee NEWMOA: Northeast Waste Management Officials Organization Grant Title Supporting the Northeast States Efforts to Implement Compliance Assistance and Pollution Prevention Software Grant Cycle 2000-2001 Grant Amoun $87,000 Abstract Under a previous grant, NEWMOA completed the first version of a Microsoft Access-based software program to provide a common system for the states to track their pollution prevention and compliance assistance activities and their outcomes. However, states need support to implement the software in their programs and on their computer systems. NEWMOA is developing a users' manual to accompany the database and implementing a training program for the states. NEWMOA is also subcontracting with the National Pollution Prevention Roundtable to provide a forum to discuss Pollution Prevention (P2) program measurement issues, and to share information about the database with states outside the NEWMOA region. Ohio Environmental Protection Agency, Division of Air Pollution Control Grantee Grant Title R'sk Management Plan / Toxics Release Inventory (RMP/TRI) Data Quality Improvement and Regulatory Assistance Grant Cycle 2000-2001 Grant Amoun $100,000 Abstract Through this project Ohio EPA plans on increasing the awareness and understanding of the RMP and TRI program requirements among the regulated community. Ohio EPA will measure the existing compliance rate with the RMP and TRI programs. Following targeted outreach for specific industrial sectors, DAPC plans on again measuring the compliance rate. Ohio EPA intends to purchase the relevant Dun and Bradstreet information to identify Ohio facilities in industrial sectors that report under RMP and TRI. This information will allow Ohio to locate facilities that may be unaware of environmental regulations to which they may be subject. Ohio EPA will provide these facilities with compliance assistance. Ohio EPA plans on also using the Harris Industrial Directory to identify facilities. Through increased awareness and understanding resulting from targeted outreach, Ohio EPA hopes to bring about increased compliance rates. Page A-22 ------- Funding Area: Performance Measurement/Program Planning Grantee Florida Department of Environmental Protection Grant Title Joint Planning to Enhance Environmental Results Grant Cycle FY2002 Grant Amoun $96,000 Abstract Florida Department of Environmental Protection (FDEP) proposes to enhance its capacity to carry out its compliance assurance responsibilities through "joint planning to enhance environmental results" that involve the development and evaluation of tools and processes in order to accomplish the following: 1) Internally integrate and evaluate priorities and strategies FDEP has developed internally over the past six months; 2) Weigh various factors in determining inspection priorities; and 3) Promote understanding, respect, alignment, and leveraging of priorities and government resources with EPA. FDEP and EPA are interested in designing a process and tools to ensure that they are individually and, wherever possible, jointly addressing priority environmental problems to the greatest extent possible. Grantee New Jersey Department of Environmental Protection Grant Title Compliance and Enforcement Target and Measure Initiative Grant Cycle FY2002 Grant Amoun $200,000 Abstract Since 1999, The New Jersey Department of Environmental Protection (NJDEP) has been collecting multimedia inspection, violation and enforcement action data in a facility-based, department-wide integrated database, called the New Jersey Environmental Management System (NJEMS). This grant project focuses on results-based resource allocation and targeting. With this goal the project uses the NJEMS data to evaluate NJDEP resources and the results from this database. This information will be used to determine appropriate shifts in resources and priorities and develop new targeting strategies. This analysis will be conducted for the five media that have at least one year of data available in NJEMS: Air, Water Quality, Water Supply, Hazardous Waste, and Solid Waste. We are proposing to evaluate at least one full year of past inspection data, focusing primarily on inspection rate and compliance rate. This evaluation will be conducted by by completing a chart developed by the Environmental Compliance Consortium (ECC), collecting staff resource data to determine effectiveness and, developing appropriate targeting strategies. We will add to this chart, data relevant to each media, such as facility type, facility size, number of employees, SIC, and other information that will be used to evaluate NJDEP effectiveness. The inspection and compliance rate data will be used as a baseline for performance measurement. New targeting strategies will be developed based on this information and inspections will be performed based on the new strategies. NJDEP will then generate the same set of inspection and compliance rate data, post inspection, to determine targeting success. This project will determine if this proposed approach produces effective targeting strategies and should be continued. If this method is effective, the lessons learned and the report development techniques will be used to determine appropriate targeting strategies for other media including Land Use, Pesticides, TCPA, DPCC, and RTK. An integral part of this project will be obtaining and using new information to generate good targeting strategies. While NJDEP has been collecting information in our facility based system, NJEMS, basic facility information is missing that should be used to evaluate past effectiveness and determine new targeting strategies consistently and for all media. NJDEP will also identify facilities it doesn't know exists. Page A-23 ------- Funding Area: Performance Measurement/Program Planning Grantee New Mexico Environment Department Grant Title Improvements from Enhanced Enforcement and Compliance Assistance Initiatives for Sand and Gravel Crushing and Asphalt Plants in New Mexico Grant Cycle FY2002 Grant Amoun $23,000 Abstract The operators of aggregate operations and asphalt plants in New Mexico are frequently issued notices of violation for non- compliance with state and federal regulations, and air quality permit conditions. This industry sector is out of compliance on a frequent basis and there are numerous repeat violations. The New Source Performance Standards that apply to most of these facilities are not well understood by the operators. In addition, many operators do not understand the conditions of their permits or federal standards, and how these apply to their facilities. Operators often do not comply with permit requirements to reduce and eliminate dust from fugitive sources, resulting in complaints from communities and nearby residents. The resources required for responding to complaints, enforcement, and settlement actions for these facilities are taxing and time consuming for Air Quality Bureau personnel. The goals of this project are to:1) develop educational and outreach materials to assist these facilities in remaining in compliance with air quality regulations and standards, 2) create and establish a methodology for measuring improvement in compliance, and 3) reduce the percentage of non-compliance in this industry sector. The components of this project will consist of developing compliance assistance tools and outreach, and enhancing enforcement for this sector by increasing the number of inspections to these facilities. While outreach is taking place, and for the following two years, the state will track the number of enforcement actions, the severity of violations, the number of repeat offenders, and improvements. The number of facilities making environmental management changes as a result of compliance assistance and/or enforcement actions will also be recorded. Grantee North Carolina Department of Environmental and Natural Resources Grant Title Compliance Improvements Resulting from Environmental Management System Implementation on Swine Operations Grant Cycle FY2002 Grant Amoun $150,000 Abstract Determining the most effective and efficient approaches to improving the overall compliance and environmental performance of swine operations has been a challenge in North Carolina for several years. In the past North Carolina Department of Environment and Natural Resources (DENR) has undertaken several studies and projects to address these issues. Specific measures have not been developed and tested to show the effectiveness of environmental management systems (EMS) in obtaining and exceeding compliance at swine operations. This project goal is to develop and field test output and outcome measures to determine effectiveness of EMS as a compliance assistance tool for swine operations. Grantee South Carolina Department of Health and Environmental Control Grant Title Predicting Future Compliance from Past Performance: A Methodology for Targeting Compliance Assurance and Enforcement Activities Grant Cycle FY2002 Grant Amoun $150,213 Abstract The project goals are to: 1) Develop and test a priority-setting methodology that will ultimately allow the agency to free up resources from areas that are currently being adequately controlled and to redirect those resources to address identified priorities; 2) Incorporate this methodology into a strategy for engaging in joint planning with EPA to set priorities and to ensure that they are consistent with and reflective of the agency's media program requirements, resources, and activities;; Share results with EPA and other states in Region 4 to cultivate a better understanding of state-specific and regional priorities, and 4) To jointly leverage federal and state resources to address them. Page A-24 ------- Funding Area: Public Access Grantee Indiana Department of Environmental Management Grant Title Drinking Water Watch Program Grant Cycle 2000-2001 Grant Amoun $100,000 Abstract Indiana Department of Environmental Management (IDEM) Drinking Water Watch Project will establish a user friendly public access (through the State Website) to drinking water compliance and enforcement information for Indiana's approximately 860 community public water systems, 670 non-transient non-community water systems and 2800 transient non-community water systems. It is projected the citizens of Indiana will use this information to gain a better understanding of their local water system and the efforts taken by their system and the state to produce and ensure safe drinking water. The user will I able to see what type of contaminants are present in their drinking water and a component of the site will explain in lay terms what these contaminants may means for their family health or business. The user will be able to follow the efforts by the public water system and IDEM to resolve drinking water problems, including water quality and operation. This Web site information will compliment EPA's Envirofacts Web site. It is also anticipated that other public water system, state and local agencies, organizations, groups and institutions will also use the public water system information for research, information, and othe compliance issues. The ability of the site to locate groups of public water system with specific contaminate problems or other issues related to compliance should be invaluable to their efforts and mandates. Grantee University of South Carolina, School of the Environment Grant Title Measurement of Effectiveness of On-site Inspection with Non-regulatory Follow-up by Industry Sectors Grant Cycle 2000-2001 Grant Amoun $74,729 Abstract Under a grant from the EPA Region IV Environmental Justice Through Pollution Prevention Program (EJP2), the University of South Carolina Center for Environmental Policy through the Trident District Office of the South Carolina Department of Health and Environmental Control (SCDHEC), began the first sector-based targeted compliance assistance program. Originally, the project only targeted a single sector of small auto body shops located in the North Charleston area. Success of the original project led to an expansion of the compliance assistance program into trucking companies and private transportation firms. The program consisted of five steps: (1) Site compliance inspection by Trident SCDHEC employees; (2) Letter of non-compliance status to facility with referral to the Center for Environmental Policy (CEP) Compliance Assistance Program (in-compliance firms referred to the state pollution prevention program for beyond compliance work); (3) Non-regulatory, free assistance supplied to non-compliant companies by CEP to attain compliance within the forty-five day window for attainment; (4) Follow-up compliance inspection by Trident SCDHEC employees; and (5) Letter of compliance/non-compliance to facility. Early data indicates that of the fifty-two firms inspected, thirty-two were found to be out of compliance with SCDHEC regulations. At this time, approximately 90% of the firms have now attained compliance, with work on-going at the remaining companies. Grantee Washington State Department of Ecology Grant Title Information Display Improvements Grant Cycle 2000-2001 Grant Amoun $112,500 Abstract IRIS for Hazardous Waste (IRIS) will be a simple and intuitive way for the public to retrieve information on RCRA hazardous waste generation, management, compliance, and enforcement data in a graphical display. It will show information in a pictorial format to make it more meaningful than in a traditional tabular format. IRIS will display images on a computer screen which will change in size and context in relation to the information retrieved. The goal of this project is to make the hazardous waste information and innovative viewing tool available to a wide audience. For this reason, the tool will be developed in such a way as to accomplish the following: (1) Create maximum flexibility for customizing the application; (2) Allow a variety of data types to be linked with graphical images in the application; (3) Operate on the Internet or on stand- alone computers; (4) Contain a user help system to provide instructions on how to setup and use the system. Page A-25 ------- |