Classification No.:
Approval Date:
5360
07/16/98
AGENCY LIBRARY
290411
1 COPY
EPA QUALITY MANUAL FOR ENVIRONMENTAL PROGRAMS
1. PURPOSE. This Transmittal issues a new manual, 5360, EPA Quality Manual for
Environmental Programs.
1. EXPLANATION. . The Office of Research and Development receives approval to
issue a new manual, EPA Quality Manual for Environmental Programs, which provides program
requirements for implementing the mandatory Quality System defined in EPA Order 5360.1
CHG 1.
3. FILING INSTRUCTIONS. File this Order in a three-ring binder established for the
EPA Directives System.
I Mei Chan, Central Directives Officer
Organization and Management Consulting Services
Originator
EPA Form U15-12 (S-S6I
Organization and Management Consulting Services
Office of Administration and Resources Management
-------
EPA
QUALITY MANUAL
FOR
ENVIRONMENTAL PROGRAMS
5360
JULY 1998
United States Environmental Protection Agency
Office of Research and Development
National Center for Environmental Research and Quality Assurance
Quality Assurance Division
Washington, D.C. 20460
-------
EPA Quality Manual for Environmental Programs 5350
07/16/98
TABLE OF CONTENTS
1. QUALITY SYSTEM POLICY AND RATIONALE
1.1 Introduction
1.2 Scope
1.3 Applicability
1.3.1 Applicability to Environmental Programs
1.3.2 Applicability to Other EPA Programs .. .
1.4 Organizational Applicability
1.4.1 EPA Organizations
1.4.2 Extramural Agreements
Page
-1
-1
-2
-2
-2
-3
-4
-4
-4
1.5 Exemptions 1_4
2. QUALITY SYSTEM IMPLEMENTATION 2-1
2.1 Introduction 2-1
2.2 Implementation of Quality System Functions 2-1
2.2.1 Background 2-1
2 2.2 Mandatory' Quality Management Tasks and Descriptions 2-2
2.2.3 Non-Mandatory Quality Management Tasks and Descriptions 2-7
2.3 Reporting Requirements 2-9
2.3.1 Quality Management Plans 2-9
2.3.2 Quality Assurance Annual Report and Work Plan 2-9
2 4 Requirements for Extramural Agreements 2-9
2.4.1 Contracts 2-10
2.4.2 Assistance Agreements 2-10
2.4.3 Interagency Agreements 2-10
2.5 Requirements for Reporting Environmental Data 2-11
2.5.1 Technical Reports 2-11
2.5.2 Data Management and Storage 2-11
2.6 QA/QC Requirements and Guidance Documents 2-11
2.6.1 Agency-wide Requirements and Guidance Documents 2-11
2.6.2 Development of User-Specific QA/QC Guidance Documents 2-12
2.7 QA/QC Requirements in Regulations 2-13
2.8 Dispute Resolution 2-13
2.8.1 Technical Disputes 2-13
2.8.2 Management Systems Disputes 2-13
2.9 Performance Agreements 2-14
3. QUALITY MANAGEMENT PLANS 3-1
3.1 Introduction 3_1
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
TABLE OF CONTENTS - Continued
Page
3.2 Preparation, Submission, Review, and Approval 3-2
3.2.1 QMP Preparation Responsibility 3-2
3.2.2 Internal Submission and Approval 3-2
3.2.3 Agency Review and Approval of the QMP 3-3
3.2.4 QMP Revisions 3-3
3.3 Quality Management Plan Requirements 3-4
3.3.1 General Requirements 3-4
3.3.2 Management and Organization 3-4
3.3.3 Quality System and Description 3-5
3.3.4 Personnel Qualifications and Training 3-6
3.3.5 Procurement of Items and Services 3-6
3.3.6 Documents and Records 3-7
3.3.7 Computer Hardware and Software 3-8
3.3.8 Planning 3-8
3.3.9 Implementation of Work Processes 3-10
3.3.10 Assessment and Response 3-11
3.3.11 Quality Improvement 3-12
4. QUALITY ASSURANCE ANNUAL REPORT AND WORK PLAN 4-1
4.1 Background 4-1
4.2 Use of QAARWP Submissions 4-1
4.3 Requirements 4-1
4.3.1 QA Annual Report 4-2
4.3.2 Work Plan 4-5
5. QUALITY ASSURANCE PROJECT PLANS 5-1
5.1 Introduction 5-1
5.2 QAPP Responsibilities and Application 5-1
5.2.1 QAPP Preparation Responsibilities and Approvals 5-1
5.2.2 QAPP Implementation and Revision 5-2
5.2.3 Applicability of QAPPs 5-2
5.3 QAPP Elements and Requirements 5-3
5.3.1 General Content Requirements 5-3
5.3.2 Group A, Project Management 5-5
5.3.3 Group B,'Measurement/Data Acquisition 5-8
5.3.4 Group C, Assessment/Oversight 5-12
5.3.5 Group D, Data Validation and Usability 5-13
11
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
TABLE OF CONTENTS - Continued
Page
6. QUALITY SYSTEM ASSESSMENT
(RESERVED)
7. DESIGN, CONSTRUCTION, AND OPERATION OF ENVIRONMENTAL
TECHNOLOGY
(RESERVED)
APPENDIX A. EPA ORDER 5360.1 CHG 1 A-l
APPENDIX B. TERMS AND DEFINITIONS B-l
APPENDIX C. REFERENCES C-l
111
-------
EPA Quality Manual for Environmental Programs 5350
07/16/98
CHAPTER 1
QUALITY SYSTEM POLICY AND RATIONALE
1.1 Introduction
EPA Order 5360.1 CHG 1, Policy and Program Requirements for the Mandatory
Agency-wide Quality System (Attachment A), provides requirements for the conduct of quality
management practices, including quality assurance (QA) and quality control (QC), for all
environmental data collection and environmental technology programs performed by or for this
Agency. The primary goal of the Agency-wide Quality System is to ensure that environmental
programs and decisions are supported by data of the type and quality needed and expected for
their intended use, and that decisions involving the design, construction, and operation of
environmental technology are supported by appropriate quality assured engineering standards
and practices. The EPA Quality Manual for Environmental Programs provides program
requirements for implementing the mandatory Quality System defined in EPA Order 5360 1
CHG l".
All EPA organizational units conducting environmental programs shall comply with EPA
Order 5360.1 CHG 1. Work performed on behalf of EPA through appropriate extramural
agreements shall comply with the quality system requirements defined by EPA Order 5360.1
CHG 1 or applicable regulations, unilateral orders, and negotiated agreements. Environmental
data are any measurements or information that describe environmental processes or conditions.
or the performance of environmental technology. For EPA, environmental data include
information collected directly from measurements, produced from models, and compiled from
other sources such as data bases or the literature. Environmental technology includes treatment
systems, pollution control systems and devices, and waste remediation and storage methods.
In accordance with EPA Order 5360.1 CHG 1, EPA requires that environmental
programs be supported by a quality system that complies with the American National Standard
ANSI/ASQC E4-1994, Specifications and Guidelines for Quality Systems for Environmental
Data Collection and Environmental Technology Programs, incorporated herein by reference.
ANSI/ASQC E4-1994 is a national consensus standard authorized by the American National
Standards Institute (ANSI) and developed by the American Society for Quality (ASQ) that
provides a basis for planning, implementing, documenting, and assessing an effective quality
system for collecting and evaluating environmental data for decisions and for use in the design,
construction, and operation of environmental technologies. Copies of the standard may be
obtained from:
ASQC Quality Press
P.O. Box 3005
Milwaukee, WI 53201-3005
Phone:(800)248-1946
1-1
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
By invoking this American National Standard as the basis for its internal Quality System,
EPA recognizes that environmental programs are diverse and impact many constituencies,
including Federal, State, local, and Tribal governments and industry. EPA realizes that a
uniform, consistent set of quality management criteria are essential to assure effective
environmental programs by Government and industry alike. ANSI/ASQC E4-1994 provides a
stable foundation upon which quality systems supporting all environmental data and technology
work across the Agency may be based.
1.2 Scope
The scope of this Manual includes applicable environmental programs involving:
the collection, evaluation, and use of environmental data by and for the Agency,
and
the design, construction, and operation of environmental technology by the
Agency.
Environmental data are critical inputs to decisions involving the protection of the public
and the environment from the adverse effects of pollutants from natural and man-made sources.
Decisions concerning environmental and human health protection often result in requiring
the design, construction, and operation of pollution control or waste remediation systems. For
example, environmental technologies are required to reduce contamination levels in the
environment and to maintain the levels at concentrations that do not threaten the environment or
human health and safety.
1.3 Applicability
1.3.1 Applicability to Environmental Programs
This Manual contains the minimum specifications for quality management functions and
activities necessary to support EPA environmental programs and satisfy the requirements of EPA
Order 5360.1 CHG 1. Such programs may include activities encompassing the:
characterization of environmental or ecological systems and the health of human.
populations;
characterization of ambient conditions in air, water, sediments, and soil in terms
of physical, chemical, radiological, or biological characteristics;
1-2
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
characterization of radioactive, hazardous, toxic, and mixed wastes in the
environment and their health and ecological effects;
characterization and quantification of waste and effluent discharges to the
environment from processes and operations (e.g., energy generation, metallurgical
processes, chemicals production), during either normal or upset conditions (i.e.,
operating conditions that cause pollutant or contaminant discharges);
performance assessment of environmental technology used for pollution
prevention; pollution control; waste treatment, storage, and disposal; and waste
remediation;
demonstration of environmental technology (e.g.. treatability and pilot studies);
investigation of chemical, biological, physical, or radioactive constituents in
environmental and ecological systems, and their behavior and associated
interfaces in those systems, including exposure assessment, transport, and fate;
definition and evaluation of methods for use in the collection, analysis, and use of
environmental data;
development, evaluation, and use of computer or mathematical models (and their
input data) that characterize environmental processes or conditions;
use of environmental data collected for other purposes or from other sources (also
termed "secondary data"), including literature, industry surveys, compilations
from computerized data bases and information systems, results from computerized
or mathematical models of environmental processes and conditions; and
collection and use of environmental data pertaining to the occupational health and
safety of personnel in EPA facilities (e.g., indoor air quality measurements) and m
the field (e.g., chemical dosimetry, radiation dosimetry).
1.3.2 Applicability to Other EPA Programs
This Manual applies to the collection and use of medical testing data from Government .
and non-Government personnel in EPA facilities for determination of substance abuse.
1-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
1.4 Organizational Applicability
1.4.1 EPA Organizations
The Agency-wide Quality System requirements established in EPA Order 5360.1 CHG 1
shall apply to all EPA organizations and components thereof in which the environmental
programs conducted involve the activities described in Section 1.2 above.
1.4.2 Extramural Agreements
The Agency-wide Quality System requirements defined by Order 5360.1 CHG 1 shall
apply to non-EPA organizations as defined by terms and conditions in EPA-funded extramural
agreements. Compliance with the Agency-wide Quality System requirements may be specified
in applicable regulations for these extramural agreements. In other cases, such requirements may
be invoked as part of negotiated agreements such as memoranda of understanding. These
extramural agreements include:
Any organization or individual under direct contract to EPA to furnish services or
items or perform work (i.e.. a contractor) under the authority of 48 CFR Chapter
15, Part 1546, (including applicable work assignments, delivery orders, and task
orders);
Institutions of higher education, hospitals, and other non-profit recipients of
financial assistance (e.g., Grants and Cooperative Agreements) under the authority
of 40 CFR Part 30;
State, local, and Tribal governments receiving financial assistance under the
authority of 40 CFR Part 31 and 35; and
Other Government Agencies receiving assistance from EPA through interagency
agreements.
Extramural (non-EPA) quality systems that provide objective evidence (such as a Quality
Management Plan, quality manual, or audit report acceptable to EPA) of complying fully with
the specifications of ANSI/ASQC E4-1994 are in compliance with EPA policy.
1.5 Exemptions
Statutory requirements for quality may supersede the specifications in this Manual or be
more rigorous. In such cases, affected programs shall be exempt from the requirements of this
1-4
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Manual. EPA organizations conducting exempted activities shall comply with EPA Order
5360.1 CHG 1 in all other respects. The following exemptions from these requirements apply:
The collection of environmental data under the authority of Good Laboratory
Practices as defined by 40 CFR Part 792, for the Toxic Substances Control Act.
The collection of environmental data under the authority of Good Laboratory
Practices as defined by 40 CFR Part 160, for the Federal Insecticide, Fungicide,
and Rodenticide Act.
Requests for exemptions should be directed to the Quality Assurance Division (QAD).
Exemptions shall be made by the Assistant Administrator for Research and Development.
1-5
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
CHAPTER 2
QUALITY SYSTEM IMPLEMENTATION
2.1 Introduction
This chapter addresses the implementation of quality management activities to satisfy
EPA Order 5360.1 CHG 1. including limitations on the use of extramural support to implement
quality systems for programs involving environmental data operations; reporting requirements;
requirements for extramural agreements; requirements for reporting results from applicable
environmental programs; QA/QC requirements and guidance documents; user-specific QA/QC
guidance; and dispute resolution.
2.2 Implementation of Quality System Functions
2.2.1 Background
Many quality system activities involving environmental data operations are inherently
governmental functions and must be performed only by EPA personnel or by personnel explicitly
authorized by EPA based on statute, regulation, or by the terms of an extramural agreement.
Such representatives may include other governmental personnel and with specific authorization.
contractor personnel. When such quality management tasks are performed by a contractor, the
contract must be appropriately managed and must remain under the control of the authorized
EPA contracting representatives. EPA cannot use cooperative agreements or grants to provide
quality management activities such as QA and QC services for EPA because it is an
inappropriate use of financial assistance (Office of General Counsel memorandum, August 2,
1994).
This section describes the quality management tasks necessary to comply with the Order
and identifies those tasks that may be performed by non-government personnel under appropriate
management controls.
Two types of quality management functions are described:
Exclusively EPA Functions - inherently governmental work which must be
performed only by responsible EPA officials, including the QA Managers
(QAMs), or authorized EPA representatives.
Discretionary Functions - activities that may be performed either by EPA
personnel or by non-EPA personnel under the specific technical direction of and
performance monitoring by the QA Manager or other responsible EPA or
2-1
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Government official under an approved contract, work assignment, delivery order,
task order, etc.
In the situations involving the other associated functions, there may be instances
involving sensitive contracting services, advisory and assistance services, and vulnerable
contracting practices as defined by the Federal Acquisition Regulations. Office of Federal
Procurement Policy (OFPP), and the EPA Contracts Management Manual (EPA Order 1900).
Such situations are identified by italicized text in the following sections. In addition,
management approval of services contracts as defined by OFPP Letter 93-1 must be obtained for
many of the associated tasks.
Technical direction or other instructions to an extramural organization, relating to
performance of an extramural agreement, shall be provided only by authorized EPA or other
Government representatives in accordance with the terms of the applicable extramural
agreement. Only authorized EPA or other Government representatives are to provide direction
or instructions to an extramural organization providing quality systems support for
environmental programs. This is to avoid such actions as:
the providing of directions or instructions that are inconsistent with the terms of
an extramural agreement,
unauthorized access to confidential business information (CBI), or
unauthorized access to information that may allow an extramural organization to
gain an unfair competitive advantage.
212.2 Mandatory Quality Management Tasks and Descriptions
This section describes the activities and tasks integral to an effective quality system.
These tasks are required to implement EPA Order 5360.1 CHG 1.
2.2.2.1 Manage and Coordinate the Quality System
Exclusively EPA functions that must be performed by EPA QA personnel include:
managing the day-to-day implementation of the mandatory quality system.
acting as liaison between the organization and the QAD on matters of QA policy.
coordinating with senior management the development of and preparation of the
organization's Quality Management Plan.
2-2
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
coordinating with senior management changes to the Quality System as needed to
assure its continued effectiveness and assisting in reporting the results annually to
management and to QAD in the QA Annual Rep.ort and Work Plan.
managing organization resources designated for the quality system.
maintaining records of pertinent quality system activities performed by the
organization.
2.2.2.2 Review and Approve Procurement and Financial Assistance Documents for OA
Requirements
Exclusively EPA functions that must be performed by EPA QA personnel include:
reviewing procurement and financial assistance documents (e.g., statements of
work, scopes of work, applications for assistance, funding requests, and purchase
requests) to confirm any need for QA requirements, providing any necessary
special language or conditions for such QA requirements, and approving by
signature the appropriate Quality Assurance Review Form.
participating directly or indirectly in the solicitation or agreement review process
to advise the Project Officer on the suitability of the offerer's quality system or
quality assurance/quality control (QA/QC) approach for the particular project.
reviewing work assignments, delivery orders, and task orders to certify that
appropriate QA/QC requirements have been established and that the necessary
instructions are being communicated to the contractor to carry out the required
QA/QC tasks. Approving by signature appropriate Quality Assurance Review
Form (EPA Order 1900, Chapter 2).
2.2.2.3 Review and Approve OA Planning Documents
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representative include:
reviewing Quality Assurance Project Plans (QAPPs) for all projects, work
assignments, delivery orders, task orders, grants, cooperative agreements, and
interagency agreements involving data acquisition, data generation, and/or
measurement activities that are performed on behalf of EPA.
2-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
approving all QAPPs for implementation in all applicable projects, work
assignments, delivery orders, task orders, grants, cooperative agreements, and
interagency agreements performed on behalf of EPA.
coordinating the correction of deficient QAPPs with the Project Officer and
his/her management.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
reviewing, at the specific technical direction of the QAM, QA Project Plans and
other QA-related planning documents, such as sampling and analysis plans. Data
Quality Objectives (DOO) specifications, etc , and providing specific
substantiated recommendations to the QAM on the adequacy of the OA approach
in meeting the criteria provided by the QAM (The reviews should identify
specific technical deficiencies in the planning documents)
2.2.2.4 Track and Report Quality System Deliverables
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representative include:
tracking critical quality system deliverables for the organization and make
periodic reports to senior management on the status of reporting actions and
deliverables.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
compiling/logging administrative and management information including
turnaround times to correct deficient QAPPs, responses to audits (e.g., responses
and corrective actions), and quality reviews of final reports.
2.2.2.5 Manage Contractor Support Work Assignments. Delivery Orders, and Task Orders
Exclusively EPA functions that must be performed by EPA QA personnel include:
serving as the Contracting Officer Representative (for example, Project Officer,
Work Assignment Manager, or Delivery Order Project Officer) for specific QA
support contracts, work assignments, delivery orders, and task orders.
2-4
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
2.2.2.6 Plan and Conduct Management Assessments
Exclusively EPA functions that must be performed by EPA QA personnel include:
planning, directing, and conducting assessments of the effectiveness of the quality
system being applied to environmental data operations and reporting results to
senior management. Such assessments may be conducted using the Management
Systems Review (MSR) process.
coordinating with senior management any revision of the quality system as
necessary based on the findings of the assessment.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
providing technical support to the EPA QAM in the planning phase of
managemer . issessments. (Such activities are limited to the assembly and
compilation of background information and data, guidance documents, technical
reports, etc.. available in the public domain, for use by EPA in designing the
assessment goals and specifications.)
2.2.2.7 Plan and Conduct Technical Assessments
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representative include:
planning and directing with the responsible EPA project officials the
implementation of periodic technical assessments of ongoing environmental data
operations to provide information to management to assure that technical and
quality objectives are being met and that the needs of the customer are being
satisfied. Such assessments may include technical systems audits, surveillance,
performance evaluations, and data quality assessments.
determining conclusions and necessary corrective actions (if any) based on the
findings of the assessments.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
performing technical assessments of environmental data producing activities,
both intramural and extramural (on-site and off-site) according to a specific plan
2-5
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
approved by the QAM Preparations for such assessments may include the
acquisition or development of audit materials and standards Results (findings)
are summarized, substantiated, and presented to the QAM or authorized EPA
representative.
A determination of whether an authorized Agency representative should
accompany a contractor's personnel should be made on a case-by-case basis only
after coordination between the responsible organization and contracting officer
Such coordination should include consideration of the purpose of the
accompaniment and clear definition of the Agency representative 's role and
responsibility during the contractor's performance of the audit or technical
assessment to avoid the appearance of a personal services relationship
2.2.2.8 Prepare and Present OA Training Materials and Courses
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representa.^-e include:
developing and presenting detailed guidance and training for QA/QC activities
based on interpretation of Agency-wide requirements and guidance.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include.
providing or coordinating quality-related training for the organization in special
skill areas identified by the Agency and not generally available to the
organization.
providing allowable technical and/or logistical assistance in preparing and
presenting quality-related technical training (within the Agency's implementation
of special management and control measures and the constraints of potential for
conflict of interest, of revealing confidential business information, or of
appearing to be interpreting or representing Agency policy)
2.2.2.9 Review and Approve Final Reports for Quality Documentation
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representative include:
establishing criteria for the acceptability of quality documentation in the
organization's published papers and reports; that is, defining what is required for
2-6
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
an adequate discussion of the quality of the project results and the usability of the
information reported.
approving for publication those papers and reports that meet the defined criteria.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
conducting a substantiated technical review of all reports produced by the
organization using the qualitative and quantitative specifications obtained from
the DOO process or other criteria provided by EPA This quality review
complements the peer review process
2.2.3 Non-Mandatory Quality Management Tasks and Descriptions
This section describes other activities and tasks integral to an effective quality system.
They are not explicitly required to implement EPA Order 5360.1 CHG 1, but if implemented,
they must be implemented as described below.
2.2.3.1 Review and Assist in the Development and Preparation of Environmental Data
Collection Survey Designs
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representative include:
interpreting Agency policy and requirements pertaining to the development and
preparation of environmental data collection survey/experimental design
requirements.
providing corrective action, technical assistance, and guidance to intramural and
extramural personnel (in accordance with terms of the extramural agreement)
conducting environmental data operations to enable them to produce in a timely
manner satisfactory design documents.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
reviewing environmental data collection survey designs using criteria provided by
the QAM and providing the QAM with a substantiated technical assessment of the
strengths and weaknesses in the design.
2-7
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
2-2.3.2 Prepare and Present Quality Management Information in the Technical Literature
and at Meetings/Symposia
Exclusively EPA functions that must be performed by EPA QA personnel or their
authorized EPA representative include:
transferring information on EPA quality management subjects to other Agency,
public, or scientific groups through participation in technical meetings and
symposia, and papers or articles in the technical literature, including peer
reviewed journal papers, oral presentations, and panel discussions.
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
transferring information on quality management subjects to other groups through
participation in technical meetings and symposia and through the technical
literature, with appropriate disclaimer that the information does not represent EPA
policy or position. (NOTE. Only EPA personnel may represent the Agency in an
official role.)
2.2.3.3 Research Relative to Quality Management Issues
Discretionary functions that may be performed by either EPA personnel or non-EPA
personnel include:
providing information to the QAMs on the state-of-the-art in quality management.
performing searches of the technical and quality management literature relative to
specific QA/QC issues. This may include compiling summaries of alternative
sampling and analytical methods, identifying QC reference materials, and
availability of standard operating procedures for calibrating certain
instrumentation.
performing studies of quality management issues having a mathematical or
statistical foundation with the objective of optimizing QA/QC protocols and
procedures.
2-8
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
2.3 Reporting Requirements
2.3.1 Quality Management Plans
All Agency organizational units governed by EPA Order 5360.1 CHG 1 shall document
their quality system in a Quality Management Plan (QMP). The QMP is a policy statement
describing how an EPA organization shall comply with the requirements of EPA Order 5360.1
CHG 1. Quality systems encompass the management and technical activities necessary to plan,
implement, and assess the effectiveness of quality assurance (QA) and quality control (QC)
operations applied to environmental programs. The QMP provides the blueprint for how an
individual EPA Program Office. Region, and National Laboratory or Center will plan,
implement, and assess its quality system for the environmental work to be performed as part of
its mission. QMPs are reviewed and approved by ORD. Approval is valid for a period of up to
five years. Specific QMP requirements are described in Chapter 3.
2.3.2 Quality Assurance Annual Report and Work Plan (QAARWP)
All Agency organizations subject to the requirements of EPA Order 5360.1 CHG 1 must
submit a Quality Assurance Annual Report and Work Plan (QAARWP) annually. The
QAARWP shall summarize the results of having implemented the quality system the previous
fiscal year and describe QA activities planned for the fiscal year beginning in October. The
QAARWP may be used to identify limited changes or updates to the orgamzations's approved
QMP. The QAARWP should provide helpful information to management by documenting the
past fiscal year's activities and estimating the current year's workload based on the prior year and
the expected activities in the current year. QAARWPs are described in Chapter 4
2:4 Requirements for Extramural Agreements
All environmental data operations performed under extramural agreements shall comply
with the Agency-wide Quality System requirements as defined by the relevant regulations.
Accordingly, all acquisitions and assistance agreements must be reviewed by an authorized QA
Manager, Officer, or Coordinator, as specified in the organization's Quality Management Plan, to
determine if environmental data operations are to be performed and, if so. to ensure that
appropriate QA/QC specifications are included or identified in the acquisition and assistance
agreement solicitation package. Upon their receipt in response to the solicitation, proposals or
applications must be reviewed by the QA approval authority to evaluate the adequacy with which
the offerer or applicant addressed stated specification, as well as the adequacy of Quality
Management Plans and QA Project Plans when submitted.
2-9
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
2.4.1 Contracts
The requirements for QA/QC in contracts are given in 48 CFR 15, Part 1546 and in the
Contract Management Manual, EPA Order 1900. The requirements and the specifications set
forth in this Manual extend to all contract forms involving environmental programs, including
work assignments, delivery orders, and task orders.
The Quality Assurance Review Form (QARF) (EPA Order 1900, Chapter 2) provides
confirmation to the Office of Acquisition Management (OAM) that appropriate QA/QC
requirements have been determined. OAM officials shall then incorporate the necessary standard
clauses or conditions to assure that the minimum specifications for compliance with EPA policy
are included. The specific statement of work may include additional QA/QC specifications and
requirements identified by the project officer in consultation with the organization's QAM.
Approved QARFs are required for work assignments, delivery orders, and task orders.
For level-of-effort and delivery order contracts, only general QA/QC requirements are specified
in the contract. Since not all work assignments, delivery orders, and task orders issued involve
data collection, QA/QC specifications may not be necessary. The QARF attached to the work
assignment shall identify clearly those work assignments that need QA/QC specifications and
shall identify the necessary requirements.
2.4.2 Assistance Agreements
The regulatory requirements for QA/QC in assistance agreements are given in 40 CFR
Part 30, for assistance to institutions of higher education, hospitals, and other non-profit
organizations, and in 40 CFR Part 31, for assistance agreements to State, local, and Tribal
governments. The requirements and the specifications set forth in this Manual extend to all
assistance agreement forms involving environmental programs, including grants and cooperative
agreements.
2.4.3 Interagency Agreements
EPA cannot unilaterally require other Federal agencies to comply with Agency-wide
Quality System requirements for interagency agreements funded by EPA. QA/QC specifications
for interagency agreements must be negotiated between EPA and the other agency. When
agreement is reached on the QA/QC specifications, the specifications must be included in the .
interagency agreement.
When EPA receives funding from another Agency through an interagency agreement, the
EPA QA/QC requirements shall apply in addition to any specifications provided by the funding
2-10
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
organization. If the funding agency does not specify any requirements, EPA QA/QC
requirements given by the Order and this Manual shall apply.
2.5 Requirements for Reporting Environmental Data
2.5.1 Technical Reports
Published Agency reports containing environmental data shall be accompanied by a
readily-identifiable section or appendix that discusses the quality of the data and any limitations
on the use of the data with respect to their original intended application. Published EPA reports
include those reports printed by the Government or distributed through publication services to
the general public. This requirement does not apply to papers, journal articles, etc.. that undergo
peer review processes external to EPA.
Agency reports shall be reviewed by the QA manager (or other authorized official) before
publication to ensure that an adequate discussion of QA/QC is enclosed. Adequacy is a
subjective determination that should be based on the nature of the environmental data operations
performed and the intended and likely use of the data by others, or on the objectives of the study.
The purpose of the review is to ensure that sufficient information is provided to enable a
knowledgeable reader to determine if the technical and quality goals were met for the intended
use of the data. Reports should include applicable statements regarding the use of any
environmental data presented as a caution about possible misuse of the data for other purposes.
2.5.2 Data Management and Storage
Data management and electronic transfer and storage of environmental data shall conform
with applicable Agency information resources management policies and procedures, or with
applicable American National Standards. Agency policy requires that environmental data shall
have their location reported and documented as well (2100, Chapter 13). Other applicable EPA
Orders include 2180.1, 2180.2, 2180.3, and 7500.1 A.
2.6 OA/OC Requirements and Guidance Documents
2.6.1 Agency-wide Requirements and Guidance Documents
QAD shall develop quality management practices and "tools" for use Agency-wide to
enable effective planning, implementation, documentation, and assessment of individual quality
systems. QAD produces the following types of documents for this purpose:
2-11
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Requirements Documents (OA/R-Sertes)
Requirements Documents contain mandatory, minimum specifications or
procedures for use by non-EPA organizations that must comply with Agency-
wide Quality System requirements. These documents are usually invoked through
regulations. Requirements Documents are designated the QA/R-series and are
issued by the AA/ORD as Agency Policy documents following appropriate
review and approval.
Guidance Documents (QA/G-Series)
Guidance Documents contain non-mandatory guidelines for use by EPA and non-
EPA organizations in implementing quality management practices or QA/QC
activities. Such documents often provide suggestions on how to meet
specifications given in Requirements Documents. Guidance Documents are
designated the QA/G-series and issued as Office of Research and Development
reports following peer review and approval.
All EPA quality-related Requirements Documents and Guidance Documents shall be
valid for a period of five (5) years from the approval date. After five years, some action must be
taken to reaffirm the document's validity, revise it, or delete it from the Agency-wide Quality
System. Any changes to approved documents must comply with the procedures used for the
original review and approval.
!
2.6.2 Development of User-Specific QA/QC Guidance Documents
Additional user-specific QA/QC requirements and guidance that are tailored to a
particular organization and its mission may be appropriate given the diversity of Agency
programs. For the purposes of this Manual, "user-specific QA/QC guidance" includes but is not
limited to written documents, computer software, and videos (if used to provide instructions).
Such guidance shall be developed by the organization itself, consistent with Agency policy and
the organization's QMP.
Management shall ensure that all changes to the guidance documents are available to all
personnel using that guidance, including active contractors and assistance agreement recipients
(e.g., grantees, cooperative agreement holders). The changes do not become binding on
contractors and assistance agreement holders until the Office of Acquisition Management or the
Office of Grants and Debarmenfrevises the extramural agreement at the request of the EPA
project officer.
2-12
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
2.7 OA/OC Requirements in Regulations
EPA regulations often require the regulated community to. collect and submit
environmental data to EPA or the State as part of compliance or enforcement actions. Some
regulations include specific QA/QC requirements while others are less specific. Because critical
decisions are often made based on data collected from the regulated community, the adequacy of
those data are very important, both to EPA and to the regulated community. The inclusion of
appropriate QA/QC requirements in EPA regulations helps to assure that data of the type and
quality needed for a particular decision are obtained. The authoring organization shall ensure
that appropriate and effective specifications for QA/QC are included in proposed regulations.
2.8 Dispute Resolution
Oversight responsibilities for QA/QC may sometimes result in disagreements between
the oversight group and the program reviewed regarding the results of the activity. Such disputes
may occur in situations involving technical issues (e.g.. audits, surveillance, data quality
assessments) and management issues (e.g., QMP reviews, management systems reviews). This
section discusses the process for resolving such disputes.
2.8.1 Technical Disputes
For those situations in which technical issues regarding QA/QC are in dispute, resolution
should be sought at the lowest management level practicable All parties should make every
effort to resolve disputes through discussion and negotiation. If unsuccessful, final resolution
should be made by the senior manager for the organization.
It is recommended that an organization's QMP include a process for dispute resolution
within that organization. While the process described below (Section 2.8.2) may be used for
technical disputes, an organization may develop a process that meets its particular needs.
2.8.2 Management Systems Disputes
Implementation of the Agency-wide Quality System may create disagreements arising
from the results of the review and approval of Quality Management Plans (QMPs) and from the
performance of management assessments using Management Systems Reviews (MSRs). The
dispute resolution process should only be used when parties cannot achieve mutual resolution of.
their disagreement at the lowest possible administrative level. The dispute resolution process is
terminated at any point where resolution is achieved and the issue resolved.
Disagreements should be resolved at the lowest administrative level possible. The
dispute resolution officials for management systems issues are as follows:
2-13
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Within the National Center for Environmental Research and Quality Assurance
(NCERQA) - the Director, NCERQA.
Within the components of the Office of Research and Development (ORD) - the
Assistant Administrator for Research and Development (AA/ORD).
Between ORD and the National Program Offices or Regional Offices - the
AA/ORD and the respective National Program Office Assistant Administrator
(AA) or Regional Administrator (RA).
Should agreement not be reached at this level, the issue shall be resolved by the Deputy
Administrator.
The dispute resolution process has the following steps:
(1) The process begins when either disagreeing party declares an issue to be
unresolvable and sends a memorandum to the other party invoking this dispute
resolution process, defining the disputed issue, and presenting supporting
arguments for the first party's position on the issue.
(2) Within 30 days, the second party must send a draft dispute resolution package to
the first party. As soon as possible after this, the two parties, working together,
must submit a dispute resolution package to the dispute resolution official. This
package would contain both party's arguments, both party's rebuttals, and any
supporting materials.
(3) The dispute resolution official shall schedule a meeting for resolving the dispute
within 30 to 60 days from receipt of the dispute resolution package, and for
notifying both parties of this date. Both parties are invited to attend the resolution
meeting to present arguments and answer questions. The dispute resolution
official may get advice from third parties. The decision of the dispute resolution
official shall be binding on both parties.
2.9 Performance Agreements
Successful implementation of the Agency-wide Quality System requires that EPA
managers and staff perform specific quality management functions. Performance agreements for
senior managers, supervisors, and applicable staff shall contain critical element(s) to
commensurate with the quality management responsibilities assigned by EPA Order 5360.1
CHG 1, this Manual, and the organization's Quality Management Plan.
2-14
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
CHAPTER 3
QUALITY MANAGEMENT PLANS
3.1 Introduction
All Agency organizational units governed by EPA Order 5360.1 CHG 1 shall document
their quality system in a Quality Management Plan (QMP). The QMP is a policy statement
describing how an EPA organization shall comply with the requirements of EPA Order 5360.1
CHG 1. Quality systems encompass the management and technical activities necessary to plan,
implement, document, and assess the effectiveness of quality assurance (QA) and quality control
(QC) operations applied to environmental programs. The QMP provides the blueprint for how
an individual EPA Program Office, Region, and National Laboratory or Center will plan.
implement, document, and assess its quality system for the environmental work to be performed
as part of its mission.
The QMP defines an organization's QA-related:
policies and procedures.
criteria for and areas of application, and
roles, responsibilities, and authorities.
The QMP. therefore, is a management tool that should be appropriately tailored to the needs of
the organization. The QMP must be sufficiently inclusive, explicit, and readable to enable
managers and supervisors to understand the priority that senior management places on QA, the
established QA policies and procedures, and their respective QA roles. The QMP must be
constructed and written so that an assessment of its effectiveness following implementation can
be made. This enables managers to determine whether or not the quality system is being
implemented in a way that ensures successful results from environmental programs. The QMP
should focus on the processes used to plan, implement, document, and assess the programs to
which it is applied. The level of detail should be based on a common sense, graded approach that
establishes QA and QC requirements commensurate with the importance of the work, the
available resources, and the unique needs of the organization.
QMPs shall be tailored to individual requirements and modified as the requirements
change. This chapter describes the quality management practices which are normally considered
to be critical to an effective quality system. Each Agency organization shall evaluate these key
elements to see if they are applicable to its quality system. Where a particular element is not
relevant, a brief explanation of why it is not relevant shall be provided in the QMP. If the QMP
3-1
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
preparer determines that additional quality management elements are useful or necessary for an
adequate quality system, these elements shall be developed and discussed in the QMP.
3.2 Preparation. Submission. Review, and Approval
3.2.1 QMP Preparation Responsibility
The senior manager for each EPA organization is responsible for the preparation of a
QMP that covers all environmental programs for which the manager is accountable. A senior
manager is a manager who is responsible and accountable for mission accomplishment and
overall operations. Senior management shall ensure that the quality system documented in the
QMP complies with the requirements in this Manual.
If desired by an organization's management, a draft of the QMP may be submitted to
QAD one time for informal comment prior to the formal review and approval process. However.
an informal review by QAD shall not be used to replace a thorough review of the quality system
and the proposed QMP by the management of the organization preparing the plan.
3.2.2 Internal Submission and Approval
The QMP must be approved and signed by the senior manager of the organization
preparing the QMP. The senior manager shall indicate his/her approval of the QMP on the
signature page of the document. The senior managers are designated as follows-
Organization Preparing the OMP Senior Manager
Headquarters Office Office Director
Headquarters Field Component Office Director
Laboratory/Center/Office Laboratory/Center/Office Director
Regional Office Regional Administrator
The QMP must also be approved and signed by the QA manager of the organization, the QAD
Director, and the ORD\NCERQA Director. The senior manager may require the concurrence on
the QMP by appropriate subordinate line managers to encourage the acceptance and
implementation of the quality system. Subordinate line managers may include Division
Directors, Branch Chiefs, and other supervisory personnel as defined for a particular
organization.
3-2
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
3.2.3 Agency Review and Approval of the QMP
The QMP must be submitted to ORD\NCERQA for review and approval. Each QMP
will be reviewed to determine compliance with Agency-wide Quality System requirements. The
review of the QMP shall focus on the substance of the group's QA management process and not
on format or technical details. QMPs that address all mandatory program elements and include
acceptable QA policies, procedures, administrative criteria, and management systems for key QA
elements including systematic planning processes, QA Project Plans, other QMPs, Standard
Operating Procedures, assessments, and oversight of delegated programs shall be approved.
QMP approval shall be valid for a period not to exceed five years.
3.2.4 QMP Revisions
Although the QMP approval by the Agency is valid for up to five years, all Agency
quality systems must be reviewed at least annually by their organizations to reconfirm the
effectiveness of the approved quality management practices. This assessment must include an
evaluation of the effectiveness of the QMP. The process of developing and annually updating
the QMP provides an opportunity for management and staff to review and clarify roles and
responsibilities, to address problem areas, and to acknowledge successes Having an accurate
QMP at all times is an essential element in every quality system. Changes in QA policy and
procedures shall be documented in a timely fashion by QMP revisions. In general, a copy of any
QMP revision(s) made during the year should be submitted to QAD as an attachment to or as
part of the QA Annual Report and Work Plan (see Chapter 4).
A revised QMP may be submitted at any time, but is required under certain conditions
including:
expiration of the five-year life of the approved QMP,
a major reorganization that requires "Directive Clearance" review (EPA, 1995),
a significant change in the organization's mission, such as may occur in the
reauthorization or revision of enabling environmental legislation, or
any major change to the organization's quality system.
All appropriate personnel performing work for the organization, including active
contractors and assistance agreement holders, shall be notified of all changes to the quality
system and the QMP that may affect their work for EPA and to keep them apprised of the current
requirements.
3-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
3.3 Quality Management Plan Requirements
3.3.1 General Requirements
The QMP describes the processes by which the organization plans, implements,
documents, and determines the effectiveness of quality management practices, including QA/QC
activities, to help management to obtain results of its technical work that are of the type and
quality needed for their intended use. Specifically, the QMP must discuss:
the mission and quality policy of the organization.
the specific roles and responsibilities of management and staff with respect to
QA/QC activities,
the means and structure by which effective communications are assured,
the process(es) used to plan, implement, and assess the work performed,
the process(es) by which measures of effectiveness for QA/QC will be established
and how frequently effectiveness will be measured, and
the process for continual improvement of the organization's quality system.
The QMP should reflect the organization's commitment to quality management principles and
practices, tailored by senior management to meet the organization's needs.
To reduce duplication between QMPs and QAPPs. the QMP shall include discussion of
those activities, policies, and procedures that are common to all projects. Such discussions
provide an "umbrella" under which individual project activities may be performed.
There are ten elements contained in a QMP. If an element is not applicable to an
organization's quality system, then the QMP must state why this is the case. Specific
requirements for each of the elements follow (Sections 3.3.2 - 3.3.11).
3.3.2 Management and Organization
Provide or address the following management and organizational items:
a statement of the organization's policy on QA, including the importance of
quality in its products to the organization and its mission, and why; the general
3-4
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
objectives/goals of the quality system; and the policy for resource allocation for
the quality system, including personnel, extramural funding, and travel funding;
an organization chart that identifies all of the components of the organization and,
in particular, the organizational position and lines of reporting for the QA
Manager (and any QA staff) that confirms and documents the independence of the
QA Manager from groups generating, compiling, and evaluating environmental
data;
a discussion of the responsibilities and authorities of the QA Manager and any
other QA staff;
a brief discussion of the technical activities or programs that are supported by the
quality system and to which it applies; that is. the specific programs that require
extensive quality management controls; where oversight of delegated, contracted,
or other extramural programs is needed to assure data quality; and where internal
coordination of QA and QC among the group's organizational units needs to
occur;
a discussion of the QA/QC roles and responsibilities of line management,
technical staff, and any other staff, and how these roles and responsibilities are
incorporated into performance standards;
a discussion of the organization's process for resolving disputes regarding quality
system requirements, QA/QC procedures, assessments, or corrective actions;
a discussion of how management shall assure that applicable elements of the
quality system are understood and implemented in all environmental programs;
and
an approval page for the signatures of the senior manager, senior line management
(as appropriate), the QA manager of the organization, the QAD Director, and the
NCERQA Director. This approval page may be part of a title page or a separate
sheet following the title page. Approving officials whose signatures must be
contained on the approval page are described in section 3.2.2.
3.3.3 Quality System and Description
Discuss the principal components (or "tools") comprising the quality system and how
they are used to implement the quality system. These components include, but are not limited to
QMPs, management assessments (self and independent), systematic planning processes, QA
3-5
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Project Plans, Standard Operating Procedures, technical assessments (self and independent), and
Data Quality Assessments. This discussion shall also identify how and when the components of
the quality system are to be applied to individual projects and tasks.
3.3.4 Personnel Qualifications and Training
State the organization's policy regarding training for management and staff. Describe the
processes and the management and/or staff responsible for:
identifying statutory, regulatory, or professional certifications that may be
required to perform certain operations; and
identifying, designing, performing, and documenting technical, quality, and
project management training.
Describe how staff proficiency in critical technical disciplines is maintained and
documented.
3.3.5 Procurement of Items and Services
Describe and discuss the organization's process for ensuring that all appropriate
extramural agreements, including grants, cooperative agreements, and contracted and
subcontracted activities, involving or affecting environmental programs shall:
contain appropriate QA/QC requirements in all applicable documents;
receive the same review and approval for changes as for the original documents;
address satisfactorily all QA/QC requirements in applicable responses to
solicitations and include QA as an integral criterion in the evaluation criteria;
provide objective evidence of quality furnished by suppliers and subcontractors
for applicable items and services, including source selection, source inspections,
supplier audits, and examination of deliverables; and
provide evidence of the suppliers capability to satisfy EPA QA/QC requirements.
as defined in the extramural agreement or applicable regulation (e.g., 40 CFR Part
30, 40 CFR Part 31,48 CFR Chapter 15, Part 1546).
Describe how procurement documents or financial assistance agreements shall require
suppliers (i.e., contractors, subcontractors, or financial assistance recipients) to have a quality
3-6
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
system consistent with EPA requirements. This requirement applies only to those suppliers who
provide services or items that directly affect the quality of results or products from environmental
programs.
3.3.6 Documents and Records
Describe or provide a reference to the process:
for identifying quality-related documents and records requiring control;
for handling documents and records to assure their accessibility, protection from
damage and deterioration, and means of retention, including discussion of the
roles and responsibilities for management and staff;
by which all technical guidance documents are prepared, reviewed, approved,
issued, used, and revised; and
by which all planning documents (e.g., QA Project Plans, Sampling and Analysis
Plans) are prepared, reviewed, approved, issued, used, and revised; and
that ensures compliance with all statutory, contractual, and assistance agreement
requirements for records from environmental programs and that provides adequate
preservation of key records necessary to support the mission of the organization.
Documents and records, including revisions, must be reviewed for conformance with the quality
system requirements and approved by authorized personnel before general use.
Describe or provide a reference to the management process that ensures that records
accurately reflect completed work and/or fulfill statutory and contractual requirements, including
any specific record keeping requirements defined in EPA Order 2160 and EPA Directive 2100,
Chapter 10. The maintenance of records includes defining requirements and responsibilities for
record transmittal, distribution, retention, protection, preservation, traceability, disposition, and
retrievability.
Identify how the disposition of records, in accordance with regulatory requirements,
schedules, or directives from senior management, is accomplished.
3-7
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
3.3.7 Computer Hardware and Software
Describe or discuss:
how applicable EPA requirements for information resources management are
addressed (EPA Directive 2100) including Year 2000 compliance, security, and
privacy requirements (Chapters 5. 8, and 11 of EPA Directive 2100, respectively);
the process for ensuring that computer hardware used in environmental programs
meets technical requirements and quality expectations (i.e., configuration testing);
how changes to hardware shall be controlled to assess the impact of the change on
performance;
the process for developing computer software, for validating, verifying, and
documenting the software for its use. and for assuring that the software meets the
requirements of the user (EPA Directive 2182);
how purchased software is evaluated to meet user requirements and to comply
with applicable contractual requirements and standards; and
the process for ensuring that data and information produced from or collected by
computers meet applicable EPA information resources management requirements
and standards (EPA Directive 2100).
These discussions shall include the roles and responsibilities assigned to management and staff.
The QMP shall document how the organization manages its computer hardware and software
operations that directly impact the quality of the results of environmental programs. Computer
programs covered by this Manual include, but are not limited to. design, design analysis, data
handling, data analysis, modeling of environmental processes and conditions, operations or
process control, and data bases.
3.3.8 Planning
3.3.8.1 Systematic Planning
Environmental data operations shall be planned using a systematic planning process that
is based on the scientific method. The planning process shall be based on a common sense,
graded approach to ensure that the level of detail in planning is commensurate with the
importance and intended use of the work and the available resources. Elements of a systematic
planning approach that shall be documented include:
3-8
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Identification and involvement of the project manager, sponsoring organization
and responsible official, project personnel, stakeholders, scientific experts, etc.
(e.g., all customers and suppliers);
Description of the project goal, objectives, and questions and issues to be
addressed;
Identification of project schedule, resources (including budget), milestones, and
any applicable requirements (e.g., regulatory requirements, contractual
requirements);
Identification of the type of data needed and how the data will be used to support
the project's objectives:
Determination of the quantity of data needed and specification of performance
criteria for measuring quality;
Description of how. when, and where the data will be obtained (including existing
data) and identification of any constraints on data collection.
Specification of needed QA/QC activities to assess the quality performance
criteria (e.g.. QC samples for both the field and laboratory, audits, technical
assessments, performance evaluations, etc.).
Description of how the acquired data will be analyzed (either in the field or the
laboratory)- evaluated (i.e.. QA review, validation, verification), and assessed
against its intended use and the quality performance criteria
A systematic planning process shall ensure that all organizations and/or parties who
contribute to the quality of the environmental program or use the results are identified and that
they participate in this process. The planning process shall also provide for direct
communication between the customer and the supplier to ensure that there is a clear
understanding by all participants of the needs and expectations of the customer and the product
or results to be provided by the supplier. EPA has developed a systematic planning process
called the Data Quality Objectives Process (EPA, 1994). While not mandatory, this process is
the recommended planning approach for many EPA data collection activities.
Describe the process for planning environmental programs, including identification of
who is responsible and how general project planning is documented. Describe who uses the
3-9
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
planning "tools" (as defined in the Quality System Description section of the QMP) and the roles
and responsibilities of all management and staff involved in planning.
3.3.8.2 Quality Assurance Project Plans
Discuss how the results of planning for environmental data operations shall be
documented in a Quality Assurance Project Plan (QAPP) (see Chapter 5) and approved by
authorized personnel for implementation. The process for developing, reviewing, approving,
implementing, and revising a QAPP, must be described in this section of the QMP. Identify the
staff who is authorized to approve QAPPs.
Describe or discuss how data obtained from sources outside EPA that did not use an
EPA-approved QAPP (or equivalent planning document) for data collection shall be evaluated
and qualified for use. Discuss the process for qualifying such data, including the application of
any statistical methods used.
3.3.9 Implementation of Work Processes
Describe the process of how and by whom work shall be implemented within the
organization for:
ensuring that work is performed according to plan;
development and implementation of procedures for. <- propnate routine,
standardized, special, or critical operations, including those that address, but are
not limited to:
identification of operations needing procedures;
preparation of procedures, including form, content, and applicability, and
review and approval of procedures; and
use of QA/QC '"tools" such as standard operating procedures (SOPs).
Describe how appropriate measures for controlling the release, change, and use of
planned procedures are implemented. These measures provide for the necessary approvals,
specific times and points for implementing changes, removal of obsolete documentation from
work areas, and verification that the changes are made as prescribed.
To help to assure consistency in common procedures, SOPs are encouraged for
appropriate routine, standardized, or special/critical operations. The QMP shall contain the
organization's process for identifying the need for SOPs, the process for developing SOPs, and
3-10
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
the policy for using SOPs. The QMP shall also describe the process by which SOPs are
reviewed for initial and subsequent use.
3.3.10 Assessment and Response
Describe how and by whom assessments of environmental programs are planned,
conducted, and evaluated. Describe the process by which management chooses a particular
assessment tool, and the expected frequency of their application to environmental programs.
Available assessment tools include audits, data quality assessments, management systems
reviews, peer reviews and technical reviews, performance evaluations, readiness reviews,
technical systems audits, and surveillances. Senior management shall assess (at least annually)
the adequacy of the quality system.
Discuss or address the following items pertaining to management and technical
assessments:
how the process for the planning, scheduling, and implementation of assessments
works, as well as how the organization shall respond to needed changes;
r
esponsibilities. levels of participation, and authorities for all management and
staff participating in the assessment process, and
how. when, and by whom actions shall be taken in response to the findings of the
assessment, and how the effectiveness of the response shall be determined.
Describe how the level of competence, experience, and training necessary to ensure the
capability of personnel conducting assessments are determined. Personnel conducting
assessments shall be qualified, based on project-specific requirements, to perform the assigned
assessment. Management is responsible for choosing the assessors, defining acceptance criteria.
approving audit procedures and check lists, and identifying goals prior to initiation of an
assessment. Assessors shall be technically knowledgeable with no real or perceived conflict of
interest. If the assessors are chosen from within the organization, they must have no direct
involvement or responsibility for the work being assessed, except for self-assessments.
Describe how personnel conducting assessments shall have sufficient authority, access to
programs and managers, access to documents and records, and organizational freedom to:
identify quality problems;
identify and cite noteworthy practices that may be shared with others to improve
the quality of their operations and products;
3-11
-------
EPA Quality Manual for Environmental Programs . 5360
07/16/98
propose recommendations for resolving quality problems; and
independently confirm implementation and effectiveness of solutions.
The QMP shall also discuss conditions under which a "stop work" order may be needed and
when and how authority for such decisions shall be made.
Describe how assessment results shall be documented, reported to, and reviewed by
management. Describe how management shall respond to the results (or findings) and
recommendations from assessments in a timely manner. When conditions needing corrective
action are identified, the appropriate response must be made promptly. Indicate how follow-up
action shall be taken and documented to confirm the implementation and effectiveness of the
response action. Describe how disputes, if encountered, as a result of assessments are addressed
and by whom.
3.3.11 Quality Improvement
Describe how the organization shall detect and prevent quality problems. Describe the
organization's process for ensuring continual quality improvement, including the management
process for determining, planning, implementing, and evaluating the effectiveness of quality
improvement activities; who (organizationally) is responsible for quality improvement: and the
corrective action program to ensure that conditions adverse to quality are identified promptly and
corrected as soon as practical.
Corrective actions shall include the identification of root causes of problems, the
determination of whether the problem is unique or has more generic implications, and a
recommendation of procedures to prevent recurrence.
The QMP shall describe how staff at all levels are encouraged to identify and establish
communications among customers and suppliers, identify process improvement opportunities.
identify problems, and offer solutions to those problems.
3-12
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
CHAPTER 4
QUALITY ASSURANCE ANNUAL REPORT AND WORK PLAN
4.1 Background
Careful annual planning is necessary to the success of the Agency-wide Quality System.
In order for management to budget adequate resources to implement the quality system for an
organization, estimates of the quality system workload are needed. Moreover, management must
give priority to quality system resource needs with respect to other mission requirements.
All Agency organizations subject to the requirements of EPA Order 5360.1 CHG 1 shall
submit a Quality Assurance Annual Report and Work Plan (QAARWP) annually. The
QAARWP shall summarize the results of having implemented the quality system the previous
fiscal year and describe QA activities planned for the fiscal year beginning in October. The
QAARWP may be used to identify limited changes or updates to the organizations^ approved
Quality Management Plan (QMP) (see Chapter 3). The QAARWP should provide helpful
information to management by documenting the past fiscal year's activities and estimating the
current year's workload based on the prior year and the expected activities in the current year.
4.2 Use of OAARWP Submissions
The contents of the QAARWPs shall be used by QAD to evaluate the overall
effectiveness of the Agency-wide Quality System. As problems related to QA are identified by
EPA organizations. QAD shall use the QAARWP information to id/ -tify systemic or Agency-
wide problems and shall initiate plans to address such problems. The QAARWPs shall not be
approved as are QMPs.
4.3 Requirements
The QAARWP must be submitted under the signature of the senior manager for the
organization to the AA/ORD. Organization is defined here as an ORD Center. Laboratory, or
Office; individual Program Office one level under an AA-ship, or Region. In order to simplify
the submittal, the QAARWP and its attachments may be submitted electronically to the QAD
Director along with a copy of the original signature page. The QAARWP has two parts, the
annual report for the previous fiscal year and the proposed work plan for the new fiscal year.
Specifications for the QAARWP are contained in Sections 4.3 1 - 4.3.2.
4-1
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
4.3.1 QA Annual Report
4.3.1.1 Quality Management Resources
Resources provided here may be estimated if not strictly accounted for by position or
expense tracking. For example, if 10% of the time of all project officers is spent on quality
assurance activities, then an estimate can be made by multiplying 10% times the number of
project officers. If such an estimate is made, the algorithm should be provided to clarify the
response.
Provide a current estimate of the organization's filled FTE positions.
State the total EPA (and other Federal) FTE (to the nearest tenth of an FTE)
involved in the management of QA/QC activities. Examples of these activities
include providing input to management on the need for and use of QA resources.
disseminating Agency QA policy, developing and ensuring the implementation of
the organization's QMP (including document tracking, auditing, and training),
and acting as a liaison with QAD. Vacancies should be listed separately.
State the total EPA (and other Federal) FTE involved in QA/QC support
activities. Examples of these activities include writing and reviewing QAPPs and
Standard Operating Procedures (SOPs) and validating data.
If your organization uses contractor support to impkvient the quality system, state
the total contractor FTEs involved in QA/QC support activities. Include the
technical QA/QC support of Senior Environmental Employment Program (SEEP)
grantees or other grantees.
State the total FTEs involved in other non-technical QA/QC support activities.
This category would include the non-technical SEEP employees and clerical staff.
State the total dollar amounts (rounded to nearest $K) of other QA supporting
funds, not including travel funds or training.
State the total dollar amounts of travel funds used for QA activities such as
oversight, surveillance, and audits/assessments
State the total dollar amount of funds used for QA/QC training, including travel
for training, and the total number of people who attended the training. Include
training for QA staff.
4-2
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Discuss the adequacy of the above listed resources in relation to their impact on
your quality system, including the ability to implement last year's work plan.
4.3.1.2 Training
Briefly describe the method used to assess the organization's QA training needs
and the results of the assessment; i.e., what needs were identified. Discuss
separately any needs assessment made of other organizations participating in your
quality system (i.e., States, Tribes, Regions).
List courses and name the supplier(s) for QA/QC courses given to your
organization and other non-EPA organizations participating in your quality
system. The courses attended by the QA staff, while critically important for
educating new QA staff members, are not the primary concern of QAD. For
example, contract administration and field/lab equipment techniques are not
considered QA courses. Statistics courses, however, are considered related to QA
in terms of project planning and data analysis.
List the attendance for each course. If course attendees included persons from
outside your organization, identify the total attendance by each organization
represented.
For each course, indicate whether the course goals were achieved; that is. were the
training needs fulfilled? If not, please indicate why and what you believe needs to
be done to satisfy the remaining needs
4.'3 1.3 Management Accomplishments
Discuss any innovative quality management practices you have developed and
used in planning, implementing, or assessing your quality system. Include any
proposed revisions to your Quality Management Plan reflecting changes to your
operating practices for QA/QC.
Summarize the technical assessments that were performed by your organization
on itself and others participating in your quality system. For each assessment.
identify the type of assessment performed, the organization and project which
were the subject of the assessment, when the assessment was performed, and who
did the assessment. Also provide a general statement of the assessment results
and any corrective actions. For example, the QA staff members performed
technical systems audits of these projects: (list). Note, if this information is
4-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
indicated on an attached quality system tracking program output, give the totals
here.
.
Summarize the technical assessments that were performed on your organization
by others. For each assessment, identify the type of assessment performed, the
organization and project which were the subject of the assessment, when the
assessment was performed, and who did the assessment. Also provide a general
statement of the assessment results and any corrective actions.
Summarize technical assistance given on planning, data review, etc. For QAPPs,
the numbers of QAPPs reviewed (or re-reviewed) and an indication of average
turnaround time is sufficient. Note, if tracking program outputs are attached, give
totals for intramural and extramural projects. Include QA assistance given by the
organization or individuals to non-EPA organizations, including states, private
industry, and foreign countries. Organizations participating in your quality
system that have QMPs reviewed and approved by you should also be listed.
List any new or revised QA guidance developed by your organization. It is not
necessary to list SOPs written and revised during the past year. The numbers of
both new and revised SOPs is sufficient.
List any publications and presentations concerning QA/QC practices and results
by your organization. QA guidance listed above need not be repeated. Internet or
other electronic document forms should be included.
List any awards or recognition related to QA given to your organization or to
individual staff members.
4.3.1.4 Management Assessment of the Approved Quality System
Summarize the management assessments (i.e. management systems reviews) that
were performed bv your organization on itself and others participating in your
quality system. Include the part of the implemented program that was examined
and what was learned (including positive findings). If corrective actions were
indicated, summarize the response actions taken, and discuss progress toward
their implementation. Report on their effectiveness, if known.
Summarize the management assessments that were performed bv others
(including QAD) on your quality system. Include the part of the implemented
program that was examined and what was learned. If corrective actions were
indicated, briefly summarize the response actions taken, and discuss progress
4-4
-------
EPA Quality Manual for Environmental Programs 5350
07/16/98
toward their implementation. In particular, highlight any incomplete corrective
actions resulting from QAD's assessments. Report on the effectiveness of the
corrective actions, if known.
4.3.2 Work Plan
4.3.2.1 Quality Management Resources
State the total EPA (and other Federal) FTE (to the nearest tenth of an FTE)
proposed for supporting quality management activities in your organization.
Examples of these activities include providing input to management on the need
for and use of QA resources, disseminating Agency QA policy, developing and
ensuring the implementation of the organization's QMP (including document
tracking, auditing, and training), and acting as a liaison with QAD. Vacancies
should be listed separately.
State the total EPA (and other Federal) FTE proposed for QA/QC support
activities. Examples of these activities include writing and reviewing QAPPs and
SOPs and validating data.
If your organization uses contractor support to implement the quality system, state
the total contractor FTEs proposed for the QA/QC support activities.
State the total FTEs proposed for other non-technical QA/QC support activities.
This category would include Senior Environmental Employment Program
employees, other grantees, and clerical staff
State the total dollar amounts (rounded to nearest $K) of proposed QA/QC
support funds, not including travel funds or training.
State the total dollar amounts of proposed travel funds for QA activities such as
oversight, surveillance, and audits.
State the total dollar amounts of proposed funds for training, including travel.
4.3.2.2 Activities
List and briefly describe anticipated major QA/QC activities expected during the
year including QA/QC-related training to be given, taken, or developed, guidance
to be developed or revised, technical and management assessments of your
4-5
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
organization and others participating in your quality system, and implementation
of corrective actions from prior MSRs of your quality system.
4-6
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
CHAPTER 5
QUALITY ASSURANCE PROJECT PLANS
5.1 Introduction
EPA policy requires that all work performed by or on behalf of EPA involving the
collection of environmental data shall be implemented in accordance with an Agency-approved
Quality Assurance Project Plan (QAPP). The QAPP defines and documents how specific data
collection activities shall be planned, implemented, and assessed during a particular project. This
chapter presents detailed specifications on the information that must be addressed in a QAPP for
environmental data operations performed by or on behalf of EPA and on the procedures for its
review and approval. Guidance on developing QAPPs, including examples of QAPP elements,
may be found in EPA QA/G-5, Guidance on Qualify Assurance Project Plans.
The QAPP is a critical planning document for any environmental data operation since it
documents how environmental data operations are planned, implemented, documented, and
assessed during the life cycle of a program, project, or task. The ultimate success of an
environmental program or project depends on the adequacy and sufficiency of the quality of the
environmental data collected and used in decision-making This may depend significantly on the
adequacy of the QAPP and its effective implementation. Quality planning (Section 3.3.8.1) is an
absolutely essential component of project management and the QAPP provides the mechanism
for documenting the results of the planning process. This planning must include the
"stakeholders" (i.e., the data users, data producers, decision makers, etc.) to ensure that all needs
are defined adequately at the outset and that the planning for quality addresses the specific needs
defined.
In the sections to follow, the elements of the QAPP are discussed in detail. These
elements represent the information generally required for most data operations involving the
characterization of environmental processes and conditions Because of the diversity of Agency
programs, some elements described in this chapter may not be applicable to all programs The
final decision on the applicability or use of any or all of these elements for QAPPs shall be made
by individual EPA organizations. EPA organizations may tailor these requirements in their own
implementation documents to better fit their specific needs.
5.2 OAPP Responsibilities and Application
5.2.1 QAPP Preparation Responsibilities and Approvals
The EPA organization's Quality Management Plan (QMP) establishes how, when, and by
whom development, review, approval, and effective oversight of QAPPs occurs, including
situations in which QAPPs are prepared by extramural (non-EPA) organizations. In some cases,
5-1
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
it may be necessary to add special requirements to the QAPP. The EPA organization sponsoring
the work shall define any specific requirements beyond those listed in this manual.
*
No environmental data collection work shall be started until the QAPP has been approved
and distributed to project personnel except under circumstances requiring immediate action to
protect human health and the environment or operations conducted under police powers. Some
non-data collection activities such as equipment procurement, instrument calibration, etc., may
be conducted prior to the approval of the QAPP. In limited circumstances, EPA may grant
conditional approval to a QAPP to permit some work to begin while non-critical deficiencies in
the QAPP are being resolved.
5.2.2 QAPP Implementation and Revision
All QAPPs shall be implemented as approved by EPA. The organization performing the
work shall implement the approved QAPP and ensure that all personnel involved in the work
have copies of the approved QAPP and all other necessary documents. Personnel implementing
the approved QAPP should understand the requirements prior to the start of data generation
activities.
Because of the complex and diverse nature of environmental data operations, changes to
original plans are often needed. The EPA Project Manager, with the assistance of the QA
Manager as appropriate, must determine the impact of such changes on the technical and qual'ity
objectives of the project. When a substantive change is warranted, the originator of the QAPP
shall modify the QAPP to document the change and submit the revision for approval by the same
authorities that performed the original review Only after the revision has been approved and
received (at least verbally with written follow-up) by project personnel, shall the change be
implemented.
It is essential that the QAPP be kept current and that all personnel involved in the work
have easy access to a current version of the QAPP. For programs or projects of long duration,
such as multi-year monitoring programs, the QAPPs shall be reviewed at least annually by the
Project Manager. If revisions are necessary to reflect current needs, the QAPP must be revised
and resubmitted for review and approval.
5.2.3 Applicability of QAPPs
The QAPP requirements in this chapter apply to all (intramural and extramural)
environmental data operations that acquire, generate, or compile environmentally-related data
and that are performed by or on behalf of EPA. Extramural data operations may include
contracts and work assignments, deliver)' orders, task orders, cooperative agreements.
interagency agreements, State-EPA agreements, State, local, and Tribal Financial
5-2
-------
EPA Quality Manual for Environmental Programs . 5360
07/16/98
Assistance/Grants, Research Grants, and responses to statutory or regulatory requirements and to
consent agreements negotiated as part of enforcement actions. QA/QC requirements shall be
negotiated into applicable interagency agreements, including sub-agreements since EPA cannot
unilaterally impose its QA/QC requirements in these agreements. Where specific Federal
regulations require QA/QC, QAPPs shall be prepared, reviewed, and approved in accordance
with the specifications contained in this document for the data collection activity unless
superseded by the regulation.
5.3 OAPP Elements and Requirements
Environmental data operations encompass diverse and complex activities, including rule
making, compliance with regulations, and research. As a result, some environmental data
operations may only require a qualitative discussion of the experimental process and its
objectives while others may require extensive documentation in order to adequately describe a
complex environmental program. The content and level of detail in each QAPP may vary
according to the nature of the work being performed and the intended use of the data. The final
decision on QAPP content and level of detail belongs to the EPA organization responsible for the
work to be done, consistent with the approved QMP.
5.3.1 General Content Requirements
The QAPP must provide sufficient detail to demonstrate that:
the project technical and quality objectives (e g., Data Quality Objectives) are
identified;
the intended measurements or data acquisition methods are appropriate for
achieving project objectives;
assessment procedures are sufficient for confirming that data of the type and
quality needed and expected are obtained; and
any limitations on the use of the data can be identified and documented.
Most environmental data operations require the coordinated efforts of many individuals, possibly
including managers, engineers, scientists, statisticians, and others. The QAPP must integrate the
contributions and requirements of everyone involved into a clear, concise statement of what
needs to be accomplished, how it shall be done, and by whom. It must provide understandable
instructions to those who must implement the QAPP, including the field sampling team, the
analytical laboratory, and the data reviewers. The use of standard operating procedures and
national standards and practices is encouraged in all aspects of the QAPP.
5-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
In order to be effective, the QAPP must specify the level or degree of QA/QC needed for
the particular environmental data operations. The QA/QC technical requirements of a project
should commensurate with:
«
the purpose of the environmental data collection (e.g., enforcement action,
research and development),
the type of work to be done (e.g., monitoring, site characterization, bench level
proof of concept), and
how the results shall be used (e.g., regulatory enforcement, permit approval).
The QAPP must be composed of standardized, recognizable elements covering the entire
project from planning, through implementation, to assessment. The QAPP elements that follow
are presented in that order and have been arranged for convenience into four general groups. The
four groups of elements and their intent are summarized as follows:
A. Project Management - These elements cover the basic area of project
management, including the project history, project objectives, and roles and
responsibilities of the participants. These elements document that the project has
a defined goal and that the participants understand the goal and the approach to be
used.
B. Measurement/Data Acquisition - These elements cover all aspects of
measurement systems design and implementation, ensuring that appropriate
methods for sampling, analysis, data handling, and QC are employed and are
properly documented.
C. Assessment/Oversight - These elements address the activities for assessing the
effectiveness of the implementation of the project and associated QA/QC. The
purpose of assessment is to ensure that the QAPP is implemented as prescribed.
D. Data Validation and Usability - These elements cover the QA activities that
occur after the data collection phase of the project is completed. Implementation
of these elements ensures that the data conform to the specified criteria, thus
achieving the project objectives.
All applicable elements defined by the EPA organization sponsoring the work must be
addressed in the QAPP. Documentation, such as an approved Work Plan, Standard Operating
Procedures (SOPs), etc., may be referenced in response to a particular required QAPP element to
reduce the size of the QAPP and the time required for preparation and review. All referenced
5-4
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
documents must be attached to the QAPP itself or be placed on file with the appropriate EPA
office and available for routine referencing when needed. Such references must be kept current
by the submitter. The QAPP shall also address related QA planning documentation (e.g., Quality
Management Plans) from subcontractors or suppliers of services critical to the technical and
quality objectives of the project or task.
5.3.2 Group A, Project Management
This group of QAPP elements covers the basic area of project management, including:
Al Title and Approval Sheet
A2 Table of Contents
A3 Distribution List
A4 Project/Task Organization
A5 Problem Definition/Background
A6 Project/Task Description
A7 Quality Objectives and Criteria for Measurement Data
A8 Special Training Requirements/Certification
A9 Documentation and Records
5.3.2.1 A1. Title and Approval Sheet
Include the title of the plan, name of the organization(s) implementing the project, and
names, titles, signatures of appropriate approving officials and their - ^proval dates. Approving
officials include the Organization's Project Manager, Organization's Quality Assurance Manager.
EPA Project Manager, and EPA Quality Assurance Manager, as appropriate. Other officials, as
needed, may include the field operations manager, laboratory manager. State officials, and other
Federal Agency officials.
5.3.2.2 A2. Table of Contents
List the sections, figures, tables, references, and appendices. Document control format
may be required at the option of the Project Manager and QA Manager. When required, use a
document control format on each page following the Title and Approval Sheet. For example, the
following may be placed on the upper right hand comer of each page:
Section No.
Revision No.
Date
Page of
5-5
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
5.3.2.3 A3. Distribution List
List the individuals and their organizations who shall receive copies of the approved
QAPP and any subsequent revisions. Include all persons responsible for implementation
(including managers), the QA managers, and representatives of all groups involved.
5.3.2.4 A4. Project/Task Organization
Identify the individuals or organizations participating in the project and discuss their
specific roles and responsibilities. Include the principal data users, the decision-makers, the
project QA manager, and all persons responsible for implementation. The project quality
assurance manager must be independent of the unit generating the data. (This does not include
being independent of senior officials, such as corporate managers or agency administrators, who
are nominally, but not functionally, involved in data generation, data use. or decision-making.)
If someone other than the project manager is responsible for approving and accepting final
products and deliverables, then that individual shall be identified. The individual responsible for
maintaining the official, approved QAPP shall also be identified.
Provide a concise organization chart showing the relationships and the lines of
communication among all project participants. Include other data users who are outside of the
organization generating the data, but for whom the data are nevertheless intended; e.g., modelers,
risk assessors, design engineers, lexicologists, etc. The organization chart must also identify any
subcontractor relationships relevant to environmental data operations. Where direct contact
among project managers and data users does not occur, such as a S^v-rfund Potentially
Responsible Party and the EPA Risk Assessment staff, the organization chart should show the
pathway by which information is exchanged.
5.3.2.5 A5 Problem Definition/Background
State the specific problem to be addressed or decision to be made. Include sufficient
background information to provide the historical perspective for the project.
5.3.2.6 A6. Project/Task Description
Provide a description of the work to be performed and schedule for implementation. This
discussion may not need to be lengthy or overly detailed, but it should give an overall picture of
how the project shall resolve the problem or question described in A5. Describe in general terms
the following, as needed:
Measurements that will be made during the course of the project.
5-6
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Applicable technical, regulatory, or program-specific quality standards, criteria, or
objectives.
%
Any special personnel and equipment requirements.
The assessment tools needed (i.e., program technical reviews, surveillances, and
technical audits as needed by the project or specified by the QMP) for the project.
A schedule for the work to be performed.
Project and QA/QC records required, including the types of reports needed.
5.3.2.7 A7. Quality Objectives and Criteria for Measurement Data
Provide a statement of the project quality goals or objectives and measurement
performance criteria. EPA requires the use of a systematic planning process and prefers that
most project planning be accomplished using the DQO Process. For details on the DQO Process
and when it may be used, see the Guidance for the Data Quality Objectives Process (EPA
1994).
5.3.2.8 A8. Special Training Requirements/Certification
Identify and describe any specialized training or certification requirements needed by
personnel in order to successfully complete the project or task. Discuss how such training shall
be provided and how the necessary skills shall be assured and documented.
5:3.2.9 A9 Documentation and Records
Describe the process and responsibilities for ensuring that the most current approved
version of the QAPP is available.
Itemize the information and records which must be included in a data report package and
specify the desired reporting format. Documentation can include raw data, field logs, instrument
printouts, and results of calibration and QC checks. Specify the level of detail of the field
sampling and/or laboratory analysis narrative needed to provide a complete description of any
difficulties encountered during sampling or analysis. The narrative refers to an annotated
summary of the analytical work performed by a laboratory that describes in narrative form what
activities were performed and identifies any problems encountered that provides additional
information to users in interpreting the data received.
5-7
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Specify any requirements for the final disposition of records and documents from the
project, including location and length of retention period.
5.3.3 Group B, Measurement/Data Acquisition
This group of QAPP elements covers all aspects of measurement systems design and
implementation, including:
Bl Sampling Process Design (Experimental Design)
B2 Sampling Methods Requirements
B3 Sample Handling and Custody Requirements
B4 Analytical Methods Requirements
B5 Quality Control Requirements
B6 Instrument/Equipment Testing, Inspection, and Maintenance
Requirements
B7 Instrument Calibration and Frequency
B8 Inspection/Acceptance Requirements for Supplies and Consumables
B9 Data Acquisition Requirements (Non-direct Measurements)
B10 Data Management
5-3.3.1 Bl. Sampling Process Design (Experimental Design)
Describe the experimental design or data collection design for the project, including as
appropriate the types and numbers of samples required, the design of the sampling network,
sampling locations and frequencies, sample matrices, measurement parameters of interest, and
the rationale for the design. Classify each measurement as critical (i.e., required to achieve
project objectives) or non-critical (informational purposes only).
5.3.3.2 B2. Sampling Methods Requirements
Describe the procedures for collecting samples and identify the sampling methods and
equipment, including any implementation requirements, sample preservation requirements.
decontamination procedures, and materials needed. Identifying sampling methods by number,
date, and regulatory citation (as appropriate) is often sufficient. If a method allows the user to
select from various options, then the method citations should state exactly which options are
being selected. Describe specific performance requirements for the method. For each sampling
method, identify any support facilities needed. The discussion should also address what to do
when a failure in the sampling or measurement system occurs and who is responsible for
corrective action and how the effectiveness of the corrective action shall be determined and
documented.
5-8
-------
EPA Quality Manual for Environmental Programs 5350
07/16/98
Describe the process for the preparation and decontamination of sampling equipment,
including the disposal of decontamination by-products; the selection and preparation of sample
containers, sample volumes, preservation methods, and maximum holding times to sample
extraction and/or analysis.
5.3.3.3 B3. Sample Handling and Custody Requirements
Describe the requirements and provisions for sample handling and custody in the field,
laboratory, and transport, taking into account the nature of the samples, the maximum allowable
sample holding times before extraction or analysis, and available shipping options and schedules.
Sample handling includes preservation, packaging, shipment from the site, and storage at the
laboratory. Examples of sample labels, custody forms, and sample custody logs should be
included.
5.3.3.4 B4. Analytical Methods Requirements
Identify the analytical methods and equipment required, including subsampling or
extraction methods, laboratory decontamination procedures and materials (such as in the case of
hazardous or radioactive samples), waste disposal requirements (if any), and any specific
performance requirements for the method. Address what to do when a failure in the analytical
system occurs and who is responsible for corrective action and how the effectiveness of the
corrective action shall be determined and documented.
Identifying analytical methods by number, date, and regulatory citation (as appropriate) is
often sufficient. If a method allows the user to select from various options, then the method
citations should state exactly which options are being selected. For non-standard methods, such
as- unusual sample matrices and situations, appropriate method performance study information is
needed to confirm the performance of the method for the particular matrix. If previous
performance studies are not available, they must be developed during the project and included as
part of the project results.
5.3.3.5 B5 Quality Control Requirements
Identify QC procedures needed for each sampling, analysis, or measurement technique.
For projects at or beyond the "proof-of-concept" stage and projects employing well-characterized
methods, this section should list each required QC procedure, along with the associated
acceptance criteria and corrective action. Because standard methods are often vague or
incomplete in specifying QC requirements, simply relying on the cited method to provide this
information is usually insufficient.
5-9
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Identify required measurement QC checks for both the field and the laboratory; for
example, blanks, duplicates, matrix spikes, laboratory control samples, surrogates, or second
column confirmation. State the frequency of analysis for each type of QC check, and the spike
compounds sources and levels. State or reference the required control limits for each QC check
and corrective action required when control limits are exceeded and how the effectiveness of the
corrective action shall be determined and documented.
Describe or reference the procedures to be used to calculate each of the QC statistics,
including the QC checks described in the preceding paragraph as well as precision and bias.
Copies of the formulas are acceptable as long as the accompanying narrative or explanation
specifies clearly how the calculations will address difficult situations such as missing data values
and "less than" or "greater than" values.
5.3.3.6 B6. Instrument/Equipment Testing. Inspection, and Maintenance Requirements
Describe how inspections and acceptance testing of environmental sampling and
measurement systems and their components shall be performed and documented to assure their
intended use as specified by the design. Identify and discuss the procedure by which final
acceptance shall be performed by independent personnel (e.g.. personnel other than those
performing the data collection work) and/or by the EPA Project Officer. Describe how
deficiencies are to be resolved, and when re-inspection shall be performed and how the
effectiveness of the corrective action shall be determined and documented.
Identify the equipment and/or systems requiring periodic maintenance. Describe or
reference how periodic preventive and corrective maintenance of measurement or test equipment
shall be performed to ensure availability and satisfactory performance of the systems. Discuss
how the availability of critical spare parts, identified in the operating guidance and/or design
specifications of the systems, shall be ensured and maintained.
5.3.3.7 B7. Instrument Calibration and Frequency
Identify all tools, gauges, instruments, and other sampling, measuring, and test equipment
used for data collection activities affecting quality that must be controlled and, at specified
periods, calibrated to maintain performance within specified limits. Describe or reference how
calibration shall be conducted using certified equipment and/or standards with known valid
relationships to nationally recognized performance standards. If no such nationally recognized
standards exist, document the basis for the calibration. Identify the certified equipment and/or
standards used for calibration. Indicate how records of calibration shall be maintained and be
traceable to the instrument.
5-10
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
5.3.3.8 B8. Inspection/Acceptance Requirements for Supplies and Consumables
Describe how and by whom supplies and consumables sjiall be inspected and accepted
for use in the project. State acceptance criteria for such supplies and consumables. They
include, but are not limited to: sample bottles, calibration gases, reagents, hoses, materials for
decontamination of sampling equipment, deionized water, and potable water.
5.3.3.9 B9. Data Acquisition Requirements (Non-direct Measurements')
Identify any types of data needed for project implementation or decision making that are
obtained from non-measurement sources such as computer data bases, spreadsheets, programs,
and literature files. Define acceptance criteria for the use of such data in the project. Discuss any
limitations on the use of the data resulting from uncertainty in its quality and from the impact of
adding more error to the results.
5.3.3.10 BIO. Data Management
Describe the project data management scheme, tracing the path of the data from their
generation in the field or laboratory to their final use or storage. Describe or reference the
standard record-keeping procedures, document control system, and the approach used for data
storage and retrieval on electronic media Discuss the control mechanism for detecting and
correcting errors and for preventing loss of data during data reduction (i.e., calculations), data
reporting, and data entry to forms, reports, and databases. Provide examples of any forms or
checklists to be used.
Identify and describe all data handling equipment and procedures to process, compile.
ahd analyze the data including procedures for addressing data generated as part of the project as
well as data from other sources. Include any required computer hardware and software and
address any specific performance requirements for the hardware/software configuration used.
Describe the procedures that shall be followed to demonstrate acceptability of the
hardware/software configuration required
Describe the process for assuring that applicable Agency information resource
management requirements (EPA Directive 2100) are satisfied. Agency policy requires that
locational data be collected and reported with environmental data. If other Agency data
management requirements are applicable, such as the Chemical Abstract Service Registry
Number Data Standard (EPA Order 2180.1). Data Standards for the Electronic Transmission of
Laboratory Measurement Results (EPA Order 2180.2), or the Minimum Set of Data Elements for
Ground-Water Quality (EPA Order 7500.1 A), discuss how these requirements are addressed.
5-11
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
5.3.4 Group C, Assessment/Oversight
This group of QAPP elements addresses the activities for assessing the effectiveness of
the implementation of the project and associated QA/QC, including:
C1 Assessments and Response Actions
C2 Reports to Management
5.3.4.1 C1. Assessments and Response Actions
Identify the number, frequency, and type of assessment activities needed for this project.
Assessments include, but are not limited to surveillance, management systems review, readiness
review, technical systems audit, performance evaluation, audit of data quality, and data quality
assessment.
List and describe the assessments to be used in the project. Discuss the information
expected and the success criteria (i.e.. goals, performance objectives, acceptance criteria
specifications, etc.) for each assessment proposed. List the approximate schedule of activities.
For any planned self-assessments (utilizing personnel from within the project groups), identify
potential participants and their exact relationship within the project organization. For
independent assessments, identify the organization and person(s) that shall perform the
assessments if this information is available. Describe how and to whom the results of the
assessments shall be reported.
Define the scope of authority of the assessors, including stop work orders. Define
explicitly the unsatisfactory conditions under which the assessors are authorized to act and
provide an approximate schedule for the assessments to be performed.
Discuss how response actions to non-conforming conditions shall be addressed and by
whom. Identify who is responsible for implementing the response action. Describe how
response actions shall be verified, validated, and documented.
5.3.4.2 C2. Reports to Management
Identify the frequency and distribution of reports issued to inform management of the
status of the project, results of performance evaluations and system audits; results of periodic
data quality assessments; and significant quality assurance problems and recommended
solutions. Identify the preparer and the recipients of the reports.
5-12
-------
EPA Quality Manual for Environmental Programs 5350
07/16/98
5.3.5 Group D, Data Validation and Usability
This group of QAPP elements covers the QA activities that occur after the data collection
phase of the project is completed, including :
Dl Data Review, Validation, and Verification Requirements
D2 Validation and Verification Methods
D3 Reconciliation with User Requirements
5.3.5.1 Dl. Data Review. Validation, and Verification Requirements
State the criteria used to review and validate - that is, accept, reject, or qualify - data, in
an objective and consistent manner. Provide examples of any forms or checklists to be used.
Identify any project-specific calculations required.
5.3.5.2 D2. Validation and Verification Methods
Describe the process to be used for validating and verifying data, including the chain of
custody for data throughout the life cycle of the project or task. Discuss how issues shall be
resolved and the authorities for resolving such issues. Describe how the results are conveyed to
data users.
5.3.5.3 D3. Reconciliation with User Requirements
Describe how the results obtained from the project or task shall be reconciled with the
requirements defined by the user. Describe how issues shall be resolved. Discuss how
limitations on the use of the data shall be reported to decision makers
5-13
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
APPENDIX A
EPA ORDER 5360.1 CHG 1
POLICY AND PROGRAM REQUIREMENTS
FOR THE MANDATORY AGENCY-WIDE QUALITY SYSTEM
1. PURPOSE. This Order re-affirms the policy defined by EPA Order 5360.1, April 1984, and
expands that policy to accommodate the current and evolving needs of the Agency. The Order
establishes policy and program requirements for the preparation and implementation of
organizational or programmatic management systems pertaining to quality and contains the
minimum requirements for the mandatory Agency-wide Quality System.
2. BASIS. AUTHORITY. AND REQUIREMENTS.
a. Since 1979. Agency policy has required participation in an Agency-wide Quality
System by all EPA organizations (office, region, national center or laboratory) supporting
environmental programs and by non-EPA organizations performing work in behalf of EPA
through extramural agreements This policy was affirmed in EPA Order 5360.1 in April 1984
and is reaffirmed in this Order.
b. It is EPA policy that all environmental programs performed by EPA or directly for
EPA through EPA-funded extramural agreements shall be supported by individual quality
systems that comply fully with the American National Standard ANSI/ASQC E4-1994,
Specifications and Guidelines for Quality Systems for Environmental Data Collection and
Environmental Technology'Programs, incorporated herein by reference. ANSI/ASQC E4-1994
is a national consensus standard authorized by the American National Standards Institute (ANSI)
and developed by the American Society for Quality Control (ASQC) that will provide a basis for
the planning, implementation, documentation, and assessment of the Agency-wide Quality
System. Adoption of this standard is consistent with the statutory authority of the National
Technology Transfer and Advancement Act of 1995 and the implementation authority of Office
of Management and Budget (OMB) Circular A-l 19, Federal Participation in the Development
and Use of Voluntary Consensus Standards and in Conformity Assessment Activities.
c Under Delegation of Authority-I-41, "Mandatory Quality Assurance Program,'' the
Office of Research and Development (ORD) is the focal point in the Agency for Quality System
policy. ORD is responsible for developing quality assurance and quality control (QA/QC)
requirements and for overseeing implementation of the Agency-wide Quality System. The
Assistant Administrator for Research and Development (AA/ORD) is designated as the Agency
Senior Management Official for Quality. The Quality Assurance Division (QAD) is designated
by the AA/ORD to serve as the central management authority for this program.
A-l
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
d. Each EPA Headquarters Office, National Program Office, Region, and components
thereof, that conducts activities described by ANSI/ASQC E4-1994 shall develop and implement
a quality system that complies with the requirements of this Ord.er.
3. BACKGROUND
a. The Agency-wide Quality System is a management system that provides the necessary
elements to plan, implement, document, and assess the effectiveness of QA/QC activities applied
to environmental programs conducted by or for EPA. This system embraces many functions
including:
establishing quality management policies and guidelines for the development of
organization- and project-specific quality plans;
establishing criteria and guidelines for planning, implementing, documenting, and
assessing activities to obtain sufficient and adequate data quality,
providing an information focal point on QA/QC concepts and practices:
performing management and technical assessments to ascertain effectiveness of QA/QC
implementation; and
identifying and developing training programs related to QA/QC implementation.
In addition, this Order expands the applicability of QA/QC to the design, construction, and
operation by EPA organizations of environmental technology such as pollution control and
abatement systems; treatment, storage, and disposal systems; and remediation systems
b. A consistent. Agency-wide Quality System will provide, when implemented, the
needed management and technical practices to assure that environmental data used to support
Agency decisions are of adequate quality and usability for their intended purpose. Since most
EPA decisions rest on environmental data, a management system is needed that provides for: (1)
identification of environmental programs for which QA/QC is needed. (2) specification of the
quality of the data required from environmental programs, and (3) provision of sufficient
resources to assure that an adequate level of QA/QC is performed.
4. REFERENCES. The following documents contain provisions which, through reference in
this text, constitute provisions of this Order. At the time of the issuance of this Order, the
editions were valid. Since policy documents and standards are subject to periodic revision, users
of this Order should apply the most recent editions of the documents indicated below.
a. 40 CFR Pan 30, "Grants and Agreements With Institutions of Higher Education.
Hospitals, and Other Non-Profit Organizations."
A-2
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
b. 40 CFR Part 31, "Uniform Administrative Requirements for Grants and Cooperative
Agreement to State and Local Governments."
c. 40 CFR Part 35, "State and Local Assistance."
d. 48 CFR Chapter 15, Subpart 1546.2, "Contract Quality Requirements."
e. ANSI/ASQC E4-1994, Specifications and Guidelines for Quality Systems for
Environmental Data Collection and Environmental Technology Programs, American National
Standard, January 1995.
f. Circular A-l 19, Federal Participation in the Development and Use of Voluntary
Consensus Standards and in Conformity Assessment Activities, Office of Management and
Budget, February 1998.
g. Delegation of Authority 1-41, "Mandatory Quality Assurance Program,'' U.S.
Environmental Protection Agency, Washington, DC, April 1981.
h. EPA Order 5360. EPA Quality Manual for Environmental Programs. 1998.
i. National Technology Transfer and Advancement Act of 1995. PL 104-113. March 1996
5 SCOPE AND FIELD OF APPLICATION.
a. Scope. This Order defines the minimum requirements for quality systems supporting
EPA environmental programs that encompass:
(1) the collection, evaluation, and use of environmental data by or for EPA. and
(2) the design, construction, and operation of environmental technology by EPA.
b- Applicability to Environmental Programs. This Order applies to (but is not limited to)
the following environmental programs:
(1) the characterization of environmental or ecological systems and the health of
human populations;
(2) the direct measurement of environmental conditions or releases, including
sample collection, analysis, evaluation, and reporting of environmental data,
A-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
(3) the use of environmental data collected for other purposes or from other
sources (also termed "secondary data"), including literature, industry surveys, compilations from
computerized data bases and information systems, results from computerized or mathematical
models of environmental processes and conditions; and
%
(4) the collection and use of environmental data pertaining to the occupational
health and safety of personnel in EPA facilities (e.g., indoor air quality measurements) and in the
field (e.g., chemical dosimetry, radiation dosimetry).
c. Applicability to Other EPA Programs. This order applies to the collection and use of
medical testing data from Government and non-Government personnel in EPA facilities for
determination of substance abuse.
d. Organizational Applicability.
(1) EPA Organizations. The Agency-wide Quality System requirements defined
by this Order apply to all EPA organizations, and components thereof, in which the
environmental programs conducted involve the scope of activities described in Section 5.a above.
The authority of this Order applies only to EPA organizations except as addressed by Section
5.d(2) below.
(2) Extramural Agreements. Agency-wide Quality System requirements may
also apply to non-EPA organizations. These requirements are defined in the applicable
regulations governing extramural agreements. Agency-wide Quality System requirements may
also be invoked as part of negotiated agreements such as memoranda of understanding. Non-
EPA organizations that may be subject to quality system requirements include:
(a) Any organization or individual under direct contract to EPA to furnish
services or items or perform work (i.e., a contractor) under the authority of 48 CFR Chapter 15,
Part 1546. (including applicable work assignments, delivery orders, and task orders);
(b) Institutions of higher education, hospitals, and other non-profit
recipients of financial assistance (e.g.. Grants and Cooperative Agreements) under the authority
of 40 CFR Part 30;
(c) State, local, and Tribal governments receiving financial assistance
under the authority of 40 CFR Part 31 and 35; and
(d) Other Government Agencies receiving assistance from EPA through
interagency agreements.
A-4
-------
EPA Quality Manual for Environmental Programs . 5360
07/16/98
6. QUALITY SYSTEM REQUIREMENTS AND IMPLEMENTATION.
a. Quality System Requirements. EPA organizations cqvered by the scope of this Order
shall develop, implement, and maintain a quality system that demonstrates conformance to the
minimum specifications of ANSI/ASQC E4-1994 and that additionally provides for the
following:
(1) A quality assurance manager (QAM), or person assigned to an equivalent
position, who functions independently of direct environmental data generation, model
development, or technology development responsibility; who reports on quality issues to the
senior manager having executive leadership authority for the organization; and who has
sufficient technical and management expertise and authority to conduct independent oversight of
and assure the implementation of the organization's quality system in the environmental
programs of the organization.
(2) A Quality Management Plan (QMP), which documents the organization's
quality policy, describes its quality system, identifies the environmental programs to which the
quality system applies, and which is implemented following approval by the organization's
executive leadership and the AA/ORD.
(3) Sufficient resources to implement the quality system defined in the approved
QMP.
(4) Assessments of the effectiveness of the quality system at least annually.
. (5) Submittal to the AA/ORD of the Quality Assurance Annual Report and Work
Plan (QAARWP) for the organization that summarizes the previous year's QA/QC activities and
outlines the work proposed for the current year.
(6) Use of a systematic planning approach to develop acceptance or performance
criteria for all work covered by this Order. (See Section 3.3.8 of the EPA Quality Manual for
Environmental Programs, 1998.)
(7) Approved Quality Assurance Project Plans (QAPPs), or equivalent documents
defined by the QMP, for all applicable projects and tasks involving environmental data with
review and approval having been made by the EPA QAM (or authorized representative defined
in the QMP). QAPPs must be approved prior to any data gathering work or use, except under
circumstances requiring immediate action to protect human health and the environment or
operations conducted under police powers.
A-5
-------
EPA Quality Manual for Environmental Programs . 5360
07/16/98
(8) Assessment of existing data, when used to support Agency decisions or other
secondary purposes, to verify that they are of sufficient quantity and adequate quality for their
intended use.
(9) Implementation of Agency-wide Quality System requirements in all
applicable EPA-funded extramural agreements (see Section 5.d(2)).
(10) Implementation of corrective actions based on assessment results.
(11) Appropriate training, for all levels of management and staff, to assure that
QA/QC responsibilities and requirements are understood at every stage of project
implementation.
b. Quality System Implementation.
(1) EPA Organizations. Mandatory requirements for implementing this Order are
contained in the EPA Quality Manual for Environmental Programs, hereafter referred to as the
EPA Quality Manual. Additional non-mandatory guidance for implementing the requirements
are provided in EPA Guidance Documents which may be applied to intramural environmental
programs, as appropriate.
(2) Extramural Agreements.
(a) Mandatory requirements for implementing this Order are defined in
applicable EPA regulations. EPA Requirements Documents provide specifications for satisfying
the requirements of these regulations. The EPA Requirements Documents provide the equivalent
information to the EPA Quality Manual, except they have been written especially for the
extramural user. Non-mandatory guidance for implementing the requirements are provided in
EPA Guidance Documents which may be applied to extramural environmental programs, as
appropriate.
(b) Extramural organizations that provide objective evidence (such as a
QMP or quality manual) of conforming to the specifications of the American National Standard
ANS1/ASQC E4-1994 are in compliance with this Order.
A-6
-------
EPA Quality Manual for Environmental Programs
07/16/98
7- GENERAL REQUIREMENTS FOR MANAGERS AND STAFF
a' Assistant Administrator for Research and Development and ORQ Senior Manaperg
(1) The AA/ORD, as the Agency Senior Management Official for Quality, shall:
(a) Establish, document, and periodically revise Agency policies and
procedures for planning, implementing, and assessing the effectiveness of the mandatory
Agency-wide Quality System.
(b) Review and approve QMPs from Agency components conducting
environmental programs for implementation for up to five years.
(c) Perform periodic management assessments of all EPA organizations
conducting environmental programs to determine the effectiveness of their mandatory quality
systems and recommend corrective actions.
, (d) Develop generic training programs, for all levels of EPA management
and stati, so that quality management responsibilities and requirements are understood at every
stage of project implementation.
(2) The AA/ORD and ORD senior managers shall:
(a) Designate a representative for quality management and QA/QC to
advise and assist the AA in the planning, implementation, documentation, and assessment of the
quality systems for organizations under the AA's responsibility.
(b) Ensure that all ORD components and applicable programs comply
fully with the requirements of this Order.
(c) Ensure that quality management is an identified activity with
associated resources adequate to accomplish its program goals and is implemented as prescribed
in approved QMPs.
(<0 Ensure that all ORD-funded environmental programs implemented
through extramural agreements comply fully with applicable QA/QC requirements.
(e) Ensure that environmental data from research and development
programs are of sufficient quantity and adequate quality for their intended use and are used
consistent with such intentions.
A-7
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
(f) Perform periodic assessments of ORD organizations conducting
environmental programs to determine the conformance of their mandatory quality systems to
their approved QMPs and the effectiveness of their implementation.
(g) Ensure that deficiencies highlighted in the assessments of ORD
organizations are appropriately addressed.
(h) Identify program-specific QA/QC training needs for all levels of
management and staff and provide for this training.
(i) Ensure that performance plans for supervisors, senior managers, and
appropriate staff contain critical element(s) that are commensurate with the quality management
responsibilities assigned by this Order and the organization's QMP.
b. National Program Office Assistant Administrators and Senior Managers.
(1) Each National Program Office (NPO) Assistant Administrator shall designate
a representative for quality management and QA/QC to advise and assist the AA in the planning.
implementation, documentation, and assessment of the quality systems for organizations under
the AA's responsibility.
(2) The National Program Office (NPO) Assistant Administrators and senior
managers shall:
(a) Ensure that all NPO components and applicable programs comply
fully with the requirements of this Order.
(b) Ensure that quality management is an identified activity with
associated resources adequate to accomplish its program goals and is implemented as prescribed
in the organization's approved QMP.
(c) Ensure that all environmental programs implemented through
extramural agreements comply fully with applicable QA/QC requirements.
(d) Ensure that environmental data from the parts of National Programs
implemented by the Regions or delegated to State, local, and Tribal governments are of sufficient
quantity and adequate quality for their intended use and are used consistent with such intentions.
(e) Ensure that all proposed and final regulations needing environmental
data during their development or implementation include the application of sufficient and
adequate QA/QC during the collection and use of such data.
A-8
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
(0 Perform periodic assessments of NPO organizations conducting
environmental programs to determine the conformance of their mandatory quality systems to
their approved QMPs and the effectiveness of their implementation.
(g) Ensure that deficiencies highlighted in the assessments are
appropriately addressed.
(h) Identify program-specific QA/QC training needs for all levels of
management and staff and provide for this training.
(i) Ensure that performance plans for supervisors, senior managers, and
appropriate staff contain critical element(s) that are commensurate with the quality management
responsibilities assigned by this Order and the organization's QMP.
c- Regional Administrators and Senior Managers. Regional Administrators and senior
managers shall:
(1) Ensure that all Regional components and programs comply fully with the
requirements of this Order.
(2) Ensure that quality management is an identified activity with associated
resources adequate to accomplish its program goals and is implemented as prescribed in the
organization's approved QMP.
(3) Ensure that all environmental programs implemented through extramural
agreements comply fully with applicable QA/QC requirements.
(4) Ensure that the environmental data from environmental programs delegated to
State, local, and Tribal governments are of sufficient quantity and adequate quality for their
intended use and are used consistent with such intentions.
(5) Ensure that training is available for State, local, and Tribal governments
performing environmental programs for EPA in the fundamental concepts and practices of
quality management and QA/QC that they may be expected by EPA to perform.
(6) Perform periodic assessments of Regional organizations conducting
environmental programs to determine the conformance of their mandatory quality systems to
their approved QMPs and the effectiveness of their implementation.
(7) Ensure that deficiencies highlighted in the assessments are appropriately
addressed.
A-9
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
(8) Identify QA/QC training needs for all levels of management and staff and
provide for this training.
(9) Ensure that performance plans for supervisors, senior managers, and
appropriate staff contain critical element(s) that are commensurate with the quality management
responsibilities assigned by this Order and the organization's QMP.
d. Quality Management Personnel. Quality management personnel, including the QAM,
refers to individuals within the organization who are assigned specific quality management duties
and are delegated authority for quality management as defined in the organization's QMP. The
functions of the quality management personnel may be totally related to quality system activities
or be in conjunction with other functions and responsibilities within the organization. If these
personnel have other functions to perform, there should be no conflict of interest. Specific duties
and responsibilities of all quality management personnel shall be documented in the
organization's QMP. Specific responsibilities shall include:
(1) facilitating QMP development and approval by the organization and preparing
updates to the approved QMP;
(2) representing the organization to QAD and other groups on matters pertaining
to quality management and QA/QC,
(3) providing expert assistance to the staff in the organization on QA/QC
policies, requirements, and procedures applicable to procurement an- technical activities;
(4) reviewing and approving QMPs and QAPPs submitted by intramural
programs and by holders of extramural agreements as defined in the organization's QMP;
(5) identifying QA/QC training needs for the organization;
(6) providing oversight of QA/QC implementation in the environmental
programs conducted by or for the organization; and
(7) performing assessments of environmental programs and confirming the
effectiveness of corrective actions.
A-10
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
e. Agency Managers and Staff.
(1) Managers at all levels shall:
(a) Ensure that quality management is an identified activity with
associated resources adequate to accomplish its program quality goals.
(b) Ensure that all organizational components and programs comply fully
with the requirements of this Order.
(c) Ensure that all applicable environmental programs for which
management is responsible comply fully with the requirements of this Order.
(d) Perform all other quality management roles and responsibilities
assigned to them in their organization's QMPs.
(2) Managers and staff shall:
(a) Ensure that all applicable intramural programs and activities comply
fully with the requirements of this Order.
(b) Ensure that all applicable extramural environmental
which the manager or staff member is responsible comply fully with the requir
Order.
programs for
requirements of this
(c) Assure that the results of environmental programs are of sufficient
qnantity and adequate quality for their intended use.
(d) Perform all other quality management roles and responsibilities
assigned to them in their organization's QMPs.
8. DEFINITIONS. The following terms have special meanings in relation to this Order.
a. assessment - the evaluation process used to measure the performance or effectiveness
of a system and its elements. As used here, assessment is an all-inclusive term used to denote
any of the following: audit, performance evaluation, management review, peer review.
inspection, or surveillance.
b. environmental data - any measurements or information that describe environmental
processes, location, or conditions; ecological or health effects and consequences; or the
performance of environmental technology. For EPA, environmental data include information
A-ll
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
collected directly from measurements, produced from models, and compiled from other sources
such as data bases or the literature.
c. environmental programs - work or activities involving the environment, including but
not limited to: characterization of environmental processes and conditions; environmental
monitoring; environmental research and development; the design, construction, and operation of
environmental technologies; and laboratory operations on environmental samples.
d. environmental technology - an all-inclusive term used to describe pollution control
devices and systems, waste treatment processes and storage facilities, and site remediation
technologies and their components that may be utilized to remove pollutants or contaminants
from or prevent them from entering the environment. Examples include wet scrubbers (air), soil
washing (soil), granulated activated carbon unit (water), and filtration (air, water). Usually, this
term applies to hardware-based systems; however, it also applies to methods or techniques used
for pollution prevention, pollutant reduction, or containment of contamination to prevent further
movement of the contaminants, such as capping, solidification or vitrification, and biological
treatment.
e. extramural agreement - a legal agreement between EPA and an organization outside
EPA for items or services to be provided. Such agreements include contracts, work assignments.
delivery orders, task orders, cooperative agreements, research grants, state and local grants, and
EPA-funded interagency agreements.
f. management system - a structured non-technical system describing the policies.
objectives, principles, organizational authority, responsibilities, accountability, and
implementation plan of an organization for conducting work and producing items and services.
g. organization - a company, corporation, firm, enterprise, or institution, or part thereof.
whether incorporated or not. public or private, that has its own functions and administration. In
the context of this Order, an EPA organization is an office, region, national center or laboratory.
h. process - a set of interrelated resources and activities which transforms inputs into
outputs. Examples of processes include analysis, design, data collection, operation, fabrication.
and calculation.
i. quality - the totality of features and characteristics of a product or service that bear on
its ability to meet the stated or implied needs and expectations of the user.
j. quality assurance (QA) - an integrated system of management activities involving
planning, implementation, documentation, assessment, reporting, and quality improvement to
A-12
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
ensure that a process, item, or service is of the type and quality needed and expected by the
customer.
k. quality assurance manager (QAM) - the individual designated as the principal manager
within the organization having management oversight and responsibilities for planning,
documenting, coordinating, and assessing the effectiveness of the quality system for the
organization.
1. quality assurance project plan (QAPP) - a document describing in comprehensive
detail the necessary QA/QC and other technical activities that must be implemented to ensure
that the results of the work performed will satisfy the stated performance criteria.
m. quality control (QC) - the overall system of technical activities that measures the
attributes and performance of a process, item, or service against defined standards to verify that
they meet the stated requirements established by the customer; operational techniques and
activities that are used to fulfill requirements for quality.
n. quality management - that aspect of the overall management system of the
organization that determines and implements the quality policy. Quality management includes
strategic planning, allocation of resources, and other systematic activities (e.g., planning,
implementation, documentation, and assessment) pertaining to the quality system.
o quality management plan (QMP) - a document that describes a quality system in terms
of the organizational structure, policy and procedures, functional responsibilities of management
and staff, lines of authority, and required interfaces for those planning, implementing,
documenting, and assessing all activities conducted.
p. quality system - a structured and documented management system describing the
policies, objectives, principles, organizational authority, responsibilities, accountability, and
implementation plan of an organization for ensuring quality in its work processes, products
(items), and services. The quality system provides the framework for planning, implementing,
documenting, and assessing work performed by the organization and for carrying out required
QA/QC.
q. user - an organization, group, or individual that utilizes the results or products from
environmental programs or the customer for whom the results or products were collected or
created.
A-13
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
9. SUPERSESSION. This Order replaces EPA Order 5360.1, dated April 1984, in its entirety.
/s/
David J. O'Connor
Director
Office of Human Resources
and Organizational Services
A-14
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
APPENDIX B
TERMS AND DEFINITIONS
assessment - the evaluation process used to measure the performance or effectiveness of a
system and its elements. As used here, assessment is an all-inclusive term used to denote any of
the following: audit, performance evaluation, management systems review, peer review,
inspection, or surveillance.
audit (quality) - a systematic and independent examination to determine whether quality
activities and related results comply with planned arrangements and whether these arrangements
are implemented effectively and are suitable to achieve objectives.
bias - the systematic or persistent distortion of a measurement process which causes errors in one
direction (i.e., the expected sample measurement is different from the sample's true value).
calibration - comparison of a measurement standard, instrument, or item with a standard or
instrument of higher accuracy to detect and quantify inaccuracies and to report or eliminate those
inaccuracies by adjustments.
data quality assessment (DQA) - a statistical and scientific evaluation of the data set to
determine the validity and performance of the data collection design and statistical test, and to
determine the adequacy of the data set for its intended use.
data quality objectives (DQOs) - qualitative and quantitative statements derived from the DQO
Process that clarify study objectives, define the appropriate type of data, and specify tolerable
levels of potential decision errors that will be used as the basis for establishing the quality and
quantity of data needed to support decisions.
data quality objectives process - a systematic planning tool to facilitate the planning of
environmental data collection activities. Data quality objectives are the qualitative and
quantitative outputs from the DQO Process.
design - specifications, drawings, design criteria, and performance requirements. Also the result
of deliberate planning, analysis, mathematical manipulations, and design processes.
document - any compilation of information which describes, defines, specifies, reports, certifies.
requires, or provides data or results pertaining to environmental programs.
environmental conditions - the description of a physical medium (e.g., air. water, soil,
sediment) or biological system expressed in terms of its physical, chemical, radiological, or
biological characteristics.
B-l
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
environmental data -any measurements or information that describe environmental processes,
location, or conditions; ecological or health effects and consequences; or the performance of
environmental technology. For EPA, environmental data include information collected directly
from measurements, produced from models, and compiled from other sources such as data bases
or the literature.
environmental data operations - work performed to obtain, use, or report information
pertaining to environmental processes and conditions.
environmental processes - manufactured or natural processes that produce discharges to, or that
impact, the ambient environment.
environmental programs - work or activities involving the environment, including but not
limited to: characterization of environmental processes and conditions; environmental
monitoring; environmental research and development; and the design, construction, and
operation of environmental technologies; and laboratory operations on environmental samples
environmental technology - an all-inclusive term used to describe pollution control devices and
systems, waste treatment processes and storage facilities, and site remediation technologies and
their components that may be utilized to remove pollutants or contaminants from or prevent them
from entering the environment Examples include wet scrubbers (air), soil washing (soil).
granulated activated carbon unit (water), and filtration (air. water) Usually, this term applies to
hardware-based systems: however, it also applies to methods or techniques used for pollution
prevention, pollutant reduction, or containment of contamination to» prevent further movement of
the contaminants, such as capping, solidification or vitrification, and biological treatment.
extramural agreement - a legal agreement between EPA and an organization outside EPA for
items or services to be provided Such agreements include contracts, work assignments, delivery
orders, task orders, cooperative agreements, research grants, state and local grants, and EPA-
funded interagency agreements.
financial assistance - the process by which funds are provided by one organization (usually
government) to another organization for the purpose of performing work or furnishing services or
items. Financial assistance mechanisms include grants, cooperative agreements, and government
interagency agreements.
graded approach - the process of basing the level of application of managerial controls applied
to an item or work according to the intended use of the results and the degree of confidence
needed in the quality of the results.
B-2
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
independent assessment - an assessment performed by a qualified individual, group, or
organization that is not a part of the organization directly performing and accountable for the
work being assessed.
management - those individuals directly responsible and accountable for planning,
implementing, and assessing work.
management assessment - the qualitative assessment of a particular program operation and/or
organization(s) to establish whether the prevailing quality management structure, policies.
practices, and procedures are adequate for ensuring that the type and quality of results needed are
obtained. A management assessment may either be performed by those immediately responsible
for overseeing and/or performing the work (i.e., a management self-assessment) or by someone
other that the group performing the work (i.e., a management independent assessment).
management system - a structured non-technical system describing the policies, objectives,
principles, organizational authority, responsibilities, accountability, and implementation plan of
an organization for conducting work and producing items and services.
management systems review (MSR) - the qualitative assessment of a data collection operation
and/or organization(s) to establish whether the prevailing quality management structure, policies.
practices, and procedures are adequate for ensuring that the type and quality of data needed are
obtained.
measurement and testing equipment - tools, gauges, instruments* sampling devices or systems
used to calibrate, measure, test, or inspect in order to control or acquire data to verify
conformance to specified requirements.
.
method - a body of procedures and techniques for performing an activity (e.g., sampling.
chemical analysis, quantification) systematically presented in the order in which they are to be
executed.
observation - an assessment conclusion that identifies a condition (either positive or negative)
which does not represent a significant impact on an item or activity. An observation may
identify a condition which does not yet cause a degradation of quality.
organization - a company, corporation, firm, enterprise, or institution, or part thereof, whether
incorporated or not. public or private, that has its own functions and administration. In the
context of this Manual, an EPA organization is an office, region, national center or laboratory.
peer review - a documented critical review of work by qualified individuals (or organizations)
who are independent of those who performed the work, but are collectively equivalent in
B-3
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
technical expertise. A peer review is conducted to ensure that activities are technically adequate,
competently performed, properly documented, and satisfy established technical and quality
requirements. The peer review is an in-depth assessment of ^assumptions, calculations,
extrapolations, alternate interpretations, methodology, acceptance criteria, and conclusions
pertaining to specific work and of the documentation that supports them.
performance evaluation (PE) - a type of audit in which the quantitative data generated in a
measurement system are obtained independently and compared with routinely obtained data to
evaluate the proficiency of an analyst or laboratory.
precision - a measure of mutual agreement among individual measurements of the same
property, usually under prescribed similar conditions, expressed generally in terms of the
standard deviation.
process - a set of interrelated resources and activities which transforms inputs into outputs.
Examples of processes include analysis, design, data collection, operation, fabrication, and
calculation.
quality - the totality of features and characteristics of a product or service that bear on its ability
to meet the stated or implied needs and expectations of the user.
quality assurance (QA) - an integrated system of management activities involving planning,
implementation, documentation, assessment, reporting, and quality improvement to ensure that a
process, item, or service is of the type and quality needed and expected by the customer.
quality assurance manager (QAM) - the individual designated as the principal manager within
the organization having management oversight and responsibilities for planning, documenting.
coordinating, and assessing the effectiveness of the quality system for the organization.
quality assurance project plan (QAPP) - a document describing in comprehensive detail the
necessary QA. QC, and other technical activities that must be implemented to ensure that the
results of the work performed will satisfy the stated performance criteria.
quality- control (QC) - the overall system of technical activities that measures the attributes and
performance of a process, item, or service against defined standards to verify that they meet the
stated requirements established by the customer; operational techniques and activities that are
used to fulfill requirements for quality.
quality' improvement - a management program for improving the quality of operations. Such
management programs generally entail a formal mechanism for encouraging worker
recommendations with timely management evaluation and feedback or implementation.
B-4
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
quality management - that aspect of the overall management system of the organization that
determines and implements the quality policy. Quality management includes strategic planning,
allocation of resources, and other systematic activities (e.g., planning, implementation,
documentation, and assessment) pertaining to the quality system.
ii
quality management plan (QMP) - a document that describes a quality system in terms of the
organizational structure, policy and procedures, functional responsibilities of management and
staff, lines of authority, and required interfaces for those planning, implementing, documenting,
and assessing all activities conducted.
quality system - a structured and documented management system describing the policies,
objectives, principles, organizational authority, responsibilities, accountability, and
implementation plan of an organization for ensuring quality in its work processes, products
(items), and services. The quality system provides the framework for planning, implementing,
documenting, and assessing work performed by the organization and for carrying out required
QA and QC.
readiness review - a systematic, documented review of the readiness for the start-up or
continued use of a facility, process, or activity. Readiness reviews are typically conducted before
proceeding beyond project milestones and prior to initiation of a major phase of work.
record - a completed document that provides objective evidence of an item or process. Records
may include photographs, drawings, magnetic tape, and other data recording media
scientific method - the principles and processes regarded as necessary for scientific
investigation, including rules for concept or hypothesis formulation, conduct of experiments, and
validation of hypotheses by analysis of observations.
self-assessment - assessments of work conducted by individuals, groups, or organizations
directly responsible for overseeing and/or performing the work.
standard operating procedure (SOP) - a written document that details the method for an
operation, analysis, or action with thoroughly prescribed techniques and steps, and that is
officially approved as the method for performing certain routine or repetitive tasks.
supplier - any individual or organization furnishing items or services or performing work
according to a procurement document or financial assistance agreement. This is an all-inclusive
term used in place of any of the following: vendor, seller, contractor, subcontractor, fabricator, or
consultant.
B-5
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
surveillance (quality) - continual or frequent monitoring and verification of the status of an
entity and the analysis of records to ensure that specified requirements are being fulfilled.
«
technical assessment - the evaluation process used to measure the performance or effectiveness
of a technical system and its elements with respect to documented specifications and objectives.
Such assessments may include qualitative and quantitative evaluations. A technical assessment
may either be performed by those immediately responsible for overseeing and/or performing the
work (i.e., a technical self-assessment) or by someone other that the group performing the work
(i.e., a technical independent assessment).
technical review - a documented critical review of work that has been performed within the state
of the art. The review is accomplished by one or more qualified reviewers who are independent
of those who performed the work, but are collectively equivalent in technical expertise to those
who performed the original work. The review is an in-depth analysis and evaluation of
documents, activities, material, data, or items that require technical verification or validation for
applicability, correctness, adequacy, completeness, and assurance that established requirements
are satisfied.
technical systems audit (TSA) - a thorough, systematic, on-site. qualitative audit of facilities.
equipment, personnel, training, procedures, record keeping, data validation, data management.
and reporting aspects of a system.
user - an organization, group, or individual that utilizes the results or products from
environmental programs or a customer for whom the results or products were collected or
created.
validation - confirmation by examination and provision of objective evidence that the particular
requirements for a specific intended use are fulfilled. In design and development, validation
concerns the process of examining a product or result to determine conformance to user needs
verification - confirmation by examination and provision of objective evidence that specified
requirements have been fulfilled. In design and development, verification concerns the process
of examining a result of a given activity to determine conformance to the stated requirements for
that activity.
B-6
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
APPENDIX C
REFERENCES
Title 40, Part 30, Code of Federal Regulations, "Grants and Agreements With Institutions of
Higher Education, Hospitals, and Other Non-Profit Organizations."
Title 40, Part 31, Code of Federal Regulations, "Uniform Administrative Requirements for
Grants and Cooperative Agreement to State and Local Governments."
Title 40, Part 160, Code of Federal Regulations, "Good Laboratory Practices (Pesticides)."
Title 40, Part 792, Code of Federal Regulations, "Good Laboratory Practices (Toxic Substances
Control Act)."
Title 48, Pan 1546, Code of Federal Regulations, "Contract Quality Requirements."
ANSI/ASQC E4-1994. Specifications and Guidelines for Quality Systems for Environmental
Data Collection and Environmental Technology' Programs, American National Standard.
January 1995.
EPA Directive 2100. Information Resources Management Policy Manual. 1998
EPA Directive 2182. EPA System Design and Development Guidance, December 1996
EPA Order 1900, Contracts Management Manual. February 1998.
EPA Order 1900.1 A, Use of Contractor Services to Avoid Improper Contractor Relationship*
April 1994.
EPA Order 2160, Records Management Manual, July 1984.
EPA Order 2180.1, Chemical Abstract Service Registry Number Data Standard. June 1987.
EPA Order 2180.2, Data Standards for the Electronic Transmission of Laboratory Measurement
Results, December 1988.
EPA Order 2180.3, Facility Identifications Standard, April 1990.
EPA Order 7500.1 A, Minimum Set of Data Elements for Ground-Water Quality, October 1992.
C-l
-------
EPA Quality Manual for Environmental Programs 5360
07/16/98
Office of Federal Procurement Policy, 1992. OFPP Policy Letter 92-1, "Inherently
Governmental Functions," 57 FR 45096, Washington, DC.
Office of Federal Procurement Policy, 1993. OFPP Policy Letter 93-1, "Management Oversight
of Service Contracting," 58 FR 63593, Washington, DC.
U.S. Environmental Protection Agency, 1998. Guidance for Quality Assurance Project Plans
(QA/G-5), EPA/600/R-98/018, Office of Research and Development.
U.S. Environmental Protection Agency, 1996. Guidance for the Data Quality Assessment
Process Practical Methods for Data Analysis (QA/G-9). EPA/600/R-96/084, Office of
Research and Development.
U.S. Environmental Protection Agency, 1995. The Directives Clearance Process - What It Is
and How It Works, EPA/200/F-95/001, Office of Administration and Resource
Management.
U.S. Environmental Protection Agency, 1994. Guidance for the Data Quality Objectives
Process (QA/G-4). EPA/600/R-96/055, Office of Research and Development
U.S. Environmental Protection Agency. 1994. Memorandum from Ray E Spears, Associate
General Council, to H. Matthew Bills. Director for Modeling, Monitoring Systems and
Quality Assurance, "Use of Extramural Support to Implement Quality Systems for
Environmental Programs Involving Environmental Data Operations."
C-2
------- |