EPA REQUIREMENTS
FOR
QUALITY ASSURANCE PROJECT PLANS
EPA QA/R-5
U.S. Environmental Protection Agency
Quality Staff (2811R)
401 M Street, SW
Washington, DC 20460
INTERIM FINAL
NOVEMBER 1999
-------
FOREWORD
The U.S. Environmental Protection Agency (EPA) has developed the Quality Assurance
Project Plan (QAPP) as a tool for project managers and planners to document the type and quality
of data needed for environmental decisions and to describe the methods for collecting and
assessing those data. The development, review, approval, and implementation of the QAPP is
part of EPA's mandatory Quality System. The EPA Quality System requires all organizations to
develop and operate management structures and processes to ensure that data used in Agency
decisions are of the type and quality needed for their intended use. The QAPP is an integral part
of the fundamental principles and practices that form the foundation of the EPA Quality System.
This document provides the QAPP requirements for organizations that conduct
environmental data operations on behalf of EPA through contracts, financial assistance
agreements, and interagency agreements; however, it may be used by EPA as well. It contains the
same requirements as Chapter 5 of EPA Order 5360 (EPA 1998), The EPA Quality Manual for
Environmental Programs, which has been developed for internal use by EPA organizations. A
companion document, EPA Guidance for Quality Assurance Project Plans (QA/G-5) (EPA
1998b) provides suggestions for both EPA and non-EPA organizations on preparing, reviewing,
and implementing QAPPs that satisfy the requirements defined in this document.
This document is one of the EPA Quality System Series documents which describe EPA
policies and procedures for planning, implementing, and assessing the effectiveness of a quality
system. Questions regarding this document or other EPA Quality System Series documents
should be directed to:
U.S. EPA
Quality Staff (2811R)
401 M Street, SW
Washington, DC 20460
Phone: (202) 564-6830
FAX: (202)565-2441
e-mail: ord-qad@epa.gov
Copies of Quality System Series documents may be obtained from the Quality Staff or by
downloading them from the Quality Staff Home Page:
es.epa.gov/ncerqa/qa/index.html
Interim Final
EPAQA/R-5 i November 1999
-------
ACKNOWLEDGMENTS
This document reflects the collaborative efforts of many quality management professionals
who participate in the challenge for continual improvement in quality systems supporting
environmental programs. These individuals, representing the EPA, other Federal agencies, State
and local governments, and private industry, reflect a diverse and broad range of needs and
experiences in environmental data collection programs. Their contributions and the
comprehensive reviews during the development of this document are greatly appreciated.
Interim Final
EPA QA/R-5 ii November 1999
-------
TABLE OF CONTENTS
Page
CHAPTER 1. INTRODUCTION 1
1.1 BACKGROUND 1
1.2 QAPPs, THE EPA QUALITY SYSTEM, AND ANSI/ASQC E4-1994 2
1.3 THE GRADED APPROACH AND THE EPA QUALITY SYSTEM 4
1.4 INTENDED AUDIENCE 4
1.5 PERIOD OF APPLICABILITY 4
1.6 ADDITIONAL RESOURCES 4
1.7 SUPERSESSION 4
CHAPTER 2. QAPP REQUIREMENTS 5
2.1 POLICY 5
2.2 PURPOSE 5
2.3 APPLICABILITY 5
2.4 GENERAL CONTENT AND DETAIL REQUIREMENTS 5
2.4.1 General Content 5
2.4.2 Level of Detail '. 6
2.5 QAPP PREPARATION AND APPROVAL 6
2.6 QAPP IMPLEMENTATION 7
2.7 QAPP REVISION 7
CHAPTER 3. QAPP ELEMENTS 9
3.1 CONTENT REQUIREMENTS 9
3.2 GROUP A: PROJECT MANAGEMENT 10
3.2.1 Al - Title and Approval Sheet 11
3.2.2 A2 - Table of Contents 11
3.2.3 A3 - Distribution List 12
3.2.4 A4 - Project/Task Organization 12
3.2.5 A5 - Problem Definition/Background 12
3.2.6 A6 - Project/Task Description 12
3.2.7 A7 - Quality Objectives and Criteria for Measurement Data 13
3.2.8 A8 - Special Training/Certification 13
3.2.9 A9 - Documents and Records 13
3.3 GROUP B: DATA GENERATION AND ACQUISITION 13
3.3.1 Bl- Sampling Process Design (Experimental Design) 14
3.3.2 B2 - Sampling Methods 15
3.3.3 B3 - Sample Handling and Custody 15
3.3.4 B4 - Analytical Methods 15
3.3.5 B5 - Quality Control 16
3.3.6 B6 - Instrument/Equipment Testing, Inspection, and Maintenance 16
Interim Final
EPA QA/R-5 iii November 1999
-------
3.3.7 B7 - Instrument/Equipment Calibration and Frequency 17
3.3.8 B8 - Inspection/Acceptance of Supplies and Consumables 17
3.3.9 B9 - Non-direct Measurements 17
3.3.10 BIO - Data Management 17
3.4 GROUP C: ASSESSMENT AND OVERSIGHT 18
3.4.1 Cl - Assessments and Response Actions 18
3.4.2 C2 - Reports to Management 19
3.5 GROUP D: DATA VALIDATION AND USABILITY 19
3.5.1 Dl - Data Review, Verification, and Validation 19
3.5.2 D2 - Verification and Validation Methods 19
3.5.3 D3 - Reconciliation with User Requirements 19
REFERENCES 21
APPENDIX A. CROSSWALKS AMONG QUALITY ASSURANCE DOCUMENTS . A-l
A.I BACKGROUND A-l
A.2 CROSSWALK BETWEEN EPA QA/R-5 AND QAMS-005/80 A-l
A.3 CROSSWALK BETWEEN THE DQO PROCESS AND THE QAPP A-3
APPENDIX B. TERMS AND DEFINITIONS B-l
FIGURES
Page
1. EPA Quality System Components and Tools 3
2. Example Document Control Format 12
TABLES
Page
1. Group A: Project Management Elements 11
2. Group B: Data Generation and Acquisition Elements 14
3. Group C: Assessment and Oversight Elements 18
4. Group D: Data Validation and Usability Elements 19
Interim Final
EPA QA/R-5 iv November 1999
-------
CHAPTER 1
INTRODUCTION
1.1 BACKGROUND
Environmental programs conducted by or funded by the U.S. Environmental Protection
Agency (EPA) involve many diverse activities that address complex environmental issues. The
EPA annually spends several hundred million dollars in the collection of environmental data for
scientific research and regulatory decision making. In addition, non-EPA organizations may
spend as much as an order of magnitude more each year to respond to Agency requirements. If
decision makers (EPA and otherwise) are to have confidence in the quality of environmental data
used to support their decisions, there must be a structured process for quality in place.
A structured system that describes the policies and procedures for ensuring that work
processes, products, or services satisfy stated expectations or specifications is called a quality
system. All organizations conducting environmental programs funded by EPA are required to
establish and implement a quality system. EPA also requires that all environmental data used in
decision making be supported by an approved Quality Assurance Project Plan (QAPP). This
requirement is defined in EPA Order 5360.1 CHG 1 (EPA 1998), Policy and Program
Requirements for the Mandatory Agency-wide Quality System, for EPA organizations. Non-EPA
organizations funded by EPA are required to develop a QAPP through:
48 CFR 46, for contractors;
o 40 CFR 30, 31, and 35 for assistance agreement recipients; and
° other mechanisms, such as consent agreements in enforcement actions.
The QAPP integrates all technical and quality aspects of a project, including planning,
implementation, and assessment. The purpose of the QAPP is to document planning results for
environmental data operations and to provide a project-specific "blueprint" for obtaining the type
and quality of environmental data needed for a specific decision or use. The QAPP documents
how quality assurance (QA) and quality control (QC) are applied to an environmental data
operation to assure that the results obtained are of the type and quality needed and expected.
The ultimate success of an environmental program or project depends on the quality of the
environmental data collected and used in decision-making, and this may depend significantly on
the adequacy of the QAPP and its effective implementation. Stakeholders (i.e., the data users,
data producers, decision makers, etc.) shall be involved in the planning process for a program or
project to ensure that their needs are defined adequately and addressed. While time spent on such
planning may seem unproductive and costly, the penalty for ineffective planning includes greater
cost and lost time. Therefore, EPA requires that a systematic planning process be used to plan all
Interim Final
EPAQA/R-5 1 November 1999
-------
environmental data operations. To support this requirement, EPA has developed a process called
the Data Quality Objectives (DQO) Process. The DQO Process is the Agency's preferred
planning process and is described in the Guidance for the Data Quality Objectives Process
(QA/G-4) (EPA 1994). The QAPP documents the outputs from systematic planning.
This requirements document presents specifications and instructions for the information
that must be contained in a QAPP for environmental data operations funded by EPA. The
document also discusses the procedures for review, approval, implementation, and revision of
QAPPs. Users of this document should assume that all of the elements described herein are
required in a QAPP unless otherwise directed by EPA.
1.2 QAPPs, THE EPA QUALITY SYSTEM, AND ANSI/ASQC E4-1994
EPA Order 5360.1 CHG 1 and the applicable Federal regulations (defined above) establish
a mandatory Quality System that applies to all EPA organizations and organizations funded by
EPA. Components of the EPA Quality System are illustrated in Figure 1. Organizations must
ensure that data collected for the characterization of environmental processes and conditions are
of the appropriate type and quality for then- intended use and that environmental technologies are
designed, constructed, and operated according to defined expectations. The QAPP is a key
project-level component of the EPA Quality System.
EPA policy is based on the national consensus standard, ANSI/ASQC E4-1994,
Specifications and Guidelines for Environmental Data Collection and Environmental
Technology Programs. The ANSI/ASQC E4-1994 standard describes the necessary management
and technical elements for developing and implementing a quality system. This standard
recommends using a tiered approach to a quality system. This standard recommends first
documenting each organization-wide quality system in a Quality Management Plan (QMP) or
Quality Manual (to address requirements of Part A: Management Systems of the standard) and
then documenting the applicability of the quality system to technical activity-specific efforts in a
QAPP or similar document (to address the requirements of Part B: Collection and Evaluation of
Environmental Data of the standard). EPA has adopted this tiered approach for its mandatory
Agency-wide Quality System. This document addresses Part B requirements of the standard.
A QMP, or equivalent Quality Manual, documents how an organization structures its
quality system, defines and assigns QA and QC responsibilities, and describes the processes and
procedures used to plan, implement, and assess the effectiveness of the quality system. The QMP
may be viewed as the "umbrella" document under which individual projects are conducted. EPA
requirements for QMPs are defined in EPA Requirements for Quality Management Plans (QA/R-
2) (EPA 1999). The QMP is then supported by project-specific QAPPs. In some cases, a QAPP
and a QMP may be combined into a single document that contains both organizational and
project-specific elements. The QA Manager for the EPA organization sponsoring the work has
the authority to determine when a single document is applicable and will define the content
requirements of such a document.
Interim Final
EPA QA/R-5 2 November 1999
-------
Consensus Standards
ANSI/ASQC E4
ISO 9000 Series
Internal EPA Policies
EPA Order 5360.1
EPA Manual 5360
External Policies
Contracts - 48 CFR 46
Assistance Agreements -
40 CFR 30, 31, and 35
Supporting System Elements
(e.g., Procurements,
Computer Hardware/Software)
Training/Communication
(e.g., Training Plan,
Conferences)
Systems
i
i
Systematic
Planning
(e.g., DQO Process)
p^/Conduct Study/\_
Standard
Operating
Procedures
i
Technical
Assessments
PLANNING
4
-*• IMPLEMENTATION
-e» ASSESSMENT
Defensible Products and Decisions
Figure 1. EPA Quality System Components and Tools
EPA QA/R-5
Interim Final
November 1999
-------
1.3 THE GRADED APPROACH AND THE EPA QUALITY SYSTEM
Recognizing that a "one size fits all" approach to quality requirements will not work in
organizations as diverse as EPA, implementation of the EPA Quality System is based on the
principle of graded approach. Applying a graded approach means that quality systems for
different organizations and programs will vary according to the specific objectives and needs of
the organization. For example, the quality expectations of a fundamental research program are
different from that of a regulatory compliance program because the purpose or intended use of the
data is different. The specific application of the graded approach principle to QAPPs is described
in Section 2.4.2.
1.4 INTENDED AUDIENCE
This document is designed for organizations that conduct environmental data operations
on behalf of EPA through contracts, financial assistance agreements, and interagency agreements;
however, it may be used by EPA organizations as well. This document contains the same
requirements as Chapter 5 of EPA Order 5360 (EPA 1998), The EPA Quality Manual for
Environmental Programs, which was developed for internal use by EPA organizations.
1.5 PERIOD OF APPLICABILITY
This document shall be valid for a period of up to five years from the official date of
publication. After five years, it shall either be reissued without change, revised, or withdrawn
from the EPA Quality System.
1.6 ADDITIONAL RESOURCES
Guidance on preparing QAPPs may be found in a companion document, EPA Guidance
for Quality Assurance Project Plans (QA/G-5) (EPA 1998b). This guidance discusses the
application of the QAPP requirements and provides examples. Other documents that provide
guidance on activities critical to successful environmental data operations and complement the
QAPP preparation effort include:
Guidance for the Data Quality Objectives Process (QA/G-4), (EPA 1994)
o Guidance for the Preparation of Standard Operating Procedures for Quality-
Related Documents (QA/G-6), (EPA 1995)
« Guidance for Data Quality Assessment: Practical Methods for Data Analysis
(QA/G-9), (EPA 1998a)
1.7 SUPERSESSION
This document replaces QAMS-005/80, Interim Guidelines and Specifications for
Preparing Quality Assurance Project Plans (EPA 1980) in its entirety.
Interim Final
EPAQA/R-5 4 November 1999
-------
CHAPTER 2
QAPP REQUIREMENTS
2.1 POLICY
All work funded by EPA that involves the acquisition of environmental data generated
from direct measurement activities, collected from other sources, or compiled from computerized
data bases and information systems shall be implemented in accordance with an approved QAPP.
The QAPP will be developed using a systematic planning process based on the graded approach.
No work covered by this requirement shall be implemented without an approved QAPP available
prior to the start of the work except under circumstances requiring immediate action to protect
human health and the environment or operations conducted under police powers.
2.2 PURPOSE
The QAPP documents the planning, implementation, and assessment procedures of, and
how specific QA and QC activities will be applied during, a particular project. The QAPP
demonstrates conformance to Part B requirements of ANSI/ASQC E4-1994.
2.3 APPLICABILITY
These requirements apply to all environmental programs funded by EPA that acquire,
generate, or compile environmental data including work performed through contracts, work
assignments, delivery orders, task orders, cooperative agreements, interagency agreements, State-
EPA agreements, State, local and Tribal Financial Assistants/Grants, Research Grants, and in
response to statutory or regulatory requirements and consent agreements. These requirements are
negotiated into interagency agreements, including sub-agreements, and, in some cases, are
included in enforcement settlement and consent agreements and orders. Where specific Federal
regulations require the application of QA and QC activities (see Section 1.1), QAPPs shall be
prepared, reviewed, and approved in accordance with the specifications contained in this
document unless explicitly superseded by the regulation.
2.4 GENERAL CONTENT AND DETAIL REQUIREMENTS
2.4.1 General Content
The QAPP must be composed of standardized, recognizable elements covering the entire
project from planning, through implementation, to assessment. Chapter 3 of this document
describes specific elements to address for QAPPs submitted to EPA. In some cases, it may be
necessary to add special requirements to the QAPP. The EPA organization sponsoring the work
has the authority to define any special requirements beyond those listed in this document. If no
additional requirements are specified, the QAPP shall address all required elements. Each EPA
Interim Final
EPAQA/R-5 5 November 1999
-------
organization defines their organizational-specific requirements for QAPP documentation in their
QMP. All applicable elements defined by the EPA organization sponsoring the work must be
addressed.
While most QAPPs will describe project- or task-specific activities, there may be
occasions when a generic QAPP may be more appropriate. A generic QAPP addresses the
general, common activities of a program that are to be conducted at multiple locations or over a
long period of time; for example, it may be useful for a large monitoring program that uses the
same methodology at different locations. A generic QAPP describes, in a single document, the
information that is not site or time-specific but applies throughout the program. Application-
specific information is then added to the approved QAPP as that information becomes known or
completely defined. A generic QAPP shall be reviewed periodically to ensure that its content
continues to be valid and applicable to the program over time.
2.4.2 Level of Detail
The level of detail of the QAPP should be based on a graded approach so that the level of
detail in each QAPP will vary according to the nature of the work being performed and the
intended use of the data. As a result, an acceptable QAPP for some environmental data
operations may require a qualitative discussion of the experimental process and its objectives
while others may require extensive documentation to adequately describe a complex
environmental program.
2.5 QAPP PREPARATION AND APPROVAL
The QAPP may be prepared by an EPA organization, a contractor, an assistance
agreement holder, or another Federal agency under an interagency agreement. Except where
specifically delegated in the QMP of the EPA organization sponsoring the work, all QAPPs
prepared by non-EPA organizations must be approved by EPA before implementation.
The QAPP shall be reviewed and approved by an authorized EPA reviewer to ensure that
the QAPP contains the appropriate content and level of detail. The authorized reviewer, for
example the EPA project manager1 with the assistance and approval of the EPA QA Manager or
by the EPA QA Manager alone, are defined by the EPA organization's QMP. In some cases, the
authority to review and approve QAPPs is delegated to another part of the EPA organization
covered by the same QMP. In cases where the authority to review and approve QAPPs is
delegated in writing by EPA to another organization (i.e., a Federal agency or a State under an
EPA-approved QMP when the environmental data operation itself has been delegated to that
1 This term refers to the EPA official responsible for the project. This individual may also be called Project Officer,
Delivery Order Project Officer, Work Assignment Manager, or Principal Investigator.
Interim Final
EPA QA/R-5 6 November 1999
-------
organization for implementation), it is possible that the EPA project manager and EPA QA
Manager may not be involved in the review and approval steps.
2.6 QAPP IMPLEMENTATION
None of the environmental work addressed by the QAPP shall be started until the QAPP
has been approved and distributed to project personnel except in situations requiring immediate
action to protect human health and the environment or operations conducted under police powers.
Subject to these exceptions, it is the responsibility of the organization performing the work to
assure that no environmental data are generated or acquired before the QAPP is approved and
received by the appropriate project personnel. However, EPA may grant conditional approval to
a QAPP to permit some work to begin while non-critical deficiencies in the QAPP are being
resolved.
The organization performing the work shall ensure that the QAPP is implemented as
approved and that all personnel involved in the work have direct access to a current version of the
QAPP and all other necessary planning, implementation, and assessment documents. These
personnel should understand the requirements prior to the start of data generation activities.
2.7 QAPP REVISION
Although the approved QAPP must be implemented as prescribed; it is not inflexible.
Because of the complex and diverse nature of environmental data operations, changes to original
plans are often needed. When such changes occur, the approving official shall determine if the
change significantly impacts the technical and quality objectives of the project. When a
substantive change is warranted, the originator of the QAPP shall modify the QAPP to document
the change and submit the revision for approval by the same authorities that performed the
original review. Only after the revision has been received and approved (at least verbally with
written follow-up) by project personnel, shall the change be implemented.
For programs or projects of long duration, such as multi-year monitoring programs or
projects using a generic QAPP, the QAPPs shall be reviewed at least annually by the EPA Project
Manager (or authorized representative). When revisions are necessary, the QAPP must be revised
and resubmitted for review and approval.
Interim Final
EPAQA/R-5 7 November 1999
-------
(This page is intentionally blank.)
Interim Final
EPAQA/R-5 8 November 1999
-------
CHAPTER 3
QAPP ELEMENTS
3.1 CONTENT REQUIREMENTS
The QAPP is a formal document describing in comprehensive detail the necessary QA,
QC, and other technical activities that must be implemented to ensure that the results of the work
performed will satisfy the stated performance criteria. The QAPP must provide sufficient detail to
demonstrate that:
o the project technical and quality objectives are identified and agreed upon;
o the intended measurements, data generation, or data acquisition methods are
appropriate for achieving project objectives;
o assessment procedures are sufficient for confirming that data of the type and
quality needed and expected are obtained; and
o any limitations on the use of the data can be identified and documented.
Most environmental data operations require the coordinated efforts of many individuals, including
managers, engineers, scientists, statisticians, and others. The QAPP must integrate the
contributions and requirements of everyone involved into a clear, concise statement of what is to
be accomplished, how it will be done, and by whom. It must provide understandable instructions
to those who must implement the QAPP, such as the field sampling team, the analytical
laboratory, modelers, and the data reviewers. In all aspects of the QAPP, the use of national
consensus standards and practices are encouraged.
In order to be effective, the QAPP must specify the level or degree of QA and QC
activities needed for the particular environmental data operations. Because this will vary
according to the purpose and type of work being done, EPA believes that the graded approach
should be used in planning the work. This means that the QA and QC activities applied to a
project will be commensurate with:
° the purpose of the environmental data operation (e.g., enforcement, research and
development, rulemaking),
o the type of work to be done (e.g., pollutant monitoring, site characterization, risk
characterization, bench level proof of concept experiments), and
o the intended use of the results (e.g., compliance determination, selection of
remedial technology, development of environmental regulation).
Interim Final
EPAQA/R-5 9 November 1999
-------
The QAPP shall be composed of standardized, recognizable elements covering the entire
project from planning, through implementation, to assessment. These elements are presented in
that order and have been arranged for convenience into four general groups. The four groups of
elements and their intent are summarized as follows:
A Project Management - The elements in this group address the basic area of project
management, including the project history and objectives, roles and responsibilities
of the participants, etc. These elements ensure that the project has a defined goal,
that the participants understand the goal and the approach to be used, and that the
planning outputs have been documented.
B Data Generation and Acquisition - The elements in this group address all aspects
of project design and implementation. Implementation of these elements ensure
that appropriate methods for sampling, measurement and analysis, data collection
or generation, data handling, and QC activities are employed and are properly
documented.
C Assessment and Oversight - The elements in this group address the activities for
assessing the effectiveness of the implementation of the project and associated QA
and QC activities. The purpose of assessment is to ensure that the QAPP is
implemented as prescribed.
D Data Validation and Usability - The elements in this group address the QA
activities that occur after the data collection or generation phase of the project is
completed. Implementation of these elements ensures that the data conform to the
specified criteria, thus achieving the project objectives.
All applicable elements, including the content and level of detail under each element,
defined by the EPA organization sponsoring the work must be addressed in the QAPP. If an
element is not applicable, state this in the QAPP. Documentation, such as an approved Work
Plan, Standard Operating Procedures, etc., may be referenced in response to a particular required
QAPP element to reduce the size of the QAPP. Current versions of all referenced documents
must be attached to the QAPP itself or be placed on file with the appropriate EPA office and
available for routine referencing when needed. The QAPP shall also address related QA planning
documentation (e.g., Quality Management Plans) from suppliers of services critical to the
technical and quality objectives of the project or task.
3.2 GROUP A: PROJECT MANAGEMENT
The elements in this group (Table 1) address project management, including project
history and objectives, roles and responsibilities of the participants, etc. These elements document
that the project has a defined goal, that the participants understand the goal and the approach to
be used, and that the planning outputs have been documented.
Interim Final
EPAQA/R-5 10 November 1999
-------
Table 1. Group A: Project
Management Elements
Al
A2
A3
A4
A5
A6
A7
A8
A9
Title and Approval Sheet
Table of Contents
Distribution List
Project/Task Organization
Problem Definition/Background
Project/Task Description
Quality Objectives and Criteria for
Measurement Data
Special Training/Certification
Documents and Records
3.2.1 Al - Title and Approval Sheet
On the Title and Approval Sheet, include the title of the plan, the name of the
organization(s) implementing the project, the effective date of the plan, and the names, titles,
signatures, and approval dates of appropriate approving officials. Approving officials may
include:
Organization's Project Manager
Organization's QA Manager
EPA Project Manager
EPA QA Manager
Others, as needed (e.g., field operations manager, laboratory managers,
State and other Federal agency officials)
3.2.2 A2 - Table of Contents
Provide a table of contents for the document, including sections, figures, tables,
references, and appendices. Apply a document control format (Figure 2) on each page following
the Title and Approval Sheet when required by the EPA Project Manager and QA Manager.
EPA QA/R-5
11
Interim Final
November 1999
-------
Section No. _
Revision No.
Date
Page of
Figure 2. Example Document
Control Format
3.2.3 A3 - Distribution List
List the individuals and their organizations who need copies of the approved QAPP and
any subsequent revisions, including all persons responsible for implementation (e.g., project
managers), the QA managers, and representatives of all groups involved. Paper copies need not
be provided to individuals if equivalent electronic information systems can be used.
3.2.4 A4 - Project/Task Organization
Identify the individuals or organizations participating in the project and discuss their
specific roles and responsibilities. Include the principal data users, the decision makers, the
project QA manager, and all persons responsible for implementation. The project quality
assurance manager must be independent of the unit generating the data. (This does not include
being independent of senior officials, such as corporate managers or agency administrators, who
are nominally, but not functionally, involved in data generation, data use, or decision making.)
Identify the individual responsible for maintaining the official, approved QAPP.
Provide a concise organization chart showing the relationships and the lines of
communication among all project participants. Include other data users who are outside of the
organization generating the data, but for whom the data are nevertheless intended. The
organization chart must also identify any subcontractor relationships relevant to environmental
data operations, including laboratories providing analytical services.
3.2.5 AS - Problem Definition/Background
State the specific problem to be solved, decision to be made, or outcome to be achieved.
Include sufficient background information to provide a historical, scientific, and regulatory
perspective for this particular project.
3.2.6 A6 - Project/Task Description
Provide a summary of all work to be performed, products to be produced, and the
schedule for implementation. Provide maps or tables that show or state the geographic locations
Interim Final
EPAQA/R-5 12 November 1999
-------
of field tasks. This discussion need not be lengthy or overly detailed, but should give an overall
picture of how the project will resolve the problem or question described in A5.
3.2.7 A7 - Quality Objectives and Criteria for Measurement Data
Discuss the quality objectives for the project and the performance criteria to achieve those
objectives. EPA requires the use of a systematic planning process to define these quality
objectives and performance criteria.
3.2.8 A8 - Special Training/Certification
Identify and describe any specialized training or certifications needed by personnel in order
to successfully complete the project or task. Discuss how such training will be provided and how
the necessary skills will be assured and documented.
3.2.9 A9 - Documents and Records
Describe the process and responsibilities for ensuring the appropriate project personnel
have the most current approved version of the QAPP, including version control, updates,
distribution, and disposition.
Itemize the information and records which must be included in the data report package
and specify the reporting format for hard copy and any electronic forms. Records can include raw
data, data from other sources such as data bases or literature, field logs, sample preparation and
analysis logs, instrument printouts, model input and output files, and results of calibration and QC
checks.
Identify any other records and documents applicable to the project that will be produced,
such as audit reports, interim progress reports, and final reports. Specify the level of detail of the
field sampling, laboratory analysis, literature or data base data collection, or modeling documents
or records needed to provide a complete description of any difficulties encountered.
Specify or reference all applicable requirements for the final disposition of records and
documents, including location and length of retention period.
3.3 GROUPS: DATA GENERATION AND ACQUISITION
The elements in this group (Table 2) address all aspects of data generation and acquisition
to ensure that appropriate methods for sampling, measurement and analysis, data collection or
generation, data handling, and QC activities are employed and documented. The following QAPP
elements describe the requirements related to the actual methods or methodology to be used for
the:
Interim Final
EPAQA/R-5 13 November 1999
-------
collection, handling, and analysis of samples;
« data obtained from other sources (e.g., contained in a computer data base from
previous sampling activities, compiled from surveys, taken from the literature); and
• the management (i.e., compiling, handling) of the data.
The methods described in these elements should have been summarized earlier in element A6. The
purpose here is to provide detailed information on the methods. If the designated methods are
well documented and are readily available to all project participants, citations are adequate;
otherwise, detailed copies of the methods and/or SOPs must accompany the QAPP either in the
text or as attachments.
Table 2. Group B: Data Generation and
Acquisition Elements
Bl
B2
B3
B4
B5
B6
B7
B8
B9
BIO
Sampling Process Design (Experimental Design)
Sampling Methods
Sample Handling and Custody
Analytical Methods
Quality Control
Instrument/Equipment Testing, Inspection, and Maintenance
Instrument/Equipment Calibration and Frequency
Inspection/Acceptance of Supplies and Consumables
Non-direct Measurements
Data Management
3.3.1 Bl- Sampling Process Design (Experimental Design)
Describe the experimental data generation or data collection design for the project,
including as appropriate:
° the types and numbers of samples required,
" • the design of the sampling network,
o the sampling locations and frequencies,
o sample matrices,
EPA QA/R-5
14
Interim Final
November 1999
-------
<> measurement parameters of interest, and
the rationale for the design.
3.3.2 B2 - Sampling Methods
Describe the procedures for collecting samples and identify the sampling methods and
equipment, including any implementation requirements, sample preservation requirements,
decontamination procedures, and materials needed for projects involving physical sampling.
Where appropriate, identify sampling methods by number, date, and regulatory citation. If a
method allows the user to select from various options, then the method citations should state
exactly which options are being selected. Describe specific performance requirements for the
method. For each sampling method, identify any support facilities needed. The discussion should
also address what to do when a failure in the sampling or measurement system occurs, who is
responsible for corrective action, and how the effectiveness of the corrective action shall be
determined and documented.
Describe the process for the preparation and decontamination of sampling equipment,
including the disposal of decontamination by-products; the selection and preparation of sample
containers, sample volumes, and preservation methods; and maximum holding times to sample
extraction and/or analysis.
3.3.3 B3 - Sample Handling and Custody
Describe the requirements for sample handling and custody in the field, laboratory, and
transport, taking into account the nature of the samples, the maximum allowable sample holding
times before extraction or analysis, and available shipping options and schedules for projects
involving physical sampling. Sample handling includes packaging, shipment from the site, and
storage at the laboratory. Examples of sample labels, custody forms, and sample custody logs
should be included.
3.3.4 B4 - Analytical Methods
Identify the analytical methods and equipment required, including sub-sampling or
extraction methods, laboratory decontamination procedures and materials (such as in the case of
hazardous or radioactive samples), waste disposal requirements (if any), and any specific
performance requirements for the method. Where appropriate, analytical methods may be
identified by number, date, and regulatory citation. Address what to do when a failure in the
analytical system occurs, who is responsible for corrective action, and how the effectiveness of the
corrective action shall be determined and documented. Specify the laboratory turnaround time
needed, if important to the project schedule.
List any method performance standards. If a method allows the user to select from
various options, then the method citations should state exactly which options are being selected.
Interim Final
EPAQA/R-5 15 November 1999
-------
For non-standard method applications, such as for unusual sample matrices and situations,
appropriate method performance study information is needed to confirm the performance of the
method for the particular matrix. If previous performance studies are not available, they must be
developed during the project and included as part of the project results.
3.3.5 B5 - Quality Control
Identify QC activities needed for each sampling, analysis, or measurement technique. For
each required QC activity, list the associated method or procedure, acceptance criteria, and
corrective action. Because standard methods are often vague or incomplete in specifying QC
requirements, simply relying on the cited method to provide this information is usually insufficient.
QC activities for the field and the laboratory include, but are not limited to, the use of blanks,
duplicates, matrix spikes, laboratory control samples, surrogates, or second column confirmation.
State the frequency of analysis for each type of QC activity, and the spike compounds sources and
levels. State or reference the required control limits for each QC activity and corrective action
required when control limits are exceeded and how the effectiveness of the corrective action shall
be determined and documented.
Describe or reference the procedures to be used to calculate applicable statistics (e.g.,
precision and bias). Copies of the formulas are acceptable as long as the accompanying narrative
or explanation specifies clearly how the calculations will address potentially difficult situations
such as missing data values, "less than" or "greater than" values, and other common data
qualifiers.
3.3.6 B6 - Instrument/Equipment Testing, Inspection, and Maintenance
Describe how inspections and acceptance testing of instruments, equipment, and their
components affecting quality will be performed and documented to assure their intended use as
specified. Identify and discuss the procedure by which final acceptance will be performed by
independent personnel (e.g., personnel other than those performing the work) and/or by the EPA
project manager. Describe how deficiencies are to be resolved, when re-inspection will be
performed, and how the effectiveness of the corrective action shall be determined and
documented.
Describe or reference how periodic preventive and corrective maintenance of
measurement or test equipment or other systems and their components affecting quality shall be
performed to ensure availability and satisfactory performance of the systems. Identify the
equipment and/or systems requiring periodic maintenance. Discuss how the availability of critical
spare parts, identified in the operating guidance and/or design specifications of the systems, will
be assured and maintained.
Interim Final
EPAQA/R-5 16 November 1999
-------
3.3.7 B7 - Instrument/Equipment Calibration and Frequency
Identify all tools, gauges, instruments, and other sampling, measuring, and test equipment
used for data generation or collection activities affecting quality that must be controlled and, at
specified periods, calibrated to maintain performance within specified limits. Describe or
reference how calibration will be conducted using certified equipment and/or standards with
known valid relationships to nationally recognized performance standards. If no such nationally
recognized standards exist, document the basis for the calibration. Identify the certified
equipment and/or standards used for calibration. Indicate how records of calibration shall be
maintained and be traceable to the instrument.
3.3.8 B8 - Inspection/Acceptance of Supplies and Consumables
Describe how and by whom supplies and consumables (e.g., standard materials and
solutions, sample bottles, calibration gases, reagents, hoses, deionized water, potable water,
electronic data storage media) shall be inspected and accepted for use in the project. State
acceptance criteria for such supplies and consumables.
3.3.9 B9 - Non-direct Measurements
Identify any types of data needed for project implementation or decision making that are
obtained from non-measurement sources such as computer data bases, programs, literature files,
and historical data bases. Describe the intended use of the data. Define the .acceptance criteria
for the use of such data in the project and specify any limitations on the use of the data.
3.3.10 BIO - Data Management
Describe the project data management process, tracing the path of the data from their
generation to their final use or storage (e.g., the field, the office, the laboratory). Describe or
reference the standard record-keeping procedures, document control system, and the approach
used for data storage and retrieval on electronic media. Discuss the control mechanism for
detecting and correcting errors and for preventing loss of data during data reduction, data
reporting, and data entry to forms, reports, and databases. Provide examples of any forms or
checklists to be used.
Identify and describe all data handling equipment and procedures to process, compile, and
analyze the data. This includes procedures for addressing data generated as part of the project as
well as data from other sources. Include any required computer hardware and software and
address any specific performance requirements for the hardware/software configuration used.
Describe the procedures that will be followed to demonstrate acceptability of the
hardware/software configuration required. Describe the process for assuring that applicable
information resource management requirements are satisfied.
Interim Final
EPAQA/R-5 17 November 1999
-------
Describe the process for assuring that applicable Agency information resource
management requirements (EPA Directive 2100) are satisfied (EPA QAPPs only). If other
Agency data management requirements are applicable, such as the Chemical Abstract Service
Registry Number Data Standard (EPA Order 2180.1), Data Standards for the Electronic
Transmission of Laboratory Measurement Results (EPA Order 2180.2), or the Minimum Set of
Data Elements for Ground-Water Quality (EPA Order 7500.1 A), discuss how these requirements
are addressed.
3.4 GROUP C: ASSESSMENT AND OVERSIGHT
The elements in this group (Table 3) address the activities for assessing the effectiveness
of project implementation and associated QA and QC activities. The purpose of assessment is to
ensure that the QAPP is implemented as prescribed.
Table 3. Group C: Assessment and
Oversight Elements
Cl
C2
Assessments and Response
Actions
Reports to Management
3.4.1 Cl - Assessments and Response Actions
Describe each assessment to be used in the project including the frequency and type.
Assessments include, but are not limited to, surveillance, management systems reviews, readiness
reviews, technical systems audits, performance evaluations, audits of data quality, and data quality
assessments. Discuss the information expected and the success criteria (i.e., goals, performance
objectives, acceptance criteria specifications, etc.) for each assessment proposed. List the
approximate schedule of assessment activities. For any planned self-assessments (utilizing
personnel from within the project groups), identify potential participants and their exact
relationship within the project organization. For independent assessments, identify the
organization and person(s) that shall perform the assessments if this information is available.
Describe how and to whom the results of each assessment shall be reported.
Define the scope of authority of the assessors, including stop work orders, and when
assessors are authorized to act.
Discuss how response actions to assessment findings, including corrective actions for
deficiencies and other non-conforming conditions, are to be addressed and by whom. Include
details on how the corrective actions will be verified and documented.
EPA QA/R-5
18
Interim Final
November 1999
-------
3.4.2 C2 - Reports to Management
Identify the frequency and distribution of reports issued to inform management (EPA or
otherwise) of the project status; for examples, reports on the results of performance evaluations
and system audits; results of periodic data quality assessments; and significant quality assurance
problems and recommended solutions. Identify the preparer and the recipients of the reports, and
any specific actions recipients are expected to take as a result of the reports.
3.5 GROUP D: DATA VALIDATION AND USABILITY
The elements in this group (Table 4) address the QA activities that occur after the data
collection phase of the project is completed. Implementation of these elements determines
whether or not the data conform to the specified criteria, thus satisfying the project objectives.
Table 4. Group D: Data Validation
and Usability Elements
Dl
D2
D3
Data Review, Verification,
Verification and Validation
and Validation
Methods
Reconciliation with User Requirements
3.5.1 Dl - Data Review, Verification, and Validation
State the criteria used to review and validate - that is, accept, reject, or qualify -- data, in
an objective and consistent manner.
3.5.2 D2 - Verification and Validation Methods
Describe the process to be used for verifying and validating data, including the chain-of-
custody for data throughout the life of the project or task. Discuss how issues shall be resolved
and the authorities for resolving such issues. Describe how the results are conveyed to data users.
Precisely define and interpret how validation issues differ from verification issues for this project.
Provide examples of any forms or checklists to be used. Identify any project-specific calculations
required.
3.5.3 D3 - Reconciliation with User Requirements
Describe how the results obtained from the project or task will be reconciled with the
requirements defined by the data user or decision maker. Outline the proposed methods to
analyze the data and determine possible anomalies or departures from assumptions established in
the planning phase of data collection. Describe how reconciliation with user requirements will be
EPA QA/R-5
19
Interim Final
November 1999
-------
documented, issues will be resolved, and how limitations on the use of the data will be reported to
decision makers.
Interim Final
EPA QA/R-5 20 November 1999
-------
REFERENCES
40 CFR 30, Code of Federal Regulations, "Grants and Agreements With Institutions of Higher
Education, Hospitals, and Other Non-Profit Organizations."
40 CFR 31, Code of Federal Regulations, "Uniform Administrative Requirements for Grants and
Cooperative Agreement to State and Local Governments."
40 CFR 35, Code of Federal Regulations, "State and Local Assistance."
48 CFR 46, Code of Federal Regulations, "Federal Acquisition Regulations."
ANSI/ASQC E4-1994, Specifications and Guidelines for Quality Systems for Environmental
Data Collection and Environmental Technology Programs, American National Standard,
January 1995.
EPA Directive 2100 (1998), Information Resources Management Policy Manual, U.S.
Environmental Protection Agency, Washington, DC.
EPA Order 2180.1 (June 1987), Chemical Abstract Service Registry Number Data Standard,
U.S. Environmental Protection Agency, Washington, DC.
EPA Order 2180.2 (December 1988), Data Standards for the Electronic Transmission of
Laboratory Measurement Results, U.S. Environmental Protection Agency, Washington,
DC.
EPA Order 5360 (July 1998). EPA Quality Manual for Environmental Programs, U.S.
Environmental Protection Agency, Washington, DC.
EPA Order 5360.1 CHG 1 (July 1998), Policy and Program Requirements for the Mandatory
Agency-wide Quality System, U.S. Environmental Protection Agency, Washington, DC.
EPA Order 7500.1 A (October 1992), Minimum Set of Data Elements for Ground-Water Quality,
U.S. Environmental Protection Agency, Washington, DC.
U.S. Environmental Protection Agency, 1999. EPA Requirements for Quality Management
Plans (QA/R-2), EPA/600/R-99/032, Office of Research and Development.
U.S. Environmental Protection Agency, 1998a. Guidance for Data Quality Assessment-
Practical Methods for Data Analysis (QA/G-9), EPA/600/R-96/084, Office of Research
and Development.
Interim Final
EPAQA/R-5 21 November 1999
-------
U.S. Environmental Protection Agency, 1998b. Guidance for Quality Assurance Project Plans
(QA/G-5), EPA/600/R-98/018, Office of Research and Development.
U.S. Environmental Protection Agency, 1995. Guidance for the Preparation of Standard
Operating Procedures (SOPs) for Quality-Related Documents (QA/G-6), EPA/600/R-
96/027, Office of Research and Development.
U!S. Environmental Protection Agency, 1994. Guidance for the Data Quality Objectives Process
(QA/G-4), EPA/600/R-96/055, Office of Research and Development.
U.S. Environmental Protection Agency, 1980. Interim Guidelines and Specifications for
Preparing Quality Assurance Project Plans, QAMS-005/80, Office of Research and
Development.
Interim Final
EPAQA/R-5 22 November 1999
-------
APPENDIX A
CROSSWALKS AMONG QUALITY ASSURANCE DOCUMENTS
A.1 BACKGROUND
This appendix contains crosswalks between this document and other QA planning
documents. The first crosswalk compares this requirements document with its predecessor
document, QAMS 005/80, Interim Guidelines and Specifications for Preparing Quality
Assurance Project Plans (EPA 1980). The second crosswalk compares the elements of the
QAPP defined in this document with the steps defined in Guidance for the Data Quality
Objectives Process (QA/G-4) (EPA 1994), the Agency's preferred systematic planning process
for environmental decision making. This crosswalk is provided to assist the reader in determining
how the outputs from the DQO Process can be integrated into a QAPP.
A.2 CROSSWALK BETWEEN EPA QA/R-5 AND QAMS-005/80
QAMS-005/80 ELEMENTS
1.0
2.0
3.0
4.0
5.0
6.0
7.0
8.0
Title Page with Provision for
Approval Signatures
Table of Contents
Project Description
Project Organization and
Responsibility
QA Objectives for Measurement
Data (PARCC)
Sampling Procedures
Sample Custody
Calibration Procedures and
Frequency
QA7R-5 ELEMENTS
Al
A2
A5
A6
A3
A4
A8
A9
A7
Bl
B2
B3
B7
Title and Approval Sheet
Table of Contents
Problem Definition/Background
Project/Task Description
Distribution List
Project/Task Organization
Special Training/Certification
Documents and Records
Quality Objectives and Criteria for
Measurement Data
Sampling Process Design
Sampling Methods
Sample Handling and Custody
Instrument/Equipment Calibration and
Frequency
EPA QA/R-5
A-l
Interim Final
November 1999
-------
QAMS-005/80 ELEMENTS
9.0
10.0
11.0
12.0
13.0
14.0
15.0
16.0
Analytical Procedures
Data Reduction, Validation, and
Reporting
Internal Quality Control Checks
and Frequency
Performance and Systems
Preventive Maintenance
Specific Routine Procedures
Measurement Parameters
Involved
Corrective Action
QA Reports to Management
QA/R-5 ELEMENTS
B4
Dl
D2
B9
BIO
B5
Cl
B6
D3
Cl
C2
Analytical Methods
Data Review, Verification, and
Validation
Verification and Validation Methods
Non-direct Measurements
Data Management
Quality Control
Assessments and Response Actions
Instrument/Equipment Testing,
Inspection, and Maintenance
Reconciliation with User
Requirements
Assessments and Response Actions
Reports to Management
EPA QA/R-5
A-2
Interim Final
November 1999
-------
A.3 CROSSWALK BETWEEN THE DQO PROCESS AND THE QAPP
Elements
Requirements
DQO Overlap
PROJECT MANAGEMENT
Al Title and Approval Sheet
A2 Table of Contents
A3 Distribution List
A4 Project/Task
Organization
A5 Problem Definition/
Background
A6 Project/Task Description
A7 Quality Objectives and
Criteria for
Measurement Data
A8 Special Training/
Certification
A9 Documents and Records
Title and approval sheet.
Document control format.
Distribution list for the QAPP revisions and final guidance.
Identify individuals or organizations participating in the project and
discuss their roles, responsibilities and organization.
1) State the specific problem to be solved or the decision to be made.
2) Identify the decision maker and the principal customer for the results.
1) Hypothesis test, 2) expected measurements, 3) ARARs or other
appropriate standards, 4) assessment tools (technical audits), 5) work
schedule and required reports.
Decision(s), population parameter of interest, action level, summary
statistics and acceptable limits on decision errors. Also, scope of the
project (domain or geographical locale).
Identify special training that personnel will need.
Itemize the information and records that must be included in a data report
package, including report format and requirements for storage, etc.
N/A
N/A
Step 1: State the Problem
Step 1: State the Problem
Step 1: State the Problem
Step 2: Identify the Decision
Step 1: State the Problem
Step 2: Identify the Decision
Step 3: Identify the Inputs to the Decision
Step 6: Specify Limits on Decision Errors
Step 4: Define the Boundaries
Step 5: Develop a Decision Rule
Step 6: Specify Limits on Decision Errors
N/A
Step 3: Identify the Inputs to the Decision
Step 7: Optimize the Design for Obtaining Data
DATA GENERATION AND ACQUISITION
Bl Sampling Process
Design (Experimental
Design)
B2 Sampling Methods
B3 Sample Handling and
Custody
B4 Analytical Methods
B5 Quality Control
Outline the experimental design, including sampling design and rationale,
sampling frequencies, matrices, and measurement parameter of interest.
Sample collection method and approach.
Describe the provisions for sample labeling, shipment, chain-of-custody
forms, procedures for transferring and maintaining custody of samples.
Identify analytical method(s) and equipment for the study, including
method performance requirements.
Describe quality control procedures that should be associated with each
sampling and measurement technique. List required checks and
corrective action procedures.
Step 5: Develop a Decision Rule
Step 7: Optimize the Design for Obtaining Data
Step 7: Optimize the Design for Obtaining Data
N/A
Step 3: Identify the Inputs to the Decision
Step 7: Optimize the Design for Obtaining Data
Step 3: Identify the Inputs to the Decision
EPA QA/R-5
A-3
Interim Final
November 1999
-------
Elements
B6 Instrument/Equipment
Testing, Inspection, and
Maintenance.
B7 Instrument/Equipment
Calibration and
Frequency
B8 Inspection/ Acceptance of
Supplies and
Consumables
B9 Non-direct
Measurements
BIO Data Management
Requirements
Discuss how inspection and acceptance testing, including the use of QC
samples, must be performed to ensure their intended use as specified by
the design.
Identify tools, gauges and instruments, and other sampling or
measurement devices that need calibration. Describe how the calibration
should be done.
Define how and by whom the sampling supplies and other consumables
will be accepted for use in the project.
Define the criteria for the use of non-measurement data, such as data that
come from databases or literature.
Outline the data management scheme including the path and storage of
the data and the data record-keeping system. Identify all data handling
equipment and procedures that will be used to process, compile, and
analyze the data.
DQO Overlap
Step 3: Identify the Inputs to the Decision
Step 3: Identify the Inputs to the Decision
N/A
Step 1: State the Problem
Step 7: Optimize the Design for Obtaining Data
Step 3: Identify the Inputs to the Decision
Step 7: Optimize the Design for Obtaining Data
ASSESSMENT AND OVERSIGHT
Cl Assessments and
Response Actions
C2 Reports to Management
Describe the assessment activities needed for this project.
Identify the frequency, content, and distribution of reports issued to keep
management informed.
Step 7: Optimize the Design for Obtaining Data
N/A
DATA VALIDATION AND USABILITY
Dl Data Review,
Verification, and
Validation
D2 Verification and
Validation Methods
D3 Reconciliation With
User Reauirements
State the criteria used to accept or reject the data based on quality.
Describe the process to be used for verifying and validating data,
including the chain-of-custody for data throughout the lifetime of the
project.
Describe how results will be evaluated to determine if performance
criteria have been satisfied.
Step 7: Optimize the Design for Obtaining Data
Step 3: Identify the Inputs to the Decision
Step 7: Optimize the Design for Obtaining Data
EPA QA/R-5
A-4
Interim Final
November 1999
-------
APPENDIX B
TERMS AND DEFINITIONS
assessment - the evaluation process used to measure the performance or effectiveness of a system
and its elements. As used here, assessment is an all-inclusive term used to denote any of the
following: audit, performance evaluation, management systems review, peer review, inspection, or
surveillance.
audit (quality) - a systematic and independent examination to determine whether quality
activities and related results comply with planned arrangements and whether these arrangements
are implemented effectively and are suitable to achieve objectives.
calibration - comparison of a measurement standard, instrument, or item with a standard or
instrument of higher accuracy to detect and quantify inaccuracies and to report or eliminate those
inaccuracies by adjustments.
chain-of-custody - an unbroken trail of accountability that ensures the physical security of
samples, data, and records.
contractor - any organization or individual that contracts to furnish services or items or perform
work; a supplier in a contractual situation.
data quality assessment - a statistical and scientific evaluation of the data set to determine the
validity and performance of the data collection design and statistical test, and to determine the
adequacy of the data set for its intended use.
data usability - the process of ensuring or determining whether the quality of the data produced
meets the intended use of the data.
design - specifications, drawings, design criteria, and performance requirements. Also the result
of deliberate planning, analysis, mathematical manipulations, and design processes.
environmental conditions - the description of a physical medium (e.g., air, water, soil, sediment)
or biological system expressed in terms of its physical, chemical, radiological, or biological
characteristics.
environmental data - any measurements or information that describe environmental processes,
location, or conditions; ecological or health effects and consequences; or the performance of
environmental technology. For EPA, environmental data include information collected directly
from measurements, produced from models, and compiled from other sources such as data bases
or the literature.
Interim Final
EPAQA/R-5 B-l November 1999
-------
environmental data operations - work performed to obtain, use, or report information
pertaining to environmental processes and conditions.
environmental processes - manufactured or natural processes that produce discharges to or that
impact the ambient environment.
environmental programs - work or activities involving the environment, including but not
limited to: characterization of environmental processes and conditions; environmental monitoring;
environmental research and development; the design, construction, and operation of
environmental technologies; and laboratory operations on environmental samples.
environmental technology - an all-inclusive term used to describe pollution control devices and
systems, waste treatment processes and storage facilities, and site remediation technologies and
their components that may be utilized to remove pollutants or contaminants from or prevent them
from entering the environment. Examples include wet scrubbers (air), soil washing (soil),
granulated activated carbon unit (water), and filtration (air, water). Usually, this term will apply
to hardware-based systems; however, it will also apply to methods or techniques used for
pollution prevention, pollutant reduction, or containment of contamination to prevent further
movement of the contaminants, such as capping, solidification or vitrification, and biological
treatment.
financial assistance - the process by which funds are provided by one organization (usually
government) to another organization for the purpose of performing work or furnishing services or
items. Financial assistance mechanisms include grants, cooperative agreements, performance
partnership agreements, and government interagency agreements.
graded approach - the process of basing the level of application of managerial controls applied
to an item or work according to the intended use of the results and the degree of confidence
needed in the quality of the results.
independent assessment - an assessment performed by a qualified individual, group, or
organization that is not a part of the organization directly performing and accountable for the
work being assessed.
information resources management - the planning, budgeting, organizing, directing, training
and controls associated with information. The term encompasses both information itself and
related resources such as personnel, equipment, funds and technology.
inspection - an activity such as measuring, examining, testing, or gauging one or more
characteristics of an entity and comparing the results with specified requirements in order to
establish whether conformance is achieved for each characteristic.
Interim Final
EPAQA/R-5 B-2 November 1999
-------
management system - a structured, non-technical system describing the policies, objectives,
principles, organizational authority, responsibilities, accountability, and implementation plan of an
organization for conducting work and producing items and services.
method - a body of procedures and techniques for performing an activity (e.g., sampling,
modeling, chemical analysis, quantification) systematically presented in the order in which they are
to be executed.
participant - when used in the context of environmental programs, an organization, group, or
individual that takes part in the planning and design process and provides special knowledge or
skills to enable the planning and design process to meet its objective.
performance evaluation - a type of audit in which the quantitative data generated in a
measurement system are obtained independently and compared with routinely obtained data to
evaluate the proficiency of an analyst or laboratory.
quality - the totality of features and characteristics of a product or service that bear on its ability
to meet the stated or implied needs and expectations of the user.
quality assurance (QA) - an integrated system of management activities involving planning,
implementation, documentation, assessment, reporting, and quality improvement to ensure that a
process, item, or service is of the type and quality needed and expected by the client.
quality assurance manager - the individual designated as the principal manager within the
organization having management oversight and responsibilities for planning, documenting,
coordinating, and assessing the effectiveness of the quality system for the organization.
quality assurance project plan (QAPP) - a document describing in comprehensive detail the
necessary QA, QC, and other technical activities that must be implemented to ensure that the
results of the work performed will satisfy the stated performance criteria.
quality control (QC) - the overall system of technical activities that measures the attributes and
performance of a process, item, or service against defined standards to verify that they meet the
stated requirements established by the customer; operational techniques and activities that are
used to fulfill requirements for quality.
quality management - that aspect of the overall management system of the organization that
determines and implements the quality policy. Quality management includes strategic planning,
allocation of resources, and other systematic activities (e.g., planning, implementation,
documentation, and assessment) pertaining to the quality system.
quality management plan (QMP) - a document that describes a quality system in terms of the
organizational structure, policy and procedures, functional responsibilities of management and
Interim Final
EPAQA/R-5 B-3 November 1999
-------
staff, lines of authority, and required interfaces for those planning, implementing, documenting,
and assessing all activities conducted.
quality system - a structured and documented management system describing the policies,
objectives, principles, organizational authority, responsibilities, accountability, and implementation
plan of an organization for ensuring quality in its work processes, products (items), and services.
The quality system provides the framework for planning, implementing, documenting, and
assessing work performed by the organization and for carrying out required QA and QC activities.
readiness review - a systematic, documented review of the readiness for the start-up or continued
use of a facility, process, or activity. Readiness reviews are typically conducted before proceeding
beyond project milestones and prior to initiation of a major phase of work.
record - a completed document that provides objective evidence of an item or process. Records
may include photographs, drawings, magnetic tape, and other data recording media.
specification - a document stating requirements and which refers to or includes drawings or other
relevant documents. Specifications should indicate the means and the criteria for determining
conformance.
supplier - any individual or organization furnishing items or services or performing work
according to a procurement document or financial assistance agreement. This is an all-inclusive
term used in place of any of the following: vendor, seller, contractor, subcontractor, fabricator, or
consultant.
surveillance (quality) - continual or frequent monitoring and verification of the status of an ,
entity and the analysis of records to ensure that specified requirements are being fulfilled. .
technical systems audit (TSA) - a thorough, systematic, on-site, qualitative audit of facilities,
equipment, personnel, training, procedures, record keeping, data validation, data management,
and reporting aspects of a system.
validation - confirmation by examination and provision of objective evidence that the particular
requirements for a specific intended use are fulfilled. In design and development, validation
concerns the process of examining a product or result to determine conformance to user needs.
verification - confirmation by examination and provision of objective evidence that specified
requirements have been fulfilled. In design and development, verification concerns the process of
examining a result of a given activity to determine conformance to the stated requirements for that
activity.
Interim Final
EPAQA/R-5 B-4 November 1999
------- |