INTEGRATING QUALITY ASSURANCE
INTO TRIBAL WATER PROGRAMS
A RESOURCE 6UIDE FOR RELIABLE WATER QUALITY DATA COLLECTION
-------
INTEGRATING QUALITY ASSURANCE
INTO TRIBAL WATER PROGRAMS
A RESOURCE GUIDE FOR RELIABLE
WATER QUALITY DATA COLLECTION
U.S CPA Region 8 Library !
80C-L
999 18(h Si , Suite 500
Denver, CO 80?0?-?466
Writing & technical review:
Additional technical review & editing:
Special review & comments:
Editing, design, photography & production:
Cover art work:
Chris Lehnertz, EPA Region 8
Phil Johnson, EPA Region 8
Rick Edmonds, EPA Region 8
David Rathke, EPA Region 8
Ute Mountain Ute Tribe
Fort Peck Tribes
Southern Ute Tribe
ECOS Communications, Inc.
Boulder, Colorado
Norman Lansing
Southern Ute Tribe
<)n l(HY\) /W-C ommnc)
Pdpt't with S(t-)-B,ihi(l I tiki
-------
Opening Prayer for the Conference:
"Quality Assurance for Water Quality in Indian Country"
Southern Ute Reservation, September 1992
Heavenly Father, Grandfather, we thank you for this time of day, Grand-
father, that we've gathered here in a good way, Grandfather, the participants
for this conference on water quality, Grandfather.
We thank you, Grandfather, for all that you've, created. We thank you for the
water of life, Grandfather, that these professionals are here, Grandfather, that
they can take this knowledge they've gained about their individual reserva-
tions and their homes, Grandfather, that we can protect all of our water and
our water quality, Grandfather.-
We ask in a humble way, Grandfather, for good prayers, Grandfather, for the
unborn generations, and for the little children, Grandfather. For the teenag-
er generation, Grandfather, we ask your blessings, for the adult generation,
Grandfather, for all those from the doorway in to the doorway out, that you
can take care of their needs. We thank you, Grandfather; for our elders and
our ancestors, Grandfather. Without them we would not be able to do the
things that have brought us to where we are right now, Grandfather.
All things, spoken and unspoken, we ask in a humble way that you take care
of these things, Heavenly Father, and we put these into your hands, Grand-
father. Again, Grandfather, we thank you for the water of life that we can
take care of it in a good way for all the generations that will be coming in the
future. Amen.
—Nathan Winder
Southern Ute Tribe
-------
TABLE OF CONTENTS
INTRO
INTRODUCTION
Background: the Origin and Purpose of this Guide 1
How to Use this Guide 2
CASE STUDY
CASE STUDY:
TRIBAL WATER QUALITY PROGRAM DEVELOPMENT
Program Development: Objective and Goals 3
Section 106 Grant Workplan 4
Workplan Implementation 5
Monitoring 7
Results 8
QUALITY ASSURANCE AND QUALITY CONTROL
WORKING TOGETHER
Quality Assurance and Quality Control 9
Precision and Accuracy Sampling and Calculations 10
Evaluating Results and Determining Quality 16
QUALITY ASSURANCE PROJECT PLANS
The Sixteen Elements for your Tribal Plan 17
HELPFUL RESOURCES
Glossary ¦ , 31
List of Acronyms 34
References ¦. 35
-------
INTRODUCTION
BACKGROUND
In September 1992, the Southern
Ute Indian Tribe and the United States
Environmental Protection Agency
(EPA) Region 8 co-sponsored the
workshop "Quality Assurance for Water
Quality in Indian Country." The
document before you is a result of
that workshop.- It presents workshop
information along with suggested
methods for incorporating quality
assurance—a process for evaluating
data quality—into tribal water quality
programs, based on EPA requirements.
Reauthorization of the Clean Water Act
(CWA) in 1987 created opportunities
for Indian tribes to receive financial
assistance from EPA. The Agency now
provides funding to Indian tribes for
the development of many types of
water quality projects, including: water
quality program development, lake
water quality assessment and remedia-
tion, point and nonpoint source pollu-
tion control, and wetlands protection.
When environmental data are collected
by any-entity funded through EPA, spe-
cific technical requirements must be
met in order to ensure that data are of
good quality. The system of such
By law, you cannot conduct water
monitoring under an EPA-funded pro-
gram until you have an approved
Quality Assurance Project Plan.
If a tribe is sampling under a
QA/QC program with the pre-1993
format, sampling may continue, but
the QAPP must be reformatted by
October 1994.
quality assurance is commonly known
as QA/QC (quality assurance/quality
control). QA/QC should be integratec
into a tribal water quality monitoring
program at the outset of program
development.
The QA/QC workshop is one example of technical training available from EPA.
The purpose ol this guide is to provide
you with the information that-you will
need to develop a tribal QA/QC pro-
gram. It also provides instructions for
writing the required Quality Assurance
Project Plan (QAPP) that must be
approved by EPA before monitoring
may begin under a CWA grant.
By federal regulation, any entity
funded by EPA to collect enviroment-
al data must develop a QAPP which
will document how their QA/QC pro-
gram meets EPA criteria. This is
required so that EPA and its grantees
can ensure that the data collected are
scientifically valid, of known and suit-
able quality, collected with the best
cost-effective technology available, and
legally defensible if necessary.
-------
<><><><><><><><><><><><><><><><>
Many tribal water quality programs
have already developed EPA-approved
QA/QC programs. Because the QAPP
format and contents are new and sam-
pling technology has recently changed,
previously-approved QA/QC programs
may not reflect current requirements.
Sample portions of the new QAPP for-
mat are provided in the section of this
document entitled "Quality Assurance
Project Plans."
Field sessions are part of many EPA training courses.
QA/ QC is used when making any
environmental measurement, includ-
ing those for water, air, or soil. But
how does QA/QC fit into tribal water
quality program development? From
evaluating historical data to projecting
monitoring costs for a grant proposal,
QA/QC considerations must be
included. The case study in the next
section of this guide illustrates the
integration of QA/QC into the devel-
opment of a tribal program.
HOW TO USE THIS GUIDE
This guide is divided into four sec-
tions, each of which can be read and
used as a unit, independent of the oth-
ers. Reading only one section, however,
might leave you with an incomplete
picture of the process for integrating
QA/QC into your tribal water
quality program. We suggest that you
read through the entire guide in the
order presented here. Afterward, you
may want to go back to a certain sec-
tion for further study or clarification.
The "Case Study" section provides a
step-by-step overview of the entire
process for establishing a water moni-
toring program, beginning with the
tribe's commitment and ending with an
evaluation of the data collected. The
details for developing your own
QA/QC program can be found in the
two sections following the case study.
Throughout this guide, informational
tips are presented in shaded boxes,
while important definitions can be
found in bold type in the page's outer
margin. (The Glossary, in the "Helpful
Resources" section, is another good
place to check for definitions.) The
"Quality Assurance and Quality
Control Working Together" section
contains formulas and mathematical
computations to better present several
technical concepts, and the "Quality
Assurance Project Plans" section pro-
vides numerous examples shown on
ruled or graph paper for you to follow.
Sources for additional information are
listed under References in the final sec-
tion. If you are unable to find the
answers to your questions in this guide,
contact EPA for assistance.
-------
CASE STUDY:
TRIBAL WATER QUALITY
PROGRAM DEVELOPMENT
-------
CASE STUDY:
TRIBAL WATER QUALITY P ROC RAM DEVELOPMENT
UTE MOUNTAIN UTE TRIBE
The following is an account of the
steps that could be taken by a tribe to
develop a water quality protection
program that includes adequate
QA/QC provisions. Beginning with a
stated commitment by the tribe to
protect its reservation waters, the Ute
Mountain Ute Tribe developed the
necessary systems and EPA documents
to receive a CWA grant and begin sur-
face water monitoring. Although the
timeline and progression of events will
vary from tribe to tribe, this case study
may help you to plan for the success-
ful integration of QA/QC into your
program.
In 1991, the Ute Mountain Ute Tribal
Council decided that one of the tribe's
priorities was to protect water quality
on the Ute Mountain Ute Reserva-
tion. The tribe investigated a variety
of possibilities for developing a water
quality protection program. After
applying and being approved for an
EPA Clean Water Act Section 106
grant, the tribe initiated program
development.
PROGRAM DEVELOPMENT
The first task for the tribe was to
hire a Water Quality Specialist with a
background in biology and chemistry.
The role of the Water Quality
Specialist was to provide technical
assistance to the tribe by developing
and managing a tribal water quality
program. The Water Quality Specialist
worked closely with the Tribal Council
to develop a program objective and
long-range goals. Examples of these are:
Objective:
The Ute Mountain Ute Tribe will
protect, maintain, and enhance the
quality of tribal waters.
Long-Range Goals:
1. To develop a complete set of base-
line data on the quality of tribal surface
water, groundwater, and wetlands.
Monitoring will include chemical, phys-
ical, and biological parameters as well
as habitat assessments, and will incorpo-
rate appropriate quality assurance and
quality control measures. The resulting
database will: (a) provide an overview of
the current quality of reservation waters,
(b) assist in classifying waters for the
development of water quality standards,
(c) help to inventory potential point
and nonpoint sources of pollution, and
(d) identify areas of special concern that
may need immediate attention or fur-
ther study. Data will be used for long-
'term monitoring of abatement projects,
tracking water quality standards com-
pliance, providing information for
assessing environmental impacts from
development on the reservation, and
prioritizing program activities.
Quality Assurance (OA)
is a process which
ensures that a monitor-
ing program is ade-
quately planned and
conducted to provide
data of the highest pos-
sible quality. QA is a
set of operating princi-
ples and procedures
used for data collection,
sample handling, analy-
sis, and data review
that can be used in the
field and in the labora-
tory to provide data
that are of known qual-
ity. Simply put: QA is a
way to effectively collect
environmental data and
determine how believ-
able or reliable they are.
Quality Control (OC)
is the set of steps taken
during sample collection
and analysis to ensure
that data quality meets
the minimum standards
established by a Quality
Assurance Project Plan.
Note: An EPA Section 106 grant can be a cornerstone for developing a tribal water quality program. It can
provide funding for a broad range of water pollution control projects, including wetlands protection, nonpoint
source pollution control, water quality standards development, permitting and code development, and ground-
water, surface water, and lake water quality sampling. Wastewater treatment facility construction and analysis
of drinking water are not eligible for funding under the 106 program
-------
The primary purpose of moni-
toring is to confirm or deny the
presence, amount, and extent of pol-
lutants or contaminants. Keep this
in mind when developing a moni-
toring program.
Remember that your QAPP
must be completed and approved
before you collect baseline data or
perform any monitoring. However,
you may begin compiling historic
data at any time.
period. All of the workplan activities
were tied to the long-range goals.
While some program activities would
be conducted over more than one year,
only those tasks that could be accom-
plished during the grant period were
described. Listed here, without details
such as specific tasks, budget, or
milestones, are some of the activities:
1. Establish a Water Quality
Protection Office; purchase office and
sampling equipment and supplies; hire
a Water Quality Technician to work
with the Water Quality Specialist.
2. Compile and review historical
data on the quality of reservation
waters. Develop format for water
quality database and enter data of
acceptable quality.
Water quality
monitoring is the collec-
tion and analysis of
water, organisms living
in or adjacent to the
water, or physical ele-
ments associated with
water that may serve to
characterize the quality
of the water. It may
also include data collec-
tion on the condition of
the physical and biolog-
ical habitat in and
around a body of water.
Typical monitoring data
can be separated into
chemical, physical, bio-
logical, and habitat
parameters.
2. To develop a water quality pro-
gram that will address point and non-
point sources of pollution. This will be
accomplished through the development
of rules and regulations, management
and assessment plans, best management
practices, and water quality standards.
3. To enhance the technical and
administrative expertise of water quality
program staff through training and
instruction. This will allow the tribe to
work as an equal partner with other
agencies regarding water quality issues
both on and off the reservation.
After the long-range goals were
approved by the Tribal Council, short-
range activities were translated into a
final Section 106 grant workplan.
SECTION 106
GRANT WORKPLAN
The workplan was written to
encompass activities to be completed
during the one-year grant project
Seining, a stream is one way to collect data about fish populations.
3. Determine gaps in the existing
data and outline a surface water quality
monitoring program. Before monitor-
ing is performed, the monitoring
program details will be sent to EPA as
an addition to the workplan.
-------
4. Write a Standard Operating
Procedures (SOP) manual of monitor-
ing .procedures. The SOPs will be used
whenever water quality program sam-
ples are collected.
5. Write a Quality Assurance
Project Plan (QAPP) that will outline
the QA/QC requirements for collecting
and analyzing data. Submit the QAPP
to EPA for approval.
Because the scope of work for this grant
was only one year, the tribe focused on
surface water only, and planned to
monitor groundwater and wetlands at a
later date. As soon as the workplan was
approved by EPA, work was initiated.
SOPs, if followed correctly, will
provide consistency in sampling.
All sampling procedures should be
contained in one document, and be
readily available to provide instruc-.
tion for anyone conducting field
sampling. SOPs frequently consist
of the operating manuals from field
and laboratory equipment, specific
information on how a sample
should be extracted from a body of
water, and instructions for the han-
dling of sample containers.
Depending on your experience
with monitoring and environmental
data collection, as well as your
workload, the writing of your
QAPP and SOP documents could
take from one week to several
months. The pre-work for collect-
ing equipment operating instruc-
tions, contracting with a laboratory,
and gathering information on ele-
ments for your QAPP typically
takes as long as one month.
Many of the activities of the work-
plan were conducted at the same time.
Once a Water Quality Protection
Office was established, the program
entered into the day-to-day work of
implementing other aspects of the
workplan and developing the water
quality program.
1. The Water Quality Specialist set
up the Water Quality Protection Office,
hired a Water Quality Technician,
ordered office and sampling equipment
and supplies, and began performing
activities from the workplan.
2. The Water Quality Technician
began to compile existing water quality
information from organizations that
had previously conducted water quality
monitoring on surface water, ground-
water, and wetlands within or adjacent
to the reservation boundaries. Data
were limited to information no more
than 15 years old. The Technician
looked for chemical, physical, and habi-
tat data, as well as data on the plant and
animal species found in and around ¦
aquatic areas. It was found that each of
the four drainages on the reservation
had been sampled within the previous-
15 years for physical, chemical, and
biological parameters.
3. The Specialist performed a
review of the water quality data that
had been compiled. For three of the
four drainages found on the reserva-
tion, the water quality data included
QA/QC results.
The fourth drainage, the Mancos, had
been monitored every year for the
Standard Operating
Procedure (SOP) manu-
al is a written, step-by-
step description of the
procedures that should
be usedfor collecting
samples and performing
analyses. These proce-
dures are designed to
ensure that samples are
collected, preserved,
handled, and analyzed
in a proper manner,
and that sampling is
done consistently from
year to year. SOPs also
ensure that evaluations
on habitat parameters
are performed the same
way by all water quality
personnel, to provide
consistency.
Quality Assurance
Project Plan (QAPP)
is a written plan that
outlines the procedures
to be used for ensuring
high-qtiality data when
conducting sample col-
lection and-analysis for
environmental monitor-
ing. A QAPP consists of
up to 25 elements that
comprise a quality
assurance system.
-------
5. Because there is so much overlap
between the SOPs and QAPP, they were
developed concurrently. The Tech-
nician wrote the QAPP, including the
tribe's expectations for the quality of
data, how detailed the analysis of the
data would be, and how the quality of
the results would be determined. The
QAPP included information on how
many and what types of quality control
samples would be used. This would
determine the quality of field collection
procedures as well as field and laborato-
ry analyses. It also included specific
information about how long each sam-
ple could be kept before analysis, infor-
mation on how to preserve samples, the
type of container to be used, specifics
on how the samples should be shipped,
and the analytical methods to be used.
V The QAPP was written to
include the necessary information
fdr collecting and analyzing every
type of physical and chemical para-
meter that the tribe might possibly
measure. Although the Technician
and Specialist knew they would not
monitor for every parameter in
every sample, they included all pos-
sible parameters in the QAPP so
that they would only have to write
this part of the document once, sub-
ject to change only with changes in
applicable technology.
V Keep the SOP and QAPP doc-
uments together for quick reference
in the field and laboratory. Even
when you have collected the same
type of sample every day for a
month, refer back to these docu-
ments periodically to check your
sampling procedures.
previous ten years, but there was no
indication that any QA/QC had been
used. Because there was no documen-
tation on the use of QA/QC, the quali-
ty of this data could not be determined.
The Specialist decided that the infor-
mation from the other three drainages
was of good enough quality to be
entered into the tribal database as base-
line data. The Mancos data, however,
were of unknown quality, and could
not be used in the database. Thus, the
cnly gap in baseline data was for the.
Mancos drainage.
4. In order to complete the baseline
data collection, the Specialist and the
Technician would need to monitor the
Mancos River and the seven streams
that drained into it. While the
Specialist outlined a monitoring pro-
gram for the Mancos, the Technician
began to work on developing the
required QAPP and SOP documents.
The Southern Ute Tribe developed a tribal water quality laboratory for performing
routine analyses. A review of laboratory SOPs was part of the workshop that served
as the background for this guide.
-------
~ Take time to took around you
at those things that might influence
the rivers that flow into reservation
waters. Ask questions of people
who may have valuable information
(e.g., industry operators, geologists,
weather specialists, farmers).
~ Consider the season of the year
when planning monitoring, as this
will affect flow, dilution, and other
aspects of surface waters. Storms
and droughts can also affect your
monitoring results. Make sure to
indicate current season and weather
I in your field notebook.
¦ ~ Check your data periodically,
not just.at the end of the year. Do
I they appear reasonable? Are there
any big surprises? Doing this can
help you catch problems early in the
sampling season.
To put together the SOPs, the
Technician collected all the operating
manuals for the field and laboratory
sampling equipment that the tribe had
purchased. The reference book
Standard Methods for the Examination
of Water and Wastewater (see Ref-
erences, page 35) was reviewed so that
the Technician could list die exact pro-
cedures that would be used for each
type of sample collection. Once the
Technician compiled these items, they
.were put together in one notebook.
Because one copy was needed in the
laboratory and another was needed in
the field, the Technician made two
copies (and laminated each page),
keeping the original in the office. This
way, anyone collecting samples could
refer to the SOP notebook for com-
plete instructions.
MONITORING
Water quality monitoring is con-
ducted for a wide variety of reasons.
For example, monitoring programs may
be established to collect baseline data or
to evaluate the effects of road building
and maintenance, forest harvest, appli-
cation of herbicides and pesticides,
recreation, grazing, or mining. Each of
these programs would necessitate a
specific set of monitoring tests. Clearly
stating and understanding your objec-
tive for monitoring will help you to
determine how often and where sam-
ples should .be collected.
The Specialist outlined a monitoring
plan for the Mancos drainage, aimed at
providing baseline data, and sent it to
EPA as part of the tribal workplan.
The QAPP was also sent to EPA for-
approval, with the SOPs attached for
review. Meanwhile, the Specialist and
Technician spent time in the field and
laboratory, becoming familiar with
their equipment and Standard
Operating Procedures. The first sam-
ples were collected just for practice and
-were not included in the-official water
quality database.
~ Include a statement in your field notebook aboutland use .
near arid upstream from your sampling sites. Such information
might help to explain your results, especially in explaining why
certain values turned out higher or lower than expected.
~ Are you looking for training in monitoring techniques?
Local colleges and universities may offer courses in monitoring or
environmental science. Additional resources for training include
other tribes, state and federal agencies, and a collection of
extensive literature on monitoring plans and procedures.
-------
As soon as your QAPP is approved and your SOPs are final-
ized, you and your sampling staff should read and discuss these
documents to become completely familiar with them.
Communication between people collecting data is essential; if
possible, have them sample together in the field. In addition,
sampling personnel should document their procedures (and
deviations from procedures) to help identify situations where
problems may arise because c6n£istency is not ensured. This way,
if program personnel leave the program, new staff will have accu-
rate documentation on how samples have been collected.
Data Quality
Objectives (DOOs). are
the numerical goals that
are set for a monitoring
project. Based on the
objective of the sam-
pling, numbers are
defined for the range of
data quality that will
be acceptable. DQOs
reflect the accuracy, pre-
cision, and completeness
for each parameter that
is measured.
Once the monitoring plan and the
QAPP were approved by EPA, the
Specialist and Technician were able to
begin monitoring. They collected the
samples that had been identified in the
monitoring plan, closely following the
SOPs and QAPP. The Specialist was
identified as the Quality Assurance
Officer, and ensured that the correct
methods for sample collection, preser-
vation, storage, and shipment were
used. Some of the tests, such as those
for temperature, conductivity, hard-
ness, alkalinity, dissolved oxygen, and
PH; were conducted in the field or
tribal laboratory. Samples to test for
constituents such as iron, mercury, and
atrazinewere collected and then sent to
a contract laboratory for analysis. For
both types of data, QA/QC procedures
were performed regularly.
Once the data from the monitoring
were compiled, the Specialist went
back to the QAPP to review the
requirements for acceptable data quali-
ty. By reconciling the QA/QC sample
results with the data quality objectives
outlined in the QAPP, the Specialist
was able to determine that the overall
quality of the data was good. (The
procedures for conducting this type of
reconciliation are detailed on page 16.)
Data not meeting the QA/QC guide-
lines were discarded. These steps en-
sured that the data used were likely to
represent the actual conditions of the
water. At this point, the water quality
staff could identify locations of poor
water quality and recommend
further action.
This case study is just one example of
how QA/QC can be successfully in-
corporated into a tribal water quality
program. It illustrates the importance
of developing the QAPP and SOP doc-
uments early in the process. By becom-
ing familiar with the procedures in
these documents, and using them reg-
ularly in the field and laboratory, the
tribe was able to determine the quality
of the data collected.
When choosing a laboratory
for analyzing your water quality
samples, it is best to conduct inter-
views. Provide the laboratory with a
list of questions regarding the analy-
ses you anticipate having done, and
talk directly with the laboratory
manager. When you develop the
contract, include a specific period of
time that your contract will cover,
the scope of work (including materi-
als the laboratory will furnish),
terms for payment, a provision giv-
ing both the tribe and EPA the right
to audit the laboratory, and other
terms and conditions as required or
recommended by the tribal pro-
gram. Make sure to agree on turn-
around time in advance.
-------
QUALITY ASSURANCE
AND QUALITY CONTROL
WORKING TOGETHER
-------
QUALITY ASSURANCE AND QUALITY CONTROL
WORKING TOGETHER
While quality assurance, quality
control, and SOPs are separate compo-
nents of a monitoring program, they
work together to provide data of
known quality. Together, they mini-
mize the error that is introduced in
sampling, and allow the tracking of
errors that may occur. From failing to
add the necessary preservative to a
metals sample to inadvertently using .
contaminated glassware, the possibili-
ties for system or human error in mon-
itoring are extensive. Regular control
sampling is an integral element in a
system for water quality monitoring.
QC samples should be labeled
with the same type of sample identifi-
cation number as other samples, and
submitted to the laboratory without
indication that they are QC samples.
However, these identification num-
bers should be noted in your field
sample notebook, and tracked within
your system as QC samples.
~ In order to determine the qual-
ity of the laboratory analyses, at
least 10% of the samples you sub-
mit to the laboratory should be QC
samples. At least 5% of your sam-
ples analyzed in the field should be
QC samples. For a new monitoring
program, however, it would be
appropriate to have as many as 50%
of all samples as QC samples, Until
the system is finely tuned.
Filtered samples can be easily contaminated during transfer from filtration reservoir'
to sample bottle. Getting assistance from other members of the field crew can help
you to minimize contamination.
QUALITY ASSURANCE AND
QUALITY CONTROL
QA/QC includes planning, assess-
ment, reporting, and making necessary
changes to the water monitoring
program to ensure quality data. The
system defined in your QAPP will out-
line what is acceptable for your moni-
toring objectives. If the results of your
quality control samples fall outside the
acceptable levels, these samples are
rejected. In addition, corrections may
be needed in your SOPs to ensure that
data are collected properly. Evaluation
of quality control samples allows you to
determine the quality of the overall data.
Quality control (QC) samples are col-
lected to determine precision and accu-
racy, and can be collected or prepared
-------
Precision is a measure-
ment of the closeness of
data values to each
other. This is deter-
mined by comparing the
results of several mea-
surements taken at one
location. Statistically,
precision is expressed as
a range of concentration
units, using relative
percent difference or
standard deviation.
in the field or laboratory. Field QC
samples are used to evaluate data
collection methods and field or
laboratory procedures and analyses.
Laboratory QC samples are used solely
to determine the quality of laboratory
procedures and analyses.
PRECISION AND
ACCURACY SAMPLING
AND CALCULATIONS
There are five basic types of QC
samples, numbered 1-5 on the pages
that follow. In determining precision
and accuracy, the use of basic statistics
is required. Each type of QC sample
listed below includes an example of
how the QC results would be analyzed
to determine precision or accuracy.
Samples to Determine Precision
Precision gives information about
how consistent your methods are. It
does not mean that the sample results
actually reflect the true value of the
A tribal water quality laboratory can be developed as part of the Section 106 grant
program. Equipment can be purchased with grant funds and installed by a tribal
program to perform routine laboratory analyses.
parameter measured, but rather that
your sampling is giving similar results
under similar conditions.
1. A split sample is the result of
taking one sample collected-in accor-
dance with SOPs and splitting the
sample into two bottles. The measure-
ment of agreement between the samples
will represent the precision. A sample
may be split in either the field or in
the laboratory.
EXAMPLE:
Precision Calculation for a Split
Sample
If a sample is split into two sub-
samples, or if a replicate sampling re-
sults in only two samples, the following
calculation may be used to determine
precision:
Relative Percent Difference =
Rpn I11I2 (ioo)
RPD = x,+ Xn
For example, if: Xj = 22
x2 = 18
RPD
22- 18
22 + 18
(100)
_4
40
2
(100)
5%
2. A replicate sample is obtained
by collecting two or more samples from
the same site, with the same methods,
one immediately after the other. Such
samples are considered representative
sub-samples of the same environment.
Replicate samples are processed nor-
mally through the entire measurement
-------
system. While analysis results will
never be exactly the same for any two
samples due to natural variation, the
degree of difference will allow you to
assess the variability caused by field
sampling methods.
EXAMPLE:
Precision Calculation for a Replicate
Sample
In order to assess the precision of a
replicate set where three or more sam-
ples are obtained from the same envi-
ronment, the standard deviation must
be determined. If four replicate sam-
ples were obtained consecutively from
one location to determine precision, the
following calculations would be made:
Sample results from laboratory:
Sample # Concentration (mg/1)
48
51
50
45
xi
x2
X3
X4
The equation for standard deviation (s)
is:
-x)2
n- 1
where I(xi-x)2
i=l
is the sum of the concentration values
for each of the sample results (x, . . xn)
when the average concentration is sub-
tracted from each result and the total
value is squared.
Breaking the equation into .its compo-
nents makes the calculations simple.
First, x is the average concentration,
found by:
_ _ (x, + . . xn)
In this case:
(48 + 51 + 50 + 45)
x ~ 4
x = 48.5
n
Then, X(x, - x)2 means the sum of
i=l
(x, -x)2 for all values of x from i to n.
(x, - x)2 + (x2 - x)2 + (x3 - x)2 + (x4 - x)2
= (48 - 48.5)2 + (51 - 48.5)2 +
(50 - 48.5)2 + (45 - 48.5)2
= (-0.5)2 + (2.5)2 + (1.5)2 + (-3.5)2
= 0.25 + 6.25 + 2.25 + 12.25
= 21
By placing these values in the original
equation, the result is:
¦-VT
s = Vt"
s = 2.6
The smaller the value of s, the better
the precision. The standard deviation
reflects the scatter of the values around
the average value. The results of this
calculation should be compared with
-------
the data quality objectives defined in
your QAPP. (See Element #6 in the
section "Quality Assurance Project
Plans.")
If a relationship between the standard
deviation and the concentration level is
clearly evident, use the coefficient of
variation (cv) to determine precision.
cv = |-(100)
In this example:
"=^5 (100)
cv = 5.4
When conducting an extensive sampling
event (collecting samples at different
locations during one trip), plan ahead
for the types and number of QC
samples that you will need to collect.
You will want to meet the minimum of
10% laboratory QC samples for every
sampling event, and compose the preci-
sion and accuracy makeup based on the
needs of your sampling. If you want to
evaluate the precision of the analysis for
an entire sampling event, you could
collect either a series of split samples or
a series of replicate samples. The fol-
lowing example is for an event using a
series of split samples.
v Many of today's calculators per-
form the standard deviation calcula-
tion. Consider purchasing this type
of equipment under your Section
106 grant.
ZX.\W yAz
- v s
For a sampling event involving 80
samples and a QC scheme of 10% of all
samples being analyzed for precision,
every 8th sample could be split. The fol-
lowing measurements and calculations
could be made to determine QA/QC.
The results of each pair (x, and x2) are
listed in the table below. Also listed are
the calculations that could be made for
average concentration (x), standard devi-
ation (s), and coefficient of variation (cv).
The precision of the individual mea- ¦
surements for this sampling event
could be estimated to be: (0.07) (x)
More complicated calculations may be
necessary for results where a constant
relationship does not exist. Such calcu-
lations are not included here, but can
be found in most'statistics texts.
*1
x2
x
s
cv (%)
1.5
1.7
1.60
.14
9
1.7
1.6
1.65
.07
4-
2.0
2.1
2.05
.07
3
2.4
2.1
2.25
.21-
9-
2.7
2.4
2.55
.21
8
3.9
4.3
4.10
.28
7
5.0
4.5
4.75
.35
7
5.2
4.7
4.95
.35
7
average cv = 7%
-------
Samples to Determine Accuracy
In order to determine the accuracy
of samples, they must be compared to a
reference material which is of a known
concentration. There are two types of
QC samples which determine accuracy.
3. A spike sample is a sample that
has a known amount and concentration
of a constituent, such as a metal or pes-
ticide, added to it. By introducing a
known quantity into a regularly collect-
ed sample, and determining the percent
of material that is recovered in analysis,
an evaluation of accuracy can be made.
Samples can be spiked either in the
field or in the laboratory.
By spiking a sample in the field and
determining the percent recovery of the
substance added, the results will reflect
effects associated with preservation,
shipping, laboratory preparation, and
analysis. A spike added in the laborato-
ry will incorporate effects associated
only with preparation and analysis.
Always remember safety considerations when sam-
pling during high run-off.
EXAMPLE:
Accuracy Calculation for a
Spike Sample
A sampling event collects 100 sam-
ples. To meet QA/QC requirements of
10%, 10 samples were selected to be
spiked and evaluated for accuracy.
(Note: When creating spike samples, a
sample is split. One resulting sub-sam-
ple is spiked; the other is left unspiked.)
Accuracy is the agree-
ment between the mea-
sured amount of a con-
stituent and the amount
of that constituent that
is actually present.
This is determined by
averaging several sam-
ples with a known value
added, and determining
how close they are to the
true value.
Unspiked Sample
(B;)
Spike Value
(T;)
Spiked Sample
(A;)
Recovery
(A; - B,)
% Recovery/Bias
A; + B; (100)
T;
4.0
20.0
22.8
18.8
94.0
7.9
20.0
26.2
18.3
91.5
4.5
20.0
25.4
20.9
104.5
1.3
20.0
21.2
19.9
99.5
17.3
50.0
66.7
49.4
94.8
26.3
100.0
128.0
101.7
101.7
5.7
20.0
24.8
19.1
95.5
5.0
20.0
24.8
19.8
99.0
62.5
200.0
260.5
197.8
98.9
34.5
100.0
135.3
100.8
100.8
13
-------
Bias is the difference
between a true value
and a measured value,
due to the laboratory
equipment's "normal"
skew.
Average percent of recovery is:
Pi + - K
- 980.2
P =
10
P = 98.0%
To express accuracy For the data set,
take the standard deviation:
P)2
n -1
142.58
s = V15.84
s = 4.0
This means that statistically, if the per-
cent recovery is + or - two standard
deviations, it is 98.0% +2 (4.0), and
will fall between 90% and 106%
recovery 95% of the time. Accuracy is
generally reported as a percentage (%)
of bias.
. % Bias = P - 100
In this case:
% Bias = 98-100
= 2
4. A blank sample consists of a sam-
ple container that is filled with distilled
or deionized water rather than water
taken from the stream or lake being
sampled. A blank .can be used to test
the accuracy of field or laboratory
equipment, or to let you know whether
constituents are being carried over from
one sample to another through prob-
lems with equipment or procedure.. If
any constituent is recovered during
analysis of a blank sample, it is an indi-
cation that some procedure .is allowing
for contamination or error. Some
blanks are prepared before going into
the field, s6me are prepared in the field,
Deionized water is used in the laboratory and the
field to rinse sample containers, equipment, and
laboratory ware. The unit shown here transforms
regular tap water into¦ deionized water.
Equipment calibration logs should be kept in the tribal and contract laboratories.
Documenting the calibration trends for each piece of equipment will help you to iden-
tify any damaged or broken equipment. When evaluating results, calibration logs can
help you to determine the system bias of laboratory equipment.
-------
and some are prepared in the laborato-
ry. The preparation will depend on the
purpose for using a blank.
Sanp.es Ivvr. Kcirpir.eri:
5: A calibration check is used to
check equipment performance with
laboratory-prepared standards, or in
accordance with manufacturers guide-
lines, to ensure that equipment is oper-
ating properly. A reference sample of
known concentration is used to mea-
sure accuracy. Percent bias can be de-
termined using the following equation:
% Bias = 100 (average value - true value)
true value
Measurements for such parameters as
pH, alkalinity, hardness, dissolved oxy-
gen, and even temperature should also
include a component of quality control.
Such QC will allow you to evaluate the
accuracy and precision of both your
methods and your equipment.
Another measure of QA/QC is to eval-
uate the bias of the system. Bias is the
amount of difference between a mea-
sured value and a true value that is due
solely to analysis system sources.
;SXAM?L.is
Sys:eir 3:.as C,z cz
A sample of a known concentration
(50 mg/1) is analyzed four times to
determine the bias. The results of the
analyses are:
Xj = 48 mg/1
x2 =51 mg/1
x3 = 50 mg/1
x4 = 45 mg/1
First, the average concentration is deter
mined by the formula:
(x, + . . + xn)
X =
n
or, in this case:
(48 + 51 + 50 + 45)
x =
4
194
X = 48.5 mg/1
Next, the bias is determined by sub-
tracting the true concentration from
the average concentration.
B = x - T
or:
B = 48.5 mg/1 - 50 mg/1
B = -1.5 mg/1 ¦
This is the average amount of bias that
the process of system analysis may con-
tribute to each sample in this analysis
run, for the samples that this machine
is running, until it is calibrated again.
v Laboratories conduct their own
quality control checks — including
collocated samples (those that are
arranged or organized in a certain
manner), replicates, splits, and
spikes — to determine their own
quality. When contracting with a
laboratory, be sure to get a copy of
their QA/QC plan and include it as
an appendix to your QAPP. Also,
discuss how frequently the laborato-
ry will analyze quality control sam-
ples, and be certain that the results
from the laboratory's internal quali-
ty control samples are included in
the report on your data.
-------
Completeness is a mea-
sure of the number of
samples intended to be
taken compared to the
number of samples actu-
ally taken, expressed as
a percentage. If a study
defines 80% complete-
ness, then 80 out of 100
samples must be accept-
able as valid samples. A
sample may be deter-
mined to be invalid and
rejected from the study
because it was contami-
nated or destroyed
somewhere in the sam-
pling process.
After a determination of the precision,
accuracy, and completeness of the data
is made, you will be able to do one of
the following: Completely accept the
data that you collected, accept them
with restrictions, or reject them. If you
must reject a portion of the data, you
should go back and review the proce-
dures that were used both in field col-
lection and laboratory analysis to deter-
mine where errors were introduced into
the system, and how these errors can be
avoided in the future.
When conducting environmen-
tal monitoring, be sure to document
all of the procedures and changes in
procedures that you make, both in
the field and in the laboratory.
Along with the SOP manual and
QAPP, keep waterproof field and
laboratory notebooks available to
use at every location. Record infor-
mation such as current weather,
recent storm events, specific site
location descriptions, deviations
from SOPs, sample ID numbers,
and the type of QC samples taken.
Before going into the field, make
sure your equipment is working
properly, and take spare parts with
you in case you need to repair or
replace something that breaks while
you are out.
EVALUATING RESULTS AND
DETERMINING QUALITY
• Once you have completed sampling,
sent the samples to the laboratory for
analysis, and received the results, you
will need to determine the quality of
your data. Procedures for determining
this should be covered in the "Valid-
ation and Verification" section of your
QAPP. (See Element #14 in the
following section.) But, how do vou
actually evaluate the data?
Compare the results of your data with
the information from your field note-
book. From this, you may be able to
identify errors (if any), and the source
of these errors. Use the precision and
accuracy equations outlined above to
evaluate the quality of your data.
Additional methods which are more
technical and statistical in nature may
also be used. (Consult Standard
Methods.)
Some water quality, samples will be collected directly from a water body and analyzed
¦ for total concentration of a constituent. Others, such as the sample shown here, will.
be filtered in the field and analyzedfor dissolved concentrations.
-------
QUALITY ASSURANCE
PROJECT PLANS
-------
QUALITY ASSURANCE PROJECT PLANS
A QAPP is a document that pro-
vides specific information on how
QA/QC is applied to the collection of
data. It includes information on data
collection, planning, implementation,
and assessment. If used properly, a
QAPP provides the best tool for evalu-
ating the results of monitoring.
Because the information contained in a
QAPP varies greatly from tribe to tribe,
there is no standard form to be com-
pleted. Rather, the examples included
here should serve as a guideline for your
tribe's unique QAPP. For more detailed
information on developing a QAPP,
refer to the document EPA
Requirements for Quality Assurance
Project Plans for Environmental Data
Operations (see References, page 35).
A QAPP may consist of as many as 25
different elements:, For tribal QAPPs,
only 16 of these elements are required.
~ Each year, review your ap-
proved QAPP. If there have been
changes to field or analytical
methodologies, revise the plan to
reflect these changes. Your QAPP
must be current.
~ Hiring an independent con-
sulting firm to complete your tribal
QAPP is allowed, but EPA encour-
ages tribes to write it themselves.
Because the QAPP document will
be used by tribal personnel in sam-
pling, its contents must be very
familiar to those individuals. An
outside contractor may not be able
to provide the details specific to
your tribal program as well as tribal
staff can.
All 25 possible elements are listed be-
low; an arrow indicates those required
for tribal programs in EPA Region 8.
> Title and Approval Sheet
"*¦ Table of Contents
Distribution List
- Project/Task Organization
-- Problem Definition/Background
Project/Task Description
Data Quality Objectives for
Measurement Data
Project Narrative
Special Training Requirements/
Certification
Documentation and Records
> Sampling Process Design
Sampling Methods Requirements
Sample Handling and Custody
Requirements
Analytical Methods Requirements
^ Quality Control Requirements
Instrument Testing, Inspection, and
Maintenance
^ Instrument Calibration and
Frequency
Inspection Requirements for
Supplies
Data Acquisition Requirements
Data Quality Management
^ Assessments and Response Actions
Reports to Management
^ Data Review, Validation, and
Verification Requirements
^ Validation and Verification
Methods
^ Reconciliation with Data Quality
Objectives
This section describes, gives examples
of, and lists the requirements for the 16
elements that are necessary for tribal
water quality programs.
-------
^k. ^ ^k^ k^^W ^k.^ ^k.^ ^k^ ^k^k^^W ^k.^ k^^W ^k.^ ^k.^ k^^W ^k^j k^^W ^k^ ^k^ k^^W ^k^
F^y ^^F^y ^^F^y ^^F^y ^p^F^y ^piF^y ^piF^y ^^F^y ^piF^y ^p^F^y ^^F^y ^p^F^y ^^^F^y ^^iF^y
n TITLE AND APPROVAL SHEET
¦¦ This element must include (1) title of the QAPP, (2) name of the tribe and
tribal organization implementing the plan, and (3) names, titles, signatures, and
approval dates for the Tribal Project Manager, Tribal Quality Assurance Manager,
EPA Project Officer, and EPA Quality Assurance Manager.
mm TABLE OF CONTENTS
Lists the sections, figures, tables, references, and appendices. A complete doc-
ument control number should be included at the top right corner of every page.
Section
Revision Wo.
Date
ELEMENT #2-Table of Contents Page of
This method of document control is advantageous. If you need to make minor
changes, document control will eliminate the need to resubmit a revised QAPP;
such changes to the plan can be inserted on a page-by-page basis. Major revisions
to the plan, however, must be submitted to EPA for review and approval.
mm PROJECT/TASK ORGANIZATION
Eli Identifies the personnel and departments within the tribe that will use the
data and make decisions associated with them. Includes an organizational chart
showing the relationship of these individuals and departments. Do not use specific
names, but rather job titles. Include at least one paragraph which describes the
responsibilities of each position, how the QA/QC activities will be performed, and
who will be responsible for performing which QA/QC activities.
-------
ELEMENT #3-Project/Task Organization
Organizational Chart
Tribal Members
Tribal Council
Tribal Chair
Environmental Committee Chair
Environmental Program Director
Water Quality Specialist (QA Officer)
Water Quality Technician
The Water Quality Technician will be responsible
for the field collection and. tribal laboratory analysis
of samples, and reports to the Water Quality
Specialist. The Specialist will oversee the water
quality monitoring program, act as QA Officer, and
report to the Environmental Program Director.
The Program Director is
responsible for
reviewing the work
performed and mak-
ing recommendations
to the Environmental
Committee. The
Committee Chair reports -4
to the Tribal Chair and
Tribal Council, who then
inform Tribal Members.
The coordinator of the water quality program should make sure that every
member of the sampling crew has a good understanding of how to use each
piece of equipment.
-------
PROBLEM DEFINITION/BACKGROUND
Briefly states the specific problem to be addressed in the water quality moni-
toring project. Includes brief background information on the project. Includes a
description of the EPA program that is funding the monitoring program. The
QAPP may reference this information from the annual workplan.
ELEMENT #4-Problem Definition/Background
The Ute Mountain Ute Tribe is developing a
water quality program with funding from the EPA
Clean Water Act Section 106 program. The tribe is
establishing a baseline water quality monitoring
program for surface water chemistry. The pur-
pose of collecting data is to support the tribe's
long-range goals of developing tribal rules and
regulations and water quality standards, and
creating an overview of-the quality of reserva-
tion waters. See the Section 106 grant work-
for specifics on the problems to be
addressed in water -quality monitoring.
Macroinvertebrates (insects) can. ^ ..
the stream bottom and then transported to the
laboratory for accurate identification
PROJECT/TASK DESCRIPTION
Provides a description of the work that will be performed. This description
should be as thorough as possible. If appropriate, maps and other descriptive fig-
ures are helpful to describe the data collection location. Because this portion of the
QAPP is most likely to change from year to year, the most effective way to provide
this information is by referencing the tribal workplan. (Certain other parts of the
QAPP will remain constant because procedures such as sample preservation and
handling for certain constituents are unlikely to change.)
The description in the workplan should include an identification of all measure-
ments that will be performed during the project. All measurements should be clas-
sified as either critical (required for the project) or non-critical (informational).
Ml
H
-------
ikjP* ^#*5 Pm*^ 1%^ k^Wl fev^W Wk.^ fe, J0$ Rkh A ku^#!
r^jj ^pp^ *'^1$ %jf &r^ " yn jjajr^ ^^fes! b#^ fa
-------
In this section you will identify the scope of the project, including the time frame
for conducting the monitoring, and the constraints on the project. List why the
data are needed and for what they will be used. Being very specific, list what com-
pounds are being measured, the detection levels of the compounds, the reporting
units, the acceptable level of confidence for each (standard deviation and percent
bias), and the citation for the source(s) of this information (CFR or Standard
Methods). The easiest way to do this is to present the information in a table that
specifies the quality of the data needed to achieve the project objective.
ELEMENT #6-Data Quality Objectives for Measurement Data
Parameter
Detection Reporting Precision Accuracy
Level
Units
fstd. dev.^) (% bias")
Completeness
Method (%~)
pH 0.01-14.0 SU 0.13
conductivity 0-10,000 mhos/cm 8.2
iron 0.02 mg/1 16.5
zinc 0.005 mg/1 8.4
0.05
4.8
0.06
0.4
Std Met
Std Met
Std Met
Std Met
80
80
80
80
Precision, accuracy, and completeness should be expressed in terms of numbers.
Representativeness and comparability are not numerical but are descriptive evalua-
tions of items such as sampling locations and the sampling scheme.
Representativeness is the expression of the degree to which data accurately and pre-
cisely represent a characteristic of a population, parameter variation, process
condition, or environmental condition. The Ute Mountain Ute Tribe's water
quality monitoring program is set up to delineate the water quality of the reserva-'
tion by drainage.
Comparability is the confidence with which one data set can be compared to
another. Consistency of reporting units, standardized analytical methods, and stan-
dardized data formatting will ensure comparability.
Note: The levels selected for acceptability depend entirely on the objective(s) of your monitoring program.
For instance, the accuracy and precision used when monitoring for legally-defensible data for an Environmental
Impact Statement would need to be much higher than those used when monitoring for baseline data to classify
reservation waters.
-------
SAMPLING PROCESS
DESIGN (EXPERIM ENTAL
DESIGN)
Outlines, in general terms, the experi-
mental design of the project and the
anticipated project activities. Includes
sample design, sample frequencies,
matrices, and a schedule of milestones.
It is recommended that a map be
included that identifies sampling loca-
tions. This section describes how
sampling locations and frequency of
sampling were determined; it will vary
with each monitoring plan that you
design. The best way to address this
requirement is to reference this infor-
mation from the grant workplan.
Ikdfir'
IbT^ Iteir^ tor*
~ SAMPLING METHODS REQUIREMENTS
This is a specific list of the constituents for which you will be sampling and
the methods you will use to do the sampling. A good way to illustrate this is by
developing a table of the constituents and then listing details regarding the contain-
ers, sample preservation methods, maximum holding times, and procedures. This
information comes directly from the methods in 40 CFR 136 or Standard Methods,
or from the analytical laboratory. It is best to include in the table all possible
constituents found on the reservation, even if you do not anticipate monitoring for
all of them immediately.
Hand-held conductivity meter with probe attached. Equipment such as this can be
taken into the field to perform on-site analysis.
Parameter
Procedure *
Container
Preservative
Hold Time
pH
Meter
Poly/Glass
None
0
iron
Atom Abs .
Poly
UNO 3
6 months
* Analytical Method Requiremeri; from Element #10'
-------
SAMPLE HANDLING AND CUSTODY REQUIREMENTS
Describes the procedure that will be used for keeping track of and shipping or
delivering samples to an outside laboratory for analysis. Describes the chain of cus-
tody fot both the field and the laboratory.
ANALYTICAL METHODS REQUIREMENTS
This element is a list of the analytical methods that will be used. These can
easily be included in the table developed for Sampling Methods Requirements (see
Element #8, on previous page).
ELEMENT #9-
Sample Handling 8c Custody Requirements
Samples will be labeled in the field at the sam-
ple location. Minimum information on the identifi-
cation labels will include
sample location
date and time of collection
sample type
sampler's name
preservation method
Samples for certain constituents must be stored and
shipped at specific temperatures. Coolers should be
filled and lowered to the proper temperature, then
closed securely for shipment to the contact labor-
atory. Chain of custody forms and data sheets
—*"mi the samples, enclosed in a
Samples will be sealed and preserved
appropriately for shipment, and be accompa-
nied by a chain of custody (COC) form. Upon
receipt by the lab, the receiver will sign the
COC form and return it to the Water Quality
program staff. A copy of the final COC form
will accompany the data results in the report
from the laboratory.
water-
-------
QUALITY CONTROL REQUIREMENTS
Discusses the quality control procedures that will
be used for each analysis or measurement technique.
This refers to the five different types of QC samples that
can be used to determine error in sampling, listed in the
previous section "Quality Assurance and Quality Control
Working Together." These QC requirements should be
determined when creating the monitoring plan. It is best
to present this information in table form. Also, reference
the contract laboratory's QA/QC plan.
ELEMENT #11-
Quality Control Requirements
Sample Type
Field
Laboratory
QC Frequency
5%
10%
fgi INSTRUMENT CALIBRATION AND FREQUENCY
This element describes how all of the instruments (Field and tribal laboratory)
are calibrated, along with the type of standards that will be used. Specific proce-
dures for calibrating equipment will not be listed in this section; rather, these
procedures should be included in the tribal SOP document. A simple reference
to the tribal SOP will fulfill the requirements of this element.
If the tribe is using a contract laboratory, it is acceptable to reference the laboratory's
QA/QC plan as it pertains to the laboratory's instrument calibration, frequency,
and traceability..
ELEMENT # 12-Instrument Calibration & Frequency
All of the field instruments will be calibrated
according to the manufacturer's recommendations.
Any deviation from these recommendations due to
specific peculiarities with certain instruments will be
documented in the monitoring program of the grant
workplan. All standards will be traceable to a nationally-
recognized standard and documented in field logbooks.
All instrument calibration information can be found in
the tribal Standard Operating Procedures.
The calibrations, frequency, and traceability of
laboratory instrumentation are conducted in accordance
with Section #— of (laboratory's name) QA/QC Plan.
A copy of the reference is included as Appendix A.
-------
k^pl A Pki P%L^ k^ L^ ^ki
ASSESSMENTS AND RESPONSE ACTIONS
This element identifies the type
of assessment activities that are to be
conducted during the length of the pro-
ject. Assessments are formal evalua-
tions of organizations and individuals '
performing activities for the project.
This usually includes, but is not limited
to, the following:
Performance Evaluations: evaluations
of the individuals or organizations
(including water quality programs or
laboratories participating in the project)
involved in sampling, analysis, and/or
interpretation of data. Performance for
any or all of these entities can be stud-
ied and outlined in a written report or
performance review.
System Audits: audits of the equip-
ment, personnel, and procedures by
tribal or EPA personnel to determine
the adequacy of the analytical measure-
ment system, data collection, and
other system components. The audit
may consist of a field or laboratory
audit that evaluates operations against
the requirements of the approved
QAPP and procedures. System audit
reports note problems and allow
corrective actions to be taken to
protect the validity of collected data.
When contracting with a laboratory,
a tribe should include a requirement
that both the tribe and EPA may con-
duct system audits on the laboratory
at any time.
Cooperation in recording data in the field can help to ensure data quality. Many
errors are made in transcribing data from meter to datasheet. State each reading
aloud, record it, and then repeat it aloud to minimize transcription error.
Management System Reviews: allow
for reviews of the tribal management
system associated with project
oversight.
Data Quality Audits: provide an
opportunity for tribal and EPA repre-
sentatives to review data results and
compare, them with project quality
objectives.
Inspections: site inspections allow for
evaluation of conditions and proce-
dures in field and laboratory settings.
This element also discusses what
action (s) will be taken if sample results
indicate a problem in the data collec-
tion and/or data analysis aspect of the
project.
-------
Wk i k.jA rlfo a rfrb- A n^ a i^u>! k^l P^j
y^H f%i ^r" g^l ^jr^ |^r^
HH DATA REVIEW,
Ifltf VALIDATION, AND VERI-
FICATION REQUIREMENTS
This section states the criteria that will
be used to review the data that were
collected and to decide whether they
will be accepted, rejected, or qualified.
A statement of what will be done, and
by whom, is all that is needed. A
description of how this will be done
should be provided in the QAPP
"Validation and Verification Methods,"
Element #15.
ELEMENT #13-Assessments & Response Actions
In order to identify any problem(s), the tribe
will conduct a self-assessment of the sampling
and analysis of the data collected—at least
once a year during the project. If a major
problem exists, corrective action will be
immediately taken and documented. In those
situations where independent expertise is
needed to assess a certain aspect of the pro-
ject, the tribe will request technical assis-
tance from the U.S. EPA. The U.S. EPA
Project Officer or Regional Quality
Assurance Officer may conduct any type
of assessment at any time during the
length of the project. This includes con-
ducting assessments of any contractor or sub-con-
tractor performing sampling, analysis, or any
other activity directly related to the program.
iness
EPA provides annual water quality training opportunities.
-------
hd^ ^ferfl Kd$j^ ^fefai hd0^ im^^ ^^t.# hs^^ ffi$h. j> klirrflffl ^k* *z hiA1^ feggfl^ ^%&4
"%8 iMr^ ^|y Ibf^ ^F yjr^ fer^ |flr^ |jr^ ygF™ ^tsy MF ^
trr^^iSBt;'^"
of the water. I»rn
ELEMENT #14-
Data Review, Validation, & Verification Requirements
It is the responsibility of the Water Quality
Specialist to evaluate raw data generated by the tribal
or contract laboratory for appropriate numeric reduc-
tion, data quality, and accuracy. All data will be
reviewed and reported in units specified at the detec-
tion level of the analytical methods used.
To reduce data point loss, data that are reported
as "less than" detection level will be incorporated at a
value of 1/2 the detection level.
Once data are generated, they will be compiled in
a database file. During this data transfer, the infor-
mation will be reviewed and verified
in accordance with the data quality
objectives. Data generated in the
laboratory will be validated by per-
formance checks such as duplicate
sample analysis, linear regression
curve fitting for standards, spike
recovery, inter-laboratory sample
exchange, and unknown sample
analysis reports.
Data units will be system-
atically reported in milligrams
per liter (mg/1), unless other-
wise noted, for all parameters
except pH and conductivity. Scientific notation will be
used, and significant figures will correlate with detec-
tion levels. Both graphing and narrative conclusions
will be used to describe the water quality results and
trend variations.
-------
VALIDATION AND VERIFICATION METHODS
This section describes rhe process used for validating and verifying data. It
should describe how errors, if detected, will be corrected, and how the analysis of
quality control data, detection limits, instrument calibrations, and special condi-
tions will be performed.
ELEMENT #15-Validation & Verification Methods
The Water Quality Specialist will be responsible for
receiving the data sheets and field/laboratory note-
books, checking for errors in identification numbers,
decimal placement, dates, times, units reported, and
comments. Personnel collecting data will be contacted
immediately if there are data gaps or if scheduled
sampling times, were missed. The Water Quality Spe-
cialist will make every attempt to screen inaccurate
data before they are entered in the database by ana-
lyzing all quality control data, including chain of cus-
tody, spikes, replicates, sample holding times, blanks,
equipment .calibrations, and sampling conditions.
Quality control sample results will be evaluated
individually by performing appropriate mathematical
. analysis for precision or accuracy for each sample.
Only the Water Quality Specialist and Water Quality
Technician will be allowed to access project data and
. submit reports to data users. All data will be accom-
panied by QA/QC information.
Data will be printed out in lists and graphs, with
lists checked against original data sheets. . The Water
Quality Technician will be responsible for correcting
data entry errors. A second examination will verify
that corrections are completed. Inaccurate data will be
discarded, and data anomalies will be 'evaluated on a
case-by-case basis.
-------
^^.a ^ Plii^ ifc.^W P%fc. a ^JtA P%k jt yJfi> rfcfr. 4 wl.a ^J0i Rfe.^ ^...^Fi Wk^
^%0 mt^ ^%gj y& : |lr< w*^ %# Hr^ feir^* ^N!#^ fair ^y lw^ hrfr \dr^
RECONCILIATION WITH DATA QUAIITY
OBJECTIVES (DQOs)
This activity is conducted once the data results are compiled to determine whether
the data collected for the project really meet the objectives of the project. If the data
quality objectives have not been met, the problem can be addressed either by cor-
recting errors in the system, or by adjusting the objectives. To meet this require-
ment, simply describe the process that the program will use to evaluate whether the
DQOs have been met.
ELEMENT #16-
Reconciliation with Data Quality Objectives
(DQOs)
Established DQOs will be compared with the
results of all QA/QC samples. Data that do not
meet DQOs will be discarded from the analysis
and not re-sampled. Completeness, accuracy,
precision, representativeness, and comparabili-
ty will be evaluated by the Water Quality
Specialist.
Make a checklist of all the equipment you will need to take into the field,
yon pack your vehicle. Always remember spare equipment parts.
The 16 elements described here are
those that must be covered in a tribal
Check it as
QAPP. Any of the additional nine
elements may also be covered, as a tribe
wishes. EPA staff is available to assist
tribes throughout the development of
the QAPP. Project specific changes
should be made annually to the moni-
toring program described in your grant
workplan. Changes in your QAPP
must be sent to EPA for approval.
-------
-------
OOCXSOOOOOOOOOOOOOOOOOOOOO
HELPFUL RESOURCES
GLOSSARY
Abatement: The reduction of water pollution sources.
Accuracy: The closeness of a measured value to the true value.
Aliquot: A fraction of a sample prepared for the analysis of particular constituents,
sent in a separate container to the analytical laboratory.
Analytical Laboratory: A laboratory under contract with a tribe or state to analyze
water samples collected from the field.
Analytical Laboratory Duplicates: Aliquots from a sample that is split in the ana-
lytical laboratory. The aliquots are analyzed in the same batch:
Anion: A negatively-charged ion.
Assessment: An evaluation of sources of water pollution, describing the nature,
extent, and effect of pollution.
ASTM Type I Reagent-Grade Water: Deionized water which meets American
Society for Testing and Materials specifications for Type I reagent-grade water, that
has a measured conductance of less than ] S/cm at 25°'C.
Bias: The systematic difference between a measured value and a true value.
Blank Sample. A sample of ASTM Type I reagent-grade water analyzed as a
quality control sampie.-
Calibration Blank: A solution used in standardizing or checking the calibration of
analytical instruments; also used to determine instrument detection limits.
Cation: A positively-charged ion.
Comparability: A measure of data that expresses the confidence with which one
data set can be compared to another.
Completeness: A measure of the number of samples intended to be taken com-
pared to the number of samples actually taken, expressed as a percentage.
Conductance: A measure of the electrical conductance or total ionic strength of a
water sample expressed as S/cm at 25° C.
o©oo>
-------
ooooooo«0o0oooooooooeoo0o
Confidence Interval (95%): A set of possible values within which the true value
will lie within a probable chance of 95%.
Constituent: A component which is part of a whole. For example, zinc may be,
one constituent of a water sample that has many types of heavy metals in it.
Database: Computerized results of a survey, which include the raw, veriHed, vali-
dated and final data sets as well as back-up and historical data sets.
Data Quality Objectives: Qualitative and quantitative specifications used to
design a study that will limit uncertainty to an acceptable level:
Detection Limit: The lowest concentration or amount of the component of inter-
est that can be determined by a single measurement at a stated confidence level.
Field Audit Samples: A standardized water sample submitted to a field laboratory
to check overall performance in sample analysis by field and analytical laboratories.
Field Replicate Sample: An additional sample collected at the same location
immediately after the first sample. It is possible to have more than two replicate
samples.
Holding Time: The time during which a sample is collected, preserved, and
analyzed.
Matrix: The physical and chemical composition of a sample being analyzed.
Parameter: A quantity whose value varies, used interchangeably with "constituent."
Percent Recovery: The amount of constituent recovered from a known added
concentration.
PH: The negative logarithm of the hydrogen-ion activity. The pH scale runs from
1 (most acidic) to 14 (most alkaline or basic); the difference of I pH unit indicates a
10-fold change in hydrogen-ion activity.
Precision: A measurement of the closeness of data values to one another.
Quality Assurance: A set of operating principles and procedures used to effectively
collect environmental data and determine how believable or reliable they are.
Quality Control: The set of steps taken during sample collection and analysis to
ensure that the data quality meets the minimum standards established by a Quality
Assurance Project Plan.
~oooo
-------
Reagent: A substance added to water to determine the concentration of: a specific
analyte.
Remediation: The act of correcting a problem; returning a situation to its proper
condition.
Representativeness: A measure of data quality; the degree to which sample data .
accurately and precisely reflect the characteristics of a population.
Sample: An environmental substance (e.g. water, air, soil) that is measured for
specific parameters.
Sample ID: The numeric identifier given to each sample and quality control
sample.
Spike: A known concentration of an analyte introduced into a sample or aliquot.
Standard Deviation: The square root of the variance of a given statistic, used in
determining the error of sampling.
Systematic Error: A consistent deviation from an expected or known value in the
results of sampling and/or analytical processes. Such an error commonly results in
biased estimations.
Turbidity: A measure of light scattering by suspended particles in an unfiltered
water sample.
Validation: Process by which data are evaluated for quality with reference to
the intended data uses; includes evaluation of the potential for error after data
verification.
Verification: Process of ascertaining the quality of the data in accordance with the
minimum standards established by the Quality Assurance Project Plan.
*xxx>
-------
LIST OF ACRONYMS
CFR
Code of Federal Register
COC
Chain of Custody
CWA
Clean Water Act
DQO
Data Quality Objective
EPA
Environmental Protection Agency
QA
Quality Assurance
QAPP
Quality Assurance Project Plan
QA/QC
Quality Assurance/Quality Control
QC
Quality Control
SOP
Standard Operating Procedure
ooooo
-------
ooooooooooooooooooooooooo
REFERENCES
For information about how to obtain the references listed below, or if you have
questions about further references, contact: Tribal Water Quality Coordinator, EPA
Region 8, 999 18th Street, Suite 500, Denver, CO 80202; (303) 293-1570 or
(800) 227-8917.
EPA Requirements for Quality Assurance Project Plans (QAPP) for Environmental
¦ Data Operations. EPA/QA/R-5. U.S. Environmental Protection Agency, Office
ofWater, Washington, DC.
Handbook of Methods for Acid Deposition Studies. Laboratory Analysis for
Surface Water Chemistry. 1987. EPA 600/4-87/026. U.S. Environmental
Protection Agency, Acid Deposition and Atmospheric Research Division, Office
of Acid Deposition, Environmental Monitoring and Quality Assurance, Office
of Research and Development, Washington, DC.
Handbook of Methods for Acid Deposition Studies. Field Operations for Surface
Water Chemistry. 1989. EPA 600/4-89/020. U.S. Environmental Protection
Agency, Acid Deposition and Atmospheric Research Division, Office of Acid
Deposition, Environmental Monitoring and Quality Assurance, Office of
Research and Development, Washington, DC.
Monitoring Guidelines to Evaluate Ejfects of Forestry Activities on Streams in the
Pacific Northwest and Alaska. 1991. EPA 910/9-91-001. U.S. Environmental
Protection Agency, Region 10, NPS Section, Seattle, WA.
Rapid Bioassessment Protocols for Use in Streams and Rivers. Benthic Macro-
invertebrates and Fish. 1989. EPA-444/4-85-001. U.S. Environmental
Protection Agency, Office ofWater, Washington, DC.
Standard Methods for the Examination ofWater and Wastewater, 17th Edition.
1989. American Public Health Association, American Water Works Association
and Water Pollution Control Federation, Washington, DC.
Standard Operating Procedures for Field Samples. 1988. U.S. Environmental
Protection Agency, Region 8, Environmental Services Division, Denver, CO.
Water Management Solutions - a Guide for Indian Tribes. 1993. U.S. Environmental
Protection Agency, Region 8, Denver, CO.
oooo
-------
ooooooooooooooooooooooooo
~OOOO
Ibis guide has been reviewed by EPA and approved for publication. Mention
of trade names or commercial products does not constitute endorsement or rec-
ommendation for use.
------- |