3£
f-ooz
INTEGRATING QUALITY ASSURANCE
INTO TRIBAL WATER PROGRAMS
rfc
^x^T"^^
^ %,,
Sih
r- ijsc^e^ig^
A RESOURCE GUIDE FOR RELIABLE WATER QUALITY DATA COLLECTION
-------
3
a
a
a
a
a
a
a
a
a
a
a
a
INTEGRATING QUALITY ASSURANCE
INTO TRIBAL WATER PROGRAMS
A RESOURCE GUIDE FOR RELIABLE
WATER QUALITY DATA COLLECTION
a
a
a
a
B
a
B
B
B
Writing & technical review: Chris Lehnertz, EPA Region 8
Additional technical review & editing:
Special review & comments:
Editing, design, photography & production:
Cover art work:
Phil Johnson, EPA Region 8
Rick Edmonds, EPA Region 8
David Rathke, EPA Region 8
Ute Mountain Ute Tribe
Fort Peck Tribes
Southern Ute Tribe
ECOS Communications, Inc.
Boulder, Colorado
Norman Lansing
Southern Ute Tribe
B
-------
Opening Prayer for the Conference:
"Quality Assurance for Water Quality in "Indian Country"
Southern Ute Reservation, September 1992
Heavenly Father, Grandfather, we thank you for this time of day, Grand-
father, that tue've gathered herein a good ivay, Grandfather, the participants
for this conference on water quality. Grandfather,
We thank you, Grandfather, for all that you've created. We thank you for the
water of life, Grandfather, that these professionals are'here, Grandfather, that
they .can take this knowledge they've gained about their individual reserva-
tions and their homes,. Grandfather, that we can protect all of our water and
our laater quality, Grandfather.
We ask in a humble way, Grandfather, for good prayers, Grandfather, for the
unborn generations, and for the little children, Grandfather, For the teenag-
er generation, Grandfather, we ask your blessings, for the adult generation,
Grandfather, for all those from the doorway in to the doorway out, that you
can take care of their needs. We thank you, Grandfather, for our elders and
our ancestors, Grandfather. Without them we would not be able to do the
things that have brought us to inhere we are right now, Grandfather.
All things, spoken and unspoken, we ask in a humble way that you take care
of these things, Heavenly Father, and we put these into your hands, Grand-
father. Again, Grandfather, we thank yon for the water of life that we can
take care_ of it in a good way for all the generations that will be coming in the
future. Amen.
-Nathan Winder
Southern Ute Tribe
-------
I
TABLE OF CONTENTS
INTRO
1
CASE STUDY
B
QA & QC
II
B
QAPP
RESOURCES
INTRODUCTION.
Background: the Origin and Purpose of this Guide , ; 1
How to Use this Guide ;....'... , .......;2
CASE STUDY: -
TRIBAL WATER QUALITY PROGRAM DEVELOPMENT
Program Development: Objective and Goals ... 3
Section 106 Grant Workplan ...4
Workplan Implementation ...5
Monitoring s ",.................... 7
Results ;......-..". .-.." ....8
'QUALITY ASSURANCE AND QUALITY-CONTROL
WORKING TOGETHER
Quality Assurance and Quality Control , 9
Precision and Accuracy Sampling and Calculations : ;10
Evaluating Results and Determining Quality , 16
QUALITY ASSURANCE PROJECT PLANS .
The Sixteen Elements for your Tribal Plan ;.. 17
HELPFUL RESOURCES " ~" ; . " ^~~'
Glossary > ,... 31
List of Acronyms '..... 34.
References , ^....................35
-------
B
B
B
B
B
B
B
B
B
B
I
I
I
I
I
B
I
INTRODUCTION
BACKGROUND
in September 1992, the Southern
Ute Indian Tribe and the United States
Environmental Protection Agency
(EPA) Region 8 co-sponsored the
workshop "Quality Assurance for Water
Quality in Indian Country." The
document before you is a result of
that workshop.. It presents workshop
information along with suggested
methods for incorporating quality
assurancea process for evaluating
data qualityInto tribal water quality
programs, based on EPA requirements.
Reauthorization of the Clean Water Act
(CWA) in 1987 created opportunities
for Indian tribes to receive financial
assistance from EPA. The Agency now
provides funding to Indian tribes for
the development of many types of
water quality projects, including: water
quality program development, lake
water quality assessment and remedia- .
tion, point.and nonpoint source pollu-
tion control, and wetlands protection.
When environmental data are collected
by any entity funded through EPA, spe-
cific technical requirements must be
met in order to ensure that data are of
good quality. The system of such
V By law, you cannot conduct water
monitoring under an EPA-funded pro-
gram until you have an approved
Quality Assurance Project Plan.
V If a tribe is sampling under a
QA/QC program with the pre-1993
. format, sampling may continue, but
the QAPP must be reformatted by
October 1994.
quality assurance is.commonly known
as QA/QC (quality assurance/quality
control). QA/QC should be integrated
into a tribal water quality monitoring
program at the outset of program
development.
The QA/QC workshop is one example of technical training available from EPA.
The purpose of this guide is" to- provide
you with the information that you will
need to develop a tribal QA/QC pro-
gram. It also provides instructions for
writing the required Quality Assurance
Project Plan (QAPP) that must be
approved by EPA before monitoring
may begin under a CWA grant.
By federal regulation, any entity
funded by EPA to collect enviroment-
al data must develop a QAPP which
will document how their QA/QC pro-
gram meets EPA criteria. This is
required so that EPA and its grantees
can ensure that the data collected are
scientifically valid, of known and suit-
able quality, collected with the best
cost-effective technology available, and
legally defensible if necessary.
-------
Many tribal water quality programs
have already developed EPA-approved
QA/QC programs. Because the QAPP
format and contents are new and sam-
pling technology has recently changed,
previously-approved QA/QC programs
may not reflect current requirements.
Sample portions of the new QAPP for-
mat are provided in the section of this
document entitled "Quality Assurance
Project Plans,"
Field sessions are piirt of man} F.PA training co
QA/QC is used when making any
environmental measurement, includ-
ing those for water, air, or soil. But
how does QA/QC fit into tribal water
quality program development? From
evaluating historical data to projecting
monitoring costs for a grant proposal,
QA/QC considerations must be
included. The case study in the next
section of this guide illustrates the
integration of QA/QC into the devel-
opment of a tribal program.
HOW TO USE THIS GUIDE
This guide is divided into four sec-
tions, each of which can be read and
used as a unit, independent of the oth-
ers. Reading only one section, however,
might leave you with an incomplete
picture of the process for integrating
QA/QC into your tribal water
quality program. We suggest that you
read through the entire guide in the
order presented here. Afterward, you
may want to go back to a certain sec-
tion for further study or clarification.
The "Case Study" section provides a
step-by-step overview of the entire
process for establishing a water moni-
toring program, beginning with the
tribe's commitment and ending with an
evaluation of the data collected. The
details for developing your own
QA/QC program can be found in the
two sections .following the case study.
Throughout this guide, informational
tips are presented in shaded boxes,
while important definitions can be
found in bold type in the page's outer
margin. (The Glossary, in the "Helpful
Resources" section, is another good
place to check for definitions.) The
"Quality Assurance and Quality
Control Working Together" section
"contains formulas and mathematical
computations to better present several
technical concepts, and the "Quality
Assurance Project Plans" section pro-
vides numerous examples shown on
ruled or graph paper for you to follow.
Sources for additional information are
listed under References in the final sec-
tion. If you are unable to find the
answers to your questions in this guide,
contact EPA for assistance.
-------
' t> >- *"',. «' -1
»» <;*, *-*.&-? > <
- ""
CASE STUDY:
TRIBAL WATER QUALITY
PROGRAM DEVELOPMENT
l^llK^SS^ \':-- ' ':'*"'."»'
m&m^^-
-','. - '
M^jrf^t|S>r"V. "! '' "
ysrjfflgn^i'SSKrV i" ,>';- ~ 1" . . .
C^+rsSP"*?**. --- .-- - .
?"."*J| i-C*~-ti - * *r 'r ^.
sfrS,, -*4-*-W?-," » ' '' " "" ' "
Is «:?V>eft; ,n -:..," . ^ ^ ^
--i"» 'y.-^-s-^ "r *-r'.
f^Lf^-'^f^ V' '
sl-S»--P- --
^ "* ,si^^if?- ^ , '
'&*^"^^
""SfSftr"'"*
."-*
x?;^;c.U"! -.,'-.-' : "
V^'^v/'CV^i*'./."'«v ** .-5"" " -. .
IS^t^fetr:;:.':
^KChti*** ~s*j-- -ii*v W ~ J.S*. -, -«J&A.»*-». t« ~~,~ i ^ l W-* .
-------
1
I
I
I
I
I
I
I
I
I
I
I
I
1
I
I
I
I
1
I
I
I
I
I
I
I
I
I
I
I
I
CASE STUDY:
TRIBAL WATER QUALITY PROGRAM DEVELOPMENT
UTE MOUNTAIN UTE TRIBE
The following is an account of the
steps that could be taken by a tribe to
develop a water quality protection
program that includes adequate
QA/QC provisions. Beginning with a
stated commitment by the tribe1 to
protect its reservation waters, the Ute
Mountain Ute-Tribe developed the
necessary systems and :EPA documents
to receive a GWA grant and begin sur-
face-water monitoring. Although the
timeline and progression of events will
vary from, tribe to-tribe, this case study
may help you to plan for the success--
ful integration of QA/QC into your
program, -
In'1991, the Ute Mountain Ute Tribal
Council decided that one of the tribe's
priorities was to protect water quality
on the Ute Mountain Ute Reserva- ; .
tion. The tribe investigated a variety
of possibilities for developing a water
quality protection program. After
applying and being approved for an
EPA Clean Water Act Section 106
grant, the tribe initiated program
development. .
PROGRAM DEVELOPMENT
The first task for the tribe was to
hire a Water Quality Specialist with a
background in biology and chemistry.
The role of the Water Quality
Specialist was to provide technical
assistance to the tribe by developing
and managing a tribal water quality
program. The Water Quality Specialist
worked closely with the Tribal Council
to develop, a'program objective and
long-range goals. Examples of these are;
Objective; - -
The Ute'Mountain Ute Tribe will
protect, maintain, and enhance the
quality of tribal waters:'
Long-Range, Goals:
' 1. To develop a complete set of base-
line data on the quality of tribal surface
water, groundw'ater, and wetlands. .
Monitoring will include chemical, phys-
ical,'and biological parameters as well
as habitat assessments, and will incorpo-
rate appropriate quality assurance and
quality control measures. The resulting
database will; (a) provide an overview of
the current quality of reservation waters,
(b) assist in classifying waters for the
development of water quality standards,
(c) help to inventory" potential point
and rionpoint sources of pollution, and
(d) identity areas of special concern that
may need immediate attention or fur-
ther study. Data will be used for long-
term monitoring of abatement projects,
tracking water quality standards com-
pliance, providing information for
assessing environmental impacts from
development on the reservation, and
prioritizing program activities. .
Quality Assurance (QA)
is a process which
ensures that a monitor-
ing program is ade-
quately planned and
conducted to provide
data of the highest pos-
sible quality. QA is a.
set of opera-ting princi-
ples and procedures
used for data collection,
sample handling, analy-
sis, and data review
that can be used in the
field and in the labora-
tory to provide data
that are of knoum qual-
ity. Simply put: QA is a
way to effectively collect
environmental data and
determine how believ-
able or reliable they are.
Quality Control (QC)
is the set of steps taken
during sample collection
and analysis to ensure
that data quality meets
the minimum standards
established by a Quality
Assurance Project Plan.
Note: An EPA Section 106 grant can be a cornerstone for developing a tiibd water quality program, It can
provide funding for a broad range of water pollution control projects, including wetlands protection', nonpoint
source pollution- control, water quality standards development, permitting"and code development, and ground-
water, surface water, and lake warer quality sampling. Waste'waier treatment facility construction and analysis
of drinking water are not-eligible for funding under rhe 106 program,
-------
Water quality
monitoring is the collec-
tion and analysis of
water, organisms living
in or adjacent to the
water, or physical ele-
ments associated with
water that may serve to
characterize the quality
of the water. It may
also include data collec-
tion on the condition of
the physical and biolog-
ical habitat in and
around a body of water.
Typical monitoring data
can be separated into
chemical, physical, bio-
logical, and habitat
parameters.
2, To develop a water quality pro-
gram that will address point and non-
point sources of pollution. This will be
accomplished through the development
of rules and regulations, management
and assessment plans, best management
practices, and water quality standards.
3. To enhance the technical and
administrative expertise of water quality
program staff through training and
instruction. This will allow the tribe to
work as an equal partner with other
agencies regarding water quality issues
both on and off the reservation,
After the long-range goals were
approved by-the Tribal Council,-short-
range activities were translated into a
final Section 106 grant workplan.
SECTION 106
GRANT WORKPLAN
The workplan was written to
encompass activities to be completed
during the one-year grant project
Seining
-------
The Southern Ute Tribe developed a tribal water quality laboratory for perfonning
routine analyses. A review of laboratory SOPs was part of the workshop that served
as the background for this guide.
previous ten years, bur rhere was no
indication rhar any QA/QC had been
used. Because there was no documen-
ration on the use of QA/QC, the quali-
ty of rhis dara could nor be derermined.
The Specialisr decided rhar rhe infor-
mation from rhe orher rhree drainages
was of good enough quality ro be
enrered inro rhe rribal darabase as base-
line dara. The Mancos.dara, however,
were of unknown quality, and could
nor be used in rhe darabase. Thus, rhe
only gap in baseline dara was for rhe
Mancos drainage.
4. In order ro complere rhe baseline
dara collection, rhe Specialisr and rhe
Technician would need ro moniror the
Mancos River and rhe seven srreams
rhar drained inro ir. While rhe
Specialisr outlined a momroring pro-
gram for rhe Mancos, rhe Technician
began ro work on developing rhe
required QAPP and SOP documenrs.
5. Because rhere is so much overlap
between the SOPs and QAPP, they were
developed concurrenrly. The Tech-
nician wrore rhe QAPP, including rhe
rribe's expecrarions for rhe quality of
dara, how derailed rhe analysis of rhe
dara would be, and how rhe quality of
rhe resulrs would be derermined. The
QAPP included information on how
many and what types of quality control
samples would be used. This would
derermine rhe quality of field collection
procedures as well as field and laborato-
ry analyses. Ir also included specific
informarion abour how long each sam-
ple could be kepr before analysis, infor-
marion on how ro preserve samples, rhe
type of conrainer ro be used, specifics
on how rhe samples should be shipped,
and rhe analytical merhods ro be used.
T The QAPP was written to
include the necessary information
for collecting and analyzing every
type of physical and chemical para-
meter that the tribe might possibly
measure. Although the Technician
and Specialist knew they wou!3 not
monitor for every parameter in
every sample, they included all pos-
sible parameters in the QAPP so
that they would only have to write
this part of the document once, sub-
ject to change only with changes in
applicable technology.
T Keep the SOP and QAPP doc-
uments together for quick reference
in the field and laboratory. Even
when you have collected the same
type of sample every day for a
month, refer back to these docu-
ments periodically to check your
sampling procedures.
-------
*V " ',' " ?»'
V Take rime to look around you
at those things chat might influence
the rivers that flow into reservation
waters. Ask questions of people
who may have valuable information
(e.g., industry operators, geologists,
weather specialists, farmers).
T Consider the' season of the year
when planning monitoring, as this
will affect flow, dilution, and other
aspects of surface waters. Storms
and droughts can also affect your
monitoring results. Make sure to
indicate current season and weather
in your field notebook.
V Check your data periodically,
not just at the end of the year. Do
they appear reasonable? Are there
any big surprises? Doing this can
help you catch problems early in the
sampling season.
To put together the SOPs, die
Technician collected all the operating
manuals for the field and laboratory
sampling.equipment that the tribe had
purchased. The reference book
Standard Methods for the Examination
of Water, and Waste-water (see Ref-
erences, page 35) was reviewed so that
the Technician could list the exact pro-
cedures that would be used for each
rype of sample collection. Once the
Technician compiled these'items, they
were put together in one notebook
Because one copy was receded in the
laboratory and another was' needed in
the field, the Technician made two
copies (and laminated each page),
keeping the original ia the office. This
way, anyone collecting samples could
refer to the SOP notebook for com-
plete instructions.
MONITORING
Water quality monitoring is con-
ducted for a wide variety of reasons.
For example, monitoring programs may
be established to collect baseline'data or
to evaluate the effects of road building
and maintenance, forest harvest, appli-
cation or herbicides and pesticides,
recreation, grazing, or mining. Each of
these programs would necessitate a
"specific set of monitoring tests. Clearly
stating and understanding your objec-
tive for monitoring will help you to
determine how often and where sam-
ples-should be collected. -
The Specialist outlined a monitoring
plan for the Mancos drainage, aimed at
providing baseline data, and sent it to
EPA as part .of die tribal workplan.
The QAPP was also 'sent to EPA for
approval, with the SOPs attached for
review. Meanwhile, the Specialist and
Technician spent time in the field and
laboratory, becoming familiar with
their equipment and Standard
Operating Procedures. The first sam-
ples were collected just for practice and
were not included in the official water
quality database.
f Include a statement in your field notebook about land use
near and upstream from your sampling sites. Such information
might help to explain your results, especially in explaining why
certain values turned out higher or lower than expected. .
*f Are you looking for training in monitoring techniques?
Local colleges and, universities may offer courses in monitoring or
environmental science. Additional resources for training include
other tribes, state and'federal agencies, and a collection of
extensive literature on monitoring plans and procedures.
V
-------
-T As soon as your QAPP is approved and your SOPs are final-
ized, you and your sampling staffshould read and discuss these
documents to become completely familiar with them.
Communication between people collecting data is essential; if
possible, have them sample together in the field. In addition,
sampling personnel should document their procedures (and
deviations from procedures) to help identify situations where
problems may arise because consistency is not ensured. This way,
if program personnel leave the program, new staff will have accu-
rate documentation on how samples have been collected.
quality of the data was good. (The
procedures for conducting this type of
reconciliation are detailed on page 16.)
Data not meeting the QA/QC guide-.
lines were discarded. These steps en-
sured that the data used were likely to
represent the actual conditions of the
water. At this point, xhe water quality
staff could identify locations of poor
water quality and recommend
further action.
Data Quality
Objectives (DQOs) are
the numerical goals that
are set for a monitoring
project. Based on the
objective of the sam-
pling, numbers are
defined for the range of
data quality that will
be acceptable, DQOs
reflect the accuracy, pre-
cision, and completeness
for each parameter that
is measured.
Once the monitoring plan and the
QAPP were approved by EPA, the
Specialist and Technician were able to
begin monitoring.. They collected the
samples that had been identified in the "
monitoring plan, closely following the
SOPs and QAPP. The Specialist was
identified as the Quality Assurance
Officer, and ensured that the correct
methods for sample collection, preser-
vation, storage, and shipment were
used. Some of the tests, such as those
for temperature, conductivity, hard-
ness, alkalinity, dissolved oxygen, and
pH, were conducted in the field or
tribal laboratory. Samples to test for
constituents such as iron, mercury, and
atrazine were collected and then sent to
a contract laboratory for analysis. For
both, types of data, QA/QC procedures
were performed regularly.
RESULTS
Once the data from the monitoring
were compiled, the Specialist went
back to the QAPP to review the
requirements for acceptable data quali-
ty. By reconciling the QA/QC sample
results with the data quality objectives
outlined in the QAPP, the Specialist
was able to determine that the overall
This case study is just one example of
how QA/QC can be successfully in-
corporated into a tribal water quality
program. It illustrates the importance
of developing the QAPP and SOP doc-
uments early in the process. By becom-
ing familiar with the procedures in
these documents, and using them reg-
ularly in the field and laboratory, the
tribe was able to determine the quality
of the data collected.
T When choosing a laboratory.
for analyzing your water quality
samples, it is best to conduct inter-
views. Provide the laboratory with a
list of questions regarding the analy-
ses you anticipate having done, and
talk directly with the laboratory
manager. When you develop the
contract, include a specific period of ,
time that your contract will cover,
the scope of work (including materi-
als the laboratory will furnish),
terms for payment/a provision giv-
ing both the tribe and EPA the right
to audit the laboratory, and other
terms and conditions as required or
recommended by the tribal pro-
gram. Make sure to agree on turn-
around time in advance.
-------
AND QUALITY CONTROL
WORKING TOGETHER
fe.
-------
I
QUALITY ASSURANCE AND QUALITY CONTROL
WORKING TOGETHER
I
i
m
i
H
m
While quality assurance, quality
control, and SOPs are separate compo-
nents of a monitoring program, they
work together to provide data of
known quality. Together, they mini-
mize the error that is introduced in
sampling, and allow the tracking of
errors that may occur. From failing to
add the necessary preservative to a
metals sample to inadvertently using
contaminated glassware, the possibili-
ties for system or human error in mon-
itoring are extensive. Regular control
sampling is an integral element in a
system for water quality monitoring.
T QC samples should be labeled
widi die same type of sample identifi-
cation number as other samples, and
submitted to die laboratory widiout
indication diat diey are QC samples.
However, diese. identification num-
bers should be rioted in your field
sample notebook, and tracked within
your system as QC samples.
T In order to determine the qual-
ity of die laboratory analyses, at
least, 10% of the samples you sub-
mit to the laboratory should be QC
"samples. At least 5% of your sam--
pies analyzed in the .field, should be
QC samples. For a new monitoririg
program, however, it would be
appropriate to have as many as 50%
of all samples as QC samples, until
the system is finely tuned.
Filtered samples can be easily contaminated during transfer from filtration reservoir
to sample bottle. Getting assistance from other members of the field crew can.help
you to minimize contamination. . . .'
QUALITY ASSURANCE AND
QUALITY CONTROL
QA/QC includes planning, assess-
ment, reporting, and making necessary
changes to the water monitoring
program to ensure quality data. The
system defined in your QAPP will out-
line what is acceptable for your moni-
toring objectives. If the results of your
quality control samples fall outside the
acceptable levels, these samples are
rejected. In addition, corrections may
be needed in your SOPs to ensure that
data are collected properly. Evaluation
of quality control samples allows you to
determine the quality of the overall data.
Quality control (QC) samples are col-
lected to determine precision and accu-
racy, and can be collected or prepared
-------
Precision is a measure-
ment of the closeness of
data values to each
other. This is deter-
mined by comparing the
results of several mea-
surements taken at one
location. Statistically,
precision is expressed as
a range of concentration
units, using relative
percent difference or
standard deviation.
in the field or laboratory. Field QC
samples are used to evaluate data
collection methods and field or
laboratory procedures ah-d analyses.
Laboratory QC samples are used solely
to determine the quality of laboratory
procedures and analyses.
PRECISION AND
ACCURACY SAMPLING
AND CALCULATIONS
'There are five basic types of QC
samples, numbered 1-5 on the pages
that follow. In determining precision
and accuracy, the use of basic statistics
is required. Each type of QC sample
listed below includes an example of
how the QC results would be analyzed
to determine precision or accuracy.
Samples to Determine Precision
Precision gives information about'
how consistent your methods are. It
does not mean that the sample results
actually reflect the true value of the
parameter measured, but rather that
your sampling is giving similar results
under .similar conditions. . ... . -.
1 A split sample is the result of
taking one sample collected-in accor-
dance with SOPs.and splitting the
sample into two bottles. The measure-
ment of agreement between the samples
will represent the precision. A. sample
may be split in either the field or in
the laboratory.
EXAMPLE: . - . ' .
Precision Calculation for a Split
Sample
- If a sample is split into two sub-.
samples, or if a replicate sampling re- ;
suits in only two samples, the following
calculation may be used to determine
precision:
Relative Percent Difference =
RPD .-fra'
For example, if: x( -22
. x, = 18
22- 18
RPD = 22 + 18
(100)
(100)
A tribal water quality laboratory can be developed as fart of the Section 106 grant
program. Equipment can be purchased with grant fund: and installed by a tribal
program to perform routine laboratory analyses.
= 5%
2. A replicate sample is obtained
by collecting two-or more samples from
the same site, with the same methods,
one immediately after.the other. Such
samples are considered representative
sub-samples of the same environment.
Replicate samples are processed nor-
mally through the entire measurement
-------
I
I
I
I
I
I
I
I
I
I
I
I
system. While analysis results will
never be exactly the same for any two
samples due to natural variation, the
'degree of difference will allow you to
assess the variability caused by-field
sampling methods:
EXAMPLE:
Precision Calculation for a Replicate
Sample
In order to assess the precision of a
replicate set where three or more sam-
ples are obtained from the same envi-
"rohm.ent, the standard deviation must
. be determined; If four replicate sam-
ples were obtained consecutively from
one location to determine precision, the
following calculations would be made:
Sample results from laboratory:
Sample # Concentration
x, , 48
x2 '-'' -.51
x 50
mg/1)
Breaking the equation into its compo-
nents makes the calculations simple.
First, x is the average concentration,
found by:
X =
In this case:
(48+ 51.+ 50 + 45)
X =
X =
48.5
n .
Then, £(x; - x)2 means the sum of
i=l . . '
(xj -x)' for all values of x from i to n.
-\2
(x2>x) + (x3-_x)'+ (x4-x)-'
= (48'-'48.5)2 +(51^48.5)2+
(50-48.5)2 + (45-48.5)2
= (-0.5)2 + (2.5)2 + (1.5)2+(-3,5)2
= 0.25 + 6.25 + 2.25 +.12.25
= 21
I
i
The equation for standard deviation (s)
is:
s=
1=1
where S(x; - x)2
1=1
is the sum of the concentration values
for each of the sample results (x, . . xn)
when the average concentration is sub-
tracted from each result and the total
value is squared.
By placing these values in the original
equation, the result is:
s =
The smaller the value of s, the better
the precision. The standard deviation
reflects the scatter of the values around
the average value. The results of this
calculation should be compared with
-------
the data quality objectives defined in
your QAPP (See Element #6 in the
section "Quality Assurance Project
Plans.")
If a relationship between the standard
deviation and the concentration level is
clearly evident, use the coefficient of
variation (cv) to determine precision.
cv = s
In this example:
cv
= 2.6
48.5
cv= 5.4
(100)
When conducting an extensive sampling
event (collecting samples at different
locations during one trip), plan ahead
for the types and number of QC
samples that you will need to collect.
You will want to meet the minimum of
10% laboratory QC samples for every
sampling event, and compose the preci-
sion and accuracy makeup based on the
needs of your sampling. If you want to
evaluate the precision of the analysis for
an entire sampling event, you could
collect either a series of split samples or
a series of replicate samples. The fol-
lowing example is for an event using a
series of split samples.
V Many of today's calculators per-
form the standard deviation calcula-
tion. Consider purchasing this type
of equipment under your Section
106 grant.
EXAMPLE: .
Precision Calculation for a Sampling
Event Using Splits
For a sampling event involving 80
samples and a QC scheme of 10% of all
samples being Analyzed for precision,
every 8th sample could be split. The fol-
lowing measurements and calculations
could be made to determine QA/QC.
The results of each pair (x, and x2) are
listed in the table below. Also listed are
the calculations that could be made for
average concentration (x), standard devi-
ation (s), and coefficient of variation (cv).
The precision of the individual mea-
surements for this sampling event
could be estimated to be: (0.07) (x)
More complicated calculations may be
necessary for results where a constant
relationship does not exist. Such calcu-
lations are not included here, but can
be found in most statistics texts.
cv (%)
1.5
1.7
2.0
2.4
2.7
3.9
5.0-
5.2
1.7 '
1.6
' 2.1
2.1
' .2.4
4.3
4.5
4.7
1.60
1.65
2.05
2.25
2.55
4.10
4.75
4.95
.14
.07
.07
.21
.21
.. .28
.35
' .35
9
4
3 .
9
8
- 7 -
7
7
average cv = 7%
-------
I
Samples to Determine Accuracy
In order' to determine the accuracy
ofsamples, they must be compared to a
reference material which is of a known
concentration. There are two types of
QC samples which determine accuracy.'
3. A spike sample is a sample that
has a known amount and concentration
of a constituent, such as a metal or pes-
ticide,' added to it. By introducing a
known quantity into a regularly collect-
,ed sample., and determining the percent
of material that is .recovered in analysis,
'an evaluation of accuracy can be made.
Samples can be spiked either in the
field or in the laboratory.
By spiking a sample in the field and
determining the percent recovery of the
substance added, the results will reflect
effects associated'with preservation,
shipping, laboratory preparation, and
analysis. A spike added in the laborato-
ry will incorporate effects associated
only with preparation and analysis.
Always remember safety considerations when sam-
pling during high run-off
' EXAMPLE: .
Accuracy Calculation for a
Spike Sample '
A sampling event collects 100 sam-
ples. To meet QA/QC 'requirements of
10%, 10 samples were selected to be
spiked and evaluated for accuracy.
(Note: When creating spike samples, a
sample is split. One resulting sub-sam-
ple is spiked; the other is left, unspiked.)
Accuracy is the agree-
ment between the mea-
sured amount of a con-
stituent and the amount
of that constituent that
is actually present.
This is determined by
averaging several sam-
ples with a known value
added, and determining
how close they are to the
true value,,
jiked Sample
. 4.0
7.9 -
4.5 - -
1.3
17.3
26.3 ' .
5:7 ' '
5.0'
62.5-
34.5
Spike -Value .
20.0 '
20.0
20.0 ,
20.;0
50.0
100.0'
20,0
20.0
: 200.0
100.0
' Spiked Sample
(A;)
22.8 ' -
26.2
. 25.4
21.2 '
- 66.7
.' 128.0
24.8' "
24.8 -
260.5
135.3
Recove
18'. 8
18.3
- 20.9
19.9
' - 49,4
. : 101.7
19.1
19.8
197.8
100.8
% Recover}'/Bias
":»..'.... j flOO)
^ i \j\j p
94,0
91.5
104,5
99.5
' 94.8
101.7
95.5
99.0
98.9
100.8
-------
Equipment calibration logs should be kept in the tribal and contract laboratories.
Documenting the. calibration trends for each piece of equipment will help you to iden-
tify any damaged.or broken equipment. When evaluating results, calibration lo
-------
^
i
and .some are prepared in the laborato-
ry. The preparation will depend, on the
purpose for using a blank.
Samples to Evaluate Equipment
Performance : / . /
5. A calibration'check is used to
check equipment performance with
laboratory-prepared standards, or in
accordance with manufacturers guide-
lines, to ensure, that equipment is oper-
, atirig properly. .A reference sample of
known concentration is used to mea:
sure accura'cy. Percent bias can be de-
termined using the following equation:
o/o gjas _ 100 (average value -.true value)
true value
Measurements for such parameters as
pH, alkalinity, hardness, dissolved* oxy-
gen, and even temperature should also
include a component of quality control.
Such QC will allow you to evaluate the
accuracy and precision of both your
methods and your equipment.
Another measure of QA/QC is to eval-
uate the bias of the -system. Bias is the
amount of difference between a mea- -
sured value and a true value that is due
'solely to analysis system sources; , ,
EXAMPLE:'
System Bias Calculation
A sample of a known concentration
(50 mg/1) is analyzed four times to
: determine the bias. The results of the
analyses are: - .
x, = 48 mg/1
x2 =.51 mg/1 .
x3 . = 50 mg/1 "
x4 = 45 mg/1
.First, the average concentration is deter-
mined by the formula;
or, in this case:
(48 + 51 + 50 + 45)
194
.x= 48.5 mg/1
Next, the bias is determined by sub-
tracting the true concentration from
the average concentration.
B = x-T
or:
B = 48.5 mg/1 - 50 mg/1
B =-1.5 mg/1 .
This is the average amount of bias that
the/process of system analysis may con-
tribute to each sample in this analysis
run, for the samples that this machine
is running, until it is calibrated again.
V- Laboratories conduct their own
quality control checks including
collocated samples (those that are
arranged or organized in a certain
manner), replicates, splits, and
spikes to determine their own
quality. When contracting witk a
laboratory, be sure to get a. copy of
their QA/QC plan and include it as
an appendix to your QAPP. Also,
discuss how frequently the laborato-
ry will analyze quality control sam-
ples, and be certain that the results
from the laboratory's internal quali-
ty control samples are included in
the report on your data.
-------
Completeness is a mea-
sure of the number of
samples intended to be
taken compared to the
number of samples actu-
ally taken, expressed as
a percentage. If a study
defines 80% complete-
ness, then 80 out of 100
samples must be accept-
able as valid samples. A
sample may be deter-
mined to be invalid and
rejected from the study
because it was cohtami-
nated or destroyed
sometvhere in the sam-
pling process.
EVALUATING RESULTS AND
DETERMINING QUALITY
Once you have completed sampling,
sent the samples to the laboratory for
analysis, and received the results, you
will need to determine the quality of
your data. Procedures for determining
this should be covered in the "Valid-
ation and Verification" section of your
QAPR (See Element #14 in the
following section.) But, how do you
actually evaluate the data?
Compare the results of your data with
the information from your field note-
book. From rfiis, you may be able to
identify errors (if any), and the source
of these errors. Use the precision and
accuracy equations outlined above to
evaluate the quality of your data,
Additional methods which are more
technical and statistical in nature may
also be used. (Consult Standard
Method^
Alter a determination of the precision,
accuracy, and completeness of the data
is made, you will be able to do one of
the following: Completely accept the
data that you, collected, accept them
with restrictions, or reject them. If you
must reject a portion of the data, you
should go back and review the proce-
dures that were used both in field col-
lection and laboratory analysis to deter-
mine where errors were introduced into
the system, and how these errors can be
avoided in the future.
V When conducting environmen-
tal monitoring, be sure to document
all of the procedures and changes in
procedures that you make, both in
the field and in the laboratory.
Along with the SOP manual and
QAPP, keep waterproof field and
laboratory notebooks available to
use at every location. Record infor-
mation such as current weather,
recent storm events, specific site
location descriptions, deviations
from SOPs, sample ID numbers,
and the type of QC samples taken.
Before going into the field, make .
sure your equipment is working
properly, and take spare parts with
you in case you need to repair or
replace something that breaks while
you are out.
Some water quality samples will be callscted-directly from a water body and analyzed
for total concentration of a constituent. Others, such as the sample, shown here, will
be filtered in the field and analyzed tor dissolved concentration.
-------
H~ *t '«£r- tff -
V *&&*;*
QUALITY ASSURANCE
PROJECT PLANS
' J*- tf ""t EvJ="^c 1
, "i * L-Csi-v! ito"?r~"
' *' -
-^i" -
*" s.» -v* * t J* f ft, ""^
^.f ^ fSr ,-^J- ,/"-, t - -
"-'".'*>f - -' ', .":V- ^f^SiSS^Ifl:^
:"-;,- **-* . ;. i * '-> rM*f?/fe;.?-: 4^ /Vt*^i*-? -
:^-;/-;.-/i:fe:rip^5-*ii&.
r\ ^^n^:- /^:V>^^^:^i^fc^v.
-------
I
i
QUALITY ASSURANCE PROJECT PLANS
A QAPP is a document chat pro-
vides specific information on how
' QA/QC is applied to the collection of
data. It includes information on data
collection, planning, implementation,
, and assessment. If used properly, a
QAPP provides the best tool for evalu-
ating the results of monitoring.
Because the information contained in a
QAPP varies greatly from tribe to tribe,
there-is no standard form to be com-
pleted. .Rather, the examples included
here should serve as a guideline for your
tribe's unique QAPP. For more detailed
information on developing a QAPP,
refer to the document EPA
Requirements for Quality Asmrance
Project Plans for Environmental Data
Operations (see References; page 35).
A QAPP may consist of as many as 25
different elements. For tribal QAPPs,
only 16 of these elements, a re required.
V Each year, review your ap-
proved QAPP, If there have been
changes to field or analytical
methodologies, revise the plan to
reflect these changes. Your QAPP
must be current.
^ , Hiring an independent con-
sulting firm to complete your tribal
QAPP is allowed, but ERA encour-
ages tribes to write it themselves.
Because the QAPP document will
be used by tribal personnel in sam-
pling, its contents must be very
familiar to those.individuals. An
outside contractor may not.be able
to provide the details specific to
yonr tribal program as well as tribal
staff can.
All 25 possible elements-are listed be-
low; an arrow indicates those required
for tribal programs in EPA Region 8.
> Title and Approval Sheet
> Table of Contents
Distribution List
> Project/Task Organization
2- .Problem Definition/Background
> Project/Task Description
>- Data Quality Objectives for
Measurement Data
Project Narrative
Special Training Requirements/ -
Certification
Documentation and Records
- Sampling Process Design
> Sampling Methods Requirements
> Sample-Handling and Custody
Requirements
> Analytical Methods Requirements
>~ Quality Control Requirements
Instrument Testing, Inspection, and
Maintenance
>- Instrument Calibration and
Frequency '
Inspection Requirements for
Supplies
Data Acquisition Requirements
Data Quality Management
> -Assessments and Response Actions
Reports .to Management'
>- Data Review, Validation, and
Verification Requirements
> 'Validation and Verification
Methods
>- Reconciliation with Data Quality
Objectives
This section describes, gives examples
of, and lists the requirements for the 16
elements that are necessary for tribal
water quality programs.
-------
n TITLE AND APPROVAL SHEET
This element must include (1) title of the QAPP, (2) name of the tribe and
tribal organization implementing the plan, and (3) names, titles, signatures, and
approval dates for the Tribal Project Manager, Tribal Quality Assurance Manager,
EPA Project Officer, and EPA Quality Assurance Manager.
TABLE OF CONTENTS
Lists the sections, figures, tables, references, and appendices. A complete doc-
ument control number should be included at the top right corner of every page.
Section
Revision No.
Date
ELEMENT #2-Table of Contents Page of
This method of. document control is advantageous. If you need to make minor
changes, document control will eliminate the need to resubmit a revised QAPP;
such changes to the plan can be inserted on a page-by-page basis. Major revisions
to the plan, however, must be submitted to EPA for review and approval.
' PROJECT/TASK ORGANIZATION .
Identifies the personnel and departments within the tribe that will use the
data and make decisions associated with them. Includes an organizational chart
showing the relationship of these individuals and departments. Do not use specific
names, but rather job titles. Include at least one paragraph which describes the
responsibilities of each position, how the QA/QC activities will be performed, and
who will be responsible for performing which QA/QC activities.
-------
i
ELEMENT #3-Project/Task Organization
Qrgajiizational Chart
Tribal Members
; . .Tribal.Council
.. .;...-... Tribal Chair
Enyiro.nm'ental Committee Chair
Environmental Program Director
Water Quality Specialist (QA Officer)
Water Quality Technician
The Water Quality Technician will be responsible
for the field collection and tribal laboratory analysis
of samples, and.reports to the Water Quality
Specialist. The Specialist will oversee the water
quality monitoring program, act as QA Officer, and ...
report to the Environmental Program Director,
The Program Director is
responsible for :. r~-
reviewing the work
performed and mak-
ing recommendations
to the Environmental
Committee. The
Committee Chair reports
to the Tribal Chair and.
Tribal Council, who then
inform Tribal Members.
-------
PROBLEM DEFINITION/BACKGROUND
Brief!}' states the specific problem to be addressed in the water qualify moni-
toring project, -Includes brief background information on the project. Includes a
description-of- the EPA program that is funding the monitoring program. The
QAPP may reference this information from the animal workplan.
ELEMENT #4-Problem Definition/Background
The Ute Mountain Ute Tribe is developing a
water quality program with funding from the EPA
Clean Water Act Section 106 program. The tribe is
establishing a baseline water quality monitoring
"' program for surface water chemistry. The pur-
pose of collecting data is to support the tribe's
»
long-range goals of developing tribal rules and
regulations and water quality standards, and
creating an overview of the quality of reserva-
tion waters. See the Section 106 grant work-
plan for specifics on the problems to be
addressed in water quality monitoring.
PROJECT/TASK DESCRIPTION
Provides a description of the work that will be performed. This description
should be as thorough as possible, II appropriate, maps and other descriptive fig-
ures are helpful to describe the data collection location. Because this portion of the.
QAPP is most likely to change from year to year, the most effective way to provide
this information is by referencing the tribal workplan, (Certain other parts of che
QAPP will remain constant because procedures such as sample preservation and
handling tor certain constituents are unlikely to change.)
The description in the workplan should include an identification of all measure-
ments that will be performed during the project. All measurements should be clas-
sified as either critical (required for the project) or non-critical (informational).
-------
1
1
Equipment and personnel that will be used should be included. Performance and
calibration requirements, as well as the methods and procedures to be used for field
and laboratory sampling, may be cited from the tribal Standard Operating
Procedures manual.
ELEMENT #5-Project/Task Description
The Ute Mountain Ute Tribe is located in extreme
southwest Colorado, with portions extending into Utah
and New Mexico. The reservation covers approxi-
mately 500,000 acres. Four drainages traverse the
reservation, including the Mancos River, San Juan
River, Me Elmo Creek, and Navajo Creek, Some of the
surface water bodies serve as irrigation water, and
are also important to fish and wildlife resources.
Included are numerous groundwater wells used for
construction and livestock water. Selection of moni-
toring sites was based on historical monitoring data.
Measurements which will be, made are listed in the ...
approved Section 106 grant workplan under Task #4,
"Monitoring-Program."
DATA QUALITY
OBJECTIVES FOR
MEASUREMENT DATA
State the project objective, or reference
it from the workplan. The objective
must be described in numerical terms.
This allows you to know what mea-
surements must be taken and with
what frequency. By establishing
numerical goals to support the objec-
tive, you will be able to. determine how
many samples to collect and what ana-
lytical methods to use to give results at
the sensitivity required.
LPA is available to provide technical training.
-------
In this section you will.identify the scope ot the project, including the time frame
for conducting the monitoring, and the constraints on the project. List.why the
data are needed and for what they will be used.. Being very specific, list what com-
pounds are being measured, the detection levels of the compounds, the reporting
units,-the acceptable level of confidence tor each (standard deviation and percent
bias), and the citation for the source(s) of this information (CFR or Standard_
Methods). The easiest way to do this is to present the information in a table that
specifies the .quality of the data needed to achieve the project objective.
ELEMENT #6-Data Quality Objectives for Measurement Data
Detection Reporting Precision Accuracy Completeness
Parameter Level " Units Cstd. dev.l C% bias! Method . (%) '
pH 0.01-14.0
conductivity 0-10,000
iron 0.02
zinc 0.005
su
mhos/cm
mg/1.
mg/1
0.13
8.2
16.5
8.4
0.05
4.8
0.06
0.4
Std Met
Std Met .
Std Met
Std Met
80
80
80
80
Precision, accuracy, and completeness should be expressed in terms" ot numbers.
Representativeness and comparability are not numerical but are descriptive evalua-
tions of items such as sampling locations and the sampling scheme.
Representativeness is the expression of the degree to which data accurately and pre-
cisely represent a characteristic ot a population, parameter variation, process
condition, or environmental condition. The Ute Mountain Ute Tribe's water
quality monitoring program is set up to delineate the water quality of the reserva-
tion bv drainage.
o
Comparability is the confidence with which one data set can be compared to
another. Consistency of reporting units, standardized analytical methods, and stan-
dardized data formatting will ensure comparability.
Note: The levels selected for acceptability depend entirely on the objectivefs! ot your monitoring program.
For instance, the accuracy and precision used when -monitoring for legally-defensible dara for an Ehvironmenral
Impact Statement would need to be much higher than those used when monitoring lor baseline data ro classify
reservation waters.
-------
9
3
a
a
a
i
a
a
SAMPLING PROCESS
DESIGN (EXPERIMENTAL
DESIGN)
Outlines, in.general terms, the experi-
mental design of the project and the
anticipated project activities. Includes
sample design, sample frequencies,
matrices, and a schedule of milestones.
It is recommended that a map be
included that identifies sampling loca-
tions. This section describes how
sampling locations and frequency of
sampling were determined; it will vary
with each monitoring plan that you
design. The best way to address this
requirement is to reference this infor-
mation from the grant workplan.
Hand-held conductivity meter with probe attached, Equipment such as this can be
taken into the field to perform on-site analysis.
i
1
9
SAMPLING METHODS REQUIREMENTS
This is a specific list of the constituents for which you will be sampling and
the methods you will use to do the sampling. A good way to illustrate this is by
developing a table of the constituents and then listing details regarding the contain-
ers, sample preservation methods, maximum holding times, and procedures. This
information comes directly from the methods in 40 CFR 136 or Standard'Methods,
or from the analytical laboratory. It is best to include in the table all possible
constituents found on the reservation, even if you do not anticipate monitoring for
all of them immediately.
3
a
a
B
Parameter
PH ..;.; .
iron
ELEMENT #8-Sampling Methods Requirements
Procedure "* 'Container' Preservative Hold Time
Meter Poly/Glass None
Atom Abs Poly HN03
.0... , \
6 months
-------
SAMPLE HANDLING AND CUSTODY REQUIREMENTS
Describes the procedure than will be used for keeping track of and shipping or
delivering samples ro an outside laboratory for analysis. Describes the chain of cus-
'todv for both the field and the laboratory.
ELEMENT #9-
Sample Handling & Custody Requirements
Samples will be labeled in the field at the sam-
ple location. Minimum information on the identifi-
cation labels will include
sample location
sample number
.date and time of collection
sample, type
sampler's name
preservation method
Samples will be sealed and preserved
appropriately for shipment, and be accompa-
nied by a chain of custody (COG) form. Upon .
receipt by the lab, the receiver will sign the
COG form and return it to the Water Quality
program staff. A copy of the final COG form
will accompany the data results in the report
from the laboratory.
PI ANALYTICAL METHODS REQUIREMENTS
This element is a list of" the analytical methods that will be used. These can
easily be included in the table developed for Sampling iVtethods Requirements (see
Element #8, on previous page).
-------
EQUALITY CONTROL REQUIREMENTS
Discusses the quality control procedures that will . . . . .
, ,r , ; . K , . ELEMENT #11-
be used tor each analysis or measurement technique, -"',.'- _
~,. . c . , r j -ff mr- i u Quality Control Requirements
This refers to the five different types of QC samples that
can be used to determine error in sampling, listed in the
previous section "Quality Assurance and Quality Control Sample Type QG Frequency
Working Together." These QC requirements should be Field 5%
determined when creatins; the monitoring plan. It is best - _ , nn/
,. . , LI r At c ' Laboratory 10%
to present this information in table rorm. Also, reference
the contract laboratory's QA/QC plan,
EB
INSTRUMENT CALIBRATION AND FREQUENCY
This element describes how all of the instruments (field and tribal laboratory)
are calibrated, along with the type of standards that will be used. Specific proce- .
dures for calibrating equipment will not be listed in this section; rather, these
procedures should be included in the tribal SOP document. A simple reference
to the tribal SOP will fulfill the requirements of this element.
If the tribe is using a contract laboratory, it is acceptable to reference the laboratory's
QA/QC plan as it pertains to the laboratory's instrument calibration, frequency,
and traceability. '
a
M ELEMENT #12-Instrument Calibration Se Frequency
All of the field instruments will be calibrated
.. . .
* according to the manufacturer's recommendations,
B '-.','-.... Any,deviation from these recommendations due to
mm ...... specific peculiarities with certain instruments will be
documented in the monitoring program of the grant
workp Ian. .All standards will, be traceable to a nationally-
B .". recognized standard and documented in field logbooks.
mm All instrument calibration information can.be found in
the tribal Standard Operating Procedures.
The calibrations, frequency, and traceability of
a laboratory instrumentation are conducted in accordance
mm With Section #^ of (laboratory's .name) QA/QC Plan.
A copy of the reference is included as Appendix A.
-------
ASSESSMENTS AND RESPONSE ACTIONS
This element identifies the type .
of assessment activities that are to be
conducted during the length of the pro-
ject. Assessments are formal evalua-
tions of organizations and individuals
performing activities for the project.
This usually includes, but is not limited
to, the following:
Performance Evaluations: evaluations
of the individuals or organizations
(including water quality programs or
laboratories participating in the project).
involved in sampling, analysis, and/or
interpretation of data. Performance for
any or all of these entities can be stud-
ied and outlined in a written report or
performance review.
Cooperation in recording data in the field can help to ensure data quality. Many
errors are made, in transcribing data fi-om meter to datasheet. State each reading
aloud, record it, and then repeat if aloud to minimize transcription error.
System Audits: audits of the equip-
ment, personnel, and procedures by
tribal or EPA personnel to determine
the adequacy of the analytical measure-
ment system, data collection, and
other system components. The audit .
may consist of a fiejd or laboratory
audit that evaluates operations against
the requirements of the approved.
QAPP and procedures. System audit
reports note problems and allow
corrective actions, to be taken to
protect the validity of collected data.
When contracting with a laboratory,
a tribe should include a requirement
that both the tribe and EPA may con-
duct system audits on the laboratory
at any time.
Management System Reviews: allow
for reviews of the tribal management
system associated with project .
oversight.
Data Quality Audits: provide an
opportunity for tribal and EPA repre-
sentatives to review data results and .
compare.them with project quality
objectives. "
Inspections: site inspections allow for
evaluation of conditions and proce-
dures in field and laboratory settings.
This element also discusses what
action(s) will be taken if sample results
indicate a problem1 in the data collec-
tion and/or data analysis aspect of the
project.
-------
I
ELEMENT #13-Assessments & Response Actions
In order to identify any problem(s), the .tribe
will conduct a self-assessment of the sampling
and analysis of the data collectedat least
once a year during the project. If a major
problem exists, corrective action will be
immediately taken and documented. In those
situations where independent expertise is
needed to assess a certain aspect of the pro-
ject, the tribe will request technical assis-
tance from the U.S. EPA. The US- EPA .
Project Officer or Regional Quality
Assurance Officer may conduct any type
of assessment at any time during the
length of the project. This includes con-
ducting assessments of any contractor or sub-con
tractor performing sampling, analysis, or any
other activity directly related to the program.
DATA REVIEW,
VALIDATION, AND VERI-
FICATION REQUIREMENTS
This section states the criteria that will
be used to review the data that were
collected and to decide whether they
will be accepted, rejected, or qualified.
A statement of what will be done, and
by whom, is all that is needed. A
description of how this will be done
should be provided in the QAPP
"Validation and Verification Methods,"
Element #15.
EPA provides annual water quality training opportunities.
-------
ELEMENT #14-
Data Review, Validation, & Verification Requirements
It is the responsibility of the Water Quality
Specialist to evaluate raw data generated by the tribal
or contract laboratory for appropriate numeric.reduc-
tion, data quality, and accuracy. All data will be
reviewed and reported in units specified at the detec-
tion level of the analytical methods used.
To reduce data point loss, data that are reported
as "less than" detection level will be incorporated at a
value of 1 /2 the detection level.
Once data are generated, they will be compiled in
a database file. During this data, transfer, the infor-
mation will be reviewed and verified
in accordance with the data quality
objectives. Data generated in the" -
laboratory will be validated by per-
formance checks such as duplicate
sample analysis, linear regression
curve fitting for standards, spike
recovery, inter-laboratory sample
exchange, and unknown sample
analysis reports.
Data units will be system-
atically reported in milligrams
per liter (mg/1), unless other-
wise noted, for all parameters
except pH and conductivity. .Scientific notation will be
used, and significant figures will correlate with detec-
tion levels.. Both graphing and narrative conclusions
will be used to describe the water quality results and
trend variations.
-------
VALIDATION AND VERIFICATION METHODS
This section describes the process used for validating and.verifying data. It
should describe how errors, if detected, will be corrected, and how the analysis of
quality control data, detection limits, instrument calibrations, and special condi-
tions will be performed.
ELEMENT #15 -Validation & Verification Methods
The Water Quality Specialist will be responsible for
receiving the data sheets and field/laboratory note-
books, checking for errors in identification numbers,
decimal placement, dates, times, units reported, and
comments. Personnel collecting data will be contacted
immediately if there are data gaps or if scheduled
sampling times were missed. The Water Quality Spe-
cialist will make every attempt to screen inaccurate
data before they are entered in the database by ana-
lyzing all quality control data, including chain of cus-
tody, spikes, replicates, sample holding times, blanks,
equipment calibrations, and sampling conditions.
Quality control sample results will be evaluated
individually by performing appropriate; mathematical
analysis for precision or accuracy for each sample.
Only the Water Quality Specialist and Water Quality
Technician will be allowed to access project data and
submit reports to data users. All data will be accom-
panied by QA/QC information.
Data will be printed out in lists and graphs, with
lists checked against original data sheets. The Water
Quality Technician will be responsible for correcting
data entry errors. A second examination will verify
that corrections are completed. Inaccurate data will be
discarded, and data anomalies will be evaluated on a
case-by-case basis.
-------
RECONCILIATION WITH DATA QUALITY
OBJECTIVES (DQOs)
This activity is conducted once the data results are compiled co determine whether
che data collected for the project really meet the objectives of the project. If the data
quality objectives have not been, met, the problem can be addressed either by cor-
recting errors in the system, or by adjusting the objectives. To meet this require-
ment, simply describe the process that the program, will use to evaluate whether the
DQOs have been met.
ELEMENT #16-
Reconciliation with Data Quality Objectives
(DQOs)
Established DQOs will be compared with the
results of all QA/QC samples. Data that do not
meet DQOs will be discarded from the analysis
and not re-sampled. Completeness, accuracy,
precision, representativeness, and comparabili-
ty will be evaluated by the Water Quality
Specialist.
The 16 elements described here are
those that must be covered in a tribal
QAPP. Any of the additional nine
elei 'ts may also be covered, as a tribe
wishes. EPA staff is available to assist
tribes throughout the development of
the QAPP, Project specific changes
should be made annually to the moni-
toring program described in your grant
workplan. Changes in your QAPP
musr be sent to EPA for approval.
Make a checklist of all the equipment you will need to take into the field. Check it.as
you pack your vehicle. Always remember spare equipment parts.
-------
^v^^?...-t" -,
t-jS-'1 ?}£?£'' - -
i^tfi/**-!--'-" £.':-' : :
l.vfSfi-5^--::, ..
tA>fC|%'V3<''V
p^v.iJCv;---S
'-".^g^f.:-- ->"^ -
HELPFUL
RESOURCES
mm
B
£
» -< ", >'^n :
KttC^rV.
-------
HELPFUL RESOURCES
GLOSSARY
-, ' " ' .'' "' ' '- - ' "-. ' ' :
_ . . Abatement: The reduction of water pollution sources.
. ' " ' . .' ' ' ' . '
Accuracy: The closeness of a measured value to the true value.
I Aliquot: A fraction of a sample prepared for the analysis of particular constituents,
_ sent in a separate container to the analytical laboratory.
Analytical Laboratory: A laboratory under contract with a tribe or state to analyze
.water samples collected from the field.
_ ' Analytical Laboratory Duplicates: Aliquots from a sample that is split in the ana-
- lytical laboratory. The aliquots are analyzed in the same batch.
Anion: A negatively-charged ion.
_ -Assessment: An evaluation of sources,of water pollution, describing the nature,
extent, and effect of pollution.
- "-'.' '" ' ' - ' - ' ' ' ; ' . ' . . ,'
ASTM Type I. Reagent-Grade Water: Deionized water which meets American
m Society for Testing and Materials specifications for Type 1 reagent-grade water, that
M has a measured conductance of less than 1 S/cm at 25° C.
|- Bias: The systematic difference between a measured value and a true value.
. Blank Sample: A sample of ASTM Type I reagent-grade water analyzed as a
« quality control sample.
£ Calibration Blank: .A solution used in standardizing or checking the calibration of
analytical instruments; also used to determine instrument detection limits.
m - Cation: A positively-charged ion. ..
2 Comparability: A measure of data that expresses the confidence with which one
datii set can be compared to another.
K ' ''.--. ' '__'
K Completeness: A measure of the number of samples intended to be taken com-
pared to the number of samples actually taken, expressed as a percentage..
-' ' ' - '' ; ' '
Conductance: A measure of the electrical conductance or total ionic strength of a
.' ' ' water-sample expressed as S/cm at 25° C.
-------
Confidence Interval (95%): A sec of possible values within which the true value
will lie within a probable chance of 95%.
Constituent: A component which is part of a whole. For example, zinc may be
one constituent of a water sample that has many types of heavy metals in it.
Database: Computerized results of a survey, which include the Taw, verified, vali-
dated and final data sets as well as back-up and historical data sets.
Data Quality Objectives: Qualitative and quantitative specifications used to
.design a study that will limit uncertainty' to an acceptable level.
Detection Limit: The lowest concentration or amount of the component of inter-
est that can be determined by a single measurement at a stated confidence level.
Field Audit Samples: -A standardized water sample submitted to a field laboratory
to check overall performance in sample analysis by.field and analytical laboratories.
Field Replicate Sample: An additional sample collected at the same location.
immediately after the first sample. It is possible to have more than two replicate
samples.
Holding Time: The time during which a sample is collected, preserved, and
analyzed.
Matrix: The physical and chemical composition of a sample being analyzed.
Parameter: A quantity whose value varies, used interchangeably with "constituent."
Percent Recovery: The amount of constituent recovered from a known added
concentration.
pH: The negative logarithm of the hydrogen-ion activity. The pH scale, runs from
1 (most acidic) to 14 (most alkaline or basic); the difference of 1 pH unit indicates a
10-fold change in hydrogen-ion activity.
Precision: A measurement of the closeness of data values to one another.
Quality Assurance: A set of operating principles and procedures used to effectively
collect environmental data and determine how believable or reliable they are.
Qualiry Control: The set of steps taken during sample, collection and analysis to
ensure that the data quality meets the minimum standards established by a Quality
Assurance Project Plan.
-------
Reagent: A substance added to water to determine the concentration of a specific
analyte. . .. . . .
Remediation: The act of correcting a problem; returning a situation :o its proper
condition.
Representativeness: A measure of data quality; the degree to which sample data
accurately and precisely reflect the characteristics of a population.
Sanaple: An environmental substance (e.g. water, air, soil) that is measured for
specific parameters.
Sample ID: The numeric identifier given to each sample and quality control
sample. -
Spike: A known concentration of an analyte introduced into a sample or aliquot.
Standard Deviation: The square root of the variance of a given statistic, used in
determining the error of sampling.
Systematic Error:. A consistent deviation from an expected or known value in the
results of sampling and/or analytical processes. Such an error commonly results in
biased estimations.
Turbidity: A measure of light scattering by suspended particles in an unfiltered
water sample.
Validation: Process by which data are evaluated for quality with reference to
the intended data uses; includes evaluation of the potential for error after c
verification.
Verification: Process of ascertaining the quality of the data in accordance with the
minimum standards established by the Quality Assurance Project Plan.
-------
LIST OF ACRONYMS
CFR Code of Federal Register
COC Chain of Custody
CWA Clean Water Act
DQO Data Quality Objective
EPA .. Environmental Protection Agency
QA Quality Assurance
QAPP Quality Assurance Project Plan
QA/QC Quality Assurance/Quality Control
QC Quality Control
SOP Standard Operating Procedure
-------
REFERENCES
For information about how to obtain the references listed below, or if you have
questions about further references, contact: Tribal Water,Quality Coordinator, EPA
Region 8, 999 18th Street, Suite 500, Denver, CO 80202; (303) 293-1570 or
(800)227-8917. . ' . .
EPA Requirements for Quality Assurance Project Plans (QAPP) for Environmental
Data Operations. EPA/QA/R-5, U.S. Environmental Protection Agency, Office
2 of Water, Washington, DC. . .:'.''
B - . Handbook of Methods for Acid Deposition Studies. Laboratory Analysis for
_t. 'Surface Water Chemistry, 1987. EPA 600/4-87/026. U.S. Environmental
Protection Agency, Acid Deposition and Atmospheric Research Division, Office
ft of Acid Deposition, Environmental Monitoring and Quality Assurance, Office
of Research and Development, Washington, DC.
__. ' Handbook of Methods for Acid Deposition Studies, Field Operations for Surface
' Water Chemistry. 1989. EPA 600/4-89/020. U.S. Environmental Protection
g Agency, Acid Deposition and Atmospheric Research Division, Office of Acid
Deposition, Environmental Monitoring and Quality Assurance, Office of
B Research and Development, Washington, DC.
Monitoring Guidelines to Evaluate Effects of Forestry Activities- on Streams in the
g Pacific Northwest and Alaska, 1991. EPA 910/9-91-001. U.S. Environmental
Protection Agency, Region 10, NPS Section, Seattle, WA.
B ': - . '. - .'; ; ' . . " ' . . ' _ . . ;. -.
__, Rapid Bioassessment Protocols far Use in Streams, and Rivers. Benthic Macro-
" invertebrates and Fish'. 1989. EPA-444/4-89-Q01. U.S. Environmental
K Protection Agency, Office of Water, Washington, DC. .
B Standard Methods for the Examination of Water and Wastewater, 17th Edition,
, 1989. American Public Health Association, American Water Works Association
and Water Pollution Control Federation, Washington, DC.
* - ' ' : ' - -. .-',' ": -,". . : '" '
Standard Operating Procedures for Field Samples. 1988. U.S. Environmental
B Protection Agency, Region 8r Environmental Services Division', Denver, CO,
B - ''-'. '.-'.' ' '' -
Water Management Solutions - a Guide-for Indian Tribes. 1993. U.S. Environmental
Kj Protection Agency, Region 8, Denver, CO. - ,
-------
This guide has been reviewed by EPA and approved for publication. Mention
of trade names or commercial products does not constitute endorsement or rec-
ommendation for use.
-------
45-EPA
EPA REGION 8 WATER MANAGEMENT DIVIStON
WATER QUALITY BRANCH
999 18TH STREET, SUITE 5OO
DENVER;COLORADO 8020^-2405
------- |