AREAL/RTP-SOP-QAD-553
STANDARD OPERATING PROCEDURE FOR PERFORMING THE ROUTINE
ACTIVITIES OF THE AREAL COORDINATOR OF THE
NATIONAL PERFORMANCE AUDIT PROGRAM
by
Elizabeth T. Hunike
Quality Assurance and Technical Support Division
ATMOSPHERIC RESEARCH AND EXPOSURE ASSESSMENT LABORATORY
OFFICE OF RESEARCH AND DEVELOPMENT
U.S. ENVIRONMENTAL PROTECTION AGENCY
RESEARCH TRIANGLE PARK, NORTH CAROLINA 27711
-------
AREAL/RTP-SOP-QAD-553
Revision: 1
Date: September 1993
Page: 2 of 61
STANDARD OPERATING PROCEDURE FOR PERFORMING THE ROUTINE
ACTIVITIES OF THE AREAL COORDINATOR OF THE
NATIONAL PERFORMANCE AUDIT PROGRAM
by
Elizabeth T. Hunike
Quality Assurance and Technical Support Division
DISCLAIMER
This Standard Operating Procedure has been prepared for use within the Quality
Assurance Support Branch, Quality Assurance and Technical Support Division of the
Atmospheric Research and Exposure Assessment Laboratory of EPA at Research Triangle
Park, North Carolina, and may not be applicable to the activities of other
organizations.
APPROVALS:
W.J. Mitchell, Chief, QASB Date
R.C. Evans, Director, QATSD Date
EFFECTIVE DATE: April 1991
-------
AREAL/RTP-SOP-QAD-553
Section: 1-3
Revision: 1
Date: September 1993
Page: 5 of 61
1.
SCOPE AND APPLICATION
This document describes the routine activities of the QASB/AREAL Coordinator
of the National Performance Audit Program (NPAP). The NPAP provides EPA a means
to assess the proficiency of agencies that are operating monitors in the State and
Local Air Monitoring System (SLAMS) network with one aspect of the minimum quality
control (QC) program required under Section 2.0 of 40 CFR Part 58, Appendix A.
The following criteria air pollutants are audited under NPAP: high-volume/PM-10
(SSI) (flow only), sulfur dioxide, nitrogen dioxide, carbon monoxide, ozone, lead
(analysis only), and dichotomous (PM-10). Also audited under NPAP is
sulfate/nitrate on filter strips.
2. SUMMARY OF ACTIVITIES
2.1
Overview of the Activities of the NPAP Coordinator
The NPAP Coordinator is responsible for the administration of the NPAP.
This includes contacting participants, scheduling audits, registering participants,
following up on poor performers, authorizing reaudits and changes to the information
in the data base, keeping the EPA Regional Offices informed, and performing systems
and performance audits on the on-site contractor. The duties and decisions of the
NPAP Coordinator are considered to be within the scope of policy-making and,
therefore, are within the sole purview of EPA.
Functions of the On-Site Contractor
The on-site contractor is responsible for audit material preparation,
shipment to participants, data entry, distribution of data results to the audit
participants, analysis, procurement, calibration, and repair and maintenance of
audit equipment.
2.3 Participants
All agencies that operate SLAMS samplers or Prevention of Significant
Deterioration (PSD) samplers are required by 40 CFR Part 58 to participate in the
appropriate NPAP audits.
3.
DESCRIPTION OF AUDITS
3. 1 High-Volume/PM-10 (SSI) Flow Audit
The reference flow (ReF) device used for the high volume flow audit consists
of a modified orifice, a wind deflector, a manometer, and five resistance plates.
The ReF for the PM-10 (SSI) flow audit is similar except a filter is used as the
only resistance. The procedures for calibrating the ReF device and conducting the
audit are found in AREAL/RTP-SOP-QAD-508.
-------
-------
AREAL/RTP-SOP-QAD-553
Section: 3-4
Revision: 1
Date: September 1993
Page: 6 of 61
3.2 Sulfur Dioxide/Nitrogen Dioxide/Carbon Monoxide Audits
One audit device, one zero air system, and one or two cylinders of gas are
used for all three audits. (See AREAL/RTP-SOP-QAD-520, S02 Audit Device
Calibration; AREAL/RTP-SOP-QAD-547, Conducting Performance Audits for Carbon
Monoxide; and AREAL/RTP-SOP-QAD-542, N02 Audit Device Quality Assurance Operation
Checks.)
3.3 Ozone Audit
The audit device is self-contained with its own zero air and ozone generation
system. (See AREAL/RTP-SOP-QAD-544, Conducting an Ozone National Performance
Audit.)
3. 4 Lead Audit
The samples are 1.9 cm wide and 20 cm long glass fiber filter strips that
have been spiked with an aqueous solution of lead nitrate and oven-dried. Two filter
strips comprise a sample. (See AREAL/RTP-SOP-QAD-510, Conducting the Lead NPAP
Audit.)
3.5 Dichotomous (PM-10)
The audit device consists of a laminar flow element (LFE), an inclined
manometer, an altimeter, and a small dial thermometer. It measures fine flow (15.00
1pm) and total flow (16.7 1pm). (See AREAL/RTP-SOP-QAD-543, Quality Assurance
Checks of Dichotomous (PM-10) Audit Devices.)
3.6 Sulfate/Nitrate Audits
The samples are 1.9 cm wide and 20 cm long glass fiber filter strips that
have been spiked with aqueous solutions of sodium sulfate and potassium nitrate
and oven-dried. Three filter strips comprise a set. (See AREAL/RTP-SOP-QAD-521,
Conducting the Sulfate/Nitrate NPAP Audit.)
4. PARTICIPATION OF SLAMS AND PSD SITES
4.1 Registration of Participants From Prior Years
No later than October 1 of each year, a covering letter and registration
form with instructions are sent to potential participants for the upcoming year.
If applicable, a memo concerning SLAMS site selection is included (see Section
4.3). The mailing list of potential participants is derived from the current year' s
participants and other requests. The on-site contractor supplies the NPAP
Coordinator with three sets of mailing labels. One label is attached to the letter,
one label is attached to the SLAMS site memo, and the third label is attached to
the mailing envelope. A postage paid envelope with the NPAP Coordinator's address
is included in the package sent to participants.
-------
AREAL/RTP-SOP-QAD-553
Section: 4
Revision: 1
Date: September 1993
Page: 7 of 61
Attachment 1 is an example of the letter, registration form, instructions, and
postage paid envelope that are sent. Attachment 2 is an example of the SLAMS site
selection memo.
The information from the registration forms is entered into the computer
by the NPAP Coordinator following the instructions in AREAL/RTP-SOP-QAD-546. The
registration of participants should be completed by December 1. The registration
forms are bundled according to region and stored in a file cabinet.
Participants are sent a written confirmation of their audit schedule and
are asked to notify the NPAP Coordinator immediately if there are any corrections
and/or changes to the schedule. The confirmation is computer-generated according
to the instructions in the AREAL/RTP-SOP-QAD-546. Attachment 3 is an example of
a confirmation and the accompanying memo. The EPA Regional Quality Assurance (QA)
Coordinators receive a computer-generated list of all agencies in their respective
region that are participating in the NPAP. The NPAP Coordinator maintains a file
by region of all participating agencies. If any changes and/or corrections have
to be made, the participants and Regional Offices are sent a corrected copy of the
audit schedule.
No later than December 15 of each year, the on-site contractor will be notified
that registration for the upcoming year has been completed. At this time, the
on-site contractor transfers the registration information to the main NPAP computer
located in the on-site contractor's work area. From this point on, the on-site
contractor is responsible for updating the computer files. However, the NPAP
Coordinator will approve all changes—including but not limited to additions,
deletions, corrections—prior to the on-site contractor making the change. The
authorization will be in writing and a copy will be kept in the EPA files . Attachment
4 is an example of the NPAP Change Request Form.
4.2 Registration of New Participants
Any agency that has never participated in the NPAP must be assigned a
laboratory identification (ID) number before registration is possible. The ID
number is 6 digits long and consists of the following components.
X XX XXX
Agency Number
State Code
1 Type of Agency
-------
AREAL/RTP-SOP-QAD-553
Section: 4
Revision: 1
Date: September 1993
Page: 8 of 61
where X = one digit code for type of agency
1 = Federal Agency
2 = Regional Office
3 = State Agency
4 = City/County Agency
5 = Private Company
7 = Foreign
XX =Two digit state code that is located in the FIPS (Federal Information
Processing Standards) directory
XXX =Three digit agency number code. This is determined by checking the master
list of agencies and selecting the next available number. The new
number and agency name and address will be written in the master listing.
(Note: Foreign agencies are not allowed to participate in the following audits:
dichotomous (PM-10), carbon monoxide, sulfur dioxide, nitrogen dioxide, and ozone.)
After an ID number has been assigned, registration proceeds as described in Section
4.1.
4.3 SLAMS Site Selection
Contact OAQPS by April 1 and request that the SLAMS site prioritization list
be provided by July 1 for the upcoming year. Prepare a memo for each affected NPAP
participant, list the AIRS site codes for each parameter, affix a label to the memo
that states "NOTE: These are special audits to be done in addition to your regular
NPAP audits," and enclose with the registration package for the upcoming year (see
Section 4.1). Maintain a file of the memos in numerical order according to the
laboratory identification number. If a participant notifies the NPAP Coordinator
that a site has been closed, draw a line through the AIRS number and note the reason
on the memo. When audit results for the new year are received, cross reference
the AIRS site codes and check off the sites listed on the memo that were audited.
By March 1, a list will be sent to OAQPS and the Regional Offices of the SLAMS
agencies that did not audit the special sites.
-------
AREAL/RTP-SOP-QAD-553
Section: 4
Revision: 0
Date: March 1991
Page: 9 of 61
4.4 Preparation of Audit Materials
4.4.1 Lead Audit - No later than May 1 of each year, the on-site contractor is
notified by a memo of the concentration and number of filters needed for the next
year's lead audit (see Attachment 5a). The concentrations1 range from 100-300 and
from 600-1000 ug of lead per strip. The number of filters spiked is based on the
present year's participation plus extra filters for EPA acceptance testing. Twenty
sets of filter strips for each quarter are due by September 1 from the on-site
contractor for acceptance testing by EPA and an off-site contractor (Section 6.1.4
describes acceptance/rejection of the filters). Based on the acceptance testing,
the NPAP Coordinator sends the on-site contractor a memo confirming the EPA
determined values to be used in the lead audit (see Attachment 5b).
4.4.2 Sulfate/Nitrate Audits - No later than May 1 of each year, the on-site
contractor is notified by a memo of the concentration and number of filters needed
for the sulfate/nitrate audits (see Attachment 6a) . The concentrations fall within
the following ranges:
Sulfate Nitrate
(ug/strip) (ug/strip)
Level 1: 400-800 200-300
Level 2: 1200-1600 600-800
Level 3: 2500-2800 1000-1200
These concentrations are based on observed 24-hour samples in the United States
for a variety of sampling flow rates (5-60 1pm). The number of filters spiked is
based on the present year's participation plus extra filters for EPA acceptance
testing. Twenty sets of filter strips for each audit (February and August) are
due by September 1 from the on-site contractor for acceptance testing by EPA and
an off-site contractor (Section 6.1.4 describes acceptance/rejection of the
filters). Based on the acceptance testing, the NPAP Coordinator sends
the on-site contractor a memo confirming the EPA determined values to be used in
the sulfate/nitrate audits (see Attachment 6b).
4.4.3 Sulfur Dioxide/Nitrogen Dioxide/Carbon Monoxide and Ozone Audits - Based
on requirements in the Federal Register,1 the on-site contractor selects an audit
device gas cylinder combination that yields the following:
-------
Sulfur Dioxide,
Ozone, and 2
Nitrogen Dioxide 3
Carbon Monoxide
AREAL/RTP-SOP-QAD-553
Section: 5
Revision: 0
Date: March 1991
Page: 10 of 61
Audit Concentration
Level Range, ppm
1 0.03-0.08
0.15-0.20
0.35-0.45
1 3-8
2 15-20
3 35-45
Section 6.1.1 describes the procedure to follow for acceptance/rejection of the
audit equipment.
4.5
Audit Schedules
4.5.1 Carbon Monoxide/Sulfur Dioxide/Nitrogen Dioxide Audits - These audits are
offered each quarter. Participants may select one quarter. If more than one audit
is requested, the participant must do the audits in the same quarter.
4.5.2 Ozone Audit - This audit is offered all four quarters and participants select
one quarter to perform the audit.
4.5.3 High Volume/PM-10 (SSI) and Dichotomous (PM-10) Audits - Both of these audits
are offered quarterly. Participants may select two non-consecutive quarters.
4.5.4 Lead Audit - This audit is offered each quarter and participants may select
all four quarters.
4.5.5 Sulfate/Nitrate Audit - These two audits are offered in the first quarter
(February) and in the third quarter (August). Participants may select both
quarters.
4.6 Non-Participation by Scheduled Participants
At the end of each quarter, a letter is sent to the Regional QA Coordinators
listing SLAMS and PSD sites for the previous quarter that received audit equipment
and/or filters, but did not return data results and did not notify EPA as to why
they could not participate. Attachment 7 is a sample letter that is sent to the
Regional QA Coordinators.
-------
5.
AREAL/RTP-SOP-QAD-553
Section: 5
Revision: 1
Date: September 1993
Page: 11 of 61
DATA PROCESSING AND DISTRIBUTION
5.1 Data Receipt
NPAP participants mail the audit results directly to EPA's on-site contractor
for data entry and retention of the audit data sheets.
5.2 Data Entry
The on-site contractor shall enter the audit data results exactly as received
according to the instructions in AREAL/RTP-SOP-QAD-546, Computer Data Entry, Report
Printing and Maintenance for the NPAP.
5.3 Incorrectly Completed Data Sheets
Data sheets that are completed incorrectly and cannot be entered into the
NPAP data base system are given to the NPAP Coordinator. (Examples of incorrect
data sheets are: using wrong units of measurement; failing to complete the forms;
using resistance plates with flow controlled PM-10 samplers.) The Coordinator
returns the data sheet(s) to the participant with a letter of explanation (see
Attachment 8 for a sample letter). If possible, the participant corrects the data
sheet(s) and returns to the on-site contractor for entry into the NPAP system.
5.4
Late Data
5.4.1 High Volume/PM-10 (SSI) and Dichotomous (PM-10) Audits - The closing date
for first quarter audits is March 31; for second quarter audits, June 30; for third
quarter audits, September 30; and for fourth quarter audits, December 31 of each
year. Audits that are performed and/or data sheets received after the closing date
will be entered separately and flagged. The flagged data will be clearly marked
by the on-site contractor to reflect it is data received after the audit closed
and/or the audit itself was performed after the closing date and is, therefore,
not considered part of the NPAP. The NPAP Coordinator receives all 3 copies of
the flagged data results and distributes as follows: 1 copy to participant with
a covering letter (see Attachment 9), 1 copy to the Regional QA Coordinator with
a copy of letter, and 1 copy to the Coordinator's files.
5.4.2 Lead and Sulfate/Nitrate Audits - These audits have specific closing dates
that are stated in the covering letter the on-site contractor sends with the audit
samples. Data received and/or audits performed after the closing dates are late
and shall be handled as described in Section 5.4.1.
5.4.3 Final Closing Date - The current year's audits close on December 31. Any
data received and/or audits performed after that date are late data and shall be
handled as described in Section 5.4.1.
AREAL/RTP-SOP-QAD-553
-------
5.5
Section: 5
Revision: 1
Date: September 1993
Page: 12 of 61
Data Distribution
The on-site contractor mails the data results to the audit participant and
gives the NPAP Coordinator two copies. One copy is mailed to the Regional QA
Coordinator and one copy is maintained by the NPAP Coordinator.
5.6 Unacceptable Results
Audit data results that exceed the EPA determined limits (see below) are
considered unacceptable and follow-up measures are instituted.
Audit
EPA Determined Limits
High Volume/PM-10 (SSI]
Dichotomous (PM-10)
Sulfate/Nitrate
Lead
Carbon Monoxide
Sulfur Dioxide
Nitrogen Dioxide
Ozone
% difference > +15% for 1 or more flows
% difference > +15% for 1 or more flows
% difference > +15% for 1 or more levels
% difference > +15% for 1 or more levels
Mean absolute % difference > 15%
Mean absolute % difference > 15%
Mean absolute % difference > 15%
Mean absolute % difference > 15%
All unacceptable results are entered into a "poor performers" logbook. The
logbook is divided into sections—one section for each NPAP audit. The logbook
is set up in the following manner.
(Year)
(Name of Audit)
Lab ID
No.
Date
Contacted
Data
Results
High/Low
Date
Response
Received
Comments
A letter and Audit Survey Form (Attachment 10) are sent to each poor performer.
The letter requests that the NPAP participant identify the cause of the exceedance,
complete the Audit Survey Form, and return the form to the NPAP Coordinator. One
copy of the letter is sent to the Regional QA Coordinator and one copy, along with
a copy of the poor data results, is maintained in a "pending" poor performers file
by the NPAP Coordinator. When the participant's response is received, a notation
is made in the logbook of the date received and the participant's comments. The
participant's file is removed from the poor performers file, the Audit Survey Form
is attached, and all information is refiled in numerical order in a "completed"
poor performers file. (Note: If an agency phones in its response in lieu of
returning the Audit Survey Form, the NPAP Coordinator shall write the comments on
the "pending" file copy of the letter sent to the agency, reference the phone call,
enter the information into
-------
AREAL/RTP-SOP-QAD-553
Section: 5-6
Revision: 1
Date: September 1993
Page: 13 of 61
the logbook, and file the annotated "pending" file copy of the letter in numerical
order in the "completed" poor performers file.)
Each quarter a covering memo and poor performers table are sent to the Regional
QA Coordinators (Attachment 11) . The table lists the agencies and responses
received, if any. As soon as an agency's comments are sent to the Regional Office,
the entry in the logbook is checked off using red ink. Continue to list agencies
on the table until they respond to the survey form or until the end of the first
quarter of the upcoming year.
5.7 Corrections to Data
5.7.1 Faulty EPA Audit Equipment - When complaints are received from audit
participants that they believe the EPA equipment was the cause of poor data results,
the on-site contractor is informed of the problem and asked to examine the audit
device. If the examination reveals a problem with EPA's equipment, the Coordinator
notifies the participant that another audit device will be sent. The on-site
contractor is instructed to remove the original data from the NPAP data base and
to enter the new data when received. Three copies of the data results are printed,
given to the Coordinator who marks the data "corrected" in the upper right-hand
corner, and distributes the corrected results to the audit participant, the Regional
QA Coordinator, and the NPAP files.
5.7.2 Data Entry Error - When complaints are received concerning data entry, the
Coordinator informs the on-site contractor. The original data sheets are examined
and, after verifying that a data entry error has occurred, the on-site contractor
is instructed to correct the entry in the NPAP data base and to print three copies.
For handling and distribution of the copies, see Section 5.7.1.
5.7.3 Audit Participant Error - Corrections made due to participant error (i.e.,
transposed numbers) are made by the NPAP Coordinator using a "dummy" computer
program. (See AREAL/RTP-SOP-QAD-546 for instructions.) The NPAP data base is not
changed. The correction is considered a "repeated" audit and is clearly stated
on the data results form sent to the participant (see Attachment 12) . The Regional
QA Coordinator does not receive a copy and a copy is not placed in the NPAP files.
6.0 QUALITY CONTROL
6.1 Performance Audits
6.1.1 Sulfur Dioxide/Nitrogen Dioxide/Carbon Monoxide and Ozone. Four to six
audit devices will be selected each quarter (one device every two weeks) to verify
the on-site contractor's determined values. The NPAP Coordinator will select the
audit devices by requesting that the on-site contractor pull the next device that
is ready for shipment to the field. The quality assurance audits will be conducted
by the AREAL Standards Laboratory. The audit will consist of
AREAL/RTP-SOP-QAD-553
-------
Section: 6
Revision: 1
Date: September 1993
Page: 14 of 61
running one zero point and three upscale points following the procedures in
AREAL/RTP-SOP-QAD-004, Audit Systems Verification Center Operational Procedures.
The results of the quality assurance audits will be forwarded in writing
within 5 working days to the NPAP Coordinator for comparison of the on-site
contractor's determined values and the EPA determined values. The report to the
NPAP Coordinator will also contain an assessment of the condition of the equipment
(i.e., external appearance). The audit device will be considered acceptable if
an agreement of +5 percent (based on the slope of a linear regression determination)
is achieved between the on-site contractor's determined values and the EPA
determined values. If the results are unacceptable, the NPAP Coordinator will ask
the AREAL Standards Laboratory to run the audit a second time to eliminate the
possibility of human error.
The NPAP Coordinator will forward the results of the comparison and the audit
device to the on-site contractor for review. The on-site contractor will determine
the cause of failures, if any, and report to the NPAP Coordinator in writing within
5 working days the cause and corrective action taken. If the on-site contractor
is unable to identify the cause of failure, a meeting will be held between the NPAP
Coordinator, the on-site contractor, and the AREAL Standards Laboratory to identify
an agreed upon, scientifically sound, probable error source. Minutes of this
meeting will be kept and a typed, signed copy will be kept on file by the NPAP
Coordinator and the on-site contractor.
6.1.2 High Volume/PM-10 (SSI) . Six ReF devices will be selected each quarter
following the procedure described in Section 6.1.1. The quality assurance audits
will be conducted by the AREAL Standards Laboratory. The audit will consist of
verifying the on-site contractor's calibration of the ReF device by using an
NIST-certified rootsmeter and following the procedures in AREAL/RTP-SOP-QAD-508.
The results of the audit will be given in writing within 5 working days to
the NPAP Coordinator for comparison of the on-site contractor's determined values
and the EPA determined values. The ReF is considered acceptable if the air flow
measurement generated by the on-site contractor is within +5 percent of the air
flow measurement generated by EPA. If the results are unacceptable, the NPAP
Coordinator will ask the AREAL Standards Laboratory to run the audit a second time
to eliminate the possibility of human error. See Section 6.1.1 for reporting
procedures and corrective action.
6.1.3 Dichotomous (PM-10). A system consiting of an inclined manometer, an
altimeter, a small dial thermometer, and the laminar flow element (LFE) will be
selected each quarter as described in Section 6.1.1. The audit will be conducted
by the AREAL Standards Laboratory using the LFE provided as part of the on-site
-------
AREAL/RTP-SOP-QAD-553
Section: 6
Revision: 1
Date: September 1993
Page: 15 of 61
contractor's system and compared to a system consisting of an electronic manometer,
barometer and thermometer provided by the AREAL Standards Laboratory. The flows
through the common LFE will be determined by utilizing the on-site contractor's
system and the AREAL Standards Laboratory's flow audit system. The on-site
contractor's system is considered acceptable if the two air flow measurements
determined by their system and the AREAL Standards Laboaratory system agree within
+5 percent. If the results are unacceptable, the NPAP Coordinator will ask the
AREAL Standards Laboratory to run the audit a second time to eliminate the
possibility of human error. See Section 6.1.1 for reporting procedures and
corrective action.
6.1.4 Lead and Sulfate/Nitrate Filter Strips - Twenty sets of filters shall be
randomly selected from the filters prepared for each audit for each parameter (i.e.,
a total of 80 sets of lead filters and 40 sets of sulfate/nitrate filters). The
Coordinator gives half of the filters for each parameter to the AREAL Standards
Laboratory and the other half to an off-site contractor for acceptance testing.
Filters shall be considered acceptable if within +5 percent relative standard
deviation from the average of the determined values. Any filters not meeting this
criteria shall be rejected and the on-site contractor will be instructed to remake
the rejected level. The re-made filters will be sent out for acceptance testing
as described above.
6.2 Systems Audit
Each calendar quarter, the NPAP Coordinator and a member of the AREAL Standards
Laboratory will perform a systems audit to ensure that the on-site contractor is
adhering to the SOPs that cover conducting audits, entering data, distributing data,
and maintaining files. However, during the quarter that the independent audit of
the total NPAP program is done (see Section 6.3), the NPAP Coordinator will not
do a separate systems audit on the on-site contractor. The systems audit will follow
a set format based on the information contained in the on-site contractor's SOPs.
Attachment 13 describes the format. The NPAP Coordinator will coordinate the
systems audit with the on-site contractor's manager. The results of the systems
audit will be forwarded in writing within 5 working days to the on-site contractor's
manager for review. The on-site contractor will determine the cause of
deficiencies, if any, and report to the NPAP Coordinator within 5 working days the
cause and corrective action taken.
6. 3 Audit of NPAP
The NPAP Coordinator will arrange for an independent yearly systems and
performance audit of the total NPAP program by the AREAL Quality Assurance Manager.
7. REFERENCES
^•Federal Register, 40 CFR Part 58, Appendix A, revised July 1, 1987.
AREAL/RTP-SOP-QAD-553
-------
Section: 8
Revision: 1
Date: September 1993
Page: 16 of 61
ATTACHMENTS
1. Registration letter with instructions and registration form
2. SLAMS site selection memo
3. Schedule confirmation and covering letter
4. NPAP Change Request Form
5a. Memo for on-site contractor to make lead filter strips
5b. Memo to on-site contractor confirming EPA determined limits for lead
6a. Memo for on-site contractor to make sulfate/nitrate filter strips
6b. Memo to on-site contractor confirming EPA determined limits for
sulfate/nitrate
7. Memo to Regional QA Coordinators concerning non-participation of
agencies in scheduled audits
8. Example letter for returning data sheets that cannot be entered in
NPAP data base
9. Letter sent with late data results
10. Letter sent to poor performers and Audit Survey Form
11. Memo sent to Regional QA Coordinators and poor performers table
12. Repeated audit results form
13. National Performance Audit Program Systems Audit Checklist
NOTE: While this document is meant to serve as a guideline for the activities
of the NPAP Coordinator, dates are open to negotiation with the on-site
contractor when extenuating cirumstances exist.
-------
AREAL/RTP-SOP-QAD-553
Attachment: 1
Revision: 1
Date: September 1993
Page: 17 of 61
Attachment 1
Registration letter with instructions
and registration form
-------
AREAL/RTP-SOP-QAD-553
Attachment: 2
Revision: 1
Date: September 1993
Page: 26 of 61
Attachment 2
SLAMS site selection memo
-------
AREAL/RTP-SOP-QAD-553
Attachment: 3
Revision: 0
Date: March 1991
Page: 29 of 61
Attachment 3
Schedule confirmation and covering letter
-------
DATE: 11/15/92
SUBJ: 1993 National Performance Audit Program (NPAP)
FROM: Elizabeth T. Hunike
NPAP Coordinator
TO: Audit Participant
Enclosed is a confirmation of the audit schedule you requested for 1993.
The confirmation lists the following information for each audit:
1. Name of audit
2. Quarter requested
3. Number of sites, if applicable
4. Agency contact name and address
5. Shipping address, if different from contact
IF ANY CORRECTIONS OR CHANGES NEED TO BE MADE, PLEASE NOTIFY ME NO LATER
THAN 12/1/92.
If you have any questions, please call me at 919/541-3737.
Enclosure
-------
AREAL/RTP-SOP-QAD-553
Attachment: 4
Revision: 1
Date: September 1993
Page: 32 of 61
Attachment 4
NPAP Change Request Form
-------
AREAL/RTP-SOP-QAD-553
Attachment: 5a and 5b
Revision: 1
Date: September 1993
Page: 34 of 61
Attachment 5a
Memo for on-site contractor
to make lead filter strips
Attachment 5b
Memo to on-site contractor confirming
EPA determined limits for lead
-------
AREAL/RTP-SOP-QAD-553
Attachment: 6a and 6b
Revision: 1
Date: September 1993
Page: 37 of 61
Attachment 6a
Memo for on-site contractor to
make sulfate-nitrate filter strips
Attachment 6b
Memo to on-site contractor confirming EPA
determined limits for sulfate/nitrate
-------
AREAL/RTP-SOP-QAD-553
Attachment: 7
Revision: 0
Date: March 1991
Page: 40 of 61
Attachment 7
Memo to Regional QA Coordinators
concerning non-participation of
agencies in scheduled audits
-------
MEMORANDUM
SUBJ: National Performance Audit Program (NPAP)
FROM: Elizabeth T. Hunike
RMEB/QAD/AREAL (MD-77B)
TO: Norm Beloin
Region 1
Listed below are state/local agencies and PSD sites in your region that
received audit equipment and/or filters during the first quarter of 1993. These
agencies did not return their data to EPA nor did they notify EPA that they would
not be able to participate.
Agency Audit(s)
2XXXXX (name of agency) SSI/Hi-Vol
3XXXXX (name of agency) SSI/Hi-Vol
3XXXXX (name of agency) Lead
-------
AREAL/RTP-SOP-QAD-553
Attachment: 8
Revision: 0
Date: March 1991
Page: 42 of 61
Attachment 8
Example letter for returning data sheets that
cannot be entered in NPAP data base
-------
February 21, 1993
Mr. John Doe
Environmental Affairs
10 Main Street
Any Town, GA 30332
Dear Mr. Doe:
Re: SSI/Hi-Vol Audit—1st Quarter 1993
As stated in our instructions, samplers that are equipped with flow
controllers (method codes 001 and 002) do not use the resistance plates. These
samplers use a clean filter as the only resistance in the system. Because the
correct procedure was not followed, EPA will be unable to accept your results for
the above audit at sites abc and xyz.
If you have any questions, please call me at 919/541-3737.
Sincerely yours,
Enclosure: Data Sheets
cc: Herb Harden
Region 4
Elizabeth T. Hunike
NPAP Coordinator
Quality Assurance Support Branch
Quality Assurance and Technical
Support Division (MD-77B)
-------
AREAL/RTP-SOP-QAD-553
Attachment: 9
Revision: 1
Date: September 1993
Page: 44 of 61
Attachment 9
Letter sent with late data results
-------
Dear
Re: (Name of audit and qtr)
Enclosed are your data results for the above audit. Because (the audit
was performed after the closing date/the data sheets were not received until
after the closing date), these results are late data and, therefore, are not part
of the NPAP.
Sincerely yours,
Elizabeth T. Hunike
NPAP Coordinator
Quality Assurance Support Branch
Quality Assurance and Technical
Support Division (MD-77B)
Enclosure
(QA Coordinator)
Region
-------
AREAL/RTP-SOP-QAD-553
Attachment: 10
Revision: 1
Date: September 1993
Page: 46 of 61
Attachment 10
Letter sent to poor performers and
Audit Survey Form
-------
SSI/Hi-Vol, Dichot, Lead
Sulfate/Nitrate
Dear
Your agency's audit results for the quarter 1993
Audit exceeded +15% for one or more concentrations. When results are outside +15
for this audit, we strongly recommend that the causes for the large exceedance be
identified so corrective action can be taken by the participant. Please complete
the enclosed Audit Survey sheet and return to me as soon as possible.
If you have any questions, please call me at 919/541-3737.
Sincerely yours,
Elizabeth T. Hunike
NPAP Coordinator
Quality Assurance Support Branch
Quality Assurance and Technical
Support Division (MD-77B)
Enclosure
(QA Coordinator)
Region
-------
S02, N0-N02, 03, CO
Dear
Your agency's audit results for the quarter 1993
Audit exceeded 15% for the mean absolute percent difference. When results are
outside 15% for this audit, we strongly recommend that the causes for the large
exceedance be identified so corrective action can be taken by the participant.
Please complete the enclosed Audit Survey sheet and return to me as soon as possible.
If you have any questions, please call me at 919/541-3737.
Sincerely yours,
Elizabeth T. Hunike
NPAP Coordinator
Quality Assurance Support Branch
Quality Assurance and Technical
Support Division (MD-77B)
Enclosure
(QA Coordinator)
Region
-------
AREAL/RTP-SOP-QAD-553
Attachment: 11
Revision: 0
Date: March 1991
Page: 50 of 61
Attachment 11
Memo sent to Regional QA Coordinators
and poor performers table
-------
AREAL/RTP-SOP-QAD-553
Attachment: 12
Revision: 0
Date: March 1991
Page: 53 of 61
Attachment 12
Repeated audit results form
-------
AREAL/RTP-SOP-QAD-553
Attachment: 13
Revision: 1
Date: September 1993
Page: 55 of 61
Attachment 13
NPAP Systems Audit Checklist
-------
AREAL/RTP-SOP-QAD-553
Revision: 1
Date: September 1993
Page: 3 of 61
TABLE OF CONTENTS
Section Page
1 SCOPE AND APPLICATION 5
2 SUMMARY OF ACTIVITIES 5
2.1 Overview of the Activities of the NPAP Coordinator .... 5
2.2 Functions of the On-Site Contractor 5
2.3 Participants 5
3 DESCRIPTION OF AUDITS 5
3.1 High-Volume/PM-10 (SSI) Flow Audit 5
3.2 Sulfur Dioxide/Nitrogen Dioxide/Carbon Monoxide
Audits 6
3.3 Ozone Audit 6
3 . 4 Lead Audit 6
3.5 Dichotomous (PM-10) 6
3.6 Sulfate/Nitrate Audits 6
4 PARTICIPATION OF SLAMS AND PSD SITES 6
4.1 Registration of Participants from Prior Years 6
4.2 Registration of New Participants 7
4 . 3 SLAMS Site Selection 8
4.4 Preparation of Audit Materials 9
4.4.1 Lead Audit 9
4.4.2 Sulfate/Nitrate Audits 9
4.4.3 Sulfur Dioxide/Nitrogen Dioxide/Carbon
Monoxide and Ozone Audits 9
4.5 Audit Schedules 10
4.5.1 Carbon Monoxide/Sulfur Dioxide/Nitrogen
Dioxide Audits 10
4.5.2 Ozone Audit 10
4.5.3 High Volume/PM-10 (SSI) and Dichotomous
(PM-10) Audits 10
4.5.4 Lead Audit 10
4.5.5 Sulfate/Nitrate Audit 10
4.6 Non-Participation by Scheduled Participants 10
5 DATA PROCESSING AND DISTRIBUTION 11
5. 1 Data Receipt 11
5.2 Data Entry 11
5.3 Incorrectly Completed Data Sheets 11
5.4 Late Data 11
5.4.1 High Volume/PM-10 (SSI) and Dichotomous
(PM-10) Audits 11
5.4.2 Lead and Sulfate/Nitrate Audits 11
5.4.3 Final Closing Date 11
-------
AREAL/RTP-SOP-QAD-553
Revision: 1
Date: September 1993
Page: 4 of 61
Section Page
5.5 Data Distribution 12
5.6 Unacceptable Results 12
5.7 Corrections to Data 13
5.7.1 Faulty EPA Audit Equipment 13
5.7.2 Data Entry Error 13
5.7.3 Audit Participant Error 13
6 QUALITY CONTROL 13
6.1 Performance Audits 13
6.1.1 Sulfur Dioxide/Nitrogen Dioxide/Carbon
Monoxide and Ozone 13
6.1.2 High Volume/PM-10 (SSI) 14
6.1.3 Dichotomous (PM-10) 14
6.1.4 Lead and Sulfate/Nitrate Filter Strips 15
6.2 Systems Audit 15
7 REFERENCES 15
LIST OF ATTACHMENTS
1. Registration letter with instructions and registration form 17
2. SLAMS site selection memo 26
3. Schedule confirmation and covering letter 29
4. NPAP Change Request Form 32
5a. Memo for on-site contractor to make lead filter strips 34
5b. Memo to on-site contractor confirming EPA determined limits for
lead 34
6a. Memo for on-site contractor to make sulfate/nitrate
filter strips 37
6b. Memo to on-site contractor confirming EPA determined limits for
sulfate/nitrate 37
7. Memo to Regional QA Coordinators concerning non-participation of
agencies in scheduled audits 40
8. Example letter for returning data sheets that cannot be entered
in NPAP data base 42
9. Letter sent with late data results 44
10. Letter sent to poor performers and Audit Survey Form 46
11. Memo sent to Regional QA Coordinators and poor performers table ... 50
12. Repeated audit results form 53
13. National Performance Audit Program Systems Audit Checklist 55
-------
------- |