&IEPA limited States Environmental Protection Agency Risk Reduction Engineering Laboratory Cincinnati OH 45268 Research and Development WPA/6 00/9-89/08 7 Oct. 1989 repanng erfect A Pocket Guide for the Preparation of Quality Assurance Project Plans ------- This POCKET GUIDE has been prepared by Guy F. Slmes, Quality Assurance Manager, EPA, Risk Reduction Engineering Laboratory, Cincinnati, Ohio 45268. Contact him to request addi- tional copies or suggest enhancements for future revisions. ------- INTRODUCTION This POCKET WIDE will help you prepare Quality Assurance (QA) Project Plans thoroughly and easily. It summarizes guidance found In Preparation Aids for the Development of RREL Quality Assurance Project Plans, U.S. EPA, Risk Reduction Engineering Laboratory, Cincinnati, Ohio 45268, October 20, 1989. This title Is shortened to Preparation Aids... In the Pocket Guide. RREL utilizes a four-tiered project category approach in its QA Program in order to more effectively focus QA. Category I involves the most stringent QA Approach, whereas Category IV represents the least stringent. The RREL Technical Project Manager Is responsible for assigning the category that accurately reflects the Intended use of the data and the type of work being done. Specific details regarding the category levels can be found In the "Table of Contents." Because requirements for QA Project Plans depend on the project category, the Pocket Guide has a separate section for each category. Each section contains short summaries of all topics required for your QA Project Plan. At the bottom of each page Is a reference to a specific section in Preparation Aids... where you can find more detailed Information. Using the Pocket Guide Isa simple four-step process: 1. Turn to the appropriate category (I, II, III, or IV) for your project. 2. Read the summaries of each of the topics required for that category. 3. Consult Preparation Aids... for additional Information, If needed. 4. Then prepare your QA Project Plan, confident that you will Include everything needed to ensure that your measurement program meets the data quality objectives for your project. ------- DISCLAIMER This material has been funded by the United States Environmental Protection Agency. Although It has been subject to the Agency's review, and has been approved for publication as an EPA document, It does not necessarily reflect EPA policy. ------- Table of Contents CATEGORY I PROJECTS are those producing results that are au- tonomous. These projects are of sufficient scope and substance that their results could be used directly, without additional support, for compliance or other litigation. Such projects are of critical importance to Agency goals and must be able to withstand legal challenge. Accordingly, the quality assurance requirements will be the most rigorous and detailed in order to ensure that such goals are met. Section Page Project Description 1 Project Organization and Responsibilities 2 Quality Assurance Objectives 3 Site Selection and Sampling Procedures 4 Sample Custody 6 Calibration Procedures and Frequency 7 Analytical Procedures 8 Data Reduction, Validation, and Reporting 9 Internal Quality Control Checks 10 Performance and Systems Audits 11 Preventive Maintenance 12 Calculation of Data Quality Indicators 1.3 Corrective Action 16 Quality Control Reports to Management 17 References .1.8. Other Items 19 ------- Table of Contents CATEGORY II PROJECTS are those producing results that com- plement other inputs, These projects are of sufficient scope and substance that their results could be combined with the results of other projects of similar scope to produce narratives that would be used for rulemaking, regulation making, or policy making. In addi- tion, projects that do not fit this pattern, but have high visibility, would also be included In this category. Section Page Project Description 20 Project Organization and Responsibilities 21 Quality Assurance Objectives 22 Site Selection and Sampling Procedures 23 Analytical Procedures and Calibration 25 Data Reduction, Validation, and Reporting 26 Internal Quality Control Checks 27 Performance and Systems Audits 28 Calculation of Data Quality Indicators 29 Corrective Action .32 Quality Control Reports to Management 33 References 34 Other Items 35 ------- Table of Contents CATEGORY III PROJECTS are those producing results for the purpose of evaluating and selecting basic options, or performing feasibility studies or preliminary assessments of unexplored areas which might lead to further work. Section Page Project Description 36 Quality Asurance Objectives 38 Site Selection and Sampling Procedures 39 Analytical Procedures and Calibration 41 Data Reduction, Validation, and Reporting 42 Internal Quality Control Checks 43 Performance and Systems Audits 44 Calculation of Data Quality Indicators 45 Corrective Actlon 48 Quality Control Reports to Management 49 References 50 Other Items 51 ------- Table of Cntents CATEGORY IV PROJECTS are those producing results for the purpose of assessing supositions. Section Page Project Decription 52 Quality Assurance Objectives 53 Sampling and Analytical Procedures 54 Approach to QA/QC 56 References 60 Other Items 61 ------- Category I PROJECT DESCRIPTION Q, How detailed should the description be? A. A technical person unfamiliar with your project must be able to understand what you've written. Be sure to include: General overview - Statement of the decision to be made or the question to be answered Purpose of the study In quantitative terms - Description of the site, facility, process, or operating parameters to be studied - Actual uses of the results - Consequences of incorrect decisions or conclusions based on these results Experimental design features List of all measurements, differentiating the critical measurements (i.e., process and analytical measurements essential to achieving project objectives) from the non-critical measurements Description of that portion of the environment or physical system to which decisions or conclusions will be applied - Summary table covering the following for each samplinglocation: - Total number of samples (including primary, quality control, and reserve) - Type of sample (air, water, soil, etc.) - All measurements planned for each sample Project start-up and ending dates, including preliminary studies and field and laboratory activities For more information, see "PreparationAids...," Category I, Section 1.0 ------- Category I PROJECT ORGANIZATION AND RESPONSIBILITIES Q, What's the most important thing to do here? A. Name all key individuals In charge of every major activity In your project. This applies to your subcontractors, too. Also include: A detailed organizational chart showing management structure and lines of communication Telephone numbers to facilitate communication between project officials Both technical and QA/QC functions An Independent QA coordinator Geographical locations of contractors and subcontractors Procedures for monitoring subcontractors Description of type, frequency, and mechanisms of communication between contractor and subcontractors, and among subcontractors Description of type, frequency, and mechanisms of communication among the contractor, the contractor's project quality assurance officer, and the EPA project officer Descriptions of the relevant certifications held by the responsible samplers, sample custodians, and analysts, and by the prime contractor and subcontractor organizations for the performance of their respective tasks For more information, see "Preparation Aids...," Category I, Section 2.0 ------- Category I QUALITY ASSURANCE OBJECTIVES Q, What's the most common reason for a QA Project Plan getting a NOT APPROVED rating? A.. Inadequate treatment of QA objectives. These QA objectives must be defined in terms of project requirements, not in terms of the capabilities of the test methods used. Project require- ments, in turn, must be defined in terms of the Data Quality Objectives (DQOs) developed specifically for the project during the early stages of project planning. When defined in this way, QA objectives should not only be attainable by the chosen methods of sampling, sample preparation, and analysis, but, more Important they should be indicative of the minimum quality of data project management requires to draw valid conclusions regarding the objectives of the test program and to support specific decisions or regulatory actions. Make sure you cover the following for each critical measurement and each matrix: Summary table of quantitative QA objectives - Method detection limit - Precision, both within and between samples - Accuracy Completeness (as required to achieve a specific statistical level of confidence) Discussion of qualitative QA objectives - Representativeness - Comparability Others, as applicable Discussion of how not meeting the QA objectives will affect decision making and litigious actions Discussion of how data quality indicators will affect the legal defensibility of the data For more information, see "Preparation Ads...," Category I, Section 3.0 ------- Category I SITE SELECTION AND SAMPLING PROCEDURES Q, How important is this section? !A. Very important, because collecting representative samples In both time and space Is crucial to subsequent decision making and legal defensibility of the data. Obtaining good analytical results on non-representative samples is dangerous because such results could lead to incorrect decisions and/or invalidate the use of the data for support of regulatory actions. The selection of appropriate sampling sites and sampling strategies is predicated upon the Data Quality Objectives (DQOs) developed specifically for the project during the early stages of project planning. As a result, the appropriate sampling strategy will be one that ensures attainment of the quality of data required by the project management to draw valid conclusions regarding the objectives of the test program and to support specific decisions or regulatory actions. Your QA Project Plan must describe the following: Sampling site selection - Scientific and regulatory objectives for sampling, including analyte concentrations of Interest - Statistical method or scientific rationale for choosing sampling sites and sampling frequencies - Extent to which the site selection will affect the validity of the resulting data and the project objectives Sampling site description - Chart, map, etc., showing sampling sites - Site-specific factors affecting sampling - Critical process measurements (Continued) For more information, see "Preparation Ads...," Category I, Section 4.0 ------- Category I SITE SELECTION AND SAMPLING PROCEDURES (Cont.) Sampling procedures List of analytes and sample volumes to be collected Sampling methods (composite, grab, etc.) EPA-approved or other validated standard methods-cite by reference Non-standard or modified methods-describe fully - Preparation and cleaning of sampling equipment, containers, reagents, and supplies - Calibration of equipment Preservation, transportation, nd storage Holding times of samples, before and after extraction, as applicable Whenever possible, Include standard perating procedures (SOPs) to fulfill the above requirements. For more inormation, see "Prepration Aids...," Category I, Section 4.0 5 ------- Category I SAMPLE CUSTODY Q, fe a separate section on Sample Custody really necessary? &. Yes. A complete description of all custody procedures, forms, documentation, and personnel responsibilities is needed to ensure both the scientific credibility and the legal defensibility of data obtained for ail project samples. You should include a SOP discussing the following topics: Field operations - Names of field sample custodians ~ Records of sample acquisition data, including location, time, sample size, and other pertinent parameters - Records of sample preservation methods Documentation of procedures for preparing sampling media and reagents ~ Examples of sample labels, custody seals, and field sample tracking forms - Record of field chain-of-custody - Documentation of procedures for transporting samples from field to laboratory, including Identification; of the individuals or organizations responsible for transport Laboratory operations (specify for each laboratory facility, including subcontractor facilities) - Names of laboratory sample custodians Forms for laboratory sample tracking Records of laboratory chain-of-custody - Specification of procedures for sample handling, storage, and final disposition - Documentation of procedures for disbursement and transfer of samples within the laboratory and between contractor and subcontractor laboratories For more Information, see "Preparation Aids...," Category I, Section 5.0 8 ------- Category I CALIBRATION PROCEDURES AND FREQUENCY Q, What Important information should this section include? A. Description of the calibration procedures and frequency of calibration for each analytical system, instrument, device, or technique used to obtain critical measurement data.. Be sure to include the following for each critical measurement and each method: (Note: Use a summary table whenever possible.) Calibration procedures - Reference EPA-approved or other validated, standard methods. Describe non-standard or modified methods fully. Append instrument-specific calibration SOPS as needed to support the use of non-standard or modified methods, or methods that do not Include detailed calibrationprocedures. - List standards, including source, traceability, and purity checks. Describe frequency of initial and continuing calibration checks. Define specific acceptance criteria for all calibration measurements. For more information, see "Preparation Aids...,'Category I, Section 6.0 ------- Category I ANALYTICAL PROCEDURES Q, What factors are critical in selecting analytical methods? !A.. Mehods must be appropriate for all analytes in the specific matrix at the anticipated concentrations. They require extensive validation to show that they meet your QA objectives. Include the following in your QA Project Plan: (Note: Use a summary table whenever possible.) EPA-approved or other validated standard methods Reference sample preparation and analysis methods for both critical and non-critical measurements for all matrices. - Cite by reference if method validation data are appropriate for your critical measurements. Describe your data validation plans for all critical measurements If existing validation data are inappropriate. - List independent, validated, confirmatory analytical methods for each critical measurement for which a multi-method confirmatory approach Is applicable. Non-standard or modified methods Include sample preparation and analysis methods for both critical and non-critical measurements for all matrices. Append pertinent method validation data for critical measurements, If aailable. Describe plans for conducting preliminary method validation studies as project subtasks if pertinent validation data are not available. Whenever possible include detailed SOPs to fulfill the aboverequirements. -REMEMBER- Only validated methods should be used for Category I Projects. For more information, see "PreparationAids...," Category I, Section 7.0 ------- Category I DATA REDUCTION, VALIDATION, AND REPORTING Q, What's the main purpose of this section? %.. You want to collect good data. This section shows how you plan to maintain gSod data quality throughout data reduction, transfer, storage, retrieval, and reporting. Here are tooics to discuss: Data reduction Names of Individuals responsible Summary of data reduction procedures Summary of statistical approach for reducing data, including units and definitions of terms - Examples of data sheets Description of how results on blanks will be treated in the calculations - Presentation of all calculations and significant underlying assmptions Data validation - Names of individuals responsible - Procedures for determining outliers and flagging data - Identification of critical control points Data reporting Names of Individuals responsible Flowchart of the data handling process, covering all data collection, transfer, storage, recovery, and processing steps, and including QC data for both field and labratory Identification of critical control points For more information, see "Preparation Aids...," Category I, Section 8.0 ------- Category I INTERNAL QUALITY CONTROL CHECKS Q» What determines which QC checks are needed? &. The QA objectives for your project and the anticipated uses of your results. QC checks apply to both field and laboratory activities. List the type and number of QC checks, Including acceptance criteria. Here are some QC checks to consider: (Note: Use a summary table whenever possible.) Samples* - Collocated, split, replicate Spikes* - Matrix spikes and matrix spike duplicates - Spiked blanks - Surrogates and Internal standards Others - Standard reference materials - Blanks (field, trip, method, reagent, Instrument) Zero and span gases Mass tuning for mass spectral analyses - Confirmation with second column for gas chromatographic anlyses Control charts - Calibration stadards - Proficiency testing of analysts Independent, multi-method analyses for confirmation of analytical results - Independent, multi-lboratory analyses Any additional checks required by the special needs of your project Identify ail stages In the sampling and analytical process where the QC activity will occur. For more information, see "Preparation Aids...," Category I, Section 9.0 10 ------- Category I PERFORMANCE AND SYSTEMS AUDITS Q, What information is most important here? %.. Schedule of all planned performance evaluation audits and technical systems audits. Be sure to include: Schedule of all contractor- and EPA-planned audits Personnel responsible for audits Explanation if no audits are planned Schedule for any Interlaboratory performance evaluation studies For more information, see "Prepration Aids...," Category I, Section 10.0 ii ------- Category I PREVENTIVE MAINTENANCE Q, What information needs to be included here? ft. A brief description of the types of preventive maintenance needed for adhering to project schedules and for achieving completeness objectives. Here's what to include: (Note: These may be conveniently presented In a table) A schedule of important preventive maintenance tasks for critical measurement systems A list of critical spare parts Reference to current maintenance contracts and standard maintenance procedures for critical measurement systems For more information, see "Preparation Aids...," Category I,Section 11.0 12 ------- Category I CALCULATION OF DATA QUALITY INDICATORS Q, What tells me if my data quality is "good enough"? J%. Detailed planning of data assessment procedures as summarized here, Including statistical treatment planned, equations, units, and assessment frequency. Make sure everything agrees with the QA objectives. You and other data users can then make the needed comparisons. Here's how to calculate your results: Precision If calculated from duplicate measurements: RED = - C2) x 100% C2)/2 RPD = relative percent difference Ci = larger of the two observed values C2 = smaller of the two observed values If calculated from three or more replicates, use relative standard deviation (RSD) rather than RPD: RSD = (s/y) x 100% RSD = relative standard deviation s = standard deviation y = mean of replicate analyses (Continued) For more information, see "Prearation Aids...," Category I, Section 12.0 13 ------- Category I CALCULATION OF DATA QUALITY INDICATORS (Cont.) Standard deviation,s, is defined as follows: 8 = n (y . - Z1 . _ n - i.2 - TL s = standard deviation y,= measured value of the /I th replicate y =mean of replicate measurements n = number of replicates Accuracy For measurements where matrix spikes are used: %R = 100% x s - u %R=percent recovery S = measured concentration In spiked aliquot U = measured concentration In unspiked aliquot Csa=ual concentration of spike added For situations where a standard reference material (SRM) is used instead of or in addition to matrix spikes: %R = 100% x m arm (Continued) For more information, see "Preparation Aids...," Category I, Section 12.0 14 ------- Category I CALCULATION OF DATA QUALITY INDICATORS (Cont.] %R=percent recovery Cm= measured concentration of SRM Csrm=actual concentrion of SRM Completeness (statistical) Defined as follows for all measurements: %C = 100% x ' V n %C = percent completeness V = number of measurements judged valid n = total number of measurements necessary to achieve a specified statistical level of confidence In decision making Method detection Defined as follows for all measurements: MDL (n-1, l-« =0.99) x S MDL = method detection limit S = standard deviation of the replicate analyses *(n-1.1-a = 0.99) = Scents' t-value appropriate to a 99% confidence level and a standard deviation estimate with n-1 degrees of freedom For more information, see "Preparation Aids...," Category I, Section 12.0 15 ------- Category I CORRECTIVE ACTION Q, What exactly is a "corrective action "plan? A. It's a contingency plan spelled out in IF...THEN... statements. ("IF this happens, THEN we will do the following.") For each measurement critical to the success of your project, discuss the following: Trigger points What pre-specified conditions will automatically require corrective action? Personnel Who initiates, approves, implements, evaluates, and reports corrective action? Response What specific procedures will you use when corrective action is needed? For more information, see "Preparation Aids...," Category I, Section 13.0 16 ------- Category I QUALITY CONTROL REPORTS TO MANAGEMENT What is the main purpose of this section? It helps you do several things: (1) identify the Individuals responsible for reporting; (2) describe the form and contents of all anticipated reports; and (3) present QC data so that management can monitor your data quality effectively. Here are some things to describe: Individuals preparing and receiving reports Type of report Written or oral, frequency - Interim or final (QA/QC reporting is required In Final Reports) Content of various reports - Changes in QA Project Plan Summary of QA/QC programs, training, and accomplishments Results of technical systems and performance evaluationaudits Significant QA/QC problems, recommended solutions, and results of corrective actions Data quality assessment in terms of precision, accuracy, representativeness, copleteness, comparability, and method detection limit Discussion of whether the QA objectives were met, and the resulting impact on technical conclusions and regulatory actions Limitations on use of the measurement data, and discussion of the effects of such limitations on the legal defensibility of the data For more information, see "PreparationAids...," Category I, Section 14.0 17 ------- Category I REFERENCES Q, Are references mandatory, and must they be placed in a separate section? ft. Specific references to primary methods, procedures, validation studies, and supporting information required for the project are mandatory, but they need not be placed in a separate reference section. You can also cite references in the body of the text or as footnotes. If any reference is not readily available, attach a photocopy to your QA Project Plan. Wherever you put the references, make sure they include the following information: Author Title Source, date, edition Volume, page, year Document number For more information, see "Preparation Aids...," Category I, Section 15.0 ------- Category I OTHER ITEMS Q, What else is needed? y\.. Before you begin to write a Category I QA Project Plan, Data Quality Objectives (DQOs) must be developed for the project. A definitive discussion of the DQO development process is given In "Preparation Aids,..," Category I, Appendix A. After you have written the QA Project Plan, you need a technical editor to ensure that your document Is ready to be submitted for review. Make sure vour document has the followina items: A signed QA Project Plan approval form Title page, table of contents, and distribution list, Including subcontractors when applicable EPA-approved document control format, as shown below, in the upper right-hand corner of each page: Section No.: 5.0 Revision: 0 Date: June 22, 1987 Page: I of 6 A good, clear, writing style with correct grammar and spelling Inclusion of all appendices, attachments, and figures cited -REMEMBER- Your QA Project Plan explains YOUR reguirements to the sampling team, analytical laboratory, management, and all other interested parties. Make sure it is well organized and complete to do this critical job effectively. 19 ------- Category II PROJECT DESCRIPTION Q, How detailed should the description be? %.. A technical person unfamiliar with your project must be able to understand what you've written. Be sure to include: General overview Statement of the decision to be made or the question to be answered - Purpose of the study in quantitative terms Description of the site, facility, process, or operating parameters to be studied - Anticipated uses of the results Consequences of Incorrect decisions or conclusions based on these results Experimental design features - List of ail measurements, differentiating the critical measurement (i.e., process and analytical measurements essential to achieving project objectives) from the non-critical measurements Description of that portion of the environment or physical system to which decisions or conclusions will be applied Summary table covering the following for each sampling location Total number of samples (including primary, quality control, andreserve) - Type of sample (air, water, soil, etc.) All measurements planned for each sample Project start-up and ending dates, including preliminary studies and field and laboratory activities For more information, see "Preparation Aids...," Category II, Section 1.0 20 ------- Category II PROJECT ORGANIZATION AND RESPONSIBILITIES Q, What's the most Important thing to do here? fl. Name all key Individuals in charge of every major activity in your project. This applies to your subcontractors, too. Also include: A detailed organizational chart showing management structure and lines of communication Telephone numbers to facilitate communication between project officials Both technical and QA/QC functions An independent QA coordinator Geographical locations of contractors and subcontractors Procedures for monitoring subcontractors Description of type, frequency, and mechanisms of com- munication between contractor and subcontractors, and amongsubcontractors Description of type, frequency, and mechanisms of com- munication among the contractor, the contractor's project quality assurance officer, and the EPA project officer For more information, see "PreparationAids...," Category II, Section 2.0 ------- Category QUALITY ASSURANCE OBJECTIVES Qj What's the most common reason for a QA Project P/an getting a NOT APPROVED rating? !A. Inadequate treatment of QA objectives. These QA objectives must be defined In terms of project requirements, not In terms of the capabilities of the test methods used. Make sure you cover the following for each critical measurement and each matrix: Summary table of quantitative QA objectives Method detection limit - Precision, both within and between samples - Accuracy Completeness (as required to achieve a specific, statistical level of confidence) Discussion of qualitative QA objectives - Representativeness - Comparability - Others, as applicable Discussion of how not meeting the QA objectives will affect decision making For more information, see "PreparationAids...," Category II, Section 3.0 ------- Category SITE SELECTION AND SAMPLING PROCEDURES Q, How important is this section? 5\. Very important, because collecting representative samples in both time and space is crucial to subsequent decision making. Obtaining good analytical results on non-representative samples is dangerous because such results could lead to incorrect decisions. Your QA Project Plan must describe the following: Sampling site selection Scientific and regulatory objectives for sampling, including analyte concentrations of interest Statistical method or scientific rationale for choosing sampling sites and sampling frequencies Extent to which the site selection will affect the validity of the resulting data and the project objectives Sampling site description - Chart, map, etc., showing sampling sites - Site-specific factors affecting sampling - Critical process measurements (Continued) For more information, see "PreparationAids...," Category II, Section 4.0 23 ------- Category II SITE SELECTION AND SAMPLING PROCEDURES (Cont.) Sampling procedures - List of analytes and sample volumes to be collected Sampling methods (composite, grab, etc.) EPA-approved or other validated standard methods-cite by reference Non-standard or modified methods-describe fully Preparation and cleaning of sampling equipment, containers, reagents, and supplies Calibration of equipment Preservation, transportation, and storage - Holding times of samples, before and after extraction, as applicable Whenever possible, include standard operating procedures (SOPs) to fulfill the above requirements Sample custody concerns Names of sample custodians - Records of sample acquisition data Records of sample preservation methods Examples of labels and custody seals Forms for field and lab tracking - Records of field and lab chain-of-custody - Procedures for transferring samples from field to lab, within lab, and among contractor and subcontractors - Whenever possible, include SOPS to fulfill the above requirements For more information, see "Preparation Aids...," Category II, Section 4.0 24 ------- Category II ANALYTICAL PROCEDURES AND CALIBRATION Q, What factors are critical in selecting analytical methods? A. The methods must be appropriate for all analytes in the specific matrix at the anticipated concentrations. They require extensive validation to show that they meet your QA objectives. Include the followfna in vour QA Project Plan: (Note: Use a summary table whenever possible.) EPA-approved or other validated, standard methods Reference sample preparation and analysis methods for both critical and non-critical measurements for all matrices to be studied. Cite by reference if method validation data are appropriate for your critical measurements. Describe your data validation plans for all critical measurements if existing validation data are inappropriate. Non-standard or modified methods Include sample preparation and analysis methods for all measurements for ail matrices. Describe data validation plans for all critical measurements. Whenever possible, include SOPs to fulfill the above requirements. Calibration procedures Reference EPA-approved or standard methods. Describe non-standard or modified methods fully. List standards, Including source, traceability, and purify checks. Describe frequency of calibration checks. Define acceptance criteria for all calibration measurements. For more information, see "PreparationAids...," Category li, Section 5.0 25 ------- Category II DATA REDUCTION, VALIDATION, AND REPORTING Q, What's the main purpose of this section? ft.. You want to collect good data. This section shows how you plan to maintain good data quality throughout data reduction, transfer, storage, retrieval, and reporting. Here are topics to discuss: Data reduction - Names of individuals responsible Summary of data reduction procedures Summary of statistical approach for reducing data, including units and definitions of terms - Examples of data sheets - Description of how results on blanks will be treated in the calculations Data validation - Names of individuals responsible - Procedures for determining outliers and flagging data - identification of critical control points Data reporting - Names of individuals responsible Flowchart of the data handling process, covering all data collection, transfer, storage, recovery, and processing steps, and including QC data for both field andlaboratory - Identification of critical control points For more information, see "PreparationAids...," Category II, Section 6.0 26 ------- Category II INTERNAL QUALITY CONTROL CHECKS Q, What determines which QC checks are needed? A. The QA objectives for your project and the anticipated uses of your results. QC checks apply to both field and laboratory activities. List the type and number of QC checks, including acceptancecriteria. Here are some QC checks to consider: (Note: Use a summary table whenever possible.) Samples* - Collocated, split, replicate Spikes* Matrix spikes and matrix spike duplicates -Spiked blanks Surrogates and Internal standards Others - Standard reference materials Blanks (field, trip, method, reagent, Instrument) Zero and span gases - Mass tuning for mass spectral analyses Confirmation with second column for gas chromatographic analyses - Control charts Calibration standards - Proficiency testing of analysts - Any additional checks required by the special needs of your project * Identify all stages In the sampling and analytical process where the QC activity will occur. For more Information, see 'Preparation Aids...," Category II, Section 7.0 27 ------- Category PERFORMANCE AND SYSTEMS AUDITS Q, What information is most important here? %.. A schedule of all planned performance evaluation audits and technical systems audits. Be sure to include: Schedule of all contractor- and EPA-planned audits Personnel responsible for audits Explanation if no audits are planned Schedule for any interlaboratory performance evaluation studies For more information, see "Preparation Aids...," Category II, Section 8.0 28 ------- Category II CALCULATION OF DATA QUALITY INDICATORS Q, What tells me if my data quality is "good enough"? A. Detailed planning of data assessment procedures as summarized here, Including statistical treatment planned, equations, units, and assessment frequency. Make sure everything agrees with the QA objectives. You and other data users can then make the needed comparisons. Here s now to calculate your results: Precision If calculated from duplicate measurements: RPD = (C-L - C2) x 100% C2)/2 RPD = relative percent difference Ci = larger of the two observed values C2 = smaller of the two observed values If calculated from three or more replicates, use relative standard deviation (RSD) rather than RPD: RSD = (s/y) xlOO% RSD = relative standard deviation s = standard deviation y = mean of replicate analyses (Continued) For more information, see "Preparation Aids...," Category II, Section 9.0 29 ------- Category CALCULATION OF DATA QUALITY INDICATORS (Cont.) Standard deviation, s, is defined as follows: B = n z 1=1 - y)2 n - 1 s = standard deviation y,= measured value of the / th replicate y =mean of replicate measurements n = number of replicates Accuracy - For measurements where matrix spikes are used: %R = 100% x I S - U sa I %R = percent recovery S = measured concentration In spiked aliquot U = measured concentration in unspiked aliquot Csa = actual concentration of spike added For situations where a standard reference material (SRM) is used Instead of or in addition to matrix spikes: %R = 100% x m srm (Continued) For more information, see "Preparation Aids...," Category II, Section 9.0 30 ------- Category II CALCULATION OF DATA QUALITY INDICATORS (Cont.) %R = percent recovery Cm = measured concentration of SRM Csrm = actual concentration of SRM Completeness (statistical) Defined as follows for all measurements: %C = 100% x n %C = percent completeness V = number of measurements judged valid n = total number of measurements necessary to achieve a specified statistical level of confidence In decision making Method detection limit Defined as follows for all measurements: MDL=t _ _ MDL.= method detection limit S = standard deviation of the replicate analyses l(n-1,1-a = 0.99) =Students' t-value appropriate to a 99% confidence level and a standard deviation estimate with n-1 degrees of freedom For more information, see "PreparationAids...," Category II, Section 9.0 ------- Category CORRECTIVE ACTION Q, What exactly Is a "corrective action"plan? A. It's a contingency plan spelled out in IF...THEN... statements. ("IF this happens, THEN we will do the following.") For each measurement critical to the success of your project, discuss the following: What pre-specified conditions will automatically require correctiveaction? Personnel Who initiates, approves, Implements, evaluates, and reports correctiveaction? Response What specific procedures will you use when corrective action Is needed? For more information, see "PreparationAids...," Category II, Section 10.0 32 ------- Category QUALITY CONTROL REPORTS TO MANAGEMENT Q, What is the main purpose of this section? %.. It helps you do several things: (1) identify the individuals responsible for reporting; (2) describe the form and contents of all anticipated reports; and (3) present QC data so that management can monitor your data quality effectively. Here are some things to describe: Individuals preparing and receiving reports Type of report - Written or oral, frequency - Interim or final (QA/QC reporting is required in Final Reports) Content of various reports - Changes in QA Project Plan Summary of QAIQC programs, training, and accomplishments - Results of technical systems and performance evaluation audits Significant QA/QC problems, recommended solutions, and results of corrective actions - Data quality assessment in terms of precision, accuracy, representativeness completeness, comparability, and method detection limit Discussion of whether the QA objectives were met, and the resulting impact on decision making Limitations on use of the measurement data For more information, see "Preparation Aids...," Category II, Section 11.0 33 ------- Category II REFERENCES Q, Are references mandatory,and must they be placed in a separate section? &. No to both questions. You can also cite references in the body of the text or as footnotes. If any reference Is not readily available, attach a photocopy to your QA Project Plan. Wherever you put the references, make sure they include the following information: Author Title Source, date, edition Volume, page, year Document number For more information, see "PreparationAids...," Category II, Section 12.0 34 ------- Category OTHER ITEMS Q, What else Is needed? H\.. A technical editor to ensure that your document Is ready to be submitted for review. Make sure your document has the following itemr A signed QA Project Plan approval form Title page, table of contents, and distribution list, including subcontractors when applicable EPA-approved document control format as shown below, in the upper right-hand comer of each page: Section No.: 5.0 Revision: Date: June 22, 1987 Page: 1 of6 A good, clear, writing style with correct grammar and spelling Inclusion of all appendices, attachments, and figures cited -REMEMBER- Your QA Project Plan explains YOUR requirements to the sampling team, analytical laboratory, management, and all other Interested parties. Make sure it is well organized and complete to do this critical job effectively. 35 ------- Category PROJECT DESCRIPTION Q, How detailed should the description be? &. A technical person unfamiliar with your project must be able to understand what you've written. Be sure to include: General overview - Statement of the decision to be made or the question to be answered - Description of the site, facility, process, or operating parameters to be studied - Anticipated uses of the results - Consequences of incorrect decisions or conclusions based on these results Experimental design features List of ail measurements, differentiating the critical measurements (i.e., process and analytical measurements essential to achieving project objectives) from the non-critical measurements Summary table covering the following for each sampling location: - Total number of samples (including primary, quality control, and reserve) - Type of sample (air, water, soil, etc.) - All measurements planned for each sample Project start-up and ending dates, including preliminary studies and field and laboratory activities (Continued) For more information, see 'Preparation Aids...," Category III, Section 1.0 36 ------- Category III PROJECT DESCRIPTION (Cont.) Project responsibilities Identification of all key technical and QA/QC personnel of contractor and subcontractors Designation of an independent QA/QC coordinator Communication procedures Procedures for monitoring subcontractors Communicating within and across project areas of responsibility - Reporting to EPA For more information, see "PreparationAids...," Category III, Section 1.0 37 ------- Category III QUALITY ASSURANCE OBJECTIVES What's the most common reason for a QA Project Plan getting a NOT APPROVED rating? Inadequate treatment of QA objectives. These QA objectives must be defined In terms of project requirements, not In terms of the capabilities of the test methods used. Make sure you cover the following for each critical measurement and each matrix: Summary table of quantitative QA objectives - Method detection limit Precision, both within and between samples - Accuracy - Completeness Discussion of qualitative QA objectives - Representativeness - Comparability - Others, as applicable Discussion of how not meeting the QA objectives will affect decision making For more Information, see "PreparationAids...," Category III, Section 2.0 38 ------- Category III SITE SELECTION AND SAMPLING PROCEDURES Q, How important is his section? %.. Very important, because collecting representative samples In both time and space is crucial to subsequent decision making. Obtaining good analytical results on non-representative samples Is dangerous because such results could lead to incorrectdecisions. Your QA Project Plan must describe the following: Sampling site selection - Scientific objectives for sampling, including analyte concentrations of interest - Statistical method or scientific rationale for choosing sampling sites and/or process sampling points, and samplingfrequencies - Extent to which the site selection and/or process sampling points will affect the validity of the resulting data and the project objectives Sampling site description - Chart, map, process diagram, etc., showing sampling sites Critical process measurements. (Continued) For more information, see "PreparationAids...," Category III, Section 3.0 39 ------- Category SITE SELECTION AND SAMPLING PROCEDURES (Cont.) Sampling procedures - List of analytes and sample volumes to be collected - Sampling methods (composite, grab, etc.) EPA-approved or other validated standard methods-cite by reference Non-standard or modified methods-describe fully - Preparation and cleaning of sampling equipment, containers, reagents, and supplies - Calibration of equipment - Preservation, transportation, and storage - Holding times of samples, before and after extraction, asapplicable - Whenever possible, Include standard operating procedures (SOPs) to fulfill the above requirements. Sample custody concerns - Names of sample custodians - Procedures for transferring samples from field to lab, within lab, and among contractor and subcontractors - Whenever possible, Include SOPS to fulfill the above requirements For more Information, see "PreparationAids...," Category III, Section 3.0 40 ------- Category III ANALYTICAL PROCEDURES AND CALIBRATION Q, What factors are critical In selecting analytical methods? A. The methods must be appropriate for all analytes In the specific matrix at the anticipated concentrations. They require validation to show that they meet your QA objectives. Include tho following in your QA Project Plan: (Note: Use a summary table whenever possible.) EPA-approved or other validated, standard methods - Reference sample preparation and analysis methods for both critical and non-critical measurements for all matrices to be studied. - Cite by reference If method validation data are appropriate for your critical measurements. Describe your data validation plans for all critical measurements If existing validation data are Inappropriate. Non-standard or modified methods Include sample preparation and analysis methods for all measurements for all matrices to be studied. - Describe data validation plans for all critical measurements. Whenever possible, include SOPS to fulfill the above requirements. Calibration procedures Reference EPA-approved or standard methods. Describe non-standard or modified methods fully. - List standards, including source, traceability, and purity checks. Describe frequency of calibration checks. Define acceptance criteria for all calibration measurements. For more information, see "Preparation Aids...," Category III, Section 4.0 41 ------- Category DATA REDUCTION, VALIDATION, AND REPORTING Q, What's the main purpose of this section? A. You want to collect good data. This section shows how you plan to maintain good data quality throughout data reduction, transfer, storage, retrieval, and reporting. Here are topics to discuss: Data reduction - Names of individuals responsible Summary of data reduction procedures Summary of statistical approach for reducing data, including units and definitions of terms Examples of data sheets Description of how results on blanks will be treated In the calculations Data validation Names of Individuals responsible - Procedures for determining outliers and flagging data Data reporting Names of individuals responsible Flowchart of the data handling process, covering all data collection, transfer, storage, recovery, and processing steps, and Including QC data for both field andlaboratory For more Information, see 'Preparation Aids...; Category III, Section 5.0 42 ------- Category III INTERNAL QUALITY CONTROL CHECKS Q, What determines which QC checks are needed? A. The QA objectives for your project and the anticipated uses of your results. QC checks apply to both field and laboratory activities. State the type and number of QC checks, including acceptancecriteria. Here are some QC checks to consider: (Note: Use a summary table whenever possible.) Samples* - Collocated, split, replicate Spikes* - Matrix spikes and matrix spike duplicates - Spiked blanks - Surrogates and internal standards Others - Standard reference materials - Blanks (field, trip, method, reagent, Instrument) Zero and span gases Mass tuning for mass spectral analyses - Confirmation with second column for gas chromatographic analyses - Control charts Calibration standards - Proficiency testing of analysts Any additional checks required by the special needs of your project 'Identify all stages In the sampling and analytical process where the QC activity will occur. For more information, see "Preparation Aids...," Category III, Section 6.0 43 ------- Category PERFORMANCE AND SYSTEMS AUDITS Q, What information is most important here? %.. A schedule of all planned performance evaluation audits and technical systems audits. Be sure to Include: Schedule of all contractor-planned audits Schedule for any interlaboratory performance evaluation studies For more Information see "Preparation Aids.../Category III, Section 7.0 44 ------- Category III CALCULATION OF DATA QUALITY INDICATORS Q, What tells me if my data quality is "good enough"? A. Detailed planning of data assessment procedures as summarized here, including statistical treatment planned, equations, units, and assessment frequency. Make sure everything agrees with the QA objectives. You and other data users can then make the needed comparisons. Here's how to calculate your results: Precision If calculated from duplicate measurements: RPD - c2) x 100% -L + C2)/2 RPD = relative percent difference C, = larger of the two observed values C2= smaller of the two observed values If calculated from three or more replicates, use relative standard deviation (RSD) rather than RPD: RSD = (s/y) x 100% RSD = relative standard deviation s = standard deviation y = mean of replicate analyses (Continued) For more information, see "Preparation Aids...," Category III, Section 8.0 45 ------- Category III CALCULATION OF DATA QUALITY INDICATORS (Cont.) Standard deviation,s, Is defined as follows: 8 = - 2 z 1=1 n - 1 s = standard deviation y,= measured value of the / th replicate 9 = mean of replicate measurements n = number of replicates Accuracy - For measurements where matrix spikes are used: %R = 100% x s - u sa %R = percent recovery S = measured concentration in spiked aliquot U = measured concentration In unspiked aliquot Csa = actual concentration of spike added - For situations where a standard reference material (SRM) is used instead of or In addition to matrix spikes: %R = 100% m arm (Continued) For more information, see "Preparation Aids...."Category III, Section 8.0 46 ------- Category CALCULATION OF DATA QUALITY INDICATORS (Cent.) %R = percent recovery Cm= measured concentration of SRM Csrm=actual concentration of SRM Completeness (sampling and analytical) Defined as follows for all measurements: %C = 100% x %C = percent completeness V = number of measurements judged valid T = total number of measurements Method detection limit Defined as follows for all measurements: MDL=t _ MDL = method detection limit S = standard deviation of the replicate analyses '(n-1 1-e» = 099) f Students' t-value appropriate to a 99% confidence level and a standard deviation estimate with n-1 degrees of freedom For more information, see "Preparation Aids...," Category III, Section 8.0 47 ------- Category CORRECTIVE ACTION Q, What exactly is a "corrective action "plan? A. It's a contingency plan spelled out in IF...THEN... statements. ("IF this happens, THEN we will do the following.") For each measurement critical to the success of your project, discuss the following: Trigger points What pre-specified conditions will automatically require correctiveaction? Personnel Who initiates, approves, implements, evaluates, and reports corrective action? Response What specific procedures will you use when corrective action is needed? For more information, see "Preparation Aids...," Category III, Section 9.0 48 ------- Category III QUALITY CONTROL REPORTS TO MANAGEMENT What is the main purpose of this section? It helps you do several things: (1)identify the individuals responsible for reporting; (2) describe the form and contents of all anticipated reports; and (3) present QC data so that management can monitor your data quality effectively. Here are some thinas to describe: Individuals preparing and receiving reports Type of report - Written or oral, frequency - Interim or final (QA/QC reporting is required In Final reports) Content of various reports - Changes in QA Project Plan - Results of technical systems and performance evaluation audits - Significant QA/QC problems, recommended solutions, and results of corrective actions - Data quality assessment in terms of precision, accuracy, representativeness.completeness, comparability, and method detection limit - Discussion of whether the QA objectives were met, and the resulting impact on decision making - Limitations on use of the measurement data For more information, see "Preparation Aids...," Category III, Section 10.0 49 ------- Category REFERENCES Q, Are references mandatory, and must they be placed in a separatesection ? A. No to both questions. You can also cite references in the body of the text or as footnotes. If any reference is not readily available, attach a photocopy to your QA Project Plan. Wherever you put the references, make sure they include the following information: Author Title Source, date, edition Volume, page, year Document number For more Information, see 'Preparation Aids...," Category III, Section 11.0 50 ------- Category OTHER ITEMS Q, What else is needed? y\.. A technical editor to ensure that your document is ready to be submitted for review. Make sure vour document has the followma items: A signed QA Project Plan approval form Title page, table of contents, and distribution list, including subcontractors when applicable EPA-approved document control format as shown below, in the upper right-hand comer of each page: Section No.: 5.0 Revision: o Date: June 22, 1987 Page: 1 of6 A good, clear writing style with correct grammar and spelling Inclusion of all appendices, attachments, and figures cited ~ REMEMBER~ Your QA Project Plan explains YOUR requirements to the sampling team, analytical laboratory, management, and all other interested parties. Make sure it is well organized and complete to do this critical job effectively. ------- Category IV PROJECT DESCRIPTION Q, How detailed should the description be? %.. A technical person unfamiliar with your project must be able to understand what you've written. General overview - Statement of the question to be answered - Description of the site, facility, process, or operating parameters to be studied - Anticipated uses of the results - Consequences of Incorrect decisions or conclusions based on these results Experimental design features - List of all measurements, differentiating the critical measurements (I.e., process and analytical measurements essential to achieving project objectives) from the non-critical measurements - Summary table covering the following for each sampling location: - Projected number of samples (including primary, quality control, and reserve) - Type of sample (air, water, soil, etc.) - All measurements planned for each sample Project start-up and ending dates, Including preliminary studies and field and laboratory activities Project responsibilities - Identification of all key technical and QA/QC personnel of contractor and subcontractors For more information, see "Preparation Aids...," Category IV, Section 1.0 62 ------- Category IV QUALITY ASSURANCE OBJECTIVES Q, What's the most common reason for a QA Project Plan getting a NOT APPROVED rating? 5\. Inadequate treatment of QA objectives for precision, accuracy, and limits of detection needed for each critical measurement. These QA objectives should be defined in terms of project requirements, not in terms of the capabilities of the test methods used. Make sure you cover the following for each critical measurement and each matrix: Summary table of quantitative QA objectives Method detection limit - Precision - Accuracy Discussion of qualitative QA objectives - Sample acceptance/rejection criteria - Representativeness - Comparability - Others, as applicable Discussion of how not meeting the QA objectives will affect decision making Note: Category IV projects are allowed a wide latitude in defining the specific QA objectives and methods involved. The important thing to remember here is that project-specific QA objectives and methods must be established. For more information, see "Preparation Aids...," Category IV, Section 2.0 63 ------- Category IV SAMPLING AND ANALYTICAL PROCEDURES Q, What factors are critical in selecting the procedures? &. The sampling procedures must be appropriate for the collection of a representative sample and the analytical methods must be appropriate for all analytes in the specific matrix at the anticipated concentrations. Analytical methods may be non-standard or state-of-the-art, but must be validated to show that they meet your QA objectives. Include the following in your QA Project Plan: (Note: Use a summary table whenever possible.) Sampling procedures List of analytes and sample volumes to be collected - Sampling methods (composite, grab, etc.) - Preparation and cleaning of sampling equipment, containers, reagents, and supplies - Preservation.transportation, and storage - Holding times of samples, before and after extraction, as applicable Whenever possible, include SOPs to fulfill the above requirements. EPA-approved or other validated standard methods - Reference sample preparation and analysis methods for both critical and non-critical measurements for all matrices. (Continued) For more information, see "Preparation Aids,../'Category IV, Section 3.0 54 ------- Category IV SAMPLING AND ANALYTICAL PROCEDURES (Cont.) Non-standard or modified methods - Include sample preparation and analysis methods for both critical and non-critical measurements for all matrices. - Describe data validation plans for all critical measurements. - Whenever possible, include SOPS to fulfill the above requirements. Calibration procedures - Reference EPA-approved or standard methods. - Describe non-standard or modified methods fully. - Describe frequency of calibration checks. - Define acceptance criteria for all calibration measurements. For more information, see "Preparation Aids...," Category IV, Section 3.0 66 ------- Category IV APPROACH TO QA/QC Q, What is important in planning a good approach to quality assurance and quality control for a project? &. You want to collect good data, and you want to be able to evaluate how good your data are. In this section, you show how you plan to(1) maintain good data quality during the calculation and reporting of results, (2) perform the specific internal QC activities needed to evaluate the quality of the data, and (3) calculate the data quality Indicators for precision, accuracy, and method detection limit. Here are tonics to discuss: Calculation of results - Summary of statistical approach for reducing data, including units and definitions of terms - Procedures for determining outliers and flagging data Internal QC checks (Use a summary table if possible. Identify the frequency and at what stage In the analytical process each QC activity will occur.) - Collocated, split, or replicate samples Matrix spikes and matrix spike duplicates Spiked blanks Surrogates and internal standards Standard reference materials - Blanks (field, trip, method, reagent, instrument) - Zero and span gases Mass tuning for mass spectral analyses - Control charts Calibration standards - Any additional checks required by the special needs of your project (Continued) For more information, see "Preparation Aids...."Category IV, Section 4.0 66 ------- Category IV APPROACH TO QA/QC (Cont.) Calculation of data quality indicators - Precision If calculated from duplicate measurements: (C1 - C2) x 100% RPD = + c2)/2 RPD = relative percent difference C,= larger of the two observed values C2= smaller of the two observed values If calculated from three or more replicates, use relative standard deviation (RSD) rather than RPD: RSD = (s/y) x 100% RSD = relative standard deviation s = standard deviation Y = mean of replicate analyses Standard deviation,s, is defined as follows: 8 = - 2 n (y. - y) y - n - 1 (Continued) For more information, see "Preparation Aids.,.."Category IV, Section 4.0 57 ------- Category IV APPROACH TO QA/QC (Cont.) s = standard deviation y,= measured value of the / th replicate y =mean of replicate measurements n = number of replicates Accuracy For measurements where matrix spikes are used: %R = 100% x s - u sa %R= percent recovery S = measured concentration In spiked aliquot U = measured concentration in unspiked aliquot Csa = actual concentration of spike added For situations where a standard reference material (SRM) is used instead of or in addition to a matrix spike: %R = m arm %R = percent recovery Cm= measured concentration of SRM Csrm = actual concentration of SRM (Continued) For more information, see "Preparation Aids.../'Category IV, Section 4.0 68 ------- Category IV APPROACH TO QA/QC (Cont.) Method detection limit Defined as follows for all measurements: MDL = = (n-1,1- a = 0.99) MDL = method detection limit S = standard deviation of the replicate analyses - Students' t-value appropriate to a 99% confidence level and a standard deviation estimate with n-1 degrees of freedom For more information, see "Preparation Aids.../'Category IV, Section 4.0 69 ------- Category IV REFERENCES Q, Are references mandatory, and must they be placed in a separate section ? R. No to both questions. You can also cite references in the body of the text or as footnotes. If any reference Is not readily available, attach a photocopy to your QA Project Plan. Wherever you put the references, make sure they include the following information: Author Title Source, date, edition Volume, page, year Document number For more information, see "Preparation Aids...."Category IV, Section 5.0 60 ------- Category IV OTHER ITEMS Q, What else is needed? A. A technical editor to ensure that your document is ready to be submitted for review. Make sure your document has the following items: A signed QA Project Plan approval form Title page, table of contents, and distribution list, including subcontractors when applicable Inclusion of all appendices, attachments, and figures cited -REMEMBER ~ Your QA Project Plan explains YOUR requirements to the sampling team, analytical laboratory, management, and all other interested parties. Make sure it is well organized and complete to do this critical job effectively. 81 ------- NOTES 62 ------- |