Chesapeake Bay Program
 A Watershed Partnership
                                          EPA903-R-00-016
                                           CBP/TRS 248/00
                                               July 1999
                                         Reprinted June 2001
Environmental Outcome-Based Management:
  Using Environmental Goals and Measures
        in the Chesapeake Bay Program
                                  EPA Report Collection
                                  Regional Center for Environmental Information
                                  Philadelphia, PA 19103

-------
Regional Center for Environmental Information
            US EPA Region HI
               1650 Arch St.
           Philadelphia, PA 19103

-------
FORWARD

The Chesapeake Bay Program is the unique regional partnership of federal, state and local govern-
ment agencies which has been leading the restoration of the Chesapeake Bay since the signing of the
first Chesapeake Bay Agreement in 1983. The Bay is one of the most carefully monitored bodies of
water in the world, and a considerable amount of information on environmental conditions has been
collected. Over the past decade, the U. S. Environmental Protection Agency  (EPA) and its Chesa-
peake Bay Program partners have maintained a systematic approach for the use of this information
to inform the public about the state of the Bay, to establish measurable restoration goals, and to
inform many other program management decisions. EPA believes that much of the progress of this
restoration program can be attributed to its partnership approach and the participants'  willingness to
set bold,  long-term environmental goals and to use environmental and other outcome measures to
monitor results and inform the public. Lessons  learned from this program may be of particular
interest to other natural resource agencies and to any governmental entity with interest in outcome-
based management.

This document has been a collaborative effort of managers and staff of the EPA Region  3 Chesa-
peake Bay Program Office.
                                                    - New York
                For more information about the Chesapeake Bay Program, call 1-800-YOUKBAY,
                        or visit the Bay Program web-site at www.chesapeakebay.net

                    Recycled/Recyclable - Printed on Recycled Paper 30% Post Consumer

-------
                           TABLE OF CONTENTS

                                                                          Page

FORWARD	i

TABLE OF CONTENTS	ii

INTRODUCTION	1

1.     ESTABLISHING ENVIRONMENTAL OUTCOME-BASED MANAGEMENT	5

      •     Monitoring Program	5
      •     Development of Environmental Outcome Measures	5
      •     Challenges Faced	7

2.     CHESAPEAKE BAYPROGRAM ENVIRONMENTAL INDICATORS	9

      •     Environmental Indicator Framework	9
      •     Review and Development of Indicators	10
      •     Indicator Products	11
      •     Requests and Feedback	12

3.     MANAGING FOR ENVIRONMENTAL RESULTS	15

      •     Program Planning and Assessment	15
      •     Targeting Resources	15
      •     Environmental Impacts of Results-Based Management	16
      •     Continuing Challenges	16

FUTURE DIRECTIONS	19

APPENDICES:
      A.    CBP Organizational Structure
      B.    CBP Measurable Environmental Commitments
      C.    CBP Environmental Indicators: Categorization Framework
      D.    CBP Environmental Indicators: Development and Approval Process
                            Chesapeake Bay Program
                             A Watershed Partnership

-------
INTRODUCTION
The Chesapeake Bay Program
is the premier watershed resto-
ration effort currently
underway in the United States.
It proceeds from a congression-
ally-funded $27 million,
five-year study undertaken in
the mid 1970s, when scientists
began to observe the loss of
living resources and the public
became concerned about
environmental degradation in
general. The study identified
the main source of the Bay's
degradation as an  oversupply of
nutrients entering  the Bay, and
advocated programs that would
limit nutrient loadings from
point sources like  wastewater
treatment plants and nonpoint
sources like fertilizer running
off farmland. The historic
Chesapeake Bay Agreement of
1983, signed by the governors
of Maryland, Pennsylvania and
Virginia, the mayor of the
District of Columbia, the
administrator of the Environ-
mental Protection  Agency
(EPA) for the United States
government and the chair of the
Chesapeake Bay Commission,
representing the state legisla-
tures of the three states, called
for all jurisdictions and agen-
cies to focus their existing
pollution control programs on
reducing nutrient loads to the
Bay. Subsequent  agreements
and amendments in 1987 and
1992 reflected a strong ecosys-
tem management approach
stressing the interdependent
        The Chesapeake Bay Program Partnership
        Governor of MD
               HI
Governor of VA
                                         Governor of PA
       EPA Administrator
                        Executive Council '
           ^^^S
                         Cheoapcakt B»y Program
                         ^ A Wttrahrd ftrlnmtfp
                 Chair of   ,
               Chesapeake -,
                  Bay
               Commission
relationships between living
resources and their environ-
ment, and included
commitments to a set of spe-
cific and far-reaching goals tied
to the restoration of the health
of the Bay.  The latest agree-
ment, called Chesapeake 2000,
is the most comprehensive and
far-reaching agreement in the
Bay Program's history. Most
commitments in the new
agreement are scheduled for
completion by 2010.

The Bay Program is a volun-
tary, consensus-based effort
focused on an interstate water-
shed, and built on top of the
national and state level environ-
mental regulatory programs.
The Bay Program carries out its
work through a series of com-
mittees, advisory committees
and subcommittees which
guide and advise the program
in all aspects of Bay restoration
activities (see Appendix A).
      The chief governing board of
      the program, the Chesapeake
      Executive Council, is com-
      prised of the Bay Agreement
      signatories and meets annually.
      EPA represents all federal
      agencies, and currently, there
      are 22 agencies and depart-
      ments participating as Bay
      Program partners. Formal
      advisory committees for citi-
      zens, the scientific community,
      and local governments serve as
      sounding boards for program
      policy and report to the Execu-
      tive Council at the annual
      meeting. A policy level Princi-
      pals' Staff Committee, which
      includes the chief environmen-
      tal and policy representatives of
      the governors, mayor and Bay
      Commission, and  the EPA
      Regional Administrator, meet
      several times a year.  Ongoing
      management of the program is
      by the Implementation Com-
      mittee which meets every six
      weeks and includes representa-

-------
lives of Bay Agreement signa-
tories, federal agencies, and
chairs of subcommittees and
advisory committees. The
advisory committees, the
Federal Agencies Committee,
the subcommittees and
workgroups meet regularly and
play important roles in program
development and implementa-
tion.  Because the solutions to
the Bay's problems require the
active involvement and, to a
great extent, behavioral
changes on the part of industry,
governments and the public,
widespread understanding of
Bay problems and their causes
is very important.

EPA's Chesapeake Bay Pro-
gram Office was established in
1984 to coordinate the activi-
ties, investigations, and
planning of the signatory
jurisdictions and the other
cooperating federal agencies.
The Bay Program Office
manages federal funds (ap-
proximately $19 million
annually), which are distributed
predominantly to states for
implementation of Bay restora-
tion activities and to others for
continuing scientific assess-
ments. The Bay Program
Office maintains the core  data
center and facilities for scien-
tific study, computer modeling
and program implementation,
and coordinates and supports
the extensive committee struc-
ture reporting to the Executive
Council.
Environmental
Outcome-Based
Management

The availability and use of
environmental outcome infor-
mation has had a profound
effect on the operation of the
Chesapeake Bay Program. This
"managing for results" ap-
proach has brought with it new
modes of decision making and
new standards for accountabil-
ity and responsibility,
particularly to the public. The
development of environmental
indicators/outcome measures
has enabled the Bay Program to
communicate a clear and
consistent public message,
accelerated goal setting, sharp-
ened the program's ability to
garner and target resources, and
improved the program's ability
to regularly evaluate its man-
agement strategies.

Environmental indicators/
outcome measures have sup-
ported goal setting for the Bay
Program both in longer-term
Strategic  Implementation Plans
and for annual planning and
budgeting. Improvements in
data collection and analyses  to
support indicators enable
participants to set measurable
goals and commitments with a
clear baseline established. The
Bay Program has over 40
measurable goals in place at
this time and several more
under active development (see
Appendix B).
Value of Goal-Setting

The program can point to a
landmark goal adopted in 1987
for a 40% reduction in nutrient
loading by the year 2000 as the
highly successful prototype for
many subsequent goals.  It was
the origin for an outcome-based
management ethic which has
grown stronger over the years.
This single goal, adopted by the
chief executives of the program
through a voluntary agreement,
has succeeded  in leveraging
several hundreds of million
dollars in programs and private
initiatives to reduce point and
nonpoint source nutrients to the
Bay and its rivers. This goal
has been  remarkably effective
in promoting governmental
accountability  and performance
to meet the objective.

The development and formal
adoption  of a large number of
new goals has occurred since
this landmark goal was adopted
and since the indicator program
was initiated in 1991. Several
important new  goals were
adopted in the Chesapeake
2000 agreement, including the
   Growth of Measurable
   Environmental Goals
                                                                  87 88  89  90

-------
 EPA Bay Program Budget
        (fiscal year)
primary goal to improve water
quality sufficiently to sustain
the living resources of the Bay
and its tidal tributaries, by
2010, and to maintain that
water quality into the future.
This will mean setting in-
creased nutrient reduction goals
and for the  first time  setting
sediment reduction goals
Baywide.
Experience has shown that
growing public support of and
financial investment in the Bay
Program have been associated
with the development and
communication of bottom-line
environmental results. Addi-
tionally, Bay Program Office
staff believe that the increased
support given to the program in
recent years reflects the enthu-
siasm for supporting effective
federal-state-local voluntary
partnerships to address prob-
lems. Unlike many other EPA
programs, the Bay Program
does not have independent
regulatory authorities, and
strong support by state and
local governments and other
institutions is key to its success.
Coincident with vigorous
efforts to develop goals and
environmental indicators,
federal funds appropriated for
the EPA Chesapeake Bay
Program increased from ap-
proximately $13 million in FY
1991 to nearly $21 million in
FY 1996 before leveling off to
the current level of roughly $ 19
million. When matching funds
and other leveraging options
are considered, total dollars
spent by all federal agencies,
state and local governments and
other entities is significantly
higher than this total alone.
Estimates are that approxi-
mately $150 million are spent
each year by a combination of
the EPA, other federal agen-
cies, and the states.

-------
CHAPTER 1
ESTABLISHING ENVIRONMENTAL OUTCOME-BASED MANAGEMENT
Monitoring Program

The Chesapeake Bay is one of
the most carefully monitored
bodies of water in the world.
Because concern for the Bay
dates back to the 1970s, and
implementation of restoration
efforts has been going on for
over a decade, there is a consid-
erable body of scientific
information and data  on envi-
ronmental conditions in the
Bay. Consistent and  compa-
rable data on all traditional
water parameters have been
taken at over 130 sites in the
watershed and the open Bay
since 1984. The data and trend
analyses available from this
monitoring program are some
of the best in America. A
major strength of the  Chesa-
peake Bay Program's
monitoring program,  and
outcome-based management
approach, is that it does not rely
solely on EPA generated data,
but leverages and accesses
many other reliable information
sources maintained by cooper-
ating state and federal agencies
(Maryland, Pennsylvania,
Virginia and District  of Colum-
bia environmental agencies, U.
S. Geological Survey, National
Oceanic and Atmospheric
Administration, U. S. Army
Corps of Engineers, U. S. Fish
and Wildlife Service, U. S.
Forest Service).  This greatly
extends the ability to  report on
          Chesapeake Bay Monitoring Program
    Objectives:
    • Characterize existing conditions
    • Detect changes or trends in water quality
    • Understand processes and linkages between water
      quality and living resources
    Applications:
      Evaluate water quality management programs
      Calibrate and verify water quality models
      Characterize SAV habitat requirements
      Support development of living resource habitat goals
      Establish a baseline for environmental assessments
      Stimulate research projects on hypoxia, phytoplankton,
      and fish recruitment
                                  Monitoring Stations
the major aspects of the ecosys-
tem and fill any gaps in
knowledge.

Initially, these environmental
data were collected and ana-
lyzed to define the condition of
the water quality and living
resources, and to better under-
stand the nature of the Bay's
problems. These data were also
used in the development of a
watershed model to foster
understanding of Bay water
quality processes and the
sensitivity of such processes to
external nutrient loading,
determined to be the main
cause of the Bay's degradation.
From this model, in  1987, Bay
Program participants set the
core program goal of a 40
percent nutrient reduction by
the year 2000. Subsequent
monitoring data have been used
to validate this early model and
to construct other simulation
models used to assess the
effectiveness of different
pollution control strategies.
The monitoring data were
otherwise used to develop
scientific theories and strategies
for the restoration of the Bay.
Because these data serve as the
foundation of its efforts, Bay
Program staff have put special
emphasis on establishing
quality control and quality
assurance for all aspects of the
monitoring programs in the Bay
area.

Development of
Environmental Outcome
Measures

Although the environmental
data were critical to program
development, prior to 1991
they were not used systemati-
cally to inform Bay  Program
partners and the public of the
Bay's condition, environmental
                                                                                          5

-------
problems and progress being
made in the restoration. Envi-
ronmental monitoring data and
trends were presented to the
public in the triennial "State of
the Bay" reports, but the fre-
quency and presentation were
not geared to a very eager and
interested public audience.
Prior to 1995, these triennial
reports focused almost exclu-
sively on the  water quality of
the Bay, and much less atten-
tion was devoted to describing
the health and abundance of the
living resources, which have
been the primary public con-
cern.  By failing to more
frequently advise the public of
the relative importance of
environmental problems affect-
ing the Bay, the program was
losing an opportunity to dispel
some of the misinformation
surrounding the source of the
Bay's problems. For example,
in response to information
distributed by environmental
advocacy groups in the region,
many citizens believed that
toxic emissions from large
industrial sources were the key
problem in the Bay area, when
in fact, nutrient pollution from
agriculture and urban/suburban
development is the primary
problem.

Moreover, environmental
outcome information was  not
used to make or justify man-
agement decisions. Progress
was reported in terms of the
number and timeliness of
strategies,  management plans,
and other documents included
in the list of 1987 Bay Agree-
                Striped Bass Spawning Stock
        Baywide Female Spawning Stock Biomass
                     Fishing moratoria:
                    MD&DE: 1985-1990
                      VA: 1989-1990
   Source Rugoto.«. ai 1994
   Summary Report to the Striped Beea Management Board. Atlanta States Manna Fishenea
   Commiaaion
        GOAL: The goal for a
        recovered fishery is a
        spawning stock biomass
        (SSB) equal to the
        average SSBs recorded
        during 1960 through 1972.
        STATUS: Successful
        management measures
        led to decreased harvest
        pressure. The Atlantic
        States Marine Fisheries
        Commission has
        declared the stock
        restored as of
        January 1,1995.
 The briefing slides include the goal which the indicator tracks
 and a succinct summary of the status conveyed by the
 information presented.
ment commitments, rather than
the environmental results
achieved. Although strong,
long-term goals were included
in the 1987 Bay Agreement,
few intermediate measures of
environmental progress were
used. Budget requests did not
reflect past or desired program
outcomes and consequently
presented a less compelling
rationale for resources. Early
in 1991, EPA leadership de-
cided to make the program
more accountable to the public
on a day-to-day basis by defin-
ing and communicating the
bottom line environmental
results achieved by the restora-
tion program. Based on a
series of interviews with EPA
staff about primary success
measures, the Bay Program
Office began to develop a set of
environmental indicators/
outcome measures to support
goal setting and to serve as
targets and endpoints for the
restoration effort. This set was
displayed in a first version of
the currently-used briefing
package called Environmental
Indicators: Measuring Our
Progress. A cross-disciplinary
EPA quality action team was
formed to brainstorm additional
success measures and to discuss
available data bases and appro-
priate interpretation of the data.

While EPA staff began this
effort, states and other stake-
holders became involved early
on following a briefing to the
Bay Program's Implementation
Committee. The partners in the
program soon embraced the
environmental indicators
approach and it was decided to
refine the initial  structure
through the Bay Program
committee and workgroup
structure. Individual indicators
were eventually  assigned to
appropriate Bay Program
subcommittees for review,

-------
revision, approval and mainte-
nance. The subcommittees
were also responsible for
reaching consensus on which
data sets to use and how the
data used in the indicators
should be interpreted. Often
these decisions were  reached at
the workgroup level first,
where scientists and resource
managers knowledgeable in a
very specific area (such as
oyster fisheries) could have
discussions about data interpre-
tation.  Once the workgroup
members had reached consen-
sus, it was presented  to the
Subcommittee for endorsement.
This was often quite challeng-
ing since it was hard sometimes
to choose just one, or a few sets
of data to be representative of
an indicator for the whole Bay,
and even harder sometimes to
get different jurisdictions to
agree on the interpretation of
the data. Sometimes it took
many months before the discus-
sions eventually resulted in
consensus being reached.

While the briefing package was
being used quite successfully in
presentations to managers and
scientists, there were concerns
that the materials were too
technical to be useful for public
audiences.  Workshops were
subsequently held in 1994 and
1995 to build stakeholder
involvement in the design  and
refinement of the measures and
the communication products.
The stakeholders included
representatives of citizen
groups and the press.  The goal
of the workshops was to reach
consensus on clear messages
that could be used with key
indicators to help convey a
story to the public about the
overall health of the Bay and
how the water quality and
living resources were respond-
ing to restoration efforts.
  CHALLENGES FACED
 The effort to put consensus outcome measures
 in place faced several challenges along the way.
 Such challenges or obstacles include those
 listed below and are provided so as to alert
 others to the typical reactions one might antici-
 pate in an effort like this:
 • Some organizations and individuals were
 reluctant to share data for fear of its inaccurate
 or unfavorable interpretation. They expressed
 concern that inappropriate conclusions would
 be drawn or blame for poor results would be
 assigned unfairly. Given the consensus-based
 nature of this intergovernmental effort, the
 political  implications of such mistakes could be
 costly.
 • Others had invested heavily in their data
 collection and analysis and were unwilling to
 share the information due to loss of control on
 the end use or loss of credit for the extensive
 work involved.
 • In some cases, where data were available, the
 analysis required was costly or not yet in place.
 • In other cases, data and/or indicators were not
 available for some topics of special public
 interest, like fish, shellfish, and wildlife,
 because of cost or technical difficulties
                associated with obtaining data.
                • Many resisted using outcome measures to
                depict Bay Program progress because the
                environmental systems had not been thoroughly
                studied or understood in a cause and effect
                fashion; or because the results were not under
                the direct control of the program.  Impacts on
                the Bay from natural causes, such as severe
                weather conditions, and other external factors
                affect the success of restoration efforts and are
                difficult to characterize to the public.
                In spite of these obstacles, the briefing package
                contained enough valuable information that
                several Bay Program members began to use the
                materials in presentations to a wide variety of
                audiences ranging from federal and state
                environmental resource managers to scientists.
                The initial feedback to the sharing of such
                results-oriented information was extremely
                positive.  Other feedback received during these
                presentations was used to refine and improve
                the presentation materials. After seeing the
                presentation, several organizations began to
                share additional information and data that could
                be used to develop  more indicators.

-------
CHAPTER 2
CHESAPEAKE BAY PROGRAM ENVIRONMENTAL INDICATORS
Environmental
Indicator Framework

As commonly employed, an
environmental indicator is a
discreet measure of one aspect
of environmental quality that
can be used alone or in combi-
nation with other indicators to
deliver a message or tell a story
related to the overall environ-
mental health of an ecosystem.
For example, indicators based
on ambient concentrations of
nitrogen and phosphorous in an
estuary could be combined with
an indicator based on total
acreage of submerged aquatic
vegetation to tell a story about
the effects of water quality on
Bay living resources. As
additional indicators are in-
cluded, the message or story
may become more refined and
robust.

The Bay Program's environ-
mental indicators are used for
this primary purpose of com-
municating the health of the
Bay and its rivers to public
audiences.  But they also serve
several other importance
purposes in tandem. Specifi-
cally, the Bay Program's
environmental indicators were
established for five principal
purposes:
• To evaluate progress in the
Chesapeake Bay restoration
effort;
                 Hierarchy of Indicators
               This is how we measure environmental change
      Administrative
L
Environmental
Actions by
EPA/State
Regulatory
Agencies
	 1 — r=
-#-
Responses of
the Regulated
and
Nonregutated
Community
  Source EPA Oflics ol Policy, Planning and Evali
• To monitor environmental
condition and environmental
response to restoration efforts;
• To provide information
needed to establish restoration
goals;
• To regularly inform and
involve the public in achieving
the restoration goals;
• To make detailed information
and reference data for these
indicators available upon
request so that others may
participate in the tracking of
progress.

The measures are characterized
by their position in a hierarchy
from level 1 through level 6,
ranging from indicators used to
measure administrative actions,
such as issuing permits, to
those that are indirect or direct
measures of ecological or
human health. Specifically, the
six levels include:
          Level 1: Actions by EPA/State
          Regulatory Agencies
          Level 2: Responses of the
          Regulated and Non-regulated
          Community
          Level 3: Changes in
          Discharge/Emission Quantities
          Level 4: Changes in Ambient
          Conditions
          Level 5: Changes in Uptake
          and/or Assimilation
          Level 6: Changes in Health,
          Ecology, or Other Effects

          All information captured by
          this continuum has value for
          stakeholders and policy makers.
          Although the indicators toward
          the higher end of the continuum
          (levels 4 through 6) portray a
          clearer, more direct image of
          the environmental condition,
          indicators at the lower levels
          (levels 1 through 3) are needed
          to establish a link between the
          actions taken and effects

-------
observed. It is important to
maintain indicators along the
continuum in order to
demonstrate the linkage
between actions by man  and
responses in the natural system.

A basic tenet of the Bay
Program's indicators effort is
that outcome measures be
clearly associated with strategic
goals for the program. The Bay
Program has developed a
framework for linking
environmental outcome
measures to strategic program
goals, as articulated in the 1987
Bay Agreement, and the three
primary restoration objectives:
reduction of nutrient
enrichment effects, protection
and enhancement of living
resources, and reduction of
adverse toxic impacts. Each
indicator briefing slide is
identified with one of the
restoration objectives (or
tracks). Indicators with
multiple impacts are identified
as cross-cutting.  The briefing
slides also include the goal
which the indicator tracks and a
succinct summary of the status
conveyed by the information
presented.

The three main tracks,
nutrients, living resources and
toxics, converge on the same
objective as you move up the
hierarchy towards level 6
indicators. For example, the
nutrient track takes you from
management actions to nutrient
loadings to nutrient levels and
ultimately to the health and
abundance of Bay grasses and
     How the Hierarchy and Tracks Work Together
    Lsvals 1-5=
    Hierarchy of
    Indicators
    (actions io
PROQRAM/ADMMSTRATWE MEASURES
other living resources. The
living resources track takes you
from habitat and harvest to
population measures. The
toxics track takes you from
releases of chemical
contaminants into the
environment to concentrations
in the environment and in
living resources. The common
measures of greatest
importance for all of the tracks
are the living resource
indicators.

Recently, Bay Program Office
staff have developed an
additional organizing
framework that places Bay
Program indicators into one or
several categorizes. This effort
was initiated in order to
account for the various ways
that the Bay Program, EPA
Region III, and other EPA
offices and programs are
organizing indicators.  The
categories are described in
Appendix C.  All existing
indicators, as well as those
under development, are
             organized within this
             framework and listed in
             Appendix C.

             Review and Development
             of Indicators

             At this time, the Bay Program
             uses over 90 indicators to
             gauge the progress of this
             restoration effort. For
             environmental indicators to be
             effective in tracking the health
             of the Chesapeake Bay, the data
             that underlie them must be
             updated frequently. The Bay
             Program Office Environmental
             Indicators Coordinator, as well
             as personnel from Bay  Program
             subcommittees and
             workgroups, request data from
             numerous sources on a regular
             basis. In addition to Bay
             Program monitoring data, a
             wide range of data are obtained
             from a host of federal and state
             agencies and Bay area
             universities.

             In addition to existing
             indicators, a large number of
10

-------
potential and proposed
indicators are in the
developmental phase. New
indicators are added  and old
ones updated, modified or
deleted on a regular basis,
based on changing priorities
and availability of contributing
data.  The process of adding,
deleting, or modifying
indicators is a collaborative
one, involving most Bay
Program committees,
subcommittees and
workgroups. Through
consensus, workgroups  and/or
subcommittees decide which
data to use for a particular
indicator. They agree on data
interpretation and key messages
and information to be conveyed
with the data. The
Implementation Committee
periodically reviews and may
recommend modifications to
indicators. See Appendix D for
further details regarding review
and development of indicators.

A Range of Indicator
Products

As previously noted, an
important impetus for indicator
development was EPA's
interest in defining and
communicating the bottom line
environmental results achieved
by the restoration program to
the public, and to do so on a
fairly continuous basis, not just
every three years.  To help
focus on simply stated bottom-
line results, EPA staff utilized
the image of a backyard
barbecue with friends and
neighbors, where discussions of
the Bay's condition might take
place. Lay persons at that
gathering would be less
interested in technical
descriptions of water quality
than in the progress made in
restoring the shad and striped
bass populations, and to hear
this in very simple terms.  Bay
Program participants tried to
keep that image in mind as they
proposed refinement and
development of environmental
indicator related products.

The Communication and
Education Subcommittee
continues to play an active role
in keeping this vision alive,
                          Measuring Environmental  Change
   Changes in Discharge Quantities               Changes in Ambient Conditions
    Point Source Nitrogen Loads Delivered to the Bay
                a Ottinmugn TMenM
                              GOAL: Reduce point source
                              nitrogen loads to support
                              achievement of the nutrient
                              reduction goal,
                              STATUS: Nitrogen loads
                              declined 31 % between 1985
                              and 2000 through industrial
                              reductions and some
                              installment of nutrient
                              removal technology (NRT)
                              technology.
                              An additional 11% reduction
                                xpected through 2010
                              due to increasing NRT
                              implementation as well as
                              general treatment efficiency
                               iprovements.
                              If no further actions are
                              taken, we anticipate
                              increased loads after 2010
                              due to population growth.
                           Observed Nitrogen Concentrations
                                 in the Main stem Bay
                       Annual Median Concentrations: 1965-
                                                The annual median
                                                concentration in 1998 was
                                                higher than the km level
                                                observed in 1997,
                                                probably due to higher
                                                than average freshwater
                                                flow in 1998, especially
                                                during the first half of the
                                                year.
                                                We expect future declines
                                                as efforts lo reduce
                                                nitrogen loads are
                                                accelerated.
                                  Changes in Health/Ecology
                                         Acres of Bay Grasses
                                     Pot«nU»l HablUt (600,000 ICTM)
                                                        GOAL: The interim goal is
                                                        to restore Bay grasses to
                                                        all areas where they were
                                                        mapped from 1971 -1990.
                                                        STATUS: Total acreage in
                                                        2000 is 69,126. The
                                                        increase from 1999 reflects
                                                        a strong recovery of
                                                        grasses in portions of the
                                                        upper Bay.
                                                                                                 11

-------
especially as It relates to using
environmental indicator
information in products
developed to inform and
educate the public on Bay
problems, potential  solutions,
and progress, and to stimulate
their involvement in the
restoration.  The Bernie Fowler
Sneaker Index (figure below) is
an example of an indicator that
has popular support because it
reinforces the importance of
citizen involvement in the
restoration, and demonstrates
that this can be done quite
simply. Although the index is
not strictly based on scientific
data, it highlights citizen efforts
to keep track of local water
quality conditions and to be
advocates for water quality
improvements.

The Environmental  Indicators:
Measuring Our Progress
briefing package has been
improved and updated over
time and helps to reinforce a
clear public message.  A full set
of speakers notes is  available
for consistent  interpretation of
the data. The Communication
and Education Subcommittee
developed and continuously
improves a presentation using
key environmental indicators
titled The Chesapeake Bay:
How is it Doing? Annual
reports of restoration progress,
including the popular fact sheet
Chesapeake 2000 and the Bay:
Where Are We and Where are
We Going?, and the triennial
"State of the Bay" reports
demonstrate extensive uses of
the environmental indicators.
Press releases and fact sheets
reinforce a consistent public
message using the outcome
measures. The Bay Program
web-site
(www.chesapeakebay.net)
includes all indicator related
briefing packages,
presentations and fact sheets,
and the materials may be
viewed and downloaded
by on-line users.

Requests and Feedback

In 1996, the Bay Program
Office began tracking requests
             CHESAPEAKE BAY PROGRAM • ENVIRONMENTAL INDICATORS
             Bernie Fowler's "Sneaker Index"
                  S S 5  S S S S
                                  S S
       jr MO Slato S«na!or C Barnard Fowler
           GOAL: Restore Bernie's
           sneaker visibility to chest
           depth (57 to 63 inches).

           STATUS: Wading in the
           Patuxent River at
           Broomes Island, MD,
           Bemie has seen
           improvements in water
           clarity since 1988. He
           says, "although this is not
           a scientific measure, it
           puts restoring the River
           on a human scale."
for environmental indicator
information and products made
by people outside of the office
(many people within the office
make these requests frequently
and continuously).  In 1996,
there were 41 requests for
Environmental Indicators:
Measuring Our Progress and
The Chesapeake Bay: How is it
Doing? slide presentation
materials and information.  By
1997, both of the slide
presentations and associated
materials were available on the
web-site.  In 1997, there were
89 requests for slide
presentation materials and
information. In  1998, there
were 93 requests.

In 1997, the Bay Program
began to solicit feedback by
sending feedback forms with
the slide presentation materials
and including a feedback form
with the web-site materials.
The results are summarized in
the tables below and continue
to demonstrate the great value
of these products to our
customers. One part of the
form asks for "suggestions  for
improvement". Most
suggestions  were implemented
by making revisions or
improvements.
                   TRACK 4: CROSS-CUTTING INDICATOR
72

-------
Feedback Summary
Environmental Indicators:

Year
97
98
99
Excellent
9
20
7
Measuring Our Progress
Good Fair Poor Improvements r ,, ,
Feedback
2 C
7 C
1 C
Feedback Summary
Chesapeake Bay: How is

Year
97
98
99

Excellent
6
25
10

) o ;
) 0 €
) 0 5
it Doing?
> 13
> 29
; s

Good Fair Poor Improvements ~ ,, ,
4 ^
4 ]
3 C
> 0 1
L 0 <
) o ;

2 13
t 30
^ 13
Total
Requests
22
34
21

Total
Requests
49
35
31

Response
Rate
0.59
0.85
0.38

Response
Rate
0.27
0.86
0.41


13

-------
CHAPTER 3
MANAGING FOR ENVIRONMENTAL RESULTS
Program Planning and
Assessment

The use of environmental goals
and outcome measures in
planning and assessing program
results has had a remarkable
effect on the culture of the Bay
Program Office and the broader
Bay Program. Committee
operations have been strength-
ened because an outcome
measure can be used to gauge
progress for more than one
issue or concern.  A focus  on
results, rather than activities
performed, has encouraged
professional creativity in
developing solutions to Bay
problems. Necessary  work to
develop shared definitions of
environmental measures results
in greater inter-state consis-
tency in goal setting and
progress measurement. This
facilitates clear communication
to the public. Finally, as
previously noted, improve-
ments in the environmental
indicators have facilitated goal-
setting, thus better defining
intended program outcomes
and improving accountability to
the public.

Environmental indicators are
used to develop and evaluate
the effectiveness of program
strategies. For example, to
achieve the goal of 40 percent
nutrient reduction by the year
2000, Bay Program signatories
                                                      CHESAPEAKE BAY PROGRAM
        Total Nutrient Loads Delivered to the Bay
           from "Potomac and North" Tributary Basins
        Phosphorus
Nitrogen
  Source Chesapeake Bay Program Phase 4 3 Watershed Model
  Data include total nitrogen and phosphorus loads delivered to the Bay from point and
  nonpoint sources, from 'Potomac and north* tributary basins from Chesapeake Bay
  Agreement junsdictions (MD. PA, VA and DC) only
GOAL: Reduce controllable
loads of nutrients 40% by
the year 2000 and maintain
those reduced levels into
the future.
STATUS: In "Potomac and
north" tributary basins,
phosphorus loads declined
3.8 million Ibs/yr between
1985 and 2000. We expect
to reach the goal by 2000.
Nitrogen loads declined 35
million Ibs/yr. We expect to
reach the goal through
tributary strategy
implementation, however,
strategies will not be
completely implemented by
the end of 2000.
agreed in the 1992 amendments
to develop and begin imple-
mentation of tributary-specific
strategies. These strategies
require activities beyond the
traditional controls on point
sources, such as wastewater
treatment plants, and focus on
improved technologies.  Bay
Program participants are using
a set of environmental indica-
tors, rather than counts of
outputs like enforcement
actions taken, to evaluate the
success of these tributary
strategies. In 2000, information
indicated that the phosphorus
reduction goal was met on time.
Achievement of the nitrogen
reduction goal will run two or
three years late, primarily due
to construction schedules for
treatment plant improvements.
As a result of the  recently
signed Chesapeake 2000
agreement increased nutrient,
and for the first time sediment,
    reduction goals for 2010 will be
    set by the end of 2001.  This
    will require the development of
    new indicators that will be used
    to track achievement of these
    goals.

    Targeting Resources

    The availability of accepted
    environmental goals and indi-
    cators has allowed the Bay
    Program to better target its
    resources. Within the Bay
    Program, screening criteria set
    by the Budget Steering Com-
    mittee for allocation of funds
    give great weight to proposals
    which most directly address
    commitments contained in the
    Bay agreement. Achievement
    of measurable environmental
    commitments are one of the
    principal methods for subcom-
    mittees to demonstrate resource
    needs and program success.
    Projects from subcommittees

-------
with non-measurable objectives
are at a decided disadvantage
against outcome-oriented
projects in the contest for
scarce financial resources. The
costs for high quality data, and
data collection and analysis are
considerable. About $2.2
million per year of federal
funds supports the monitoring
and data a analysis costs for air,
water, living resources, and
submerged aquatic vegetation.
Approximately $400,000 per
year is devoted to operate the
computer simulation models to
examine the potential results of
alternative strategies.  These
expenditures support the devel-
opment of bottom-line
environmental performance
measures.  Also, about
$100,000 is used annually to
develop, update and maintain
indicators and indicator prod-
ucts.

Environmental Impacts
of Results-Based
Management

Environmental results-based
management has impacted the
Bay Program in several ways
programmatically. However,
the benefits of environmental
results-based management are
not just programmatic changes,
but more importantly, measur-
able environmental
improvements. The environ-
mental benefits gained through
goal setting, indicator develop-
ment and the targeting of
resources are illustrated in the
following example.  In 1993,
Bay Program partners voluntar-
16
ily committed to removing
stream blockages and reopen-
ing 1,357 miles of Bay
tributaries for migratory fish by
the year 2003. Resources have
been targeted and progress is
reported  annually. As a result,
hundreds of miles of historic
spawning habitat have been
reopened, and even though the
interim goal was not attained
on time,  it can be argued that
without the goal and indicator,
resources would not have been
targeted for this purpose and
very few miles, if any, would
have been reopened.  The long-
term goal is projected to be met
on time.

The Bay  Program model  of
managing for environmental
results has been shared with
other EPA offices and pro-
grams, other federal agency
offices, state  and local govern-
ment agencies, and nonprofit
organizations seeking to de-
velop and implement
environmental goals and indi-
cator programs.  The Bay
Program  was part of an EPA
                         and Office of Management and
                         Budget case study and pilot
                         project, the results of which
                         were used to implement Gov-
                         ernment Performance and
                         Results Act (GPRA) require-
                         ments.

                         Continuing Challenges

                         While environmental indica-
                         tors/outcome measures
                         represent a common currency
                         among the different govern-
                         ment agencies and
                         organizations involved in the
                         Bay Program, these entities
                         may draw different conclusions
                         as to the appropriate course of
                         action to follow in response to
                         these indicators.  For example,
                         the supply of blue crabs has
                         declined over the past several
                         years.  While the participants in
                         the Bay Program agree that this
                         decline has occurred, they at
                         times may disagree on the
                         cause for this, its severity, and
                         the appropriate response.  To
                         some, placing limits on harvest-
                         ing the crabs is necessary; to
                         others in jurisdictions that place
         Stream Miles Opened to Migratory Fish
   ,1200-
   i
   j 1000-

   i 800-

   > 600-
   >
   : 400-
   >

    200-
D Opened, but not yet to Anadromous Fish
  Opened to Anadromous Rsh

  	Year 1998 joalJ731 jiniles) _
       89 90  91 92  93 94 95  96 97  98 99 2000
   Hjrce EPA Chesapeake Bay Program Otfict
GOAL: To restore access
to historical spawning
grounds for migratory fish.

STATUS: The removal of
stream blockages and
construction of fish
passages in 2000
reopened 54 new miles of
historic spawning habitat
to migratory fish, and an
additional 25.3 miles to
resident fish. Total miles
made available to
migratory fish since 1988
is 816 with an additional
107 miles to resident fish.
                   TRACK 2: LIVING RESOURCE INDICATOR

-------
                  Blue Crabs Hanging On
           Mature Female Blue Crabs
                                   • Mature female abundance is
                                    currently below the previous
                                    historical low set in 1968.
                                   • Action needs to be taken to
                                    reduce fishing effort as a way to
                                    reduce fishing mortality.
     68  72
               80  84   88  92   96 2000
great economic and societal
value on this industry, that
response is unacceptable.
Nonetheless, the presence of a
key indicator to track status and
trends for this vital resource
promotes the timely discussion
of viewpoints and potential
solutions. Most importantly, it
assists the public  in monitoring
the data and the ultimate reso-
lution.

Although the Bay Program has
benefitted from the support of
national and local leaders in
setting measurable environmen-
tal goals, political costs may be
suffered by leaders and agency
management if these goals are
not met.  Many federal govern-
ment managers are reluctant to
include annual performance
goals supported by outcome
measures, because success in
attaining such goals is affected
by factors beyond the control of
the program managers and by
time lags. The amount of time
it takes to achieve measurable
environmental improvements
from the time abatement or
restoration actions begin can be
both uncertain and lengthy.

The Chesapeake Bay Program
has emphasized the importance
of the 40 percent nutrient
reduction goal, and, while
many positive steps have been
taken to achieve this goal, the
ever-increasing pace of devel-
opment in the watershed works
against the progress made.
Increased public understanding
of the complexity of ecosystem
interactions and the time
required before actions yield
observable results may lessen
political cost. Bay Program
leadership will need to consider
how to keep public enthusiasm
and confidence in the program
if important goals are not met
or met on time.
                                                                                           77

-------
FUTURE DIRECTIONS
The development of outcome measures will
proceed in several promising directions to meet
the needs of program managers and the general
public and to keep the program in the forefront
of national ecosystem protection efforts.  The
Bay Program is placing high priority on
localizing the measures, i.e., developing more
river-specific or sub-watershed measures in
addition to Bay-wide average measures. The
public has shown a great interest in data which
describe the condition of local rivers and natural
resources and the program will enhance its
ability to collect and display this information in a
way that is indexed geographically.

New indicators are going to be developed and
several will be  modified (or replaced) as a result
of the new Chesapeake  2000 agreement.  A
major focus over the next ten years will be
removing the Bay from  the EPA list of impaired
waters in order to preclude the need for
regulatory measures slated to begin in 2011.
This will drive the development of several new
indicators related to water quality conditions
necessary to protect aquatic  living resources.

Key gaps in the indicators hierarchy and
continuum will be need  to be filled over time to
complete the "cause and effect picture" for the
watershed.  Bay Program participants will
continue to identify these gaps, which will serve
as the focus for future data collection efforts.

Reflecting the growing interest in sustainability,
new emphasis is being placed on measures
reflecting stewardship and land use. Sustainable
development indicators  and  briefing materials
were developed by EPA Bay Program Office
staff to help the program measure trends in these
areas and to stimulate further discussion of the
links between land activities and water quality.
New goals and a  long term vision for a
sustainable Chesapeake  Bay have been the result
of this effort as evidenced by numerous
commitments contained in the new agreement.
To monitor future developments in outcome-
based measures for the Chesapeake Bay
Program, check the web-site at
www.chesapeakebay.net.
         LESSONS LEARNED
• Be persistent. There are many obstacles and
challenges to be met along the path to
developing and gaining endorsement for using
indicators/outcome measures to set goals and
measure progress. However, the payoff can be
tremendous in terms of public enthusiasm and
interest, and internal and external political
support.
• Work hard to reach consensus among key
stakeholders on the selection of appropriate
measures, interpretation of data and use. Once
sold on the value of the measure they will help
maintain it over time.
• Don't wait for the system in which you are
working to be perfectly modeled or understood
by the scientists or experts. Data gaps and
analytical problems will always exist, and
insistence on using best available information
will inspire improvement over time.
• Maintain the link to the strategic goals of
organization. Indicators must have a clear end
use to be effective. Too many measures
developed for their own sake detract from the
focus of the program. Link budget support as
well to a commitment to develop tangible
measures.
• The leadership must push for the development
and use of these measures. This approach
requires persistence and patience and a long-
term vision for the program.
• Share the environmental outcome information
with the public and partners on a regular basis.
This will often yield greater understanding of
your efforts and help create the necessary public
and political support for goal-setting and
necessary environmental improvements.
                                                                                        79

-------
 2
 3
 3

 ^^

 C/3
 N

'5
 88
 6X1


O
 S3
 «
 6JD
 O


CL.
 ss
23
 55
 a>
 «•

 es"
 C  i)
 C  £•£)

-S  5
                                                                                                             ?: B-
                                                                                                                 .2-
                                                                                                           p     ^=.

                                                                                                          6  ^ -a
                                                                                                          -J
                                                                                                                0
                                                                                                                p
                                                                                                             c o
                                                                                                             ^ "5
                         u
                        -a
                         o
                     I*  I
                     i     u
                     O     ^
                     S    <
                                                                                                              CJ

                                                                                                              x
                                                                                                                                   X
                                                                                                                                  -5

                                                                                                                                   OJ
                                                                                                                                   n.
                                                                                                                                   a.
                                                                                                              u


                                                                                                              3

-------
 o
 o
 oo
 /^
O "*
-t i

|
•_•
Z

u
a
o

Sc
re' 3
£2 £
u -=>
1 1
£"<
S rs
52


o
^>
1
f*3

—



U
Cfl
Z








ons - Susquchanna River
98.5 Million Pound Cap
1 - 3.73 Million Pound Cap
-»- re
o o
"S j c
^" *p
S.2 a
*>*•• —
i •§ «

••• ^ c
I'll
.-§11
H Z ft.
*•.
_3
•5
z
£
o
a
3

5
< S
"** U
« _£
1 s
u £
="<
S (S
52


o
o

r*}

fS



U
Z








||1
a o —
f is

0 _ O
1 1 g
p~ ^ t^
S ° u
III

C/2 W !«
>-. 2
re S _2
3 o &
••Pi I
H 2 S

|
•_•
Z

3
a
o
o
3c
:;• §
es £
||
«""<
S M
52


0
o

(*}

—



U
Z








•_ U 1
« — 3
•* S °
2 la
111
•2§S

u o
ll»
*" *™
u •! =
w a w
i •§ DS
55 ^ »3
>•. 2
- a S
| £•£
Hi
H 2 S

|
•5
z

i>
a
U

Si
re' 3
ca £
ll
!<
S *^
52


o
o

^

rs



U
1/3
Z







^
Q — 0
^ S £|
2 ao" i
0 ""

u _ o
v3 ^
l~ ** "-S
S.J a
? u "u
i -i BS
C/3 ^* W3
•» ?
|j g S
lit
H Z £

3
"S
Z

o
a
u

•—
Si
-< v:
re' S
S3 £
"re JJ
jr-<
S ^
u 2


o
^5
t
rn

2



U
t/2
X







A
O s.U
21 1
0 § ft.
— c =
c« ft. g
III
"5 ~ *
W S c\
a "*" '
o *"
•« re
o o
•Sg"
S" g
a '~^
s .s a
're s u
i -5 DS
5/3 4* K
>-. s
So1 —
sis
H Z £

3
•5
z

o
£
U
Cl
eb
< ^
>. a
re «
B3 £
Is
~-<
S M
— c\
u 2


^S
0

^

—



u
C/3
Z








•, c '•"

re 'a "§
*" "3 Oi
C/3 ^ G«
> * ?
re g I
III
H Z ft.

|
"S
z

i>
fi
CJ

M
^-. "a
re o
S3 £
1 1
«"^
S ^
52


o

1
f)

—



U
Z








re
< -U
> a-s
35 o a
s ft. .=
^ O *"
«a -t ®
0 "
— re
a — °

£ *™
** .2 —
+^ y ^3
*•" -5 os
C/3 *•* »a
^ Cfi JS
III
sis
H Z ft.

3
•£
z
a
u

3

5:
< £
'?' S
03 £
11
£. ^
S ^
52


o
o
1
f)
1




u
z







^.
ons - Rappahannock Rivci
- 5.7 Million Pound Cap
1 - 0.54 Million Pound Ca
— re
u _ o
|5g
^ -S
St. 2 a
s t; -S
re 3 cj
L *^
^ ™ 05
jy^ U ^
^.tf 2
re 3 2
Iff
H Z ft.

|
•5
Z
                                                                                                                         -a

                                                                                                                         o>
                                                                                                                         CL
                                                                                                                         n.

-------
 c

 O
 E «
 u

ii

 I-
 o
U
£


U
U
•*d
«J

2
CJ
CJ
3:
< Z
'ff, C
re cj
ca £
CJ "
"re S
cj C
« ^i«
re "^
i S
u 2

o
i
it
«s



U
en
Z











re
_ U
re" "?
•ibutary Strategy Reductions - York River
trogen Reduction Goal - 4.5 Million Pound C
losphorus Reduction Goal - 0.59 Million Pouii
H Z E
^

s
i^

3
z

£J

2
CJ
CJ
^
M
< s
**l 2
re cj
ea _§
CJ ™
« 1
cj £
~- ^>
re ^
s S
uS
o
o
i
f»
r4



U
en
Z











«. re
S?U
™ ^^
U TS
•ibutary Strategy Reductions - James River
trogen Reduction Goal - 29.6 Million Pound
losphorus Reduction Goal - 4.04 Million Poun
H Z £
;/:

CJ
^

2
z
CJ
;«
CJ

re
>
>
<
o
^5
0
r~i
CJ a.
•* "3
§ E
re" S
CJ "£
5<£

^^
i
r*>
-S
•£ R S2
pa u
•s « ?
z-B f
g CJ •=
-^ J- CJ
jrrcct the nutrient and sediment-related probl
\y and its tidal tributaries sufficiently to remo
irtions of its tributaries from tbc list of impair
lean Water Act.
•<•* »» D •""
u ca S.U
~— ~. w;
v: -*--

1 s
— • •••

3 £J
Z en








7
w
C7\
CJ
>
U
CJ
5
3C
c\
1
?
«s
1
«n *?
CJ C
y s ^
SP 3 0 «
•- O CJ v-
s s-§2
-1 CS en d













v;
^
'g
Wi
O
C~J
95
m
^«
o
E
H
•_
re
CJ
>•
CJ
>
il
4
re
;«
v:
re
s.
f
»5
'£
:^
CJ
CJ
sx 5
^ o
'^ ^
.£ CJ
_: oi








~t
it
o\
CJ
>•
CJ
CJ
^
C
it
0

«
rl


CJ
en
CS
U













5«
^
E
I-;
va
i^
it
i—
o
1
re
H
re
CJ
>•
CJ
4
re
V3
V?
re
CM
y:
'£
w;
CJ
CJ
IM z
.E S
• c*:
.2 CJ
J CS
c
** &-
O *"
«r •-

5 «
« E
^ go
>•* ^
re s
aa 5
CJ S
•S-3
a *
C5 >-»
^ ^ O
Sis

o

ft
.
^
•<
0
c^
?5
SJ =.
•gs
s 2
sr s
S -S
u £
o

^
ro
•
CJ
u
5
m
o
1
ft
rs


CJ
en
CS
U










_CJ
•»
i^4
CO
^}
p
•<
o
o
>t"
o
a
_S
re
•_
y;
CJ
OS
>
<
en
£
CJ
-
y;
CJ
CJ
Sf 3
.5 c
• w;
.2 CJ
-1 CS

&

C

••H
"cj
•^
£
>-,
C5
Cfi
CJ „
v oe
— * ^*
«2
re" i-
3 -^
U £






CJ
en
CS
J







g
're
O
•*-
CJ
Z
c
u
AD
0
c^
v:
O
•«^
CJ
Z
"re
s
c
<
0
Z
i
^
re
o
O
v;
•3
e
re
CJ
£
CW
CJ
CJ
v£ «
*"" C

.C cj
u a:
CJ
"
CJ

re
>
>
<
o
C5
o
CJ
CJ £
•^ •=
S E
M* £
re i
cj 'Z
— re
U 0-
c
1-H
1
7
rs


CJ
en
CS
-J
1
•!
o

^
^
2;
re
"re
,S
•*^
c»-
O
v:
CJ
CJ
re
:hieve a net resource gain by restoring 25,000
lal wetlands.
< £
-^.
CJ
CJ
"£ 2
.E S
- v:
.£ CJ
_; cs
                                                                 X


                                                                 12

                                                                 53
                                                                 r^

                                                                 Q.

-------
 re
 o
O
u
I-
=
0
C
o
Of)
c;

"re

u
•s
>• «^
•s ~ -•
re = >-
l-II
M '-g i
0 = <«
— "S c;
re u o
« 0£ -s
l.a *
^ x S
— O k-
O H 0.
0

1
o

o
«
U
'i
" i <
'3 H Q
O "3 C/3
H c£ U)





"w

re
_
re
a =

•1 .i
i<

j= •-!
re ^
^ V>
l§
II
"o §0
s '-
0 "=
'•S o

e re
Increase the ad
with Adininistr

u
'x
o
H

0
1 S*

re c >
ja * oo
™ a S
re' .2 «
pa t> -s
0 3 W
a ~s s
re a _o

^ X C

OHO.
o
o
1
m
i
—
u
S
'£
^ E ^
'x ^ c/D
H^b
E
C«
O
**f
"5
C-

C5

M
£

£
en
CS

U
—
£Z
*s
o
CJ
_3
S
^,

re

S

"o
Achieve 75% v
the watershed.

U
•p
6
H

u
•r -r
.1-2
re c >,
8j re ex
L*- " -^
re .2 |
oa 3 i
o a ^
— "g e

^ 2 3
^ x S
— c £
OHO,

.^^
1
n
i
—




O
H
"re
"o
;L v:
u £
S «
E oi
0 0
u —

£ a"
'S .2
!•= "5
*3 ^
^ o
i J

•s s
c =
— o
II
O ft
"re %
'•? '§
re —
>. "re
« 1
™ ™j
3 g

"5 «
Achieve 75% \
establishments,

U
' JJ
6
H

u
•| j-
'7 ~ ~*
re a >..
eg re ox)
•• u
aa ^ -c
0 = ^
^ ^ H
? »S 2
* .a £
i> 'x S

0 H £
o
o

n

fS




O
H







_I"
es
3
^
3
'E
"re

o
i/^
5«
O
U
**- .
U K
21
J5
s w

M
™ Cu
Jl

Establish volun
Recreation., an
y;
cj
"x
^
H

u
•?• t
c c\
•7 "=> "*
re a s-.
CS « eft
t- = S
re .2 «
CO tS -
s -i ^

Is J
j* O CJ
ci 'x 5
— 0 •_
OHO.
o
o

s

—




O
H
n
CS
^

U
~


*•"•
_o

U
s
GJ
vf
re

«" CJ
u «s
ci os
.E ~
1 E
^ «§
•3 »,
cj £
>• '£
t.' or
re _=

5 £

"= —
Achieve 65% v
from watershec

tj
'^>
^
H

u
•£ -t
C S-\
•^ -3 "H
re s ^.
03 re ox
«. a*
re .2 «
pa -5 •=
u S C/J
-z ~? —

;*• c^ O
^ "x 5
— CM
0 H 0.

o

?>

«




O
C/3
S
U
U
2
o
o
^™ _J


ws ^3
~ O
g |

•J-oe
05 -
Cj cc
IE
U O

W3 —3
u 5
o "S
'— re
I -£
£'•-
re i
M 5
~~ "^

^. •"'
Achieve 75%
chemicals from

CJ
X
o
H


—
>• -^
-— — Z-
ec •• >-,
re' .2 «
pa t5 •=
u a «
^ •= s
S fS .2
« 5 S
« 'x S
— o ^
OHO.
o
^^
1
n

^




O
H



O
a 1
"~ re

•2 M
S P

8 g"
w .2
s^ •**
O M
OX! U
o —

!i
"re 2
_ 'o
re s
f 1
o "e
•— o
5 =
• IT" ^.
•• ^
•_ a
re '
=. .
£SS
re .2 *
a -5 -5
U = <«
•— "^ M
re « o
S J 5
^ x 5

0 H fc

o
i
^
i





O
in

j.
j^
^™
u
^

•*
'•Q
SX
re
•C
•5
E
o

U
"S
x
o
u E
= 2
O O£
^ Q
^ —
£ S
w E
u •—

•^ H
Eliminate all a<
NPDES (water

U
X
O
H
5
5"
|
^
o
o
o
w ^*
*^ .rr"
s-P
es ^
o ™

O BU
O

1
m
I
fS




O
in




"x
o

£J
_j;
'JJ
"5

=
U
U
re
_e

o
o
o
U
c
s
on
^«
'x

M>
Elimination of

•j
"x
o
H
ro

CQ

X
'-5

33
Cu
a.

-------
g
£
CJ
cj
£
^ _
c
3

•-* £J
CO -j
«- **•
•w 1*—
re 5 +rf
•_ cj s
s w 2
Iss
•• 5
5 E
^ c

cj "tT-
c u
J <

^^
1
r^
i
fS

^j
1 >-|^
y >• >• E L5
0 O "S O j
J O «C U d


>.
ca
y
5S
CJ
7v
CJ
•C
u
CJ

•fa-
c
S
c
1
3 -^
al
2 £
H O


^ ex
® i-
Recognize 165 (1
watershed as Ba;
SJC
r
G
V;
G
„
o
55

-— "
.«
~
£
*^
li
C 1-H
> «
n S
c
"P c
CJ *-S
^* CJ
J -<

^^,
1
M

2



u
O



c
"O
CJ
s
"5
5X
O
U
CJ
"•
£J
...
-tj;
™
£
£
G
^

SB
cu
>.t
SB .-
ea _3
« 3

*- •"
«*— ^
c s
Encourage 20%
2000, to achieve
sx
j^
G
i
G
_
•2
J!

•^
•—
SB
Q.
^rf
£ ^
s S
£J C
> «
o ^
c
* .2

C CJ
j •<

o
'
n

C-)



O


C^'
ce
CJ
"SB
CJ
ys
£
u
^j
*••
•*-
s
v;
g
£
= !/
3 \~
al
u ^
^ 3
o U
"^* CJ

^ fill
o >.
Recognize 330 (2
watershed as Ba;
I1
"S
u
v:
U

§
"p?

CJ
"tS
^
^

0
o
o
^J -
— •="
1 =
?5 <—

CJ ^*
•M r"
U Cb

o

m

r-i
.= — CJ
*- •— CJ
i •§ 1
III!


cs'
ca
.a
cs
CJ
VI
CJ
u
CJ
•••*
^
."
•=
"re
"*-
"S
>-
CJ
?s
c
•a

3 ^i
— —
= £
= o
CJ 0
J= IT;
?»•,
* S
fJ o
3 'M
1*
1
G
0
G
C
•2
S3

• UT"
OB
c

S5 ^
|s
"S «
^ ,0
en §S
g ffl
*•*- ^

o ^,
^3 Q
< ta,

i^
1
^

—


_ o
r- -
i M
U Sr
III

3
cj 5s
"" o
c **
II
CJ **
* s
* "S
^ cj
C -r
cs **
s "o
SB CJ
CJ A
1. __
o "
II
o 3
^ -—
""*• if
s r* £
Pi

i — ?j


CJ ~^
M -*
U 0.

*•••
1
p^
1
(S


C S- cj ,— ^
3 TB g fc.
•" "ee ~ 1^


_.1_) cj
S -5
™ ^ »*'*
•— 58 CJ
-S ^ CJ
g s s
" *Z u
£ X CJ
CC JJ* jjj
.•S 3 •»•
— "" cj
2 =' «
SD"JS £
"5 ~ «
s 5 x
£ 3 d-
o ^ o
•. S ™
^2 *"" -•
3 = •£
£ « o
If-
i- CJ C
° S "~
M — 2
Work with local
organizations to
management pla
Agreement.
I?
«-
G
P
G
^5
CJ
"

CJ
cs
^
^.

o
o
o
fN
-^ 'S*
2 "S
fS* ^

O "^
— •;
U a.

^^
i
f)
1



U
en
LGSS/N



3
2^
£

aS
J

^
b
^
o
^*
n
"ce

H
58
^
£

CJ
5
^
o
|.i
* :S
w £
1°
1
G
g
G
                                                                                                                                                  oa
                                                                                                                                                  X
                                                                                                                                                  '-5
                                                                                                                                                  CL
                                                                                                                                                  n.

-------
 es

O

 o
 =
 o
 C/2
 CJ S

 la
 =  u
 o
U
 o
U
 a
 cs
 o
o
CJ
sj
j*
o

o
o a.
cs -=
^" S
cj t^
u cu

V
<*>

£2
C/5
t/5
O




•*•*
S

cs
«
c
CS
a
^M
o
O

•w
3
s
2^
"3
U
o

si«
CJ

*"• 2
ty S
£•<£
Permanentl
watershed 1
at
U
c

C
s
'es
£
o
o
o
cj a.
f|

-J t^|
u £

i
r^

-1

c^
o





.
u
1
>
'S
•3
|_
_.
-^^

2
.Si
s
•£
p
O

a>

*
w
^ -
c!
CJ
Rehabilitat
sx
0
p

U
J
*;
5t
o
o
o
CJ a.
ll
;r a
^ tw
5 £
o
V
^
t


C/3
O


V?

g |
£ S
5W 5W <••
.— C —
r\ U ^
5' >. &
cj S w
5 5 o
S £~-
-2 o •—
1 1 1
cn c —
i^j " <•*
^ c S
W *^ ^3

• M O 6<—
Sol
<*•« t_ W ^
2 §S §
S g ts ^

s* — .ts •—
*""* ^3 ^. £
^2 **" ^
y ^ 3JD CJC
o ^" '^ *"
ll M
f) C5 ** ^
f I "? 1
1 5 S -2
II I i
M
0
p

u
75
S!
^
O
O
o
w a.
~C5 J5
CJ 2
c« ^
S £
C«£
fS
T1
^

(S
C/D
^^
O
_J
—
3 CJD
s *
"5 5
'C 68

85 CS
S 68
"5 ""
•M S
^ 5W
s*« C5
'S £
lt£
S f> Cv

^TJ='^
> -s °^
_i* a 2
^* ™ «*«
~ - 0
•- 1 .1

•S «' cs

s ^ ^*
** J^( ^^
2 * *"*
"•*" O S™
C e? 2
"«• *• 5*
C o «
Reduce the
land in the
over five ye
at
U
o
^
0
                                                                                                                                                                in

                                                                                                                                                                CQ
                                                                                                                                                                 x
                                                                                                                                                                o-
                                                                                                                                                                Cu

-------
                 Chesapeake Bay Program (CBP) Environmental Indicator Framework

 This framework is an internal CBPO document that organizes CBP indicators into one or several
 categorizes. This effort was initiated in order to account for the various ways that CBP, EPA Region III
 and EPA Headquarters are organizing indicators. The categories are described below and the following
 pages organize the indicators within this framework  All existing indicators, as well as those under
 development are included

 CBP currently uses a "hierarchv" scheme that includes six levels,  ranging from indicators that measure
 administrative actions,  such as issuing permits, to those that are direct or indirect measures of ecological
 or human health.  Specifically, the six levels include:

 Level 1 •     Actions by EPA/State Regulatory Agencies
 Level 2     Responses of the Regulated and Nonregulated Community
 Level 3     Changes in Discharge/Emission Quantities
 Level 4     Changes in Ambient Conditions
 Level 5     Changes in Uptake and/or Assimilation
 Level 6     Changes in Health, Ecology, or Other Effects

 EPA Region III currently categorizes indicators or measures as either Actions, Stressors or Conditions.

 At EPA Headquarters some branches may use one of the above schemes, but others may use another
 scheme that categorizes indicators as either Pressure. State, or Response.
                                Categorization of CBP Indicators

CBP Performance Measure - Tracks progress related to an EC Adopted Goal. Example: SAV

CBP Environmental Condition (State) - Measures status and/or trends in ambient conditions,
uptake/assimilation, or health/ecology.  Hierarchy levels 4-6.  Example:  SAV.

CBP Environmental Stressor (Pressure) - Measures trends in discharges and loadings of pollutants.
Hierarchy level 3. Example:  N loadings to the Bay (which is also a performance measure indicator). This
category' also includes some contextual indicators, like population, VMT, fish and shellfish harvest, which
can also be considered stressors.

Action (Response) - Measure responses of the regulated and unregulated community (and actions by
EPA/rules)  Hierarchy level 1-2.  Example:  Acres Under Nutrient Management

Context - Are not considered actual "environmental" indicators, but do provided context to possibly help
understand some environmental conditions. Example: Blue Crab Harvest

Emerging Science or Consensus - Measures that have  not yet been accepted by all members of
workgroups and/or subcommittees through consensus. Examples: many of the under development
indicators are included in this category since final approval has not yet been reached by the workgroups or
subcommittees.  This category would also include data that is being generated through CBP funded
monitoring efforts that is still  in the stage of being looked at and discussed by workgroups.

                                                                                 Appendix C  1

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title





CBP
Hierarchy
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)




Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
APPROVED INDICATORS
Nutrient Enrichment Indicators:
Total Nutrient Loads Delivered to the Bay
from All Bay Tributaries
Total Nutrient Loads Delivered to the Bay
from Tributary Basins with Strategies
Point Source Phosphorus (P) Loads
Delivered to the Bay
Point Source Nitrogen (N) Loads Delivered
to the Bay
P Levels in Rivers Entering the Bay. Trends
N Levels in Rivers Entering the Bay: Trends
Sediment Levels in Rivers Entering the Bay:
Trends
Observed P Concentrations in the Mainstem
Bay: Monthly Median Trends
Observed P Concentrations in the Mainstem
Bay: Annual Median Concentrations
P Concentrations in the Mainstem Bay and
Tidal Tributaries: Status and Trends
Observed N Concentrations in the Mainstem
Bay . Monthly Median Trends
Observed N Concentrations in the Mainstem
Bay: Annual Median Concentrations
N Concentrations in the Mainstem Bay and
Tidal Tributaries' Status and Trends
Dissolved Oxygen Concentrations:
Mainstem Bay Summer Trends
•~>
O
3
3
3
4
4
4
4
4
4
4
4
4
4
X
X
















X
X
X
X
X
X
X
X
X
X
X
X
X
X




















































                                                                    Appendix C   2

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title



CBP
Hierarchy
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)



Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
Bottom DO Concentrations in the Mainstem
Bay and Tidal Tributaries
Acres Under Nutrient Management
Municipal Wastewater Flow and Biological
Nutrient Removal (BNR)
Municipal Wastewater Treatment Facilities
Using Biological Nutrient Removal (BNR)
4
2
2
2




X








X
X
X








Living Resource Indicators:
Acres of Bay Grasses (total)
Acres of Bay Grasses: Density
Acres of Bay Grasses: Changes by Zone
Wetlands
Stream Miles Opened for Migratory Fish
Trends in Finfish: Striped Bass (juvenile
index)
Striped Bass Spawning Stock
American Shad Landings
American Shad: Population Trends
Hatchery Reared American Shad Stocking
Trends in Blue Crab: Commercial Harvest
and Fishing Mortality Rate
Trends in Blue Crab: Juveniles
Trends in Blue Crab: Mature Females
Trends in Shellfish: Oysters: MD and VA
Commercial Harvest
6
6
6
6
4
6
6

6
6

6
6

X


X
X









X
X
X
X
X
X
X

X


X
X








X


X


X









X











X


X


X














                                                                   Appendix C  3

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title





CBP
Hierarchy
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)




Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
Trends in Shellfish' Oyster spat MD Spat
Set
Trends in Shellfish. Oyster spat: James
River Spat Set
Designated Oyster Restoration Areas
1997 Status of Fishery Stocks Important to
Chesapeake Bay
Trends in Waterfowl' Black Duck and
Mallard
Trends in Waterfowl: Diving Ducks
Status and Trends for Chesapeake Bay
Waterfowl
6
6
6
6
6
6
6


X

X
X
X
X
X
X
X
X
X
X




























Toxics Indicators:
Bald Eagle Population Count
Industry Reported Releases and Transfers of
Chemical Contaminants
Industry Reported Releases and Transfers of
Chesapeake Bay Toxics of Concern
Releases and Transfers of Chemical
Contaminants from Federal Facilities
Acres Under Integrated Pest Management
Pesticide Collection and Disposal Programs
Status of Chemical Contaminant Effects on
Living Resources in the Bay's Tidal Rivers
Pesticide Container Recycling Programs
Consumption Bans and Advisories
Kepone in Finfish Tissue
6
-*
j
3
->
j
2
2
6

5
5

X
X
X
X
X
X



X





X

X
X

X
X
X










X
X
























                                                                    Appendix C   4

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title





CBP
Hierarchy
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)




Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
Declines in MD Oyster Tissue
Contaminants
Tributyltin Concentration Levels: Hampton
Roads. VA
Tributyltin Concentration Levels: Sarah
Creek, VA
Trends in Rainfall Metals Concentrations:
Lead and Copper at Lewes, DE
Copper Concentrations in Sediments Mid-
Chesapeake Bay Mainstem
Copper Concentrations in Sediments.
Mainstem and Tributaries
Benzo[a]pyrene Concentrations in
Sediments' Mid-Chesapeake Bay Mainstem
Benzo[a]pyrene Concentrations in
Sediments: Mainstem and Tributaries
5
4
4
3
4
4
4
4








X
X
X

X
X
X
X



X




























Cross Cutting Indicators:
Dischargers in Significant Noncompliance
(SNC)
Recreational Boat Wastes
Public Access Points to the Chesapeake Bay
and Its Triburaries
Water Trails in the Chesapeake Bay-
Watershed
Vehicle Miles Traveled vs. Population in
Chesapeake Bay Watershed
Nitrogen Oxides Emissions vs. Vehicle
Miles Traveled
2
2



•>
j
X

X
X












X
X
X
X








X
X






                                                                   Appendix C  5

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title





CBP
Hierarchy-
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)




Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
Chesapeake Basin Population, Households
and MD Lot Sizes
Chesapeake Basin Land Use and Pollutant
Loads
Chesapeake Basin Forests
Rjpanan Forest Buffer Conservation and
Restoration
Chesapeake Region Preserved Lands
Benthic Community and Habitat Condition
River Flow into Chesapeake Bay
Secchi Depth in the Mainstem Bay and
Tidal Tributaries: Status and Trends
Municipal Wastewater Flow and Population
Municipal Wastewater Flow and Municipal
Phosphorus Discharges
Municipal Wastewater Flow and Municipal
Nitrogen Discharges
Municipal P Discharge and Population
Municipal N Discharge and Population
Municipal P Delivered Load and Population
Municipal N Delivered Load and Population
Basimvide N Loadings from Septic Tanks
Percent of Households on Septic vs. Sewer
Bernie Fowler's "Sneaker Index"
Ba\ Attitudes Survey Results: Major
Misconceptions


6
6
2
6

4
i
j
->
j
3
3
••>
j
3
3
3






X

















X
X

X

X












X






X
X
X
X
X
X
X
X







X














X
X


X

X

X







X
X
X















X
X


                                                                   Appendix C  6

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title





CBP
Hierarchy
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)




Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
Ba\ Attitudes Survey Results Support for
the Clean-up
Bay Attitudes Survey Results' Causes of
Pollution
Bay Attitudes Survey Results: Support for
Pollution Prevention
Bay Attitudes Survey Results: Pollution
Reduction Activities
Bay Attitudes Survey Results: Water Quality
Chesapeake Bay Fanner Communities
Chesapeake Bay Partner Communities:
Award Status
Chesapeake Bay Partner Communities:
Benchmark Achievement
Development that Works
Preventing Pollution
Conserving and Preserving Living
Resources
Valuing Trees and Forests
Conserving the Countryside/Revitalizing
Communities
Community Participation





2
2
2
2
2
2
2
2
2





X
X








































X
X
X
X
X
X
X
\
X
X
X
X
X
X























Completed/ Awaiting Approval or Revision:
Chesapeake Bay Watershed Land
Conversion
Condition of Benthic Community in Bottom
Waters of Tidal Tributaries and Mainstem
2
6
X


X
X





X
X
                                                                   Appendix C  7

-------
Chesapeake Bay Program (CBP) Environmental Indicator Framework (2/15/00)
Title





CBP
Hierarchy
Level



CBP
Perfor-
mance
Measure


CBP
Environ-
mental
Condition
(State)

CBP
Environ-
mental
Stressors
(Pressure)

Actions
(Response)




Co
n-
text



Emerg-
ing
Science
or
Consen
-sus
Ambient Toxicity in the Chesapeake Bay,
1990-1995. Water Column Data
Ambient Toxicity in the Chesapeake Bay,
1990-1995, Sediment Data
Chesapeake Bay Ambient Toxicity Index for
Sediment: 1990-95
Chlorophyll a in the Mamstem Bay and
Tidal Tributaries: Status and Trends
Total Suspended Solids in the Mainstem
Bay and Tidal Tributaries: Status and
Trends
6
6
6
4
4





X
X
X
X
X















X
X
X
X
X
Priorities for Development
Areas Meeting Water Quality Conditions
Necessary to Protect Aquatic Living
Resources (several)
Oyster Population Increase
Acres of Wetlands Restored
# of Brownfield Sites Restored and
Rehabilitated
% of Watershed with Locally Supported
Watershed Management Plans
Track the Elimination of Mixing Zones for
Persistent or Bioaccumulative Toxics










































                                                                   Appendix C   8

-------
        Chesapeake Bay Program Environmental Indicators Development Process
 Process relative to primary indicators products, i.e., data charts and interpretations, slide show, speaker
                                notes, register of all indicators.
                    SUGGESTIONS/REQUESTS for New Indicators or
                    Modifications to Existing Materials.
                    INPUT from: Implementation Committee, Subcommittees,
                    Advisory Committees, Other Agencies, Bay Publics, etc.
                    Received by Indicator Program Coordinator.
                    Added to register of all indicators.
                        NEW INDICATOR
                                or
                        MAJOR REVISION
Screening Factors:
- data availability
- environmental results
 measure
- management needs
- request of Bay
 Publics
- other
SCREENING STEP
Indicator Coordinator
consults with any or all:
- Subcommittee Chair
- Subcommittee Coordinator
- Other innovator
(5 working days)
Refer to appropriate
persons for data
development.
Note on register as
"hold" item.
    Hold - Future
    Development
    Go Forward
    To Develop-
    ment Now
                      Relevant Subcommittee
                      requested to designate
                      lead person to review/
                      approve.
       Indicator Coordinator asks
       Subcommittee Coordinator to
       secure necessary data and
       interpretations from
       designated Subcommittee leads.
       (10 working days)
                             New Indicator
                             or Major
                             Revision?
                                                   Minor
                                                 \Revisipn?/
MODIFICATIONS
OF EXISTING
INDICATORS AND
MATERIALS
i.e. speakers notes
changes, updating data
to current year, clarify-
ing/updating chart
interpretation, refining
portrayal of existing
indicators.
                            DEVELOPMENT OF
                            EARLY DRAFTS AND
                            "MOCK UPS" by staff.
                            (time will vary)
                                                                             Appendix D - 1

-------
                            continued from page 1
EDITS
Review of
edits in 3
working
days.
                    Draft submitted to Indicator Coordinator,
                    Subcommittee Coordinator(s),
                    Subcommittee Indicator Contact.
DRAFT REVIEW / REVISION
5 working day turn around for
comments by:
- Designated Subcommittee Lead
- Subcommittee Coordinator
- Indicator Coordinator
                        Production of Final Versions
                        (new and edited copy)
                         Incorporation into
                         Presentation Materials
                   Distribution of final hard copies of new
                   indicators and edits of existing
                   indicators to:
                   - Subcommittee Coordinator
                   - Subcommittee Chairs or Leads
                   - Indicator Coordinator
                   - Communications Office
                   - Two per jurisdiction
                   (annually)
                        Annual Presentation of
                        Indicators to Implementation
                        Committee members.
                        (10 day policy level review)
                                                                       Appendix D - 2

-------