THE ENVIRONMENTAL TECHNOLOGY VERIFICATION PROGRAM

SEPA ElV ornl

ETV Joint
Verification Statement

TECHNOLOGY TYPE:

ENVIRONMENTAL DECISION SUPPORT SOFTWARE

APPLICATION:

INTEGRATION AND VISUALIZATION OF ENVIRONMENTAL
DATA SETS

TECHNOLOGY NAME:

ArcView GIS Version 3.1 using ArcView Spatial Analyst and
ArcView 3D Analyst extensions

COMPANY:

Environmental Systems Research Institute

ADDRESS:

380 New York Street PHONE: (714) 379-7000
Redlands, CA 92373-8100

WEBSITE:

www.esri.com

The U.S. Environmental Protection Agency (EPA) has created the Environmental Technology
Verification Program (ETV) to facilitate the deployment of innovative or improved environmental
technologies through performance verification and dissemination of information. The goal of the ETV
Program is to further environmental protection by substantially accelerating the acceptance and use of
improved and cost-effective technologies. ETV seeks to achieve this goal by providing high-quality,
peer-reviewed data on technology performance to those involved in the design, distribution, financing,
permitting, purchase, and use of environmental technologies.

ETV works in partnership with recognized standards and testing organizations and stakeholder groups
consisting of regulators, buyers, and vendor organizations, with the full participation of individual
technology developers. The program evaluates the performance of innovative technologies by
developing test plans that are responsive to the needs of stakeholders, conducting field or laboratory tests
(as appropriate), collecting and analyzing data, and preparing peer-reviewed reports. All evaluations are
conducted in accordance with rigorous quality assurance protocols to ensure that data of known and
adequate quality are generated and that the results are defensible.

The Site Characterization and Monitoring Technologies Pilot, one of 12 technology areas under ETV, is
administered by EPA's National Exposure Research Laboratory (NERL). With the support of the U.S.
Department of Energy's Environmental Management program, NERL selected a team from Brookhaven
National Laboratory (BNL) and Oak Ridge National Laboratory to perform the verification of
environmental decision support software. This verification statement provides a summary of the test
results of a demonstration of Environmental Systems Research Institute's (ESRI's) ArcView®
environmental decision support software (DSS) and its extensions ArcView Spatial Analyst® and 3D
Analyst™.

EPA-VS-SCM-35

The accompanying notice is an integral part of this verification statement

October 1999


-------
DEMONSTRATION DESCRIPTION

In September 1998, the performance of five DSS products was evaluated at the New Mexico Engineering
Research Institute located in Albuquerque, New Mexico. In October 1998, a sixth DSS product was
tested at BNL in Upton, New York. Each technology was independently evaluated by comparing its
analysis results with measured field data and, in some cases, known analytical solutions to the problem.

Depending on the software, each was assessed for its ability to evaluate one or more of the following
endpoints of environmental contamination problems: visualization, sample optimization, and cost-benefit
analysis. The capabilities of the DSS were evaluated in the following areas: (1) the effectiveness of
integrating data and models to produce information that supports the decision, and (2) the information
and approach used to support the analysis. Secondary evaluation objectives were to examine the DSS for
its reliability, resource requirements, range of applicability, and ease of operation. The verification study
focused on the developers' analysis of multiple test problems with different levels of complexity. Each
developer analyzed a minimum of three test problems. These test problems, generated mostly from actual
environmental data from six real remediation sites, were identified as Sites A, B, D, N, S, and T. The use
of real data challenged the software systems because of the variability in natural systems. The technical
evaluation team performed a complete baseline analysis for each problem. These results, along with the
data were used as a baseline for comparison with the DSS results.

ESRI staff used ArcView GIS Version 3.1 and its Spatial Analyst and 3D Analyst extensions to perform
the visualization endpoint using data from Sites A, B, and N. The Site A test problem, a three-
dimensional groundwater cost-benefit problem, required an analysis of remediation volume as a function
of cleanup levels for two volatile organic compounds (perchloroethene and trichloroethane). Data were
supplied at a series of wells for one representative period. Within each well, data were collected on a 5-ft
vertical spacing from the top of the water table to the confining bedrock. The Site B test problem was a
two-dimensional groundwater contamination sample optimization problem for three contaminants
(trichloroethene, vinyl chloride, and technetium-99). Developers were provided with a series of wells
containing contaminant concentrations and were asked to specify additional locations in which to collect
more data to better define the nature and extent of contamination. The Site N test problem was a two-
dimensional soil contamination cost-benefit problem. This problem included three heavy metal
contaminants (arsenic, cadmium, and chromium). The objective was to define the cost (area) of
remediation as a function of two cleanup levels for each contaminant.

The intent of the ArcView analyses was to demonstrate the capability to integrate large quantities of data
into a visual framework to assist in understanding a site's contamination problem. For the Site N
analysis, ArcView was used to estimate the area and costs associated with cleanup to different threshold
levels. Sample optimization components of the test problems were not performed.

Details of the demonstration, including an evaluation of the software's performance, may be found in the
report entitled Environmental Technology Verification Report: Environmental Systems Research
Institute, ArcView GIS Version 3.1 using ArcView Spatial Analyst and ArcView 3D Analyst Extensions,
EPA/600/R-99/094.

TECHNOLOGY DESCRIPTION

ArcView GIS version 3.1 is a geographic information system (GIS). One function of the software is to
help environmental professionals quickly and comprehensively characterize, manage, and visualize
information relevant to understanding environmental contamination problems. The ArcView GIS
integrates common database operations, such as query and statistical analysis, with the visualization and
geographic analysis benefits offered by maps. The Spatial Analyst extension was developed to solve
problems requiring that distance or other continuous surface modeling information be considered as part
of the analysis. The 3D Analyst extension permits the creation of three-dimensional surface models and

11

EPA-VS-SCM-35 The accompanying notice is an integral part of this verification statement

October 1999


-------
assists users with three primary tasks—surface model construction, analysis, and display. ArcView and
its extensions operate on Windows 95, 98, and NT platforms.

VERIFICATION OF PERFORMANCE

The following performance characteristics of ArcView GIS Version 3.1 and its extensions Spatial
Analyst and 3D Analyst were observed:

Decision Support: ArcView GIS version 3.1 was able to quickly import data on contaminant
concentrations, geologic structure, and surface structure from a variety of sources with different formats
and integrate this information on a single platform. It was able to place the information in a visual
context that supports data interpretation.

Documentation of the ArcView Analysis: ArcView generated reports that provided an adequate
explanation of the process and parameters used to analyze each problem. Documentation of data transfer,
manipulation of the data (e.g., how to treat contamination data as a function of depth in a well), and
analyses were included. Model selection and parameters for contouring were also provided in the
exportable documentation. ArcView generated graphical output in . jpg format and incorporated this
directly into a Microsoft Word file.

Comparison with Baseline Analysis and Data: ArcView generated hydraulic head, ground surface
elevation, bedrock elevation, and contaminant concentration maps. The maps ranged from posting of a
marker at each data location, in which the size was proportional to the value of the parameter being
represented (e.g., contamination level), to generation of concentration contours. Comparison of the
contours of concentration and hydraulic head with the data and the baseline analysis showed that
ArcView results were consistent with the measured values. ArcView accurately mapped wells, buildings,
and site features. It accurately posted data to sample locations and hot-linked data to well locations. The
Site N cost-benefit analysis performed using ArcView estimated the volume of contamination and the
cost of remediation and was found to be consistent with the data and baseline analysis.

Multiple Lines of Reasoning: ESRI staff used ArcView, Spatial Analyst, and 3D Analyst to provide
multiple interpretations of the data with different contouring algorithms and contouring parameters. The
best fit to the data was provided for review. The multiple representations of the data permitted a better
understanding of the extent of the contamination problem.

In addition to performance criteria, the following secondary criteria were evaluated.

Ease of Use: The demonstration showed that the basic features in ArcView were easy to use. An analyst
with a background in environmental problems and a basic knowledge of database and GIS operations can
use ArcView after one to two days of training. The ArcView platform has a graphical user interface with
a logical menu structure to permit use of the options in the software package. ArcView supports data
queries that permit evaluation of the data based on user-defined criteria, for example, using only
trichloroethene data collected in 1999 for contouring. This query capability is a powerful data analysis
tool. ArcView was demonstrated to accept a wide range of formats when importing data (e.g., database
files, drawing files in .shp and .jpg formats) and can export files using a large number of formats. Use of
advanced features, such as the Avenue scripting language, would require additional training and regular
use.

Efficiency and Representativeness: ESRI staff completed three visualization problems and generated the
report documenting the analysis with 12 person-days of effort. ArcView has a flexible database structure
that supports multiple data input formats. This provides a platform that addresses problems efficiently
and can be tailored to the problem under study. ArcView permits queries on any field (e.g., chemical

in

EPA-VS-SCM-35 The accompanying notice is an integral part of this verification statement

October 1999


-------
name, date, concentration, well identifiers) and also permits filtering (e.g., include only data between
certain dates, maximum concentration at a location over a range of sample dates). The software has the
capability to evaluate a wide range of environmental conditions (e.g., contaminant in groundwater, soil,
multiple contaminants on a single site).

Training and Technical Support: ArcView offers several options for training and technical support. A
detailed on-line help system is supplied with the software package, and a user's manual is available to
assist in operation of the software. A step-by-step tutorial that covers the major features is provided with
the software package. A one-day training course is available if desired. Technical support is available for
a yearly maintenance fee.

Operator Skill Base : To use ArcView efficiently, the operator should have a basic understanding of the
use of computer software in analyzing environmental problems. This includes fundamental knowledge
about GIS and relational database files. In addition, knowledge about contouring environmental data sets
is beneficial.

Platform: ArcView was demonstrated on a Windows NT 4.0 operating system. It requires a minimum of
128 megabytes (MB) of random access memory (RAM). During the demonstration, two machines were
used. For Sites B and N, a 233-MHz Pentium II laptop with 128 MB of RAM, a 5-gigabyte hard drive
and standard 1024x768 video monitor was used. The laptop was equipped with an internal CD drive, a
1-gigabyte Jazz drive, and a PCMCIA network adapter. For the Site A analysis, the computer contained a
300-MHz Pentium II processor with 128 MB of RAM and an Elsa Gloria XLM graphics card with 16
MB of video RAM and an Open GL chipset. This computer was equipped with an internal CD drive, a
1-gigabyte Jazz drive, an internal network adapter, and a 19-in. monitor.

Cost: Pricing varies for single stand-alone systems through enterprise-wide systems. Currently, the
government price for the Windows version of a single stand-alone system of ArcView GIS Version 3.1 is
$996; for Spatial Analyst and 3D Analyst, the Government Services Administration price is $2342 each.
Prices for these products for private industry or for use on a UNIX-based operating system are slightly
higher.

Overall Evaluations: The main strength of ArcView, Spatial Analyst, and 3D Analyst is their ability to
easily integrate data and maps in a single platform to allow spatial visualization of the data. The
visualization output was clear and easy to understand. The ability to sort and query data makes
examination of a subset of the data easy to perform. ArcView's ability to manage data files from a wide
range of sources makes it suitable for managing complex environmental contamination problems. The
ease of use makes ArcView and its extensions accessible for the occasional user who wants to view the
spatial correlation between data. For the more advanced user, the scripting language, Avenue, makes the
ArcView products extremely flexible and customizable for problem-specific applications. ArcView is a
mature product with a large customer base.

The technical team concluded that for visualization of environmental data sets, there were no major
limitations in the ArcView set of programs. Minor problems noticed by the technical team included the
inability to open some of the project files provided at the demonstration and, for a new user, the need to
learn the terminology to understand the operation of ArcView (e.g., "scenes", "themes", "program
files").

The credibility of a computer analysis of environmental problems depends on good data, reliable and
appropriate software, adequate conceptualization of the site, and a technically defensible problem
analysis. The results of the demonstration show that the ArcView software can be used to generate
reliable and useful analyses for evaluating environmental contamination problems. This is the only
component of a credible analysis that can be addressed by the software. The results of an ArcView

IV

EPA-VS-SCM-35 The accompanying notice is an integral part of this verification statement

October 1999


-------
analysis can support decision-making. ArcView has been employed in a variety of environmental
applications. Although ArcView has been demonstrated to have the capability to produce reliable and
useful analyses, improper use of the software can cause the results of the analysis to be misleading or
inconsistent with the data. As with any complex environmental DSS product, the quality of the output is
directly dependent on the skill of the operator.

As with any technology selection, the user must determine if this technology is appropriate for the
application and the project data quality objectives. For more information on this and other verified
technologies visit, the ETV web site at http://www.epa.gov/etv.

Gary J. Foley, Ph D
Director

National Exposure Research Laboratory
Office of Research and Development

David E. Reichle

ORNL Associate Laboratory Director

Life Sciences and Environmental Technologies

NOTICE: EPA verifications are based on evaluations of technology performance under specific, predetermined
criteria and appropriate quality assurance procedures. EPA, ORNL, and BNL make no expressed or implied
warranties as to the performance of the technology and do not certify that a technology will always operate as
verified. The end user is solely responsible for complying with any and all applicable federal, state, and local
requirements. Mention of commercial product names does not imply endorsement.

v

EPA-VS-SCM-35 The accompanying notice is an integral part of this verification statement

October 1999


-------