May 2007
               Bibliometric Analysis
               for the U.S. Environmental Protection Agency/Office of Research
               and Development's Drinking Water Research Program
This is a bibliometric analysis of the papers prepared by intramural and extramural researchers
of the U.S. Environmental Protection Agency's (EPA) Drinking Water Research Program.  For
this analysis, 910 papers were reviewed, and they were published from 1996 to 2006. These
publications were cited 13,632 times in the journals covered by Thomson's Web of Science1
and Scopus2. Of these 910 publications, 783 (86.04%) have been cited at least once in a
journal.

Searches of Thomson Scientific's Web of Science and Elsevier's Scopus were conducted to
obtain times cited data for the drinking water journal publications.  The analysis was completed
using Thomson's Essential Science Indicators (ESI) and Journal Citation Reports (JCR) as
benchmarks. ESI provides access to a unique and comprehensive compilation of essential
science performance statistics and science trends data derived from Thomson's databases. For
this analysis, the ESI highly cited papers thresholds as well as the hot papers thresholds were
used to  assess the influence and impact of the drinking water papers. JCR is a recognized
authority for evaluating journals. It presents quantifiable statistical data that provide a
systematic, objective way to evaluate the world's leading journals and their impact and
influence in the global research community. The two key measures used in this analysis to
assess the journals in which the EPA drinking water papers are published are the Impact Factor
and Immediacy Index. The Impact Factor is a measure of the frequency with which the
"average article" in a journal has been cited in a particular year.  The Impact Factor helps
evaluate a journal's relative importance, especially when compared to other journals in the
same field. The Immediacy Index is a measure of how quickly the "average article" in a
journal  is cited. This index indicates how often articles published in a journal are cited within
the same year and it is useful in comparing how quickly journals are cited.

The report includes a summary of the results of the bibliometric analysis, an analysis of the 910
drinking water research papers analyzed by ESI field (e.g., chemistry, microbiology,
pharmacology & toxicology), an analysis of the journals in which the drinking water papers
were published, a table of the highly cited researchers in the Drinking Water Research
Program, and a list of patents and patent applications that have resulted from the program.
    Thomson Scientific's Web of Science provides access to current and retrospective multidisciplinary information
    from approximately 8,830 of the most prestigious, high impact research journals in the world. Web of Science also
    provides cited reference searching.

2
    Scopus is a large abstract and citation database of research literature and quality Web sources designed to support
    the literature research process. Scopus offers access to 15,000 titles from 4,000 different publishers, more than
    12,850 academic journals (including coverage of 535 Open Access journals, 750 conference proceedings, and 600
    trade publications), 27 million abstracts, 245 million references, 200 million scientific Web pages, and 13 million
    patent records.

-------
            Bibliometric Analysis of Drinking Water Research Program Journal Articles
                             SUMMARY OF RESULTS

l.   More than one-fifth of the drinking water publications are highly cited papers.  193
    (21.21 %) of the drinking water papers qualify as highly cited when using the ES/ criteria for the
    top 10% of highly cited publications. This is 2.12 times the 10% of papers expected to be highly
    cited. 26 (2.86%) of the drinking water papers qualify as highly cited when using the ES/ criteria
    for the top 1%, which is 2.86 times the number expected.  1 (0.11%) of these papers qualify as
    very highly cited when using the criteria for the top 0.1 %, which is exactly the number
    anticipated. None of the papers actually meet the 0.01 % threshold for the most highly cited
    papers, which is not surprising given that the number of papers expected to meet this threshold
    for this program is 0.09.

2.   The drinking water papers are more highly cited than the average paper.  Using the ESI
    average citation rates for papers published by field as the benchmark, in 14 of the 19 fields in
    which the 910 EPA drinking water papers were published, the ratio of actual to expected cites is
    greater than 1, indicating that the drinking water papers are more highly cited than the average
    papers in those fields. For all 19 fields combined, the ratio of total number of cites to the total
    number of expected cites (13,632 to 8,944.60) is 1.52, indicating that the drinking water papers
    are more highly cited than the average paper.

3.   More than one-third of the drinking water papers are published in high impact journals.
    411 of the 910 papers were published in the top 10% of journals  ranked by JCR Impact Factor,
    representing 45.16% of EPA's drinking water papers. This number is 4.52 times higher than the
    expected 91 papers. 278 of the 910 papers appear in the top 10% of journals ranked by JCf?
    Immediacy Index, representing 30.55%  of EPA's drinking water papers. This number is 3.06
    times higher than the expected 91 papers.

4.   Fourteen of the drinking water papers qualify as  hot papers. Using the hot paper thresholds
    established by ESI as a benchmark, 14  hot papers, representing 1.54% of the drinking water
    papers, were identified in the analysis.  Hot papers are papers that were highly cited shortly after
    they were published. The number of drinking water hot papers identified is 15.4 times higher
    than the expected 0.91 hot papers.

5.   The authors of the drinking water papers cite themselves much less than the average
    author. 661  of the 13,632 cites are author self-cites. This 4.85% author self-citation rate is well
    below the accepted range of 10-30% author self-citation rate.

6.   Twenty of the authors of the drinking water papers are included in ISIHighlyCited.com,
    which is a database of the world's most influential researchers who have made key contributions
    to science and technology during the period from 1981 to 1999.

7.   There was 1  patent issued to an investigator from 1996 to 2006 for research that was
    conducted  under EPA's Drinking Water  Research Program. This patent was cited by another
    patent.

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles
Highly Cited Drinking water Publications

All of the journals covered by ESI are assigned a field, and to compensate for varying citation rates
across scientific fields, different thresholds are applied to each field.  Thresholds are set to select
highly cited papers to be listed in ESI. Different thresholds are set for both field and year of
publication. Setting different thresholds for each year allows comparable representation for older and
younger papers for each field.

The 910 drinking water research papers reviewed for this analysis were published in journals that were
assigned to 19 of the 22 ESI fields. The distribution of the papers among these 19 fields and the
number of citations by field are presented in Table 1.

                        Table 1.  Drinking Water Papers by ESI Fields
ESI Field
Agricultural Sciences
Biology & Biochemistry
Chemistry
Clinical Medicine
Computer Science
Economics & Business
Engineering
Environment/Ecology
Geosciences
Immunology
Materials Science
Microbiology
Molecular Biology & Genetics
Multidisciplinary
Neuroscience & Behavior
Pharmacology & Toxicology
Physics
Plant & Animal Science
Social Sciences, general

No. of Citations
130
354
1,360
1,575
6
57
442
2,800
9
569
0
2,212
712
199
204
2,835
27
33
108
Total = 13,632
No. of DW Papers
18
27
73
104
1
4
55
267
5
26
1
106
44
4
14
142
2
8
9
Total = 910
Average Cites/Paper
7.22
13.11
18.63
15.14
6.00
14.25
8.04
10.49
1.80
21.88
0.00
20.87
16.18
49.75
14.57
19.96
13.50
4.12
12.00
14.98

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles
There are 193 (21.21% of the papers analyzed) highly cited EPA drinking water papers in 15 of the 19
fields—Agricultural Sciences, Biology & Biochemistry, Chemistry, Clinical Medicine, Economics &
Business, Engineering, Environment/Ecology, Geosciences, Immunology, Microbiology,
Multidisciplinary, Neuroscience & Behavior, Pharmacology & Toxicology, Physics, and Social
Sciences—when using the ESI criteria for the top 10% of papers.  Table 2 shows the number of
drinking water papers in those 15 fields that meet the top 10% threshold in ESI. Twenty-six (2.86%)
of the papers analyzed qualify as highly cited when using the ESI criteria for the top 1% of papers.
These papers cover 7 fields—Chemistry, Clinical Medicine, Engineering, Environment/Ecology,
Microbiology,  Multidisciplinary, and Pharmacology & Toxicology. Table 3 shows the 26 papers by
field that meet the top 1% threshold in ESI.  The citations for these 26 papers are provided in Tables
4 through 10.  There was 1 (0.11%) very highly cited drinking water paper in the field of
Multidisciplinary. The paper, which met the top 0.1% threshold in ESI, is listed in Table 11. None
of the drinking water papers met the top 0.01% threshold in ESI, which is not surprising given that
the expected number of papers that should meet this threshold for this analysis is 0.09.
Table 2. Number of Highly Cited Drinking Water Papers by Field i
ESI Field
Agricultural Sciences
Biology & Biochemistry
Chemistry
Clinical Medicine
Economics & Business
Engineering
Environment/Ecology
Geosciences
Immunology
Microbiology
Multidisciplinary
Neuroscience & Behavior
Pharmacology & Toxicology
Physics
Social Sciences, general

No. of Citations
73
156
942
736
48
319
1,579
2
193
1,266
199
57
1,638
27
100
Total = 7,335
No. of Papers
4
4
28
16
2
19
66
1
2
18
2
1
24
1
5
Total = 193
Average Cites/Paper
18.25
39.00
33.64
46.00
24.00
16.79
23.92
2.00
96.50
70.33
99.50
57.00
68.25
27.00
20.00
38.00
top 10%)
% of Papers in Field
22.22%
14.81%
38.36%
15.38%
50.00%
34.55%
24.72%
20.00%
7.69%
16.98%
50.00%
7.14%
16.90%
50.00%
55.56%
21.21%

-------
           Bibliometric Analysis of Drinking Water Research Program Journal Articles




     Table 3. Number of Highly Cited Drinking Water Papers by Field (top 1%)
ESI Field
Chemistry
Clinical Medicine
Engineering
Environment/Ecology
Microbiology
Multidisciplinary
Pharmacology & Toxicology

No. of
Citations
43
87
95
232
318
199
761
Total =
1,735
No. of
Papers
2
1
3
11
2
2
5
Total =
26
Average
Cites/Paper
21.50
87.00
31.67
21.09
159.00
99.50
152.20
66.73
% of EPA
Papers in
Field
2.74%
0.96%
5.45%
4.12%
1.89%
50.00%
3.52%
2.86%
   Table 4. Highly Cited Drinking Water Papers in the Field of Chemistry (top 1%)
No. of
Cites
20
23
First Author
Tufenkji N
Richardson SD
Paper
Breakdown of colloid filtration theory: Role of the secondary energy
minimum and surface charge heterogeneities. Langmuir
2005;21(3):841-852.
Water analysis: emerging contaminants and current issues.
CAeiwwfry2005;77(12):3807-3838.
Analytical
Table 5.  Highly Cited Drinking Water Paper in the Field of Clinical Medicine (top 1%)
No. of
Cites
87
First Author
Linde smith L
Paper
Human susceptibility and resistance to Norwalk virus
Nature Medicine 2003;9(5):548-553.
infection.
  Table 6.  Highly Cited Drinking Water Papers in the Field of Engineering (top 1%)
No. of
Cites
57
23
First Author
RiceEW
XuJL
Paper
Evaluating plant performance with endospores. Journal American
Water Works Association 1996;88(9): 122-130.
Microbial degradation of perchlorate: principles and applications.
Environmental Engineering Science 2003;20(5):405-422.

-------
Bibliometric Analysis of Drinking Water Research Program Journal Articles
No. of
Cites
15
First Author
Budde WL
Paper
Analytical mass spectrometry of herbicides.
Reviews 2004;23(l):l-24.
Mass Spectrometry
Table 7. Highly Cited Drinking Water Papers in the Field of Environment/Ecology (top 1%
No. of
Cites
59
59
51
26
4
4
5
5
5
6
8
First Author
Styblo M
Simpson JM
Metcalfe CD
Glassmeyer
SD
Chiu WA
Craun GF
Colford J
Craun GF
Calderon RL
Craun MF
Groffman P
Paper
The role of biomethylation in toxicity and carcinogenicity of arsenic: a
research update. Environmental Health Perspectives 2002;! 10(Suppl
5):767-771.
Microbial source tracking: state of the science. Environmental Science &
Technology 2002;36(24):5279-5288.
Distribution of acidic and neutral drugs in surface waters near sewage
treatment plants in the lower Great Lakes, Canada. Environmental
Toxicology and Chemistry 2003;22(12):288 1-2889.
Transport of chemical and microbial compounds from known wastewater
discharges: potential for use as indicators of human fecal contamination.
Environmental Science & Technology 2005;39(14):5 157-5 169.
Issues in the pharmacokinetics of trichloroethylene and its metabolites.
Environmental Health Perspectives 2006;! 14(9): 1450-1456.
Observational epidemiologic studies of endemic waterborne risks: Cohort,
case-control, time-series, and ecologic studies. Journal of Water and
Health 2006;4(Suppl 2): 101-120.
A review of household drinking water intervention trials and an approach
to the estimation of endemic waterborne gastroenteritis in the United
States. Journal of Water and Health 2006;4(Suppl 2):71-88.
Assessing waterborne risks: an introduction. Journal of Water and Health
2006;4(Suppl2):3-18.
Estimates of endemic waterborne risks from community-intervention
studies. Journal of Water and Health 2006;4(Suppl 2):89-100.
Waterborne outbreaks reported in the United States. Journal of Water and
Health 2006;4(Suppl 2): 19-30.
Ecological thresholds: the key to successful environmental management or
an important concept with no practical application? Ecosystems
2006;9(1):1-13.

-------
            Bibliometric Analysis of Drinking Water Research Program Journal Articles

  Table 8.  Highly Cited Drinking Water Papers in the Field of Microbiology (top 1%)
No. of
Cites
208
110
First Author
Payer R
Morgan-Ryan
UM
Paper
Epidemiology of Cryptosporidium: transmission, detection and
identification. International Journal for Parasitology 2000;30(12-
13):1305-1322.
Cryptosporidium hominis n. sp (Apicomplexa : Cryptosporidiidae) from
Homo sapiens. Journal of Eukaryotic Microbiology 2002;49(6):433-440.
Table 9.  Highly Cited Drinking Water Papers in the Field of Multidisciplinary (top 1%)
No. of
Cites
65
134
First Author
XuP
Abrahamsen
MS
Paper
The genome of Cryptosporidium hominis. Nature 2004;43 1(7012):
1112.
1107-
Complete genome sequence of the apicomplexan, Cryptosporidium
parvum. Science 2004;304(5669):441-445.
            Table 10. Highly Cited Drinking Water Papers in the Field of
                        Pharmacology & Toxicology (top 1%)
No. of
Cites
183
134
153
187
104
First Author
Styblo M
Thomas DJ
Mass MJ
Kitchin KT
Hughes MF
Paper
Comparative toxicity of trivalent and pentavalent inorganic and methylated
arsenicals in rat and human cells. Archives of Toxicology 2000;74(6):289-
299.
The cellular metabolism and systemic toxicity of arsenic. Toxicology and
Applied Pharmacology 2001; 176(2): 127-144.
Methylated trivalent arsenic species are genotoxic. Chemical Research in
Toxicology 2001;14(4):355-361.
Recent advances in arsenic carcinogenesis: modes of action, animal model
systems, and methylated arsenic metabolites. Toxicology and Applied
Pharmacology 200l;l72(3y.249-26l.
Arsenic toxicity and potential mechanisms of action. Toxicology Letters
2002;133(1):1-16.

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles

                Table 11. Very Highly Cited Drinking Water Paper (top 0.1%)
ESI Field
Multidisciplinary
No. of
Cites
134
First Author
Abrahamsen MS
Paper
Complete genome sequence of the apicomplexan,
Cryptosporidiumparvum. Science 2004;304(5669):441-445.
Ratio of Actual Cites to Expected Citation Rates

The expected citation rate is the average number of cites that a paper published in the same journal in
the same year and of the same document type (article, review, editorial, etc.) has received from the
year of publication to the present.  Using the ESI average citation rates for papers published by field as
the benchmark, in 14 of the 19 fields in which the EPA drinking water papers were published, the ratio
of actual to expected cites is greater than 1, indicating that the drinking water papers are more highly
cited than the average papers in those fields (see Table 12).  For all 19 fields combined, the ratio of
total number of cites to the total number of expected cites (13,632 to 8,944.60) is 1.52, indicating that
the drinking water papers are more highly  cited than the average paper.

     Table 12. Ratio of Actual Cites to Expected Cites for Drinking Water Papers by Field
ESI Field
Agricultural Sciences
Biology & Biochemistry
Chemistry
Clinical Medicine
Computer Science
Economics & Business
Engineering
Environment/Ecology
Geosciences
Immunology
Materials Science
Microbiology
Molecular Biology & Genetics
Multidisciplinary
Neuroscience & Behavior
Pharmacology & Toxicology
Total
Cites
130
354
1,360
1,575
6
57
442
2,800
9
569
0
2,212
712
199
204
2,835
Expected Cite
Rate
95.80
323.92
668.55
1,166.73
4.02
18.30
194.77
1,734.88
18.33
514.70
0.22
1,357.75
1,135.17
14.06
221.60
1,400.67
Ratio
1.36
1.09
2.03
1.35
1.49
3.11
2.27
1.61
0.49
1.10
0.00
1.63
0.63
14.15
0.92
2.02

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles
ESI Field
Physics
Plant & Animal Science
Social Sciences, general
TOTAL
Total
Cites
27
33
108
13,632
Expected Cite
Rate
7.80
38.23
29.10
8,944.60
Ratio
3.46
0.86
3.71
1.52
JCR Benchmarks

Impact Factor.  The JCR Impact Factor is a well known metric in citation analysis. It is a measure of
the frequency with which the "average article" in a journal has been cited in a particular year.  The
Impact Factor helps evaluate a journal's relative importance, especially when compared to others in the
same field. The Impact Factor is calculated by dividing the number of citations in the current year to
articles published in the 2 previous years by the total number of articles published in the 2 previous
years.

Table 13 indicates the number of drinking water papers published in the top 10% of journals, based  on
the JCR Impact Factor.  Four hundred eleven (411) of 910 papers were published in the top 10% of
journals, representing 45.16% of EPA's drinking water papers. This indicates that nearly one-half of
the drinking water papers are published in the highest quality journals as determined by the JCR
Impact Factor, which is 4.52 times higher than the expected percentage.

        Table 13. Drinking Water Papers in Top 10% of Journals by JCR Impact Factor
Drinking
Water Papers
in that
Journal
2
1
1
1
1
1
1
1
1
1
1
Journal
Science
Nature
Nature Medicine
Lancet
Nature Biotechnology
Chemical Reviews
Mass Spectrometry Reviews
Genome Biology
Drug Discovery Today
Nucleic Acids Research
FASEB Journal
Impact
Factor
(IF)
30.927
29.273
28.878
23.878
22.738
20.869
13.273
9.712
7.755
7.552
7.064
JCR IF
Rank
6
11
12
17
20
23
60
106
151
162
181

-------
Bibliometric Analysis of Drinking Water Research Program Journal Articles
Drinking
Water Papers
in that
Journal
1
1
1
1
2
24
29
3
2
5
5
3
1
1
10
1
1
1
1
4
55
3
5
1
9
46
1
1
1
Journal
Progress in Nuclear Magnetic Resonance Spectroscopy
Molecular Microbiology
Bioinformatics
Journal of Biological Chemistry
AIDS
Analytical Chemistry
Environmental Health Perspectives
Mutation Research — Reviews in Mutation Research
Emerging Infectious Diseases
Journal of Virology
Carcinogenesis
American Journal of Epidemiology
Critical Reviews in Toxicology
Free Radical Biology and Medicine
Journal of Infectious Diseases
Bioscience
Cancer Epidemiology Biomarkers & Prevention
Pediatrics
Current Opinion in Infectious Diseases
TrAC - Trends in Analytical Chemistry
Environmental Science & Technology
International Journal of Epidemiology
Epidemiology
Drug Metabolism and Disposition
Infection and Immunity
Applied and Environmental Microbiology
Ecological Applications
Current Opinion in Drug Discovery & Development
Langmuir
Impact
Factor
(IF)
6.462
6.203
6.019
5.854
5.835
5.635
5.342
5.333
5.308
5.178
5.108
5.068
5.000
4.971
4.953
4.708
4.460
4.272
4.258
4.088
4.054
4.045
4.043
4.015
3.933
3.818
3.804
3.778
3.705
JCR IF
Rank
201
213
224
232
234
242
257
259
264
278
288
290
297
303
307
336
378
420
425
460
467
470
471
481
506
544
548
555
569
                                10

-------
                 Bibliometric Analysis of Drinking Water Research Program Journal Articles
Drinking
Water Papers
in that
Journal
1
1
11
5
1
9
2
3
8
14
1
1
1
21
1
7
30
1
1
7
45
8
1
Total = 411
Journal
Journal of Nutrition
Human Reproduction
Journal of Analytical Atomic Spectrometry
Journal of the American Society for Mass Spectrometry
Methods
Journal of Clinical Microbiology
Ecosystems
International Journal for Parasitology
Mutation Research-Fundamental and Molecular Mechanisms
of Mutagenesis
Chemical Research in Toxicology
Journal of Economic Geography
Microbiology-SGM
Archives of Biochemistry and Biophysics
Toxicology and Applied Pharmacology
Reproduction
Journal of Chromatography A
Toxicological Sciences
Critical Reviews in Environmental Science and Technology
Virology
Cancer Letters
Water Research
Analyst
Environment International

Impact
Factor
(IF)
3.689
3.669
3.640
3.625
3.591
3.537
3.455
3.346
3.340
3.339
3.222
3.173
3.152
3.148
3.136
3.096
3.088
3.080
3.080
3.049
3.019
2.858
2.856

JCR IF
Rank
574
581
591
594
610
630
661
695
697
700
733
751
762
765
768
779
781
786
786
801
810
877
879

Immediacy Index.  The JCR Immediacy Index is a measure of how quickly the average article in a
journal is cited. It indicates how often articles published in a journal are cited within the year they are
published.  The Immediacy Index is calculated by dividing the number of citations to articles published
in a given year by the number of articles published in that year.
                                              11

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles
Table 14 indicates the number of drinking water papers published in the top 10% of journals, based on
the JCR Immediacy Index. Two hundred seventy-eight (278) of the 910 papers appear in the top 10%
of journals, representing 30.55% of the drinking water papers. This indicates that nearly one-third of
the drinking water papers are published in the highest quality journals as determined by the JCR
Immediacy Index, which is 3.06 times higher than the expected percentage.

          Table 14.  Drinking Water in Top 10% of Journals by JCR Immediacy Index
Drinking
Water Papers
in that Journal
1
1
2
1
1
1
1
3
10
1
1
2
5
1
1
1
4
1
1
3
5
1
1
29
Journal
Lancet
Nature Medicine
Science
Nature
Nature Biotechnology
Chemical Reviews
Mass Spectrometry Reviews
International Journal of Epidemiology
Journal of Infectious Diseases
Molecular Microbiology
Nucleic Acids Research
International Journal of Toxicology
Epidemiology
Journal of Biological Chemistry
Genome Biology
FASEB Journal
Mutation Research-Reviews in Mutation Research
Drug Discovery Today
Progress in Nuclear Magnetic Resonance Spectroscopy
American Journal of Epidemiology
Journal of Virology
Pediatrics
Harmful Algae
Environmental Health Perspectives
Immediacy
Index
(II)
7.347
6.600
6.398
5.825
5.210
4.523
2.220
1.791
1.547
1.402
1.391
1.309
1.298
1.265
1.230
1.181
1.143
1.125
1.111
1.099
1.059
1.005
0.976
0.955
JCR II
Rank
5
6
7
11
16
23
76
111
145
170
173
193
198
208
221
238
251
257
266
271
284
309
331
346
                                             12

-------
Bibliometric Analysis of Drinking Water Research Program Journal Articles
Drinking
Water Papers
in that Journal
1
2
5
2
1
1
1
6
14
1
24
1
1
8
4
1
1
1
1
5
9
4
30
1
1
1
1
Journal
Bioinformatics
AIDS
Carcinogenesis
Emerging Infectious Diseases
Archives of Biochemistry and Biophysics
Drug Metabolism and Disposition
Bioscience
Science of the Total Environment
Chemical Research in Toxicology
Methods
Analytical Chemistry
Free Radical Biology and Medicine
Human Reproduction
Mutation Research-Fundamental and Molecular
Mechanisms of Mutagenesis
TrAC - Trends in Analytical Chemistry
ATLA-Alternatives to Laboratory Animals
Mental Retardation and Developmental Disabilities
Research Reviews
Virology
Current Opinion in Drug Discovery & Development
Journal of the American Society for Mass Spectrometry
Infection and Immunity
Human and Ecological Risk Assessment
Toxicological Sciences
Langmuir
Journal of Nutrition
Current Opinion in Infectious Diseases
Microbiology-SGM
Immediacy
Index
(II)
0.944
0.937
0.935
0.840
0.774
0.733
0.731
0.731
0.729
0.720
0.713
0.696
0.693
0.682
0.679
0.676
0.667
0.664
0.662
0.649
0.648
0.628
0.617
0.610
0.598
0.585
0.571
JCRll
Rank
354
360
362
440
495
534
538
538
542
558
569
585
596
604
610
615
628
638
642
660
663
698
715
723
741
767
800
                                13

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles
Drinking
Water Papers
in that Journal
7
8
1
1
55
Total = 278
Journal
Journal of Exposure Analysis and Environmental
Epidemiology
Analyst
Diagnostic Microbiology and Infectious Disease
Ecological Applications
Environmental Science & Technology

Immediacy
Index
(II)
0.571
0.546
0.546
0.543
0.541

JCRll
Rank
800
861
861
869
874

Hot Papers

ESI establishes citation thresholds for hot papers, which are selected from the highly cited papers in
different fields, but the time frame for citing and cited papers is much shorter—papers must be cited
within 2 years of publication and the citations must occur in a 2-month time period. Papers are
assigned to 2-month periods and thresholds are set for each period and field to select 0.1% of papers.
There were no hot papers identified for the current 2-month period (i.e., March-April 2007), but there
were a number of hot papers identified from previous periods.

Using the hot paper thresholds established by ESI as a benchmark, 14 hot papers, representing 1.54%
of the drinking water papers, were identified in four fields—Economics & Business,
Environment/Ecology, Multidisciplinary, and Pharmacology & Toxicology.  The number of drinking
water hot papers is 15.4 times higher than  expected. The hot papers are listed in Table 15.

                     Table 15.  Hot Papers Identified Using ESI Thresholds

Field
Economics &
Business

Environment/
Ecology
ESI Hot
Papers
Threshold
3
4

7
No. of Cites
in 2-Month
Period
3 cites in
November
2002
4 cites in
November
2002
10 cites in
July-August
2004

Paper
Irwin EG, Bockstael NE. The problem of identifying land
use spillovers: measuring the effects of open space on
residential property values. American Journal of
Agricultural Economics 2001;83(3):698-704.
Irwin EG, Bockstael NE. Interacting agents, spatial
externalities and the evolution of residential land use
patterns. Journal of Economic Geography 2002;2(l):31-54.
Styblo M, et al. The role of biomethylation in toxicity and
carcinogenicity of arsenic: a research update.
Environmental Health Perspectives 2002;110(Suppl 5):767-
771.
                                              14

-------
                 Bibliometric Analysis of Drinking Water Research Program Journal Articles
      Field
 ESI Hot
  Papers
Threshold
No. of Cites
in 2-Month
   Period
Paper
Environment/
Ecology
              12 cites in
              December
            2006-January
               2007
             Glassmeyer ST, et al. Transport of chemical and microbial
             compounds from known wastewater discharges:  potential
             for use as indicators of human fecal contamination.
             Environmental Science & Technology 2005;39(14):5157-
             5169.
                               3 cites in
                               September
                                 2006
                          Chiu WA. Issues in the pharmacokinetics of
                          trichloroethylene and its metabolites. Environmental Health
                          Perspectives 2006;! 14(9): 1450-1456.
                             4 cites in June
                                 2006
                          Craun GE, Calderon RL.  Observational epidemiologic
                          studies of endemic waterborne risks: cohort, case-control,
                          time-series, and ecologic studies. Journal of Water and
                          Health 2006;4(Suppl 2): 101-120.
                             5 cites in June
                                 2006
                          Colford Jr. JM, et al. A review of household drinking water
                          intervention trials and an approach to the estimation of
                          endemic waterborne gastroenteritis in the United States.
                          Journal of Water and Health 2006;4(Suppl 2):71-88.
                             5 cites in June
                                 2006
                          Craun GF, et al. Assessing waterborne risks:  an
                          introduction. Journal of Water and Health 2006;4(Suppl
                          2):3-18.
                             5 cites in June
                                 2006
                          Calderon Rl, Craun GF. Estimates of endemic waterborne
                          risks from community-intervention studies. Journal of
                          Water and Health 2006;4(Suppl 2):89-100.
                             6 cites in June
                                 2006
                          Craun, et al. Waterborne outbreaks reported in the United
                          States. Journal of Water and Health 2006;4(Suppl 2): 19-30.
                               3 cites in
                               May-June
                                 2006
                          Groffman P, et al.  Ecological thresholds: the key to
                          successful environmental management or an important
                          concept with no practical application? Ecosystems
                          2006;9(1):1-13.
Multidisciplinary
              9 cites in
             September-
            October 2004
             Abrahamsen MS, et al.  Complete genome sequence of the
             apicomplexan, Cryptosporidium parvum.  Science
             2004;304(5669):441-445.
Pharmacology &
Toxicology
              7 cites in
             November-
             December
                2002
             Thomas DJ, et al. The cellular metabolism and systemic
             toxicity of arsenic. Toxicology and Applied Pharmacology
             2001;176(2):127-144.
                               11 cites in
                                August-
                               September
                                 2004
                          Nesnow S, et al. DNA damage induced by methylated
                          trivalent arsenicals is mediated by reactive oxygen species.
                          Chemical Research in Toxicology 2002; 15(12): 1627-1634.
                                                15

-------
                 Bibliometric Analysis of Drinking Water Research Program Journal Articles

Author Self-Citation

Self-citations are journal article references to articles from that same author (i.e., the first author).
Because higher author self-citation rates can inflate the number of citations, the author self-citation rate
was calculated for the drinking water papers. Of the 13,632 total cites, 661 are author self-cites—a
4.85% author self-citation rate.  Garfield and Sher3 found that authors working in research-based
disciplines tend to cite themselves on the average of 20% of the time. MacRoberts and MacRoberts4
claim that approximately  10% to 30% of all the citations listed fall into the category of author self-
citation. Kovacic and Misak5 recently reported a 20% author self-citation rate for medical literature.
Therefore, the 4.85% self-cite rate for the drinking water papers is well below the range for author self-
citation.

Highly Cited Researchers

A search of Thomson's ISIHighlyCited. com  revealed that 20 (0.93%) of the 2,142 authors of the
drinking water papers are highly cited researchers. ISIHighlyCited.com is a database of the world's
most influential researchers who have made  key contributions to science and technology during the
period from 1981 to 1999. The highly cited researchers identified during this analysis of the drinking
water publications are presented in Table 16.

           Table 16. Highly Cited Researchers Authoring Drinking Water Publications
Highly Cited
Researcher
Allen, Herbert E.
Anderson, Melvin E.
Birnbaum, Linda S.
Boobis, Alan R.
Brusseau, Mark L.
Dubey, Jitender P.
John, Giesy P.
Glass, Roger I.
Groffinan, Peter Mark
Affiliation
University of Delaware
CUT Centers for Health Research
U.S. Environmental Protection
Agency
Imperial College London
University of Arizona
U.S. Department of Agriculture/
Agricultural Research Services
University of Saskatchewan
Centers for Disease Control and
Prevention
Institute of Ecosystem Studies
ESI Field
Environment/Ecology
Pharmacology
Pharmacology
Pharmacology
Environment/Ecology and
Engineering
Plant & Animal Science
Environment/Ecology
Microbiology
Environment/Ecology
   Garfield E, Sher IH.  New factors in the evaluation of scientific literature through citation indexing. American
   Documentation 1963;18(July):195-210.

4  MacRoberts MH, MacRoberts BR. Problems of citation analysis: a critical review. Journal of the American Society of
   Information Science  1989;40(5):342-349.

5  Kavaci N, Misak A.  Author self-citation in medical literature. Canadian Medical Association Journal
   2004;170(13):1929-1930.
                                                16

-------
                Bibliometric Analysis of Drinking Water Research Program Journal Articles
Highly Cited
Researcher
Johnson, Kenneth M.
Kimber, Ian
Lindsay, David S.
Liu, Jie
Paerl, Hans E.
Pearson, William R.
Schwartz, Joel D.
Thurman, E. Michael
Truhlar, Donald G.
Turner, Monica G.
Wiens, John A.
Total = 20
Affiliation
University of Texas Medical Branch
at Galveston
Syngenta Central Toxicology
Laboratory
Virginia Polytechnic Institute and
State University
National Institute of Environmental
Health Sciences
University of North Carolina-Chapel
Hill Institute of Marine Sciences
University of Virginia
Harvard School of Public Health
U.S. Geological Survey
University of Minnesota
University of Wisconsin
Nature Conservancy

ESI Field
Pharmacology
Pharmacology
Plant & Animal Science
Pharmacology
Plant & Animal Science
Biology & Biochemistry
Environment/Ecology
Environment/Ecology and
Engineering
Chemistry
Environment/Ecology
Environment/Ecology

Patents


There was 1 patent issued to an investigator during the period 1996 to 2006 for research that was
conducted under EPA's Drinking Water Research Program. This patent has been cited by one other
patent. The patent and the patent that cites it are listed in Table 17.

           Table 17. Patent from the Drinking Water Research Program (1996-2006)
Patent No.
6,365,048
Inventor(s)
Masten SJ
Yavich AA
Title
Method for treatment of organic
matter contaminated drinking
water
Patent Date
4/2/02
Patents that Referenced This
Patent
Referenced by 1 patent:
(1)6,893,559 System and
method for removing organic
compounds from waste water
by oxidation
                              This bibliometric analysis was prepared by
                        Beverly Campbell of The Scientific Consulting Group, Inc.
                                     in Gaithersburg, Maryland
                                under EPA Contract No. EP-C-05-015
                                              17

-------