<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Tahoma","sans-serif";}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Tahoma","sans-serif";
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-AU" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Where do I start?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">JIF and most other quantitative measures of quality have been shown to have major problems of external influence, the results being largely irreproducible, and methodology. Despite
that the bean counters love it!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">This is essential reading.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Seglen, P. O. (1997). "Why the impact factor of journals should not be used for evaluating research."
<u>British Medical Journal</u> <b>314 </b>(Feb 15): 498-502.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">The JIF is an inverted extension of Bradford’s Law<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Bradford S C (1934) “Sources of information on specific subjects”
<i>Engineering: An Illustrated Weekly Journal </i>Arthur Ernest Maw, London 137(3550) [Reprinted (1985)
<i>J Information Science </i><b>10</b>,176-180]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">which has been shown to be a Gini distribution anyhow.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Burrell, Q. L. (1992). "The Gini Index and the Leimkuhler Curve for Bibliometric Processes."
<u>Information Processing & Management</u> <b>28</b>(1): 19-33.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">You can get a summary of that and its development in<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Lamp, J. W., S. K. Milton, L. Dawson and J. Fisher (2007) "RQF Publication Quality Measures: Methodological Issues",
<i>Proceedings of the Eighteenth Australasian Conference on Information Systems</i>, University of Southern Queensland, 478-486<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><a href="http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1012&context=acis2007">http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1012&context=acis2007</a>
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Do also have a look at
<a href="http://lamp.infosys.deakin.edu.au/journals/?page=rankanalysis">http://lamp.infosys.deakin.edu.au/journals/?page=rankanalysis</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Specifically IS related sample:<o:p></o:p></span></p>
<p class="MsoNormal">Ferratt, T.W., Gorman, M.F., Kanet, J.J. & Salisbury, W.D. (2007) "IS Journal Quality Assessment Using the Author Affiliation Index "<cite><span style="font-family:"Calibri","sans-serif"">Communications of the Association for Information
Systems</span></cite>, 19(34).<o:p></o:p></p>
<p class="MsoNormal">Katerattanakul, P., B. Han, et al. (2003). "Objective quality ranking of computing journals."
<i>Communications of the ACM</i> 46(10): 111-114. <o:p></o:p></p>
<p class="MsoNormal">Katerattanakul, P., M. Razi, et al. (2003). "IS journal rankings versus citation analysis: consistency and concerns".
<i>Ninth Americas Conference on Information Systems</i>, Tampa, Florida.<o:p></o:p></p>
<p class="MsoNormal">Knight, S.A. (2009)."Journal Self-Citation XVI: Academic Citations - A Question of Ethics?,"
<i>Communications of the Association for Information Systems</i> 25(1), 130-139. <o:p>
</o:p></p>
<p class="MsoNormal">Lamp, J. W. (2006) "Recognition as a distinguishing characteristic of IS journals"
<i>Australasian Journal of Information Systems</i>, 13(2), 7-16 <a href="http://lamp.infosys.deakin.edu.au/pubs/06_ajis_recognition.pdf">
<span style="text-decoration:none"><img border="0" width="16" height="16" id="Picture_x0020_2" src="cid:image001.gif@01CEB83E.9C691AA0" alt="Click for PDF file"></span></a><o:p></o:p></p>
<p class="MsoNormal">Lamp, J. W. (2007) "Perceptions of Gender Balance of IS Journal Editorial Positions"
<i><u><span style="color:blue">Communications of the AIS</span></u></i>, 20, 124-133
<a href="http://lamp.infosys.deakin.edu.au/pubs/getgb.php"><span style="text-decoration:none"><img border="0" width="16" height="16" id="Picture_x0020_1" src="cid:image001.gif@01CEB83E.9C691AA0" alt="Click for PDF file"></span></a><o:p></o:p></p>
<p class="MsoNormal">Lamp, J. W. (2009). "Journal Ranking and the Dreams of Academics."
<i>Online Information Review</i> 33(4): 827-30. <o:p></o:p></p>
<p class="MsoNormal">Mingers, J, Macri, F & Petrovici, D (2012), "Using the h-index to measure the quality of journals in the field of business and management",
<i>Information Processing & Management</i>, 48(2), 234-41. <o:p></o:p></p>
<p class="MsoNormal">Mylonopoulos, N. A. and V. Theoharakis (2001). "Global Perceptions of IS Journals: Where is the Best IS Research Published?"
<i>Communications of the ACM</i> 44(9): 29-33.<o:p></o:p></p>
<p class="MsoNormal">Peffers, K. and Y. Tang (2003). "Identifying and evaluating the universe of outlets for information systems research: Ranking the journals."
<i>J Information Technology Theory and Application</i> 5(1): 63-84. <o:p></o:p></p>
<p class="MsoNormal">Rainer, R. K. and M. D. Miller (2005). "Examining Differences Across Journal Rankings."
<i>Comm of the ACM</i> 48(2): 91-94. <o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">I also have these:<o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Althouse, B. M., et al. (2008). "Differences in impact factor across fields and over time."
<u>Journal of the American Society for Information Science and Technology</u> <b>
60</b>(1): 27-34.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Bjork, B.-C. and D. Solomon (2012). "Open access versus subscription journals: a comparison of scientific impact."
<u>BMC Medicine</u> <b>10</b>(1): 73.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Drew, D. E. (2009). "Journal Self-Citation XXII: On the Journal Impact Factor–A Historical Perspective."
<u>Communications of the Association for Information Systems</u> <b>25</b>(1): 22.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Eugene, G. (2005). The Agony and the Ecstasy—The History and Meaning of the Journal Impact Factor.
<u>International Congress on Peer Review And Biomedical Publication</u>.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Garfield, E. (1996). "How can impact factors be improved?"
<u>BMJ: British Medical Journal</u> <b>313</b>(7054): 411.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Huang, M.-H. and W.-Y. C. Lin (2012). "The Influence of Journal Self-citations on Journal Impact Factor and Immediacy Index."
<u>Online Information Review</u> <b>36</b>(5).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Jacsó, P. (2012). "Using Google Scholar for journal impact factors and the h-index in nationwide publishing assessments in academia – siren songs and air-raid sirens."
<u>Online Information Review</u> <b>36</b>(3): 462 - 478.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Jarwal, S. D., et al. (2009). "Measuring research quality using the journal impact factor, citations and 'Ranked Journals': blunt instruments or inspired metrics?"
<u>Journal of Higher Education Policy and Management</u> <b>31</b>(4): 289 - 300.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Lozano, G. A., et al. (2012). "The weakening relationship between the Impact Factor and papers' citations in the digital age."
<u>arXiv preprint arXiv:1205.4328</u>.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Seglen, P. O. (1999). "Causal relationship between article citedness and journal impact."
<u>Journal of the American Society for Information Science</u> <b>45</b>(1): 1-11.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Solomon, D. J. and B.-C. Björk (2012). "A study of open access journals using article processing charges."
<u>Journal of the American Society for Information Science and Technology</u> <b>
63</b>(8): 1485-1495.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US">Excuse the mixed reference format!
</span><span style="font-family:Wingdings;color:#1F497D;mso-fareast-language:EN-US">J</span><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F4E79">Cheers<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F4E79">John<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> aisworld-bounces@lists.aisnet.org [mailto:aisworld-bounces@lists.aisnet.org]
<b>On Behalf Of </b>Kappelman, Leon<br>
<b>Sent:</b> Monday, 23 September 2013 3:23 AM<br>
<b>To:</b> aisworld@lists.aisnet.org<br>
<b>Subject:</b> [AISWorld] Downside of impact factors: Scientists engaging in 'citation stacking'<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoPlainText"><span lang="EN-US">Some of our institutions have adopted or are considering the use of impact factors as a metric for faculty performance. Certainly our current faculty performance measures are less than perfect so it seems to be a
suggestion worthy of consideration. But impact factors are not without controversy and apparently prone to manipulation and questionable behaviors. So before embracing impact factors, consider that at least to some extent they are a measure of what some
might call “incestuous citation behaviors.” Not surprising since most all of us understand that when it comes to human behavior, you get what you measure. The big question is: Do the positives of using impact factors, or any other metric or combination of
measure for that matter, sufficiently outweigh the negatives? <o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US">Here is some of the “food for thought” that raised my eyebrows enough to send this note:<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><a href="http://www.nature.com/news/brazilian-citation-scheme-outed-1.13604">http://www.nature.com/news/brazilian-citation-scheme-outed-1.13604</a><o:p></o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><a href="http://occamstypewriter.org/scurry/2012/08/13/sick-of-impact-factors/">http://occamstypewriter.org/scurry/2012/08/13/sick-of-impact-factors/</a><o:p></o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><a href="http://retractionwatch.wordpress.com/2013/08/30/journal-retracts-two-papers-after-being-caught-manipulating-citations/">http://retractionwatch.wordpress.com/2013/08/30/journal-retracts-two-papers-after-being-caught-manipulating-citations/</a><o:p></o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText" style="margin-left:36.0pt"><span lang="EN-US"><a href="http://www.naturalnews.com/042152_citation_stacking_scientific_journals_dishonesty.html"><span style="color:windowtext;text-decoration:none">http://www.naturalnews.com/042152_citation_stacking_scientific_journals_dishonesty.html</span></a><o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-bottom:6.0pt"><span lang="EN-US" style="font-size:12.0pt;font-family:"Tahoma","sans-serif";color:black">Best wishes,<br>
Leon Kappelman<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-top:6.0pt"><b><span lang="EN-US" style="font-size:9.0pt;font-family:"Tahoma","sans-serif";color:black">“Only a virtuous people are capable of freedom.” – Benjamin Franklin
<o:p></o:p></span></b></p>
<p class="MsoNormal" style="margin-top:6.0pt;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:9.0pt;font-family:"Tahoma","sans-serif";color:black">----------------------------------------------------------------------------------------------------------------------------------------------<br>
</span><span lang="EN-US" style="font-size:8.0pt;font-family:"Tahoma","sans-serif";color:black">Leon A. Kappelman, Ph.D.
<br>
Professor of Information Systems <br>
Director Emeritus, Information Systems Research Center<br>
Fellow, Texas Center for Digital Knowledge<br>
College of Business, University of North Texas<br>
Voice: 940-565-4698 Email: </span><span lang="EN-US"><a href="mailto:kapp@unt.edu"><span style="font-size:8.0pt;font-family:"Tahoma","sans-serif"">kapp@unt.edu</span></a></span><span lang="EN-US" style="font-size:8.0pt;font-family:"Tahoma","sans-serif";color:black"><br>
Founding Chair, Society for Information Management's Enterprise Architecture Working Group<br>
</span><span lang="EN-US" style="font-size:9.0pt;font-family:"Tahoma","sans-serif";color:black">----------------------------------------------------------------------------------------------------------------------------------------------</span><span lang="EN-US" style="font-size:8.0pt;font-family:"Tahoma","sans-serif";color:black"><br>
</span><span lang="EN-US" style="font-size:9.0pt;font-family:"Tahoma","sans-serif";color:#1C7C00">Please consider the environment before printing this e-mail</span><span lang="EN-US" style="font-size:9.0pt;font-family:"Tahoma","sans-serif";color:#006666"> </span><span lang="EN-US" style="font-family:"Tahoma","sans-serif";color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<span style="font-size: 9.0pt; font-family: 'Calibri'; "><em><strong><br>Important Notice:</strong> The contents of this email are intended solely for the named addressee and are confidential; any unauthorised use, reproduction or storage of the contents is expressly prohibited. If you have received this email in error, please delete it and any attachments immediately and advise the sender by return email or telephone.<br><br>Deakin University does not warrant that this email and any attachments are error or virus free.</em></span></body>
</html>