Durham Leading Research Module 13 (Bibliometrics and Altmetrics)
•Als PPTX, PDF herunterladen•
2 gefällt mir•532 views
See Module 14 (Part 1 - open access) at http://prezi.com/_ldummy-8rak/?utm_campaign=share&utm_medium=copy
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Andere mochten auch (8)
Ähnlich wie Durham Leading Research Module 13 (Bibliometrics and Altmetrics)
Ähnlich wie Durham Leading Research Module 13 (Bibliometrics and Altmetrics) (20)
Mehr von Jamie Bisset
Mehr von Jamie Bisset (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Durham Leading Research Module 13 (Bibliometrics and Altmetrics)
- 1. Leading Research Programme 2015: Module 13 Academic Impact: Bibliometrics & Altmetrics James Bisset Academic Liaison Librarian (Research Support)
- 2. Session outline - Introduction - Citations - Monitoring and assessing - Author metrics - Networking opportunities & performance measurement ? - Journal metrics - Impact factors and where to publish - Altmetrics (in brief) - Changes in scholarly communication
- 4. What can you measure with bibliometrics? • Article/Book Impact: One measure of the impact of individual journal articles, conference proceedings or books, can be measured by the number of times they are cited by other works.
- 5. What can you measure with bibliometrics? • Article/Book Impact: One measure of the impact of individual journal articles, conference proceedings or books, can be measured by the number of times they are cited by other works. • Journal impact: The perceived impact of a specific academic journal can be assessed by the number of times their articles are cited and where they are cited.
- 6. What can you measure with bibliometrics? • Article/Book Impact: One measure of the impact of individual journal articles, conference proceedings or books, can be measured by the number of times they are cited by other works. • Journal impact: The perceived impact of a specific academic journal can be assessed by the number of times their articles are cited and where they are cited. • Researcher impact: The number of outputs and citations a researcher generates can be an indicator for the impact of an individual researcher.
- 7. What can you measure with bibliometrics? • Article/Book Impact: One measure of the impact of individual journal articles, conference proceedings or books, can be measured by the number of times they are cited by other works. • Journal impact: The perceived impact of a specific academic journal can be assessed by the number of times their articles are cited and where they are cited. • Researcher impact: The number of outputs and citations a researcher generates can be an indicator for the impact of an individual researcher. • Institutional impact: The prestige of a department or area of research within an institution compared to those at other institutions can be measured by the sum of individual researchers ‘impact’.
- 8. Impact?
- 9. Are bibliometrics effective & reliable measures of academic impact?
- 10. Quick Survey (1) • Web of Science • JCR • SciVerse Scopus • PoP software • JIF • Eigenfactor • h – index / g-index • altmetrics
- 11. Quick Survey (2) • What does it mean if an article has a citation count of 97? • What does it mean if an author has an h-index of 14? • What does it mean if a journal has a Journal Impact Factor of 1.317? • What does it mean if an article has an altmetric score (on altmetric.com) of 2734?
- 13. Citations • Links between papers that have something in common
- 14. Citations • Links between papers that have something in common • Building on or challenging research
- 15. Citations • Links between papers that have something in common • Building on or challenging research • Help make a judgement about impact an article has made
- 16. Citations • Links between papers that have something in common • Building on or challenging research • Help make a judgement about impact an article has made • Sum of citations can be an indication of the impact of an author’s work / a journal as a collection of articles
- 17. The problem How do you identify what has cited a publication you have written / read?
- 18. Citation indices 1955 Eugene Garfield - the idea of creating a citation index for science to…
- 19. Citation indices “eliminate the uncritical citation of fraudulent, incomplete or obsolete data by making it possible for the conscientious scholar to be aware of criticisms of earlier papers.” Garfield, E (1955) ‘Citation Indexes for Science’ Science, New Series, Vol. 122, No. 3159, pp. 108-111
- 20. Citation indices 1955 Eugene Garfield - the idea of measuring the “impact” of journal articles using citations
- 21. Citation indices 1955 Eugene Garfield - the idea of measuring the “impact” of journal articles using citations 1960s Science Citation Index developed to highlight “formal, explicit linkages between papers that have particular points in common”
- 22. Citation indices 1955 Eugene Garfield - the idea of measuring the “impact” of journal articles using citations 1960s Science Citation Index developed to highlight “formal, explicit linkages between papers that have particular points in common” 1975 Journal Citation Reports – uses Web of Science data to rank journals within disciplines
- 23. Citation indices (2008) Taylor and Francis LibSite Newsletter, issue 9. p. 5 Science subjects Social-science subjects
- 24. Citation indices “reference lists are held under copyright by academic publishers which makes tracking citations impossible” The death of the reference and the re-use factor (2013) http://figshare.com/blog/The_Death_Of_The_Reference_and_the _reuse_factor/103
- 25. Web of Science • Part of the Web of Knowledge, provided by Thomson Reuters. • Includes the Sciences, Social Sciences, Arts & Humanities & Books Citation Indexes. • Indexes about 11,000 journals, plus conference proceedings. • Approximately 4,000 journals covering arts, humanities and social sciences.
- 26. SciVerse Scopus • Launched in 2004 by Elsevier as the new main commercial competition to Web of Science • Main emphasis on sciences initially, but now broader in scope. • Currently indexes c.19,000 ‘active’ journals plus conference proceedings • c11,000 titles (journals & conference papers) covered in both WoS and Scopus
- 27. Google Scholar • Pulls data from a much broader range of documents (eg books, reports, academic blogs, wider range of journal publishers). • Useful for subjects not covered by Web of Science. • Some concern over quality and accuracy of citation data, and how regularly it is updated.
- 28. Demo Web of Science / Google Scholar
- 32. Citation metrics • h-index (Hirsch, 2005) – An author’s number of articles (h ) that have received at least h citations – a researcher with an h-index of 10 has published 10 articles that have each been cited at least 10 times • g-index (Egghe, 2006) – The highest number (g) of papers that together received g2 or more citations – a researcher with a g-index of 10 has published 10 papers that together have been cited at least 100 times
- 33. H-index
- 34. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 “no. of articles (n) that have received at least n citations”
- 35. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 H-index: 3 (at least 3 References with 3 or more citations) “no. of articles (n) that have received at least n citations”
- 36. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 H-index: 3 (at least 3 References with 3 or more citations) “no. of articles (n) that have received at least n citations”
- 37. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 H-index: not 4 (only 3 References with 4 or more citations) “no. of articles (n) that have received at least n citations”
- 38. h-index – what’s in a number? • Nobel Prize Winner 2013, Peter W Higgs
- 39. h-index – what’s in a number? • Nobel Prize Winner 2013, Peter W Higgs - H-index (Google Scholar) = - H-index (Web of Science) =
- 40. h-index – what’s in a number? • Nobel Prize Winner 2013, Peter W Higgs - H-index (Google Scholar) = 12 - H-index (Web of Science) = 10
- 43. G-index
- 44. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 “The highest number (g) of papers that together received g2 or more citations”
- 45. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 G-index: 5 (5x5 =25… top 5 cited articles= 31) “The highest number (g) of papers that together received g2 or more citations”
- 46. Author: Smith, J Has written and published 9 articles (a-i), which have been cited as follows: a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3 G-index: not 6 (6x6 =36… top 5 cited articles= 34) “The highest number (g) of papers that together received g2 or more citations”
- 47. g-index – what’s in a number? • Nobel Prize Winner 2013, Peter W Higgs - g-index (Web of Science) = 20 - g-index (Google Scholar) = 20+
- 49. Issues
- 50. Issues • Author identification • eg Professor Gordon Love
- 51. Issues • Author identification • eg Professor Gordon Love A name is not unique... - Prof. Gordon Love, University of California Riverside (Earth Science) - Dr Gordon L Love, Sacramento (Medicine and Health) - Prof. Gordon Love, Durham University (Physics)
- 52. Issues • Author identification • eg Professor Gordon Love ...so you need an alternative identifier (or 3) - ORCID profile (0000-0001-5137-9434) - Researcher ID profile (A-3071-2011) - Google Scholar profile (3xJXtlwAAAAJ)
- 55. Google Scholar • Track citations to your publications – Check who is citing your publications. Graph your citations over time. Compute citation metrics. • View publications by colleagues – Keep up with their work. See their citation metrics. • Appear in Google Scholar search results – Create a public profile that can appear in Google Scholar when someone searches for your name.
- 57. Publish or Perish Software • Anne-Wil Harzing (2006), current version 4.14.1 (1st March 2015) • Aimed at individual researchers • Analyse own performance using a range of metrics • FREE TO DOWNLOAD (Windows, Apple OS X, GNU/Linux) and FREE TRAINING MATERIAL • http://www.harzing.com/pop_win.htm
- 59. Citation indices 1955 Eugene Garfield - the idea of measuring the “impact” of journal articles using citations 1960s Science Citation Index developed to highlight “formal, explicit linkages between papers that have particular points in common” 1975 Journal Citation Reports – uses Web of Science data to rank journals within disciplines
- 60. Journal Citation Reports • JCRs – annual publication of journals and their impact factors. • Over 10,800 titles had JIFs in 2014 Science and Social Science editions • A journal that is cited once, on average, for each article published has an JIF of 1.
- 61. Journal Citation Reports • 2014 release = • 2013 JCR edition • Counting citation data from 2013 • For articles published in 2011/12
- 62. Citations in 2013 to all articles published by Journal X in 2011 & 2012 Journal X’s 2013 impact factor = Journal Impact Factor =
- 63. Citations in 2013 to all articles published by Journal X in 2011 & 2012 Number of articles that were published in Journal X in 2011 & 2012 Journal X’s 2013 impact factor = Journal Impact Factor
- 64. Citations in 2013 (in journals indexed in Web of Science) to all articles published by Journal X in 2011 & 2012 Number of articles (deemed to be citable by Web of Science) that were published in Journal X in 2011 & 2012 Journal X’s 2013 impact factor = Journal Impact Factor
- 65. Journal Ranking
- 66. Journal Ranking
- 68. Other journal impact metrics • Eigenfactor - http://www.eigenfactor.org/ – Web of Science data • SCImagoJR - http://www.scimagojr.com/ – Scopus data – Includes country ranking
- 69. Issues • Citation cultures vary across disciplines • Publication cultures vary too • Research careers have different stages • Citation counts do not = excellence • Scholarly communication is evolving - social media and altmetrics - open access publishing
- 70. Metrics and the REF • REF2014 – 11 of 36 panels assessing submissions looked at citation data – Benchmarked against data for comparable articles – Did not take into account Journal Impact Factors in assessment • REF2020 – Consulting on use of metrics as part of the assessment.
- 72. Altmetrics (in brief) “Unlike the JIF, altmetrics reflect the impact of the article itself, not its venue. Unlike citation metrics, altmetrics will track impact outside the academy, impact of influential but uncited work, and impact from sources that aren’t peer-reviewed.“ http://altmetrics.org/manifesto/
- 75. Altmetrics (in brief) • But you must still approach altmetrics as you do any metric... ... with a critical head. • Any result touching on religion AND medicine/health is likely to be picked up and shared far more than a high quality piece of research on optical binding forces and two dimensional structures...
- 82. Any Questions?
- 83. Further Reading Pendlebury, D.A. (2009) The use and misuse of journal metrics and other citation indicators. Archivum immunologiae et therapiae experimentalis. 57(1): 1-11 (includes “ten commandments of citation analysis”) Smeyers, P & Burbules, N.C. (2011) How to improve your impact factor: questioning the quantification of academic quality. Journal of Philosophy of Education. 45(1): 1-17 Van Noorden, R. (2010) A profusion of measures. Nature. 465: 864-866 (has a handy “field guide to metrics”) www.journalmetrics.com (2010) The evolution of journal assessment. (compares SCIMagoJR, AI, SNIP and JIF metrics in table at the en (2007) Show me the data. Journal of Cell Biology. 179 (6): 1091 Available at http://jcb.rupress.org/content/179/6/1091.full Why you should ignore altmetrics and other bibliometric nightmares ; http://www.dcscience.net/?p=6369
- 84. Image Credits [Slide 4] Via Flickr Creative Commons, by HeavyWeightGeek. Available at http://www.flickr.com/photos/heavyweightgeek/2334939683/ [Slide 11] Via Flickr Creative Commons, by Kirsty Andrews. Available at http://www.flickr.com/photos/47745961@N08/5169765739 [Slide 30] Via Flickr Creative Commons, by THOR. Available at http://www.flickr.com/photos/49503154413@N01/2326873674 [Slides 56] Via Flickr Creative Commons, by marya. Available at http://www.flickr.com/photos/35237093637@N01/56156364 [Slide 85] Created using http://photofunia.com [Slides 108-111] Vitae®, © 2010 Careers Research and Advisory Centre (CRAC) Limited‘ Available at www.vitae.ac.uk/rdf
Hinweis der Redaktion
- Focus on published literature, specifically journal literature where citation analysis tools more developed. Precede this with an introduction to look at (i) what you can measure with bibliometrics and (ii) to set a context when we talk about “Impact”
- http://www.flickr.com/photos/heavyweightgeek/2334939683/ (CC-BY) HeavyWeightGeek
- Will come back to highlight the issues with this…
- What do I mean by impact? - “REF” impact is not measured by bibliometrics measures - bibliometrics are restricted to academic impact - in terms of academic impact, bibliometrics can give an indication of dissemination, readership and the impact the research has made with others finding and using it. It cannot give an indication of quality, nor a critical evaluation of the content, findings or arguments a piece of research makes.
- Question you should bear in mind during everything covered in this session, and if you ever find yourself under pressue to publish in “high impact” journals or to maximise you personal author metric scores.
- Stress that sum of citations useful indication of impact of an author – not the only method but one that has been used, especially in some disciplines, as a primary means of measuring “impact”. Useful as researcher to establish impact/importance of an article and as an author to monitor your impact.
- Stress that sum of citations useful indication of impact of an author – not the only method but one that has been used, especially in some disciplines, as a primary means of measuring “impact”. Useful as researcher to establish impact/importance of an article and as an author to monitor your impact.
- Stress that sum of citations useful indication of impact of an author – not the only method but one that has been used, especially in some disciplines, as a primary means of measuring “impact”. Useful as researcher to establish impact/importance of an article and as an author to monitor your impact.
- Stress that sum of citations useful indication of impact of an author – not the only method but one that has been used, especially in some disciplines, as a primary means of measuring “impact”. Useful as researcher to establish impact/importance of an article and as an author to monitor your impact.
- Stress that sum of citations useful indication of impact of an author – not the only method but one that has been used, especially in some disciplines, as a primary means of measuring “impact”. Useful as researcher to establish impact/importance of an article and as an author to monitor your impact.
- Eugene Garfield founded the Institute for Scientific Information (ISI). In 1955 proposed a methodology for the creation of a citation index for science.
- Citation index not a completely new idea in other contexts, such as the legal field where case citation indexes to track the subsequent treatment of judicial decisions had been in place in the US since 1873, and in the UK from 1947. - ASK IF ANYONE FROM LAW? EXAMPLE OF NEEDING TO KNOW IF A CASE HAS SUBSEQUENTLY BEEN CITED IN COURT, AND IF ITS JUDGMENT HAD SINCE BEEN OVERRULED (equivalent to having doubt cast on findings) OR DISTINGUISHED (roughly equivalent to having the findings being reinterpreted in a new context or new way) From this, came his first mention of using this data to measure the “impact factor” – in this initial paper, at an article level, but later at the journal level.
- One key tool in this area is WoS. Stress WoS and not WoK. Indexes approx 12, 000 journals. Aim to rank journals within categories. Not designed to make judgements about performance but now a shift in that direction they have developed tools to help in this respect. But WoS indexes subject areas to varying degrees Mention Scopus / Google Scholar
- One key tool in this area is WoS. Stress WoS and not WoK. Indexes approx 12, 000 journals. Aim to rank journals within categories. Not designed to make judgements about performance but now a shift in that direction they have developed tools to help in this respect. But WoS indexes subject areas to varying degrees Mention Scopus / Google Scholar
- One key tool in this area is WoS. Stress WoS and not WoK. Indexes approx 11, 000 journals. Aim to rank journals within categories. Not designed to make judgements about performance but now a shift in that direction they have developed tools to help in this respect. But WoS indexes subject areas to varying degrees Mention Scopus / Google Scholar
- Total of about 4000 Arts & Humanities (1727) / Social Sciences (3134) journals covered in WoS (March 2014 data – A&H and SS not mutually exclusive lists). Up until 2004, Web of Science was the tool to use. But, there is a no single data set covering all academic literature, so no means of identifying all possible citations to an article. WoS is still the primary tool, and will be the focus of today as the main academic resource Durham currenlty has access to, but there are other tools available. http://admin-apps.webofknowledge.com/JCR/static_html/notices/notices.htm
- (To reiterate one reason for there being no single data set covering all academic literature.) The Impact Factor and similar are tools, just part of a researchers arsenal for evaluating and identifying places to publish. They are not, as publishers and some academics would like to think, the benchmark of quality. They are a tool sold by publishers, to academics, to tell them how important the publishers products are.
- Many commercial competitor to WoS. Significant overlap between WoS and Scopus. 11,000 titles – journals and conference paper series (so still many journals indexed in WoS but not Scopus)
- Another tool which is challenging domination of WoS More comprehensive in some areas: for example, covers open access repositories so can pick up citations from different versions of the same article. There are oddities that do occur: For example, works (eg published in 2014) being cited by works published in previous years (eg cited by a book published in 2005). Some issues around author indexes… and distinguishing between authors with the same or very similar names (mention researcher id and ORCID) Citation index updated annually… current date was July 2013 (checked March 2014), so may not pick up very recent citation data in metric tools (but can pick up from other sources and author additions). “Take the book Quantum Computation and Quantum Information by M Nielsen and I Chuang (2000 Cambridge University Press), for example. According to Web of Science, this book has been cited more than 2800 times. However, Scopus says it has been cited 3150 times, Google Scholar 4300 times, Physical Review Online Archive 150 times, ScienceDirect 375 times, the Institute of Physics Journal Archive 290 times, and arXiv.org 325 times. If only Web of Science is used, we would miss all of the citations found through Google Book Search and arXiv.org plus hundreds of the citations found through the other databases or tools. “ Meho 2007 Meho: We compared results of citation coverage from Web of Science, Scopus and Google Scholar for a sample of 25 highly published researchers in our field of information science and found that Scopus and Google Scholar increase the citation counts of scholars by an average of 35% and 160%, respectively. Increase in data means that multiple citation tools allow us to generate much more accurate maps or visualizations of scholarly communication networks in general, such as establishing links between authors, departments, disciplines, journals or countries that cite or influence each other. More tools mean it is a harder job as different documtns are included eg reports, dissertations, book chapters eprints and with that have to weigh up quality and value ofs ource of the citation.
- Demo 1 – (Web of Science) Search for citations to a particular article - end by asking what does “having a citation count of Demo 2 – (Web of Science) Search for citations to articles in that journal for that particular year - this demo is to provide context to the “number of citations” revealed by demo 1 Demo 3 – (Google Scholar)
- WoS citation mapping - screenshots as usually cannot show on teaching pc.
- Suggestion: locate an article, follow the citations. Possibly compare to other articles published in the same year. Then, compare the article on Google Scholar, explore some of the citations.
- http://www.flickr.com/photos/26296445@N05/5917135851
- Explain more complex means of measuring citation than just counting numbers: both different ways of looking at consistency – obv penalises newer researchers That is why citation report for journal in a specific year is good so you can compare like with like Both indexes and others calculable using Google Scholar data via ‘Publish or Perish’ software – free to download. Search for any name and select a subset of publications.
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- Close before example to consider issues for ECRs: If you have published 1 article, and it has been cited 3000 times, what is the maximum h-index score you could have? 1 If you have published 3 articles, and 1 has been cited 3000 times, and 2 have never been cited, what is the maximum h-index score you could have? 1
- Examples of taking h-index with a pinch of salt… Higgs – 2 issues. Comparatively low h-index compared to some researchers in field. H-index does not reflect several of his articles having multiple thousands of citations.
- HAS BEEN PUBLISHING FOR SEVERAL DECADES, MIGHT BE CONSIDERED TO HAVE MADE A SIGNIFICANT IMPACT ON HIS FIELD OF RESEARCH DURING THAT PERIOD. AVERAGE H-INDEX IN HIS FIELD IS ABOUT 35 9BUT CONSTANTLY CHANGES AND VARIES BY WHICH DATA SET IS USED TO CALCULATE IT) Examples of taking h-index with a pinch of salt… Higgs – 2 issues. Comparatively low h-index compared to some researchers in field. H-index does not reflect several of his articles having multiple thousands of citations.
- Examples of taking h-index with a pinch of salt… Higgs – 2 issues. Comparatively low h-index compared to some researchers in field. H-index does not reflect several of his articles having multiple thousands of citations. Highest cited article attracted at least 1369 citations.
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- CHANCE FOR INTERACTION – ASK SOMEONE TO WORK OUT WHAT THE H-INDEX OF THIS AUTHOR IS. Smith , J articles /citations : (a:3, b:6, c:6, d:2, e:13, f:3, g:0, h:1, i:3) H-index = 3 - Not 6 (only 3 articles authored have 6 citations (or more). 6 articles have 3 or more citations, so h-index = 3. If article a, which currently has 3 citations was cited once more (so having 4 citations) would then have an h-index of 4 (as articles a, b, c and e have 4 or more citations) G-index = 5 - 5 because top 5 cited articles have received (13+6+6+3+3 =) 31 citations, which is greater than 5 squared. - Not 6 because top cited 6 articles total only (13+6+6+3+3+3 =) 34. Would need to be at least 36 (6 squared) to give a g-index of 6)
- Actually, the g-index for Professor Higgs doesn’t have a huge impact, simply because he has not published as widely or frenetically as other colleagues in the same field. Highest cited article attracted at least 1369 citations. Does this lack of citations and low citation metrics mean that he has not had a significant impact in his and other fields or study, or that he is not seen as a valuable asset to his institution or research community? (Link to Google Scholar results – point out that once past page 2, results are actually duplicates, or odd inclusions such as talks at discussions, an academic blog citing information about P Higgs from Wikpedia (supposedly from 1929 – page 5))
- Demo 4 – (Web of Science) Searching for author citations
- Suggestion:
- Question audience: Can anyone spot any problems with identifying an author an generating an – index and other author metrics?
- Author identification – if just by name, how do you account for full name/initial citations etc., changes in affiliation etc. NB: could also use Tom Ward’s profile (uses ORCID, Google Scholar and ORCID) https://www.dur.ac.uk/mathematical.sciences/people/profile/?mode=staff&id=10645
- NOTE: G Love in California Riverside, was also research fellow at Newcastle University within the past 10 years. NB: could also use Tom Ward’s profile (uses ORCID, Google Scholar and ORCID) https://www.dur.ac.uk/mathematical.sciences/people/profile/?mode=staff&id=10645
- ORCID: most recent enterprise (launched 2012), but developed for academics by academics. Non profit making and community led, but had attracted support from over 300 research organisations and publishers before launch. - offers unique, free registry for individual academics - API’s to link information into existing research management systems, academic databases and publisher services. - By the end of 2013 ORCID had 111 member organizations (including Elsevier, Springer, Nature and Wiley, and universities such as Caltech and Cornell, and research funders such as the Wellcome Trust) and over 460,000 registrants. Researcher ID: launched in 2008, same premise as ORCID, but proprietary system developed and owned by ThomsonReuters. Thomson Reuters have enabled data exchange between its ResearcherID system and ORCID, and vice versa. Google Scholar: Allows authors to create free online profile, and list publications. This will then collect citation data from Google Scholar, and allow you to generate some author level metrics. (Durham Law example) https://www.dur.ac.uk/law/staff/?id=11690 - Dr Vincenzo Bavoso http://orcid.org/0000-0003-4985-9804 http://www.researcherid.com/rid/H-9394-2013
- Demo 5
- Mention purpose:- - Trialling in Physics of including citation data from profiles.
- Demo 5
- Suggestion:
- Version 3.8.1 in October 2012. Metrics include “M-quotient”, which divides h-index by number of years and academic has been active. Also individual (compensates for co-authors) and contemporary (compensates for inability of h-index to decline, even despite retirement).
- (This slide is a repeat of earlier, reflecting back to creation of citation indices...)
- Benefits – small time frame so stops bias towards older journals Bias to those which publish a lot of review articles as they are more likely to widely cited Bias towards Eur and North American – remember only journals in this database and there are few LOTE (languages other than English) in here
- Benefits – small time frame so stops bias towards older journals Bias to those which publish a lot of review articles as they are more likely to widely cited Bias towards Eur and North American – remember only journals in this database and there are few LOTE (languages other than English) in here
- JCR 2012 just published this month Explain that denominator and numerator are not based on the same criteria. Citations in 2011 to all articles published by Journal X in 2009 & 2010 (Numerator) is everything cited in a journal Number of articles that were published in Journal X in 2009 & 2010 (Denominator) is all “research” articles (excluding letters, opinion papers, etc)
- So, it takes the journal articles published in that journal for the previous two years, and the number of citations to those articles from that year. JCR 2012 just published this month Explain that denominator and numerator are not based on the same criteria. Citations in 2011 to all articles published by Journal X in 2009 & 2010 (Numerator) is everything cited in a journal Number of articles that were published in Journal X in 2009 & 2010 (Denominator) is all “research” articles (excluding letters, opinion papers, etc)
- JCR 2012 should be available c. June/July 2013 Explain that denominator and numerator are not based on the same criteria. Citations in 2011 to all articles published by Journal X in 2009 & 2010 (Numerator) is everything cited in a journal Number of articles that were published in Journal X in 2009 & 2010 (Denominator) is all “research” articles (excluding letters, opinion papers, etc)
- Illustration on difference between disciplines.
- This graph shows how it can even vary quite a bit in a single subject area – therefore no generalisations can be made or comparisons between subject areas. An impact factor of 1.5 could be excellent for one discipline but sub-standard for another.
- Demo 6 – Refer back to earlier article (Amin, 2004) for citations. Now look at journal it was published in… Show how to look up JIF, and the how to provide that with some context and relevance in its subject category.
- Suggestion: Explore some journals in your subject field (baring in mind limited coverage in some fields)
- Eigenfactor: “The Eigenfactor Score calculation is based on the number of times articles from the journal published in the past five years have been cited in the JCR year, but it also considers which journals have contributed these citations so that highly cited journals will influence the network more than lesser cited journals. References from one article in a journal to another article from the same journal are removed, so that Eigenfactor Scores are not influenced by journal self-citation.” Article influence factor: The Article Influence determines the average influence of a journal's articles over the first five years after publication. It is calculated by dividing a journal’s Eigenfactor Score by the number of articles in the journal, normalized as a fraction of all articles in all publications. This measure is roughly analogous to the 5-Year Journal Impact Factor in that it is a ratio of a journal’s citation influence to the size of the journal’s article contribution over a period of five years. The mean Article Influence Score is 1.00. A score greater than 1.00 indicates that each article in the journal has above-average influence. A score less than 1.00 indicates that each article in the journal has below-average influence.
- Altmetrics / Social Media / Open Access / Open Data http://altmetrics.org/manifesto/ Altmetrics: “Unlike the JIF, altmetrics reflect the impact of the article itself, not its venue. Unlike citation metrics, altmetrics will track impact outside the academy, impact of influential but uncited work, and impact from sources that aren’t peer-reviewed.“ http://altmetrics.org/manifesto/
- http://www.flickr.com/photos/26296445@N05/5917135851
- Standard now to be able to tweet, share, like, plus, favourite and bookmark In browser or in social bookmarking sites or online citation management software) websites, blogs, newsppaer articles and other online content. So altmetrics are one way of trying to ‘measure’ the dissemination, reach and readership of academic publications using similar tools.
- FOLLOW LINK IN PICTURE TO EXPLORE WHAT IS MEASURED... http://www.altmetric.com/details.php?citation_id=103551
- FOLLOW LINK IN PICTURE TO EXPLORE WHAT IS MEASURED... http://www.altmetric.com/details.php?citation_id=103551
- And again, the number of citations/shares/likes etc does not equal quality... Or even that something was read and meant something.
- And again, the number of citations/shares/likes etc does not equal quality... Or even that something was read and meant something.
- And again, the number of citations/shares/likes etc does not equal quality... Or even that something was read and meant something.
- And again, the number of citations/shares/likes etc does not equal quality... Or even that something was read and meant something.
- Just mention that can visit altmetric.com, download a free bookmarklet for their browser which allows you to quickly see (based on articles doi) an ‘altmetric’ score and track if and how it has been shared.
- Just mention that can visit altmetric.com, download a free bookmarklet for their browser which allows you to quickly see (based on articles doi) an ‘altmetric’ score and track if and how it has been shared.
- Overview of Twitter.. Don’t show how to create account – on handout. Headlined / about Profile and home page @ Connections page (mentions and interactions) Search function (tweets, users, lists)