This document provides an introduction to bibliometrics and altmetrics. It discusses what bibliometrics are and why they are important. It outlines several metrics used to measure research impact, including total citations, h-index, and variations. The document recommends tools for identifying your own citation metrics and potential collaborators. Finally, it notes that bibliometrics only indicate impact and not quality, and should be used alongside other evaluation methods.
4.18.24 Movement Legacies, Reflection, and Review.pptx
Showcasing your Research Impact using Bibliometrics
1. An Introduction to Bibliometrics
Ciarán Quinn Subject Librarian
20th June 2013
2. What are
Bibliometics &
Altmetrics?
Why are they
important for me?
How to identify your
research
impact/profile
How do I improve
my citation count?
Using metrics to
identify potential
research
collaborations
3. A range of statistical analyses related to
publications and their authors.
4. Measures are:
◦ Related to discipline characteristics
◦ Inclusiveness of the measures
◦ Accessibility of the data
◦ No single measure should be used in isolation
◦ Statistics can be misused
◦ Measures impact not quality
There are different emphasis and tools for different groups
◦ For example if much of your work feeds into government reports,
advisory committees or the media you may not get due credit
using traditional metrics alone.
5. • Total number of papers
• Total number of citations
• The h-index
• A number of variations on the h-index have emerged. These include:
1)Egghe’s g-index which gives more weight to the highest cited papers
2)The individual h-index which accounts for co-authorship in calculating impact by giving less
weight to such papers
3)The contemporary h-index gives less weight to older cited papers so you lose weighting over
time
4)The age-weighted citation rate which also accounts for the age of papers
5) M- Index: takes differences in career length into account, by dividing your h-index by
the number of years that you have been publishing.
6. H Index (Used by WOS Citation Indexes & Scopus Author Evaluator)
◦ measures the quantity & sustainability of an individuals research
output
Citation Analysis
◦ how many times your publications have been cited on Journal and
Citation Indexes such as Scopus and Web of Science (JCR & JIF)
Journal based metrics and Impact Factors
◦ Journal Citation Reports (Web of Knowledge)
◦ Journal Impact Factor (data from JCR)
◦ Eigenfactor (http://www.eigenfactor.org/) (data from JCR)
◦ Journal Analyzer (Scopus)
7. Use citation counts & analysis to
◦ Assess your own research performance
◦ Evaluate and track the impact your published research
◦ Identify Journals with the greatest impact in your
research area
◦ Support applications for promotion, tenure and grant
funding
◦ Identify potential collaboration opportunities with other
researchers
◦ Enhance the international reputation of yourself, your
department and your Institution by showcasing your
citations
8. A collaborative project of four Irish academic libraries
producing a set of materials to support bibliometrics
training.
http://www.ndlr.ie/myri/
Contains:
◦ An online tutorial
This is in 3 modules: introductory overview; journal ranking;
bibliometrics to support your career and research strategy.
Includes videos and other interactive elements.
◦ Product Profiles
◦ Datasheets
9. ISI Journal Citation Reports
◦ Most frequently cited Journals in a field
◦ Highest Impact in a field
◦ Largest Journal in a field
Web of Science
◦ Article analysis (Impact) Times cited, number of citations by year,
◦ average citation rate, h index and Journal Impact Factor
Incites
◦ InCites is a customized, citation-based research evaluation tool on the Web that enables you to
analyze institutional productivity and benchmark your output against peers worldwide. Contact
Subject Librarian to arrange access
Scopus : View Citation overview, Journal Analyzer,
SciVal Strata: is a visualization tool that helps users track team and individual
research performance across a flexible spectrum of benchmarks and measures.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20. Google Scholar Citations
Google Scholar Metrics (includes Books)
SciMago Journal and Country Rank
21. Altmetrics.org
◦ Altmetric for Scopus App
◦ Altmetrics.org/tools/
Impact Story
PLoS Article Level Metrics (App)
PMC Citation Search: (uses PubMed ID’s)
Publish or Perish
Reader Meter: Researcher-level metrics based on
readership. Currently from Mendeley.
22.
23. There may be specialist databases for your field that offer
citation tools and a good coverage of the literature, here are
some examples:
Spires - free resource covering physics literature. Includes
bibliometric data. http://www.slac.stanford.edu/spires/
Medline - free resource indexing life science and biomedical
publications. Includes citation data. http://medline.cos.com/
CiteSeer - free resource for computer and information
science publications.Includes citation data .
http://citeseer.ist.psu.edu/citeseer.html
ArXiv - Open access. Covers physics, mathematics,
computer science, quantitative biology, quantitative finance
and statistics . http://arxiv.org/
25. Citation databases such as Web of Science and
Scopus index International, high Impact, Peer
Reviewed Journal Titles
◦ Exclude many books/conference proceedings/non English
language
Are you publishing in those Journals?
Do you publish mainly in Books?
Are there opportunities to publish in Journals?
Is your research in a field not prioritised by the
bibliographic data providers?
◦ If not notify us and we’ll supply details to the database provider
if the journal has a international audience
26. Use Researcher Profile Directory: expert database of all
researchers at NUI Maynooth.
Use NUI Maynooths Institutional Repository ‘Eprints’
◦ Open Access policy
◦ Deposit publications to RIS & automatically sent to eprints
Avoid using different versions of your name and Institutional
name variants (National University of Ireland Maynooth,)
◦ Beware collaborative articles as it can affect the name variants !
Use Research ID (Web of Knowledge)
◦ Check your name variants & align with your publications
Use Author Identifier (Scopus)
◦ Merge your Author identities (disambiguation)and align with
your articles
27. Help the Literature Reviewer !
◦ Don’t be obscure use commonly used descriptors
◦ Use informative titles
◦ Be clear and informative in writing abstracts and book
descriptions. Include the key points of the research.
◦ Collaborative works attract more citations due to
networking across researchers
◦ Self cite but keep it in line with other academics
Use social media and traditional media to get your
work noticed
28. Increase your profile
Promote your research
Tools:
◦ SciVal ® Strata (Elsevier):
◦ Incites (Thomson Reuters)
29. Bibliometrics & citation analysis is only one quantitative indicator of
research. There are other quantitative indicators and qualitative
approaches of which peer-review is a key indicator.
Bibliometric Measures:
◦ Patterns of authorship, publication & the use of literature
Benefits
◦ Quantitative approaches could be argued to be fairer than qualitative methods e.g.
peer-review
◦ Cost effective
◦ Efficiency advantage and consistency
Application & importance varies from field to field
◦ tremendous controversy surrounds any assessment of the intellectual output of
academics and researchers
Examples Times Higher & QS Ranking to assess University
Performance. Whole range of indices.
◦ Measuring impact of literature
◦ Just one of many measures
What are Bibliometrics?What are Altmetrics?Altmetric’s are non traditional metrics (e.g. Measuring Social Media)Why are they important?How can you measure? What are the metrics?What resources are available to you?Subscribed and Unsubscribed resourcesHow to identify your research impact /profileHow to improve your citationsWhere should I publishUsing keywords/descriptorsIncreasing visibilityUsing metrics to identify potential research collaborations
‘Bibliometrics is a term that encompasses the range of statistical analysis related to publications and their authors.This data is used to develop research impact “profiles” for specific individuals, papers, journals and disciplines, institutions and countries.’Each measure has advantages and disadvantages, related to discipline characteristics, inclusiveness of the measures, and the accessibility of the data; and no single measure should be used in isolation.Rymer, L. (2011). Measuring the impact of research - the context for metric development. In The Group of Eight (Ed.), Go8 Backgounder (Vol. 23). Turner, ACT.
Each measure has advantages and disadvantages, related to discipline characteristics, inclusiveness of the measures, and the accessibility of the data; and no single measure should be used in isolation.Some disciplines such as Engineering and Computer Science are more focused on proceedings and seminarsAre the Journals you publish in ,included in the databases?Statistics can be quite subjective
A variety of metrics have been developed to help assess the output of researchers. Here are some of the most popular:Total number of papers: a simple count of the number of papers a researcher has publishedTotal number of citations:a count of all the citations received by a researcher’s published works The h-index: has become the most popular metric for assessing the output of individuals since it was developed by Hirsch in 2005. The h-index of an individual is the number of their papers that have been cited at least h times e.g. a researcher has an h-index of 25 if 25 of their papers have been cited at least 25 times. Measures the researcher impact.
H Index measures the quantity & sustainability of an individuals research output (for example a H Index of 15 means an author has 15 published papers with at least 15 citations)Use Web of Science (Citation Indexes), Scopus (Author evaluator)and Publish or Perish to find theseOnly useful for comparing those within the same discipline as citation conventions differ between disciplinesCitation Analysis: Discover how many times your publications have been cited on Journal and Citation Indexes such as Scopus and Web of ScienceJournal based metrics and Impact Factors: Measures the impact by the number of times articles, published in a journal, have been cited in a given period and measures it against the average impact factor for that discipline.Journal Citation Reports (JCR) helps to measure research influence and impact at the journal and category levels, and shows the relationship between citing and cited journals.(Web of Knowledge, Thomson Reuters)Journal Impact Factor: average number of times articles from the journal published in the past two years have been cited in the Journal Citation Reports (JCR) year.Eigenfactorhttp://www.eigenfactor.org/ a measure of the journal's total importance to the scientific community (JCR Data from Thomson Reuters)Journal Analyzer is a part of Scopus and contains, SCImago Journal Rank (SJR)& Source Normalized Impact Per Paper (SNIP)SCImago Journal and country rank is a portal that includes the journals and country scientific indicators developed from the information contained in SCOPUS (Elsevier) http://www.scimagojr.com/
ISI Journal Citation Reports: From over 11,000 scholarly and technical journals from more than 3,300 publishers in over 80 countries. Journal Citation Reports® evaluates and compare journals using citation dataIncludes science, technology, and social sciences. JCR shows you the:Most frequently cited journals in a field,Highest impact journals in a field.,Largest journals in a fieldWeb of Science:. Article Analysis and Impacti) For any article retrieved follow who has cited that article using the Times Cited linkii) View the Journal Impact Factor for any article retrieved – the product is linked to Journal Citation Reports. Once you see the Journal Impact Factor details you can also click on the “return to Journal” button and will then be able to see the full JCR range of metrics for the journal such as immediacy indexiii) For any group of articles or individual article in a group, use Create Citation Report to see sum of times cited, number of citations by year, average citation rate, h-index for the setb. Individual or Group Author analysisi) For any article retrieved follow who has cited that article using Times Cited linkii) Use Cited Reference Search to find the articles that cite a person’s or group’s work – the work itself does not have to be indexed in the product e.g. it could be a monographiii) On any set of articles built up through individual or group author search use Create Citation Report to see sum of times cited, number of citations by year, average citation rate, h-index for the setc. Journal Analysisi) Search for Publication Name and then use Create Citation Report to see for all articles published the sum of times cited, number of citations by year, average citation rate, h-index for the journal article setIncites:InCites is a customized, citation-based research evaluation tool on the Web that enables you to analyze institutional productivity and benchmark your output against peers worldwide. Contact Subject Librarian to arrange accessSCOPUS:a. Article Analysis and Impacti) Each document returned indicates the number of citations found in the database and these can be viewed in detailii)The View Citation Overview option provides for analysis of individual articles or sets, presents analysis by year, and provides the h-index for the setb. Individual or Group Author analysisi) For any set of references for author(s) you can view the citing articles.ii) Use View Citation Overview for the main analysis of citation counts by year, and to view the h- index for the author or groupc. Journal Analysis i) Use the Analytics tab to avail of the Journal Analyzer tool for summary information. Drag and drop your chosen title to get analysis of the journal. This provides for each year: number of articles published; number of citations; number of articles not cited at all Two other journal rankings are provided, that are not in Journal Citation Reports:SJR which weights citations according to the prestige of their source journal.SNIP which corrects for differences in the frequency of citation across research fields and is therefore a normalised indicator that can be compared across research fields You can compare the performance of various journals within one graph/table to aid publication strategyii) For detailed article analysis within a journal use the Sourcestab. This provides the SJR and SNIP rankings for the entire journal which are alternatives to the ISI Journal Impact Factor. Move into Citation Overview to get citation counts, detailed citation information and the h-index for the whole set of journal title articles, year by yearThe database, launched in 2004, is updated daily.SciVal Strata: SciVal ® Strata is a visualization tool that helps users track team and individual research performance across a flexible spectrum of benchmarks and measures.
Results found: 33 Sum of the Times Cited [?] : 4351 Sum of Times Cited without self-citations [?] : 4296 Citing Articles[?] : 3286 Citing Articles without self-citations [?] : 3268 Average Citations per Item [?] : 131.85 h-index [?] : 17
Selected Citation Overview from Documents List for above.Selected Author H Index (view h-graph) for the next slide)
Image is from the Documents tab by Subject Area and SourcesOther Options: H Index GraphicCitations Graph
InCites™ is a customized, web-based research evaluation tool that allows you to analyze institutional productivity and benchmark your output against peers worldwide. With customized citation data, global metrics, and multidimensional profiles on the leading research institutions, InCites gives comprehensive insight into your institution's performance. And with robust visualization and reporting tools, you can create and share reports quickly and easily.With InCites You CanCompare quantitative and qualitative aspects of performance against other institutions and world and field benchmarks Pinpoint influential and emerging researchers and research trends Showcase strengths and identify potential areas for growth Set measurable goals; allocate funds accurately and intelligently Monitor collaboration activity and track new collaboration opportunities Support accreditation activity, funding proposals, legislative agendas, alumni appeals, faculty and student recruitment Plan a research strategy with metrics that can be tracked over time
SciVal ® Strata is a flexible benchmarking tool that provides quantitative analyses of team or researcher performance, complementing the peer-review approach.Make informed decisions regarding recruitment, retention and promotionSimulate collaborative networks and model scenarios based on any researcher globallyAssess team and researcher performance across a flexible range of benchmarks and measuresAssign resources by applying quantitative metrics as part of your allocation exerciseShowcase your excellence to support funding and assessment exercises
Google Scholar CitationsCreate a profile and track citation data such as h-index & i10-index (number of articles with at least 10 citations)Google Scholar Metric’s: Track citations to your publications Check who is citing your publications. Graph your citations over time. Compute citation metrics. View publications by colleagues Keep up with their work. See their citation metrics. Appear in Google Scholar search results Create a public profile that can appear in Google Scholar when someone searches for your name.ScimagoJournal and Country RankFree but uses the Scopus DataSCImago Journal Rank (SJR)Source Normalized Impact per Paper (SNIP)
Altmetrics.org: maintains links to new online tools for calculating impactAltmetric for Scopus: Application that tracks mentions of papers across social media sites, science blogs, media outlets and reference managersImpact Story: Aggregates online altmetrics to create collections of material through online identifiers such as Google Scholar Profiles, DOI’s (digital object identifiers), and PubMed IDsPubMed ID’s Each record in PubMed (Medline) (Pub Med Central) is assigned a unique identifier - the PubMed ID, or PMID for short. This number is always displayed in the PubMed citations. Used across a number of sources such as Mendeley & PLoSPLoS(Public Library of Science) Article Level Metrics a leading open access journal repositoryPMC (PubMed Central) Citation Search: National Library of Medicine free archive of biomedical and life sciences journal literature.Publish or Perish: Harvests from Google Scholar based on Authors name. More diverse bibliometrics. H Index and alternatives (G Index, HC Index)Reader Meter: Takes Readership data from Mendeley. ReaderMeter queries the data provider’s API for articles matching a given author string. It parses (breaks down into its components) the response and generates a report with several metrics that attempt to quantify the relative impact of an author’s scientific production based on its consumption by a population of readers (in this case the 500K-strong Mendeley user base)
Downloadable application to use with Google Scholar - Anne-Will Harzing developed the application which retrieves Google Scholar data but performs a more detailed citation analysis and calculates several indicators.On its own Google Scholar provides for individual items citation counts from its corpus and you can view all the citing publications. No other metrics are provided and amalgamation of results is not possible (e.g. for duplicate entries consisting of different versions of the same article title such as pre-print and published version). With Publish or Perish however this is possible, and a wide variety of metrics are provided, calculated from the underlying Google Scholar dataset.a. Article analysisThe General Citation Search option provides the ability to search for a single article or group by keyword etc.For individual article or a checked selection a range of metrics is provided including number of citations, number of years covered, average citations per year, per paper, per author.H-index is given for the set and a wide range of variants and alternatives to it such as e-index, g-index.b. Author analysisGeneral Citation Search can also be used to search for a set of papers by an author to analyse as above.Author Impact Analysis is provided,giving extra options to link authors, and to specify the year range required for the citation analysis. The metrics provided are the same as above.C. Journal AnalysisJournal Impact Analysis is used to key in a journal title. It will show all the articles published with the same range of metrics as above for this journal set. General Citation Search can also be used to search for journal articles. However, no ranking of journals is offered here.
Academia.edu: Paper sharing platform to increase visibility and monitor research across its Scholarly network.Mendeley: Citation manager plus a scholarly social networkSocial Science Research Network (SSRN) Online article repository includes a database, electronic paper collection and 20 specialised subject networks VIVO:An interdisciplinary networkEnabling collaboration and discovery among scientists across all disciplines.Makes connections between researchers via uploaded faculty profiles. VIVO is an open source! semantic web! application that enables the discovery of research and scholarship across disciplines at a particular institution and beyond.VIVO is populated with detailed profiles of faculty and researchers including information such as publications, teaching, service, and professional affiliations.VIVO also provides a powerful search functionality for locating people and information within the institution.Microsoft Academic Search: free service developed by Microsoft Research to help scholars, scientists, students, and practitioners quickly and easily find academic content, researchers, institutions, and activities.
Use Researcher Profile Directory: expertise database of all researchers at NUI Maynooth. The RPD facilitates potential collaborators finding the expertise they need, while publicising the variety of research conducted at NUIM
SciVal Strata(Elsevier):SciVal ® Strata is a flexible benchmarking tool that provides quantitative analyses of team or researcher performance, complementing the peer-review.SciVal Strata is a research performance visualization tool, designed in collaboration with research managers and other institutional authorities, that helps decision-makers: • Make informed decisions regarding recruitment, retention and promotion • Track, compare and review the performance of any researcher represented within Scopus • Measure team performance across a flexible spectrum of benchmarks and measures • Allocate resources by individuals, teams and departments • Apply a wide variety of research indicators to assess return on investment • Simulate collaborative networks and what-if scenarios for cross-disciplinary and/or multi-national research • Export and share the findings with other stakeholders Incites (Thomson Reuters):is a customized, citation-based research evaluation tool on the Web that enables you to analyze institutional productivity and benchmark your output against peers worldwide.