Presentation on the use of altmetrics to inform stories about altmetrics. Presented for Open Access week 2013 in Amsterdam. See http://uba.uva.nl/home/componenten/agenda-2/agenda-2/content/folder/lezingen/13/10/altmetrics.html

1. Telling your research story
with (alt)metrics
Paul Groth (@pgroth)
Web & Media Group
VU University Amsterdam
http://www.few.vu.nl/~pgroth

4. Research Project Grants
Applications, awards, and success rates
NIH Data Book – (http://report.nih.gov/ndb/index.aspx)
Data provided by the Division of Information Services, Reporting Branch

5. "Outside letters basically trump
everything," says Robert
Simoni, chairman of the biology
department at Stanford University
in California.
Metrics: Do metrics matter?
Nature 2010
http://doi.org/10.1038/465860a

7. http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest

9. ―Imagine how the academic appointment process might change
if search and review committees had access—within an
appropriately tagged or linked online CV, for example, or via the
ORCID system—to information about the specific contributions
made by a candidate to each of his/her works, including
contributions that might not otherwise have qualified for
‗authorship‘ status?‖
Point of view: Faculty appointments and the record of
scholarship
Amy Brand
http://dx.doi.org/10.7554/eLife.00452

10. Point of view: Faculty appointments and the record of scholarship
Amy Brand
http://dx.doi.org/10.7554/eLife.00452
Opportunities
• Individuals and institutions need better tools
for curating and networking their own record
of scholarship
• Institutions need more information about
scholarly contribution
• ALMs that reliably differentiate sources of
input (general; academic; expert; etc.) would
be more useful‖
Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx

11. ENTER ALTMETRICS

12. Altmetrics is the study and use of scholarly
impact measures based on activity in online
tools and environments.
http://doi.org/10.1371/journal.pone.0048753

13. ―It took approximately a generation (20
years) for bibliographic citation analysis to
achieve acceptability as a measure of
academic impact."
(Vaughan and Shaw,
2003)

14. What altmetrics are not good at

15. (Wouters & Costas, 2012)

16. ―The main problem is that none of the new
tools we reviewed meet crucial
requirements for data quality and indicator
construction. This prevents them from
currently being usable in the context of
research evaluation and assessment.‖
(Wouters & Costas, 2012)

17. http://www.slideshare.net/paulwouters1/issi2013-wg-pw

18. (Birkholtz et al. 2013)
(Fausto et al 2012)
http://jasonpriem.org/self-archived/5uni-poster.png
The Research is Happening
http://ploscollections.org/altmetrics
http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html

19. http://www.cwts.nl/pdf/CWTS-WP-2013-003.pdf

20. Why now?

21. Figure 1. Terms and definitions.
Allen HG, Stanton TR, Di Pietro F, Moseley GL (2013) Social Media Release Increases Dissemination of Original Articles in the
Clinical Pain Sciences. PLoS ONE 8(7): e68914. doi:10.1371/journal.pone.0068914
http://www.plosone.org/article/info:doi/10.1371/journal.pone.0068914

22. SOURCES

23. http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest

27. Largest List of Metrics Sources
•
•
•
•
•
•
•
•
•
•
Amazon
Bit.ly
CrossRef
Delicious
Dryad
dSpace
ePrints
Facebook
Figshare
Github
•
•
•
•
•
•
•
•
•
Google+
Medwave
Mendeley
Microsoft
Academic Search
PLOS
PubMed
Reddit
Research Blogging
Scopus
•
•
•
•
•
•
•
•
•
SlideShare
SourceForge
Stack Overflow
Twitter
USPTO
Vimeo
Wikipedia
Worldcat
YouTube
27
From Andrea Michalek

31. STORIES

32. Steve

34. Published AND discussed AND cited
34

39. THE FUTURE – RICHER VIEWS
OF IMPACT

40. • Cameron Neylon - ALM Workshop 2013
Summary
• http://article-levelmetrics.plos.org/files/2013/10/Neylon.pptx

41. Not very high views

42. Not an obvious outlier...

43. ...but interesting interact

45. ...driven by this person...

46. ...who I can talk to.

49. See http://bit.ly/NJOyUn for the whole conversation

50. This. Is Impact.

51. SUPPORT FOR YOUR STORY

52. Three Points
1) The story you want to convey
2) Metrics as evidence
3) Transparency is central

53. Conclusion
• Altmetrics is still developing
– But useful today
• Your content is embedded in a network of
content
– Show the impact of your content through
associated content
• Tell a story using your network

54. Thanks
Collaborators: Peter van den Besselaar, Julie
Birkholz, Frank van Harmelen, Shenghui
Wang, Rinke Hoekstra, Thomas Gurney, Mike
Taylor, Anita de Waard, Jason Priem, Dario
Taraborelli, Cameron Neylon