Academia.eduAcademia.edu

Alternative Impact Metrics: UK Faculty Evaluation

2013

“Alternative impact metrics: UK Faculty evaluation Derek R. Lane, Ph.D. ci Senior Associate Dean OCtober 22, 2013 IMPACT? EVIDENCE? STUDENTS Served ASSESS SCH generated FACULTY CREDENTIALS BIG DATA SALARIES RANKINGS Decisions STUDENT PLACEMENT PATENTS http://www.ibm.com/analytics/us/en/what-is-smarter-analytics/big-data-analysis.html Assessing Research IMPACT (and usage) “Peer-REVIEWED JOURNAL ARTICLE PUBLICATION IS THE PRIMARY MODE OF COMMUNICATION AND RECORD OF SCIENTIFIC RESEARCH.” http://arxiv.org/ftp/cs/papers/0503/0503020.pdf EXPERT PEER REVIEW - FILTER ASSESSING RESEARCH IMPACT @UK ASSESSING RESEARCH IMPACT @UK # of EXPERT Peer-REVIEWED PUBLICATIONS AUTHOR ORDER JOURNAL QUALITY* (Tier, SCOPE) IMPACT FACTOR* OUTSIDE EXPERT LETTERS *IMPACT FACTORS AS Predictors http://www.nature.com/nmat/journal/v12/n2/full/nmat3566.html altmetrics IMPACT Or “EMPTY BUZZ” altmetrics REPLACEMENT OR VALUE ADDED altmetrics http://altmetrics.org/manifesto/ Moving Beyond citation Counts http://www.plumanalytics.com/index.html http://impactstory.org/ http://www.altmetric.com/ Moving Beyond citation Counts http://www.altmetric.com/ Moving Beyond citation Counts •Meaningful Metrics •Holistic View of Research Output •20 Different Types of Artifacts http://www.plumanalytics.com/index.html altmetrics Artifacts http://www.plumanalytics.com/metrics.html USAGE http://www.plumanalytics.com/metrics.html CAPTURES http://www.plumanalytics.com/metrics.html MENTIONS http://www.plumanalytics.com/metrics.html SOCIAL MEDIA http://www.plumanalytics.com/metrics.html CITATIONS http://www.plumanalytics.com/metrics.html POTENTIAL ADVANTAGES: “MORE” • MORE “Nuanced Understanding” ✤(read, discussed, saved, recommended, AND cited) • MORE “Timely Data” ✤(evidence of impact in days instead of years) • MORE “Artifacts” ✤(datasets, software, blog posts, videos, slide decks, etc.) • MORE “IMPACTS” ✤(diverse audiences, practitioners, clinicians, educators, general public) http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.pdf The 3 A’s of ALTMETRICS Ques%on  1  (Acceptance):   Will  faculty,  administrators,  and  professional  colleagues   accept  altmetrics  to  assess  research  impact  as  it  relates  to   tenure,  promo%on,  and  merit?   Ques%on  2  (Ar%facts):     Which  specific  ar%facts  should  be  used  to  assess  research   impact?     Ques%on  3  (Adop%on):     When,  if  at  all,  should  the  “adop%on”  occur?   EXPERT PEER REVIEW - FILTER