Surge gery y Resear search ch Con Conference The e Go Good - - PowerPoint PPT Presentation

Surge gery y Resear search ch Con Conference

“The e Go Good

• d and

and Bad ad News of O Obje ject ctiv ive B Bib iblio iometric ics” Raul aul Urrut utia ia, M MD

August 15th, 2018

ACCME A Accre reditation

• n S

Statement: : The Medical College of Wisconsin is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for

• physicians. AMA Cr

Credi dit D Desig ignation St Stat atement: The Medical College of Wisconsin designates this live activity for a maximum of 1.0 AMA PRA Category 1 Credit™. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Hours o

• f Partic

icip ipat atio ion f for Alli lied H Health C h Care P Professionals ls: : The Medical College of Wisconsin designates this activity for up to 1.0 hours of participation for continuing education for allied health professionals.

SAVE VE th the e DATE

8/22 22-8/2 /23/1 /18 Solid id O Organ T gan Trans ansplant antat atio ion R n Res esear earch S Symposiu ium Helfaer A Audi ditorium 7: 7:30-5: 5:00pm 0pm 9/14 14/18 Fal all Res esear earch S Symposiu ium Helfaer A Audi ditorium 12: 12:00-4: 4:00 00pm pm 9/24 24/18 Resear earch D Day HUB G Galle llery-1st Floor

• or

1:00 00-4:00p 00pm

Rese search ch: V Visu sual A Abst stract cts

20 2019 9 Call ll for

• r ABS

ABSTRACTS

Abstract Submission Closes: Friday, A August 2 24th

th, 2

2018

14th Annual Academic Surgical Congress

Whe hen: F Febru ruary 5 5-7, 7, 20 2019 Where: H Houst ston, T Texas xas Regist istrat atio ion O Open: L Late F Fall 2 2018

Intro t to REDCap Cap

Next M Month:

Rese search Resi sidents and and Int ntro to REDCap DCap

Mar Mark Oi Oium RE REDCap Sys ystems Man Manag ager

2018-201 019 Resear earch R Res esid ident ent Int Introductio ions ns

Erin in St Strong, g, M MD (Su Surgi gical O Oncology gy) & & Christina B Bence, M MD (Pedia iatric S Surge gery)

Septemb mber er 1 12th, 201 018 Conferen ence Room m M 5:00-6:00pm

Academi mic M Metri rics: s: Understa tand nding ng H H-index an and d Blue Ri e Ridg dge N NIH H Awar ard Ran d Rankin kings gs

Raul U l Urru rutia, M , MD

The Go he Good and nd Bad Ne News o s of f “Obje bjectiv ive B Bibliom ibliometric ics”

Raul U l Urrutia ia, M MD Division o

• f Resea

esearch Depa epartmen ent of

• f Surger

ery

Discl sclaimer mers

• The speaker has been charged by the Division of Research to provide definitions

and the use of Bibliometrics

• The data here provided rarely represents the speaker’s personal opinion, unless

clearly stated

• In other words, the speaker develops the material based on a robust investigation of

Bibliometrics

• Bibliometrics described here applies to career scientists. Different variations of the

metrics may be adopted to evaluate physicians engaged in research and/or practitioners

Thu Thus… please ase…do do n not s shoot t the m messe ssenger!! !!

Bibliom ibliometric ics: :

Wikipedia contributors. (2018, June 19). Bibliometrics. In Wikipedia, The Free Encyclopedia. Retrieved 16:25, August 15, 2018, from https://en.wikipedia.org/w/index.php?title=Bibliometrics&oldid=846500665

Bibliometrics is statistical analysis of written publications, such as books or articles. Bibliometric methods are frequently used in the field of library and information science, including scientometrics Scientometrics is the study of measuring and analyzing science, technology and innovation

What at ar are Bibliom ibliometric ics u used d for

• r?

Bibliometrics are used by National and International organizations to rank individuals, departments, universities, and health care organizations Those who have contributed with a unique discovery that advances science beyond their own time of existence must not worry about metrics For the rest, building a solid academic career, for oneself and for mentees, requires to understand and adhere to certain metrics Bibliometrics either influence or even determine promotions and long-term job security There are many metrics and yet no perfect one. Thus, all institutions collect them all, at the same time. Therefore, keep eep an eye e on all the e met etrics

Type pes of

• f Bibliom

ibliometric ic Me Meas asures

Trad adit itio ional al

• Publication Number
• Citation Counts

Mod Modern

• Impact Factor (IF)
• Indexes
• Google Scholar Metrics

Tra raditi tional: Numb Numbers vs vs Cita tati tions

Tra raditional Metri trics: Number ers vs.

• vs. Ci

Cita tations

“Publish or Perish” but be careful…you can also “Publish to Perish”

# of c f citati itations qu quality

The metrics apply differently depending on the goal of their use, career stage, etc There are different careers which are evaluated through “collab aborat ativ ive e metrics cs” while others by “aut author p posit itio ion” n” metrics

Numb Numbers vs.

• vs. Cita

tati tions

Cou

• unting
• Rules based on counting and classifying the type of publications are adopted by different

communities through tradit itio ion, they vary with the cultural values of the group evaluating them

• Numbers vs. Journal Reputation
• Balance between original contributions in the form of full articles, case reports, abstracts,

books, book chapters, editorials, and opinions

• Me

Metrics cs mostly apply to original contributions and review articles - they are seldom considered for book chapters, editorials, letter to editors, and abstracts

• Balance between collaborative publications vs. those signed as first or senior author

Cit Citations

• Assumes that the article with more citations is more influential, however, articles with the wrong

view have dominated in a quasi-dogmatic manner in many fields, cited widely and yet found to be wrong later

Mo Mode dern B Bibl bliometrics:

The I he Imp mpact F ct Fact ctor ( (IF) F)

• Impa

pact Fa Factor: frequency with which the average article in a journal has been cited in a year.

• The calculation is based on a two-year period and involves dividing the number of times

articles were cited by the number of articles that are citable.

A A = t the num numbe ber o

• f c

cit itations dur uring 2 2016, f for a an a n article p pub ublished in a in a sp specific jo jour urnal in in 2014 and 2 201 015 B B = t the total num numbe ber o

• f '

'cit itable it item ems' publis ished ed b by that j journa nal i in 2014 a and 2

• 2015. (

. ('Cit itable e items' a are u e usua ually a artic icles es, r , revie iews, p , proceed eeding ings, et , etc.; n ; not e editoria ials, l , let etter ers-to to-the-ed edit itor, c , case e reports o

• r abstracts)

2016 i 6 impact ct fa factor = = A/B

• Use the Journal Citation Reports (JCR) to locate true

ue imp mpact factors.

• The JCR also lists journals and their impac

pact factors with a ranking in the context of their specific field(s).

Clarivate Analytics. (2018, July 10). Retrieved from https://clarivate.libguides.com/jcr

Im Impac pact F Fac actor

• r: C

: Con

• nside

iderat ation ions

• IF = Number of citations / total number of articles published
• Self Citations: several journal organizations control for self-citation
• Reducing the number of published articles: by elimination of case

reports, letters to the editors, and meeting proceedings

• Open Access: paper that is not found is never cited
• Citation of original articles decreases due to the popularity of high

impact reviews: e.g. Na Natur ure Reviews.

• The highest impact factor journals are not necessarily the most

cited ones: (JBC and PNAS).

• Funding considerations apply!

Journal al Citat ation Repo ports (JCR JCR): Rel eliability

• Journal Citation Reports (JCR) provide information about

academic journals in the natural sciences and social sciences, including impact factors

• The JCR was originally published as a part of Scie

ience Cit itatio ation Ind Index, currently, the JCR, as a distinct service, is based on citations compiled from the Sci cience ce Cita itatio tion Index ex Expa pand nded and the Social al Scien ence Ci Citation

• n Index.

Clarivate Analytics. (2018, July 10). Retrieved from https://clarivate.libguides.com/jcr

The The I Ind ndexes

Goog

• gle S

Scholar M Metr trics: August 2 t 2, , 2018 Release

• Hirsch-Index (H-Index)
• i10-Index
• H5-(H-Index for the last 5 complete years)
• H5-core
• H5-median

The H he Hirsc sch-Inde dex ( x (H-In Inde dex): x):

The H-inde dex or Hirsch ch inde dex, measures the impact

• f a particular scientist rather than a journal.

"It is defined as th the highest num numbe ber

• f

publ ublicat ation

• ns of a scie

ientis ist that at receiv eived ed h or more re cit itatio ions eac ach, while the other publications have not more than h citations each."1 For example, a scholar with an h-index of 5 had published 5 papers, each of which has been cited by others at least 5 times.

Hirsch, J.E. Proceedings of the National Academy of Sciences. USA. 102 (46): 16569-16572 November 15 2005.

The he H Hirsc sch-Ind ndex ( x (H-Index): x): S Strengt ngths hs

• The h-in

inde dex, when used as an author-level metric, attempts to measure both the productivity and cit itat atio ion impact of the publications of a scientist or scholar

• The in

inde dex is based on the set of the scientist's most cited papers and the number of citations that they have received in other publications

• The advantage of the h-in

inde dex is that it combines productivity (i.e., number of papers produced) and impact (number of citations) in a single number

Hirsch, J.E. Proceedings of the National Academy of Sciences. USA. 102 (46): 16569-16572 November 15 2005.

Hirsch reckons that after 20 years

• f research, an h in

inde dex of 20 is good, 40 is outstanding, and 60 is truly exceptional

Hirsch, J.E. Proceedings of the National Academy of Sciences. USA. 102 (46): 16569-16572 November 15 2005.

Th The e Hi Hirsch-Inde Index x (H-Index): ): Controversi sial Weak aknesse sses s

Does not differentiate between those papers that are collaborative vs. those published as major authors (1st and Senior Authors) Influenced by Self-citations It is difficult to compare H-scores across fields. Does not include a correction for the size

• f the field or the popularity of the topics (Scientifically Fashionable or Better-Funded).

For instance, an article on p53 and colon cancer is more cited than one that focused on a less known, yet similarly important protein (KLF4), just because of “field bias” It has started to create a culture of “H-index entrepreneurs”, as it does not focus on “creativity and innovation” but rather of a particular numbers. “When this happens, universities will cease to be knowledge creators and instead become metric maximisers”

• Explainer. (2015, May). Retrieved from https://theconversation.com/explainer-what-is-an-h-index-and-how-is-it-calculated-41162

i10 10-In Inde dex ( x (I-In Inde dex) x)

i10-Ind Index = the number of publications with at least 10 citations. This very simple measure is

• nly used by Google Scholar, and is another way to

help gauge the productivity of a scholar. Advantages of i10-Ind Index

Hirsch, J.E. Proceedings of the National Academy of Sciences. USA. 102 (46): 16569-16572 November 15 2005.

H5 H5-Index ex

h5 h5-index is the h-index for articles published in the last 5 complete years. It is the larg rgest number h r h such that h articles published in 2013-2017 have at least h citations each. h5 h5- median ian for a publication is the median number of citations for the articles that make up its h5-index

Hirsch, J.E. Proceedings of the National Academy of Sciences. USA. 102 (46): 16569-16572 November 15 2005.

h-cor

• re an

and d h-med median

• The h-core of a publication is a set of top cited h articles

from the publication. These are the articles that the h-index is based on.

• The h-median

ian of a publication is the median of the citation counts in its h-core. For example, the h-median of the publication above is 9. The h-median is a measure of the distribution of citations to the articles in the h-core.

Hirsch, J.E. Proceedings of the National Academy of Sciences. USA. 102 (46): 16569-16572 November 15 2005.

Blue Ridge Rankings

NIH Funding Rank of US Medical Schools from 2006-2017

Blue Ridge Institute for Medical Research. (2009, February). Retrieved from http://www.brimr.org/NIH_Awards/NIH_Awards.htm

Total NIH Awards to all Medical School Departments of a given discipline: Surger ery is y is nu number 16 Total NIH Awards to each Medical School in 2017 including percentage of direct and indirect Costs: MCW is is nu number 5 52 from a total o

• f 1

141 sch choo

• ols

Blue Ridge Institute for Medical Research. (2009, February). Retrieved from http://www.brimr.org/NIH_Awards/NIH_Awards.htm

Blue Ridge Institute for Medical Research. (2009, February). Retrieved from http://www.brimr.org/NIH_Awards/NIH_Awards.htm

MCW is going through its strategic planning for research Centers and departments strategic planning for research will likely need to be updated.

Consider

Intro t to REDCap Cap

Next M Month:

Rese search Resi sidents and and Int ntro to REDCap DCap

Mar Mark Oi Oium RE REDCap Sys ystems Man Manag ager

2018-201 019 Resear earch R Res esid ident ent Int Introductio ions ns

Erin in St Strong, g, M MD (Su Surgi gical O Oncology gy) & & Christina B Bence, M MD (Pedia iatric S Surge gery)

Septemb mber er 1 12th, 201 018 Conferen ence Room m M 5:00-6:00pm