Max Weber Stiftung MWS HIRMEOSWorkshop Metrics and Altmetrics

Max Weber Stiftung (MWS) HIRMEOS-Workshop Metrics and Altmetrics for Open Access Monographs 11. Januar 2019 Dr. Tina Rudersdorf Head of Section for Evaluation, Funding and Public Relations

28. 11. 2020 Name 2

Purpose of the Foundation „The purpose of the foundation is to promote the following: research focusing on history, cultural studies, economics and the social sciences in selected countries and mutual understanding between Germany and such countries. “ (§ 1 MWS Statutes) 3

Quality Assessment in the MWS 4

Quality Assessment in the MWS The evaluation procedure of the MWS is based on the procedures of the • Leibniz-Gemeinschaft and the German • Wissenschaftsrat. It is an institutional evaluation by informed peerreview taking into account the performance of an institute for the past seven years. 5

Quality Assessment in the MWS The evaluation reports focus on • Structure and positioning, overall concept and profile (Development in the past years and strategic work planning for the years to come) • Work results (Research and publication achievements, special results, publication concept, additional researchbased work results) • International forum functionality, events and public image • Adequacy of the facilities • Staff • Promotion of young talent • Cooperation and networking • Quality assurance 6

Quality Assessment in the MWS Work results (Research and publication achievements, special results, publication concept, additional research-based work results) Quantitative and qualitative indicators used to evaluate publications: • Number of publications per type of publication and year • Publication strategy also regarding Open Access • List of the best 10 publications from the past seven years and reviews thereof • List of publications per research focus or department, publication year and type of publication • Access numbers/downloads for electronic ressources, databases, digital editions • Access numbers for website, social media and subscription numbers for newsletter 7

Quality Assessment in the MWS Types of publication: • Monographs • Edited volumes (Collective works, conference proceedings, special journal issues, etc. ) • Individual contributions in collective works • Institute series (individual volumes) • Individual contributions in institute series • Lectures as single publications • Articles in peer-reviewed journals • Articles in other journals • Research reports, conference reports, miscellaneous, reviews • Working papers • (Individual contributions to) blogs 8

Quality Assessment in the MWS Peers are asked to evaluate the information given in light of the following questions: • Are the research results of the institute theoretically and methodologically sound? • Is the publication concept convincing? • How should the indicators of work performance be assessed (e. g. number of publications depending on the publication culture of the disciplines, especially in peer-reviewed journals, at peer-reviewed congresses, in monographs)? 9

Quality Assessment in the MWS How should the indicators of work performance be assessed (e. g. number of publications depending on the publication culture of the disciplines, especially in peer-reviewed journals, at peerreviewed congresses, in monographs)? Peer assessment tends towards • „less is more“ (Qualität statt Quantität) • Peer-reviewed journals • Special journal issues • Monographs published by internationally renowned publishing houses tends against • Conference proceedings in monographical form 10

Quality Assessment in the MWS Assessment of individual publications: • Close reading • Quality and quantity of reviews 11

Quality Assessment in the MWS During evaluations Open Access is discussed in the context of the publication strategy of an institute, not in the context of metrics. Access numbers or downloads are part of the required information regarding electronic ressources and social media, but they are so far rarely provided by the institutes (often due to technical problems) and so far not considered important by the evaluating experts. 12

Quality Assessment in the MWS • Strong bias in German humanities against the use of metrics in research assessment • Equally strong bias against the use of social media, which means that altmetrics are not regarded as a valid alternative to other metrics • Publication strategy is still not always discussed in detail with younger researchers 13

Contact Dr. Tina Rudersdorf Rheinallee 6, 53173 Bonn Tel. : 0228 -37786 -38 E-Mail: rudersdorf@maxweberstiftung. de www. maxweberstiftung. de gab. hypotheses. org mws. hypotheses. org Twitter: @webertweets Facebook: maxweberstiftung Vimeo: maxweberstiftung 14