Changing research evaluation policies in China — insights and impacts

In this free webinar, speakers discuss China’s new research policies and their potential impact on publishers, research institutions and researchers

By Rachel Guest - June 23, 2020
Chinese research webinar screenshot
A slide from the presentation of Christos Petrou, founder and Chief Analyst at Scholarly Intelligence. You can find a link to this webinar in the article.

In February 2020, China’s Ministry of Science and Technology (MOST) and Ministry of Education (MoE) published policy documents to initiate a steer away from assessing research by the number of articles published and SCI-listed journals to a focus on publishing a limited number of high quality papers.

In this free webinar, our speakers provide insights into the background of these policy announcements and their potential impact on publishers, research institutions and researchers. Speakers are:

  • Dr. Shuai Yan, Beijing-based publishing consultant
  • Christos Petrou, founder and Chief Analyst at Scholarly Intelligence

Here are some of their key points.

1. China will classify science and technology (S&T) evaluation into basic and applied research.

For basic research evaluation, a system of representative papers will be implemented. This will include no less than a third of papers published in China-based S&T journals.

Shuai Yan, PhD Shaui said: “One of the elements being introduced is that the MOST will increase the weight and assessment of high value work to encourage the publication of high quality papers. In this evaluation, the quality and impact of landmark achievements will be more of the focus.”

2. China will recognize three types of papers as high quality:

  • Papers published in domestic S&T journals with international influence.
  • Papers in top tier or important international S&T journals.
  • Papers delivered at top academic conferences at home and abroad.

Shaui explained:

For points one and two the important international journals and the top conferences will be selected by academic committees of universities and research institutes. Overall the aim is to place an emphasis on fewer but better papers when it comes to evaluating researchers and their research institutions.

Shaui also noted that China is going to eliminate “Science Citation Index (SCI) worship” and abandon the practice of “judging papers by journals.” Universities and concerned institutions shall not adopt, quote or promote the rankings compiled with SCI papers and Essential Science Indicators (ESI) as core indicators.

3. China's research output accounts for no less than 20 percent of global academic journal output. As a result, the newly announced policies will have implications for research stakeholders worldwide.

Christos said:

Whatever happens in China should matter globally. One of the goals of this new policy is to move away from rating performance based exclusively on science citation index (SCIE) journals.  In the past, Chinese researchers have truly tried to publish in SCIE journals. Their global share of publications is 20 percent; in SCIE journals, it’s higher. In top-tier SCIE journals, it’s 25 percent, and the flip-side is that in the non-SCIE journals, it’s 5 percent.

Volume of global content and proportion of China conent by type of journal.  (<em>2018 Articles and Reviews per Web of Science Core Collection Journal Data</em>)

4. Operational challenges are likely to slow down the policies’ implementation and their impact.

Through trial and error, however, the Chinese administration is likely to eventually succeed in strengthening the local publishing industry and creating its own tools and standards for research evaluation.

Christos PetrouAs Christos explained:

Setting up a lot of journals locally takes time. And setting up your own list of journals in a recurring sustainable way, you need an abstracting and indexing database – something like Scopus or Web of Science. That also takes time. It’s not a simple task. Article output is also dependent on how much research is being conducted. It might be that this policy is implemented and we don’t see a drop in output. Also we might not see a change in habit among researchers who are used to publishing in high impact journals. But it is reasonable to expect that researchers will adapt to the new policy.


Access the free on-demand webinar

Dr. Shuai Yan

Dr. Shuai Yan is a Beijing-based publishing consultant. His previous career endeavors include Academic Relationship Director at Springer Nature Greater China, Associate Chief Editor of Tsinghua University Press (TUP) and Director of TUP’s Journal Publishing Center, and Editor-in-Chief of  Journal of Tsinghua University (Science and Technology). Prior to Tsinghua University, he held several senior roles at Beijing Forestry University (BFU) and with multiple prestigious societies and government organizations in China.

Christos Petrou

Christos Petrou is founder and Chief Analyst at Scholarly Intelligence, where he supports stakeholders in the scholarly communications industry with analytics and strategy services. He is a former analyst of the Web of Science Group at Clarivate Analytics and the Open Access portfolio at Springer Nature. He previously worked as a consultant for A.T. Kearney, and he holds an MBA from INSEAD. A geneticist by training, he received technical training at Zhejiang University.


Related stories

Contributors


https://www.elsevier.com/__data/assets/image/0020/711209/Rachel-Guest.jpg
Written by

Rachel Guest

Written by

Rachel Guest

Rachel Guest is a professional marketer. Having studied Marketing Management at Oxford Brookes University and gaining her CIM Professional Postgraduate Diploma in Marketing at Oxford College of Marketing, she worked in various business and marketing roles before returning to Oxford Brookes University some years later as their Promotions Officer. In 2006 she joined Elsevier and progressed to Head of Marketing Communications for life and social science journals. She began a freelance marketing consultancy in 2013 and is proud to count Elsevier and KeAi as clients. She lives in Oxford, UK.

What does the pandemic mean for research in biodiversity conservation?
US business students visit Elsevier to learn about Pride and I&D in the workplace
Editor in a (60-second) spotlight – Amanda Kenny

Comments


comments powered by Disqus