Chinese guide to peer review aims to help public make sense of science claims
Adaptation of ‘I Don’t Know What to Believe’ based on input from research community in China
By Julia WIlson Posted on 10 May 2013
We hear all kinds of claims in the media and on the internet that are based on scientific studies. When faced with a headline that suggests genetically modified corn causes infertility or an Alzheimer's drug increases the risk of heart attack, people have to work out what to believe. Which claims should be taken seriously? Which are scares?
A free leaflet called I Don't Know What to Believe: Making Sense of Science Storiesexplains the peer review process – the system researchers use to assess the validity, significance and originality of papers. It captures experiences and insights from editors and scientists and encourages people to ask, when reading science stories: "Is it peer reviewed?"
Now, the guide has been translated into Chinese by the journalist Yue Yaun, Editor of Sanlian Life Weekly, and is being hosted on Guokr.com, a Chinese information site.
The peer review system plays an important role in ensuring the scholarly record is as sound as possible. 85 percent of Chinese researchers' questioned in a 2009 survey said they considered peer review an important part of improving the quality of research papers, and 90 percent saw it as greatly helping scientific communication. The survey – one of the largest ever peer review surveys of over 4,000 authors and reviews – was conducted by Sense About Science with support from Elsevier.
Yue Yuan said the guide was important in light of how his nation has been "changing rapidly toward a new era" and so much information is available online, including the opinions of those who may not be well informed about science:
Many new thoughts and special-interest groups are trying to win over public support. A lot of movie and sport stars have much more power over public opinion than before. In this confusing time, it is even more important to be able to separate fact from fiction. This guide is a good start. The peer review system can make mistakes but it is the most reliable quality-control system by far. You will be less likely to make mistakes if you trust the peer review system, rather than your own gut feeling, or the politicians or individual scholars.
Lai Xu, Chief Editor of Guokr.com, said the ability to read scientific papers is a "required skill" for science reporters: "One of the most important jobs of a science reporter is to inform the public about the peer review system so they can weigh up the meaning and significance of scientific papers."
The Chinese edition is based on the original UK edition of the guide.
The decision to launch the guide in China, and how to adapt it, were based on survey results as well as meetings with members of the Chinese research community.
A fact-finding mission in China
Two years ago, Tracey Brown, Managing Director of Sense About Science, embarked on a fact-finding mission, which she later discussed in Editor's Update.
Brown said she had two key aims in mind: to test out views advanced about the integration of Chinese authors and reviewers into international STM publishing, and to explore future collaborations to help researchers, policymakers and journalists identify the best science.
During the two-week visit, which was supported by Elsevier, she met with officials from the Chinese Academy of Sciences (CAS) as well as Science.net, journalists, post docs and publishers.
"People raised many interesting points and some quite contradictory ones," Brown said in the article. "The early career researchers I spoke with viewed international journals as motivated by quality and fairness, and in some cases compared them favorably with Chinese journals, which can be seen as wedded to the relationships and prestige of individuals and institutions.
"On the other hand, some of the more editorially-experienced people had stories of less than positive attitudes among international editors to Chinese papers," she added. "They were concerned about a head-in-the-sand approach to such a major research base and that valuable new insights could be missed."
Her other takeaways included:
- General agreement that reviewing is an important part of the role of a researcher. However, involvement in it varies enormously.
- As in many other countries, a researcher's day is structured in a way that makes it difficult to find time to review, and their career progresses in response to grants and publications, not time spent reviewing. Views differed widely about the problems this posed and whether it inhibited the reviewing effort.
- A strong interest in training, both for authors and reviewers.
- Interest in other metrics for evaluating research output, the respective contributions of regions/countries and the performance of individual institutions.
Now, in the press release announcing the launch of the peer review guide in China, Brown stated: "It explains that the status of research findings is as important as the findings themselves. This understanding has the capacity to improve the decisions we make across all of society."
Meeting with members of the research community in China:Tracey Brown, Managing Director of Sense About Science; David Ruth, SVP of Global Communications at Elsevier; and Hugo Zhang, Elsevier Managing Director S&T China (left) meet with Mr Jinghai Li, Vice President of the Chinese Academy of Sciences (right).
What is Sense About Science?
Sense About Science(SAS) is a UK charitable trust that equips people to make sense of science and evidence on issues that matter to society. With a network of more than 5,000 scientists, the organization works with scientific bodies, research publishers, policymakers, the public and the media to lead public discussions about science and evidence. Through award-winning public campaigns, it shares the tools of scientific thinking and the peer-review process. Sense About Science's growing Voice of Young Science network engages hundreds of early career researchers in public debates about science.
- Elsevier's partnership with Sense About Science: www.elsevier.com/senseaboutscience
- Results from the 2009 Peer Review Survey: www.senseaboutscience.org/pages/peer-review-survey-2009.html
- Article about the 2009 Peer Review Survey by Adrian Mulligan, Research Director for Elsevier, and Ellen Raphael, former UK director of Sense About Science: http://uksg.metapress.com/content/411338803w4v164n/fulltext.html
- UK edition of I Don't Know What to Believe: www.senseaboutscience.org/resources.php/16/i-dont-know-what-to-believe
- Sense About Science's work on peer review: www.senseaboutscience.org/pages/peer-review.html
- More peer review articles in Elsevier Connect: elsevierconnect.com/cat/story/publishing/peer-review/
Reporting for Elsevier Connect ...
Julia Wilson is Development Manager at Sense About Science, a UK charity that helps people make sense of science and evidence. She is responsible for the organization's fundraising activities and international work. Wilson previously coordinated their Voice of Young Science program, which encourages early-career researchers to take an active role in public debates about science. She has a degree in biology from the University of Manchester.