Point of View: Beware ‘persuasive communication devices’ when writing and reading scientific articles
Abstract
Authors rely on a range of devices and techniques to attract and maintain the interest of readers, and to convince them of the merits of the author’s point of view. However, when writing a scientific article, authors must use these ‘persuasive communication devices’ carefully. In particular, they must be explicit about the limitations of their work, avoid obfuscation, and resist the temptation to oversell their results. Here we discuss a list of persuasive communication devices and we encourage authors, as well as reviewers and editors, to think carefully about their use.
Main text
Writing a research article is difficult for many reasons. First, there are many things that need to be done besides writing, such as generating the figures. Second, a research article is typically several thousand words long, so there is a lot of writing to do and many decisions to make (such as what to include and what to leave out). Third, most articles have multiple authors, so it will be necessary to circulate drafts to co-authors and act on their feedback. In this article we will focus on the second of these tasks – the act of writing the article itself.
All writing that is intended for publication should be clear and engaging, and the authors of scientific articles can use a wide range of persuasive communication devices to achieve these goals. An obvious example is to give the article an eye-catching title, and this is perfectly fine if the title reflects the content of the paper. However, it is also possible for these devices to be mis-used in ways that can mislead readers (including reviewers) by, for example, giving a false impression about the significance of the work being reported. Clearly, this is not fine.
In this article – which builds on a preprint we posted in March 2022 (Corneille et al., 2022) – we describe a range of persuasive communication devices that can be used to exaggerate the importance of and/or hide the weaknesses of scientific work, and urge authors to exercise caution when thinking about using such devices.
A tentative typology of persuasive communication devices
Good scientific writing is hard, and it is easy to make mistakes, so we will not point to examples in the literature. Instead, over the last year, we have reflected on our own writing styles, and on the writing styles we have encountered when reading or reviewing academic articles, chapters and books. We have shared these reflections with each other and compiled a list of persuasive communication devices, which we have organized in a tentative typology (Table 1). This typology contains 22 devices arranged in four categories: mischaracterizing the state-of-the-art; overselling; smoke screening and deflection; and the misuse of authority (and authors). We hope that this list will encourage reflection on, and fostering of, good scientific writing.
Mischaracterizing the state-of-the-art
Researchers are at risk of misleading the reader about the novelty or strength of their research when they make inaccurate statements about the current state of scientific knowledge. This mischaracterization can take various forms and often involves failing to cite articles that are relevant, or citing articles that are not relevant. For example, authors might fail to cite articles that have already reported a similar result (device 1 in Table 1; ignoring previous work), ignore work that is inconsistent with their own work (device 2; one-sided citation), cite supportive work of weak quality (device 3; reliance on weak evidence), cite work that is agnostic to the point the author is trying to make (device 4; misleading use of references), or make statements that are not backed-up by a relevant citation (device 5; missing evidence). It is important to avoid bias in the reporting and citing of previous research because the cumulative effects of such biases can, for example, inflate the apparent efficacy of medical treatments (see de Vries et al., 2018 for a study of treatments for depression).
It is probably not possible to estimate how often authors fail to cite articles they should have cited (devices 1 and 2). However, as regards articles that are cited, it has been estimated that around a quarter of the articles cited in ‘high-impact general science journals‘ do not completely support the statement they are supposed to support (Smith and Cumberledge, 2020), and similar findings have been reported in psychology (Cobb et al., 2023). Another problem is the practice of citing an original study without citing failures to replicate it (von Hippel, 2022): indeed, it has been estimated that only 12% of citations of non-replicated findings acknowledge the failure(s) to replicate (Serra-Garcia and Gneezy, 2021). However, it should also be noted that authors are sometimes compelled to cite articles that are not relevant by editors hoping to increase the impact factor of their journal (Fong et al., 2023).
Overselling
The second category in our typology concerns authors trying to inflate the perceived importance of their own research. This can involve the use of attention-grabbing titles which make claims that go well beyond the findings of a study (device 6; excessive titles), or authors overgeneralizing their conclusions without sufficient evidence (device 7; overgeneralization). Examples of the latter might include generalizing from college students to all human adults, or from one species to another. The inappropriate use of adjectives such as ‘striking,‘ ‘important,‘ or ‘remarkable,‘ and wording that makes the author’s research questions seem more important than they really are, are also problematic (device 8; hype). Reviewers will often ask authors to tone down their language, but one journal (ACS Catalysis) has gone a step further and now pre-screens submissions for words like ‘outstanding,‘ ‘excellent,‘ and ‘unprecedented‘ (Scott and Jones, 2017). The hyping of research has been particularly noticeable during the COVID-19 pandemic (Hyland and Jiang, 2021).
The perceived coherence of the narrative can also be increased by not reporting findings that would weaken the article (device 9; selective reporting), or by claiming that the results were consistent with a hypothesis when, in fact, the hypothesis was generated after the data had been collected (device 10; HARKing). The practice of HARKing (which is short for hypothesizing after the results are known; Kerr, 1998), has been widely discussed in the literature (for a nuanced discussion, see Hollenbeck and Wright, 2017 and Rubin, 2017).
Smoke screening and deflection
The third category contains devices that are designed to reduce transparency and prevent debate. One tactic is being inconsistent in the use of terminology in order to prevent other researchers testing – and possibly refuting – an author’s claims (device 11; inconsistent terminology): in psychology, for example, an author might describe the same mental process as efficient in one article, unconscious in a second article, and unintentional in a third. Another tactic is to mislead the reader about other work being cited through selective quotation, misquotation, or quotation out of context (device 12; selective quotation).
Relying on ‘straw-person‘ arguments is another form of smoke screening: an author may interpret a claim or theory in its most exaggerated form, and then try to convince readers who are not familiar with the nuances of the claim or theory that it is foolish and therefore wrong (device 13; straw-person argument: see, for example, Aikin and Casey, 2022). Likewise, writing that is cryptic, obscure or undecipherable can convey a false sense of expertise and may prevent a fair assessment of the claims, theories, or analyses in a paper (device 14; cryptic writing: see, for example, Frankfurt, 2005). In a related tactic, an author may seek to overwhelm the reader with large volumes of poorly structured/explained supplementary material in order to prevent scrutiny of a paper’s conclusions (device 15; (supplementary) information overload). Smoke screening can also be implemented by not noting all the limitations of a study, or highlighting relatively minor limitations while seeking to downplay more serious limitations (device 16; limiting what is said about limitations).
Authors can also use ambiguous or polysemous terminology to inflate claims or deflect critiques (device 17; ambiguity). For instance, the word ‘influence‘ can be used to suggest causality, without explicitly claiming that causality has been demonstrated, thus providing the author with wiggle room if another researcher challenges the finding. Words like ‘influence‘ are particularly deceptive when used to describe results derived from weak theories where causality cannot be easily identified (Rohrer, 2018). Another way for an author to deflect a critique is to demand stronger evidence from a researcher with a competing perspective than the author demands from themself (device 18; selective appeal for rigor).
Superficial engagement with open research practices (such as underspecifying a pre-registered study) can also be used to mislead readers and reviewers about the strength of research (device 19; open research washing). For instance, one study of data availability in economics found that only 47.5% of articles in journals with a data-availability policy actually complied with the policy (Vlaeminck and Podkrajac, 2017; see also Tedersoo et al., 2021).
Misuse of authority (and authors)
Our fourth category is a range of devices that rely on authority rather than sound arguments. An author may suggest, for example, that some procedure (e.g., a measurement technique) is valid because it has been used in a large number of studies, even though the procedure is known to have flaws (device 20; reliance on precedent). Likewise, an author may write that there is growing interest in X or that there have been lots of papers about Y to give the impression that their own paper is more important than it really is (device 21; reliance on number of citations).
Honorary authorship is the practice of including someone as an author on a paper because they are famous and/or important, even though their contribution to the article in question does not warrant their inclusion in the author list (device 22; honorary authorship). Honorary authorship is a well-known problem in medicine (Flanagin et al., 1998; Macdonald, 2022).
Where do we go from here?
Our intention in writing this article was to recognize how difficult it is to effectively and accurately convey one’s research to the scientific community and beyond, while at the same time encouraging self-reflection amongst authors, reviewers and editors. This self-reflection should focus on the potential misuse of persuasive communication devices in scientific writing, so that as a global scholarly community we can uphold the highest possible standards of research rigor with a level-playing field.
We want to emphasize that the issues listed here do not necessarily arise from a deliberate intention on the part of the author to mislead the reader. For instance, ignorance of relevant work need not be deliberate, or there may be a limit on the number of references that can be cited. More generally, authors may simply conform to examples set in other papers. However, we find it useful to raise awareness of writing practices that may lead to the misinterpretation of research results, both within and outside our scientific community. Moreover, the scientific writing issues discussed here can be detrimental even when they are not implemented purposefully.
The typology we present is tentative, and is not intended to be a dogmatic list of dos and don’ts. We do not mean to suggest either that incoherent narratives or exceedingly boring or technical titles and abstracts should be the rule. However, there is a point at which the writing style of an article, chapter, or book, is at risk of misleading the readers, be it on purpose or not. In its extreme version, an article may ‘camouflage true phenomena in the name of promoting Wow Effects and preferred narratives‘ (Jussim et al., 2016).
Going beyond scientific writing per se, one should keep in mind that we may be tempted to use the same or related persuasive communication devices in all kinds of science communication. In oral talks, scientific poster presentations, interviews, and even in discussions with colleagues, we may find ourselves resorting to persuasive tactics that are not always consistent with good research practices.
The descriptions of the persuasive communication devices we have identified are necessarily brief as there are 22 of them overall. We are also certain that this is an incomplete list (see, for example, O’Donohue, 2023, for a discussion of the use of rhetoric in clinical science). However, we firmly believe that highlighting these issues and encouraging discussion around them is part of the solution. As authors prepare articles for submission, and as reviewers and editors assess these articles, we encourage them to think about the devices listed in Table 1, and to identify other devices that also have the effect of exaggerating importance or hiding weaknesses. In particular, we urge authors to reflect on whether any article they are writing or reviewing (formally or informally) is fair, and will bring readers closer to truth, or is just as likely to steer them away from it.
References
-
The problem of miscitation in psychological science: Righting the shipThe American Psychologist 1:amp0001138.https://doi.org/10.1037/amp0001138
-
BookOn BullshitPrinceton University Press.https://doi.org/10.1515/9781400826537
-
The Covid infodemic: Competition and the hyping of virus researchInternational Journal of Corpus Linguistics 26:444–468.https://doi.org/10.1075/ijcl.20160.hyl
-
Interpretations and methods: Towards a more effectively self-correcting social psychologyJournal of Experimental Social Psychology 66:116–133.https://doi.org/10.1016/j.jesp.2015.10.003
-
HARKing: Hypothesizing after the results are knownPersonality and Social Psychology Review 2:196–217.https://doi.org/10.1207/s15327957pspr0203_4
-
The gaming of citation and authorship in academic journals: A warning from medicineSocial Science Information 61:457–480.https://doi.org/10.1177/05390184221142218
-
Thinking clearly about correlations and causation: Graphical causal models for observational dataAdvances in Methods and Practices in Psychological Science 1:27–42.https://doi.org/10.1177/2515245917745629
-
Superlative scientific writingACS Catalysis 7:2218–2219.https://doi.org/10.1021/acscatal.7b00566
-
Quotation errors in general science journalsProceedings of the Royal Society A 476:20200538.https://doi.org/10.1098/rspa.2020.0538
-
Is psychological science self-correcting? Citations before and after successful and failed replicationsPerspectives on Psychological Science 17:1556–1565.https://doi.org/10.1177/17456916211072525
Article and author information
Author details
Funding
The authors declare that there was no funding for this work.
Acknowledgements
We thank Iain Johnston, Christoph Stahl and Florence Stinglhamber for providing encouraging and useful comments on previous versions of this article.
Publication history
- Received:
- Accepted:
- Version of Record published:
Copyright
© 2023, Corneille et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 16,060
- views
-
- 1,262
- downloads
-
- 10
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Astrocytes derive from different lineages and play a critical role in neuropathic pain after spinal cord injury (SCI). Whether selectively eliminating these main origins of astrocytes in lumbar enlargement could attenuate SCI-induced neuropathic pain remains unclear. Through transgenic mice injected with an adeno-associated virus vector and diphtheria toxin, astrocytes in lumbar enlargement were lineage traced, targeted, and selectively eliminated. Pain-related behaviors were measured with an electronic von Frey apparatus and a cold/hot plate after SCI. RNA sequencing, bioinformatics analysis, molecular experiment, and immunohistochemistry were used to explore the potential mechanisms after astrocyte elimination. Lineage tracing revealed that the resident astrocytes but not ependymal cells were the main origins of astrocytes-induced neuropathic pain. SCI-induced mice to obtain significant pain symptoms and astrocyte activation in lumbar enlargement. Selective resident astrocyte elimination in lumbar enlargement could attenuate neuropathic pain and activate microglia. Interestingly, the type I interferons (IFNs) signal was significantly activated after astrocytes elimination, and the most activated Gene Ontology terms and pathways were associated with the type I IFNs signal which was mainly activated in microglia and further verified in vitro and in vivo. Furthermore, different concentrations of interferon and Stimulator of interferon genes (STING) agonist could activate the type I IFNs signal in microglia. These results elucidate that selectively eliminating resident astrocytes attenuated neuropathic pain associated with type I IFNs signal activation in microglia. Targeting type I IFNs signals is proven to be an effective strategy for neuropathic pain treatment after SCI.
-
- Neuroscience
Background:
Post-stroke epilepsy (PSE) is a critical complication that worsens both prognosis and quality of life in patients with ischemic stroke. An interpretable machine learning model was developed to predict PSE using medical records from four hospitals in Chongqing.
Methods:
Medical records, imaging reports, and laboratory test results from 21,459 ischemic stroke patients were collected and analyzed. Univariable and multivariable statistical analyses identified key predictive factors. The dataset was split into a 70% training set and a 30% testing set. To address the class imbalance, the Synthetic Minority Oversampling Technique combined with Edited Nearest Neighbors was employed. Nine widely used machine learning algorithms were evaluated using relevant prediction metrics, with SHAP (SHapley Additive exPlanations) used to interpret the model and assess the contributions of different features.
Results:
Regression analyses revealed that complications such as hydrocephalus, cerebral hernia, and deep vein thrombosis, as well as specific brain regions (frontal, parietal, and temporal lobes), significantly contributed to PSE. Factors such as age, gender, NIH Stroke Scale (NIHSS) scores, and laboratory results like WBC count and D-dimer levels were associated with increased PSE risk. Tree-based methods like Random Forest, XGBoost, and LightGBM showed strong predictive performance, achieving an AUC of 0.99.
Conclusions:
The model accurately predicts PSE risk, with tree-based models demonstrating superior performance. NIHSS score, WBC count, and D-dimer were identified as the most crucial predictors.
Funding:
The research is funded by Central University basic research young teachers and students research ability promotion sub-projec t(2023CDJYGRH-ZD06), and by Emergency Medicine Chongqing Key Laboratory Talent Innovation and development joint fund project (2024RCCX10).