Chatbots, Generative AI, and Scholarly Manuscripts

WAME Recommendations on Chatbots and Generative Artificial Intelligence in Relation to Scholarly Publications

See Spanish language version in Colombia Médica

Revised May 31, 2023

 

Chris Zielinski (1), Margaret A. Winker (2), Rakesh Aggarwal (3), Lorraine E. Ferris (4), Markus Heinemann (5), Jose Florencio Lapeña, Jr (6), Sanjay A. Pai (7), Edsel Ing (8), Leslie Citrome (9), Murad Alam (10), Michael Voight (11), Farrokh Habibzadeh (12), on behalf of the WAME Board

  1. Vice President, WAME; Centre for Global Health, University of Winchester, UK
  2. Trustee, WAME; US
  3. President, WAME; Associate Editor, Journal of Gastroenterology and Hepatology; Director, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India
  4. Trustee, WAME; Professor, Dalla Lana School of Public Health, University of Toronto, Canada
  5. Treasurer, WAME; Editor-in-Chief, The Thoracic and Cardiovascular Surgeon, Professor, Universitaetsmedizin Mainz, Germany
  6. Secretary, WAME; Editor-in-Chief, Philippine Journal of Otolaryngology Head & Neck Surgery; Professor, University of the Philippines Manila
  7. Director, WAME; Working Committee, The National Medical Journal of India
  8. Director, WAME; Section Editor, Canadian Journal of Ophthalmology; Professor, University of Toronto and University of Alberta, Canada
  9. Director, WAME; Editor-in-Chief, Current Medical Research and Opinion; Topic Editor for Psychiatry for Clinical Therapeutics; Clinical Professor of Psychiatry & Behavioral Sciences, New York Medical College, US
  10. Director, WAME; Editor-in-Chief, Archives of Dermatological Research; Professor, Northwestern University, US
  11. Director, WAME; Executive Editor-in-Chief; International Journal of Sports Physical Therapy; Professor, Belmont University School of Physical Therapy, US
  12. Past President, WAME; Editorial Consultant, The Lancet; Associate Editor, Frontiers in Epidemiology; Iran

Introduction

This statement revises our earlier “WAME Recommendations on ChatGPT and Chatbots in Relation to Scholarly Publications” (January 20, 2023). The revision reflects the proliferation of chatbots and their expanding use in scholarly publishing over the last few months, as well as emerging concerns regarding lack of authenticity of content when using chatbots. These Recommendations are intended to inform editors and help them develop policies for the use of chatbots in papers published in their journals. They aim to help authors and reviewers understand how best to attribute the use of chatbots in their work, and to address the need for all journal editors to have access to manuscript screening tools. In this rapidly evolving field, we will continue to modify these recommendations as the software and its applications develop.

A chatbot is a tool “[d]riven by [artificial intelligence], automated rules, natural-language processing (NLP), and machine learning (ML)…[to] process data to deliver responses to requests of all kinds.” (1) Artificial intelligence (AI) is “the ability of a digital computer or computer-controlled robot to perform tasks commonly associated with intelligent beings.” (2)

“Generative modeling is an artificial intelligence technique that generates synthetic artifacts by analyzing training examples; learning their patterns and distribution; and then creating realistic facsimiles. Generative AI (GAI) uses generative modeling and advances in deep learning (DL) to produce diverse content at scale by utilizing existing media such as text, graphics, audio, and video.” (3, 4)

Chatbots are activated by a plain-language instruction, or “prompt,” provided by the user. They generate responses using statistical and probability-based language models. (5) This output has some characteristic properties. It is usually linguistically accurate and fluent but, to date, it is often compromised in various ways. For example, chatbot output currently carries the risk of including biases, distortions, irrelevancies, misrepresentations, and plagiarism – many of which are caused by the algorithms governing its generation and heavily dependent on the contents of the materials used in its training. Consequently, there are concerns about the effects of chatbots on knowledge creation and dissemination – including their potential to spread and amplify mis- and disinformation (6) – and their broader impact on jobs and the economy, as well as the health of individuals and populations. New legal issues have also arisen in connection with chatbots and generative AI. (7)

Chatbots retain the information supplied to them, including content and prompts, and may use this information in future responses. (8) Therefore, scholarly content that is generated or edited using AI would be retained and as a result, could potentially appear in future responses, further increasing the risk of inadvertent plagiarism on the part of the user and any future users of the technology. Anyone who needs to maintain confidentiality of a document, including authors, editors, and reviewers, should be aware of this issue before considering using chatbots to edit or generate work. (9)

Chatbots and their applications illustrate the powerful possibilities of generative AI, as well as the risks. These Recommendations seek to suggest a workable approach to valid concerns about the use of chatbots in scholarly publishing.

A note on changes introduced since the previous WAME Recommendations

  • A new recommendation (#4) has been added to the four original principal recommendations: 1) Only humans can be authors; 2) Authors should acknowledge the sources of their materials; 3) Authors must take public responsibility for their work; 4) Editors and reviewers should specify, to authors and each other, any use of chatbots in evaluation of the manuscript and generation of reviews and correspondence; and 5) Editors need appropriate digital tools to deal with the effects of chatbots on publishing.
  • In addition, this revision acknowledges that chatbots are used to perform different functions in scholarly publications. Currently, individuals in scholarly publishing may use chatbots for: 1) simple word-processing tasks (analogous to, and an extension of, word-processing and grammar-checking software), 2) the generation of ideas and text, and 3) substantive research. The Recommendations have been tailored for application to these different uses.

WAME Recommendations on

Chatbots and Generative Artificial Intelligence in Relation to Scholarly Publication

WAME Recommendation 1: Chatbots cannot be authors. Journals have begun to publish articles in which chatbots such as Bard, Bing and ChatGPT have been used, with some journals listing chatbots as co-authors. The legal status of an author differs from country to country but under most jurisdictions, an author must be a legal person. Chatbots do not meet the International Committee of Medical Journal Editors (ICMJE) authorship criteria, particularly that of being able to give “final approval of the version to be published” and “to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.” (10) No AI tool can “understand” a conflict-of-interest statement, and does not have the legal standing to sign a statement. Chatbots have no affiliation independent of their developers. Since authors submitting a manuscript must ensure that all those named as authors meet the authorship criteria, chatbots cannot be included as authors.

WAME Recommendation 2: Authors should be transparent when chatbots are used and provide information about how they were used. The extent and type of use of chatbots in journal publications should be indicated. This is consistent with the ICMJE recommendation of acknowledging writing assistance (11) and providing in the Methods detailed information about how the study was conducted and the results generated. (12)

WAME Recommendations 2.1: Authors submitting a paper in which a chatbot/AI was used to draft new text should note such use in the acknowledgment; all prompts used to generate new text, or to convert text or text prompts into tables or illustrations, should be specified.

WAME Recommendation 2.2: When an AI tool such as a chatbot is used to carry out or generate analytical work, help report results (e.g., generating tables or figures), or write computer codes, this should be stated in the body of the paper, in both the Abstract and the Methods section. In the interests of enabling scientific scrutiny, including replication and identifying falsification, the full prompt used to generate the research results, the time and date of query, and the AI tool used and its version, should be provided.

WAME Recommendation 3: Authors are responsible for material provided by a chatbot in their paper (including the accuracy of what is presented and the absence of plagiarism) and for appropriate attribution of all sources (including original sources for material generated by the chatbot). Authors of articles written with the help of a chatbot are responsible for the material generated by the chatbot, including its accuracy. Noting that plagiarism is “the practice of taking someone else's work or ideas and passing them off as one's own” (13), not just the verbatim repetition of previously published text. It is the author’s responsibility to ensure that the content reflects the author's data and ideas and is not plagiarism, fabrication or falsification. Otherwise, it is potentially scientific misconduct to offer such material for publication, irrespective of how it was written. Similarly, authors must ensure that all quoted material is appropriately attributed, including full citations, and that the cited sources support the chatbot’s statements. Since a chatbot may be designed to omit sources that oppose viewpoints expressed in its output, it is the authors’ responsibility to find, review and include such counterviews in their articles. (Of course, such biases are also found in human authors.) Authors should identify the chatbot used and the specific prompt (query statement) used with the chatbot. They should specify what they have done to mitigate the risk of plagiarism, provide a balanced view, and ensure the accuracy of all their references.

WAME Recommendation 4: Editors and peer reviewers should specify, to authors and each other, any use of chatbots in the evaluation of the manuscript and generation of reviews and correspondence. If they use chatbots in their communications with authors and each other, they should explain how they were used. Editors and reviewers are responsible for any content and citations generated by a chatbot. They should be aware that chatbots retain the prompts fed to them, including manuscript content, and supplying an author's manuscript to a chatbot breaches confidentiality of the submitted manuscript.

WAME Recommendation 5: Editors need appropriate tools to help them detect content generated or altered by AI. Such tools should be made available to editors regardless of ability to pay for them, for the good of science and the public, and to help ensure the integrity of healthcare information and reducing the risk of adverse health outcomes. Many medical journal editors use manuscript evaluation approaches that were not designed to deal with AI innovations and industries, including manipulated plagiarized text and images and papermill-generated documents. They have already been at a disadvantage when trying to differentiate the legitimate from the fabricated, and chatbots take this challenge to a new level. Editors need access to tools that will help them evaluate content efficiently and accurately. This is of particular importance to editors of medical journals where the adverse consequences of misinformation include potential harms to people.

We encourage comments and feedback from WAME Members and other readers. Please contact us at <[email protected]>.

Competing Interests: All of the authors report that they have no competing interests aside from any affiliations as editors.

References

1. What is a chatbot? Oracle Cloud Infrastructure. https://www.oracle.com/chatbots/what-is-a-chatbot/ Accessed May 27, 2023.

2. Copeland BJ (fact-checked by the Editors of Encyclopaedia Britannica). Artificial intelligence. Britannica Last Updated: May 26, 2023). https://www.britannica.com/technology/artificial-intelligence Accessed May 27, 2023.

3. Gui J, Sun Z, Wen Y, Tao D, and Ye J. A review on generative adversarial networks: Algorithms theory and applications. IEEE Trans Knowl Data Eng. 2023; 35:3313-3332. DOI: 10.1109/TKDE.2021.3130191

4. Abukmeil M, Ferrari S, Genovese A, Piuri V, Scotti F. A survey of unsupervised generative models for exploratory data analysis and representation learning. ACM Comput Surv. 2021;54(5):1-40.

5. Wun STY, He SZ, Liu JP, Sun SQ, Liu K, Han QL, Tang Y. A brief overview of ChatGPT: The history, status quo and potential future development. IEEE/CAA J Autom Sinica. 2023;10(5):1122–1136. DOI: 10.1109/JAS.2023.123618

6. Bhuiyan J. OpenAI CEO calls for laws to mitigate ‘risks of increasingly powerful’ AI. The Guardian. May 16, 2023. https://www.theguardian.com/technology/2023/may/16/ceo-openai-chatgpt-ai-tech-regulations Accessed May 27, 2023.

7. Appel G, Neelbauer J, Schweidel DA. Generative AI Has an Intellectual Property Problem. April 07, 2023. Harvard Business Review. https://hbr.org/2023/04/generative-ai-has-an-intellectual-property-problem Accessed May 27, 2023.

8. Thorbecke C. Don’t tell anything to a chatbot you want to keep private. CNN Business. April 6, 2023.https://www.cnn.com/2023/04/06/tech/chatgpt-ai-privacy-concerns/index.html Accessed May 27, 2023.

9. Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. Updated May 2023. https://www.icmje.org/news-and-editorials/icmje-recommendations_annotated_may23.pdf Accessed May 27, 2023.

10. Who Is an Author? Defining the Role of Authors and Contributors. ICMJE. https://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html. Accessed May 27, 2023.

11. Non-Author Contributors. Defining the Role of Authors and Contributors. ICMJE. https://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html. Accessed May 27, 2023.

12. Methods. Preparing a Manuscript for Submission to a Medical Journal. ICMJE. https://www.icmje.org/recommendations/browse/manuscript-preparation/preparing-for-submission.html#d Accessed May 27, 2023.

13. Plagiarism. Oxford Reference, https://www.oxfordreference.com/display/10.1093/oi/authority.20110803100329803;jsessionid=D1759DA0FD79ACB96407CDB4B7BC8FA0 Accessed May 27, 2023.

 

Cite as: Zielinski C, Winker MA, Aggarwal R, Ferris LE, Heinemann M, Lapeña JF, Pai SA, Ing E, Citrome L, Alam M, Voight M, Habibzadeh F, for the WAME Board. Chatbots, Generative AI, and Scholarly Manuscripts. WAME Recommendations on Chatbots and Generative Artificial Intelligence in Relation to Scholarly Publications. WAME. May 31, 2023. https://wame.org/page3.php?id=106

WAME encourages WAME Members to republish this statement in their journals with attribution to the original publication on WAME.org. WAME will list journal citations and links to the re-publications on this page. Please contact Margaret Winker at [email protected] with any questions.

This statement has been republished in the following journals:

Philippine Journal of Otolaryngology Head and Neck Surgery. 2023 Jun. 4;38(1):7-9. Available from: https://pjohns.pso-hns.org/index.php/pjohns/article/view/2135

Global Journal of Medicine & Public Health. 2023; 12(2).  https://www.gjmedph.com//Uploads/E1_Vol12_No2_2023.pdf

Open Access Macedonian Journal of Medical Sciences. 2023;11(A):263-5. https://doi.org/10.3889/oamjms.2023.11723

Philippine Journal of Pathology. 2023; 8(1),6–8.  https://philippinejournalofpathology.org/index.php/PJP/article/view/405

Journal of Postgraduate Medical Institute. 2023; 37(3). https://doi.org/10.54079/jpmi.37.3.3284https://jpmi.org.pk/index.php/jpmi/article/view/3284 

National Medical Journal of India. 2023; 36(1):1-4. doi: 10.25259/NMJI_365_23  https://nmji.in/chatbots-chatgpt-and-scholarly-manuscripts-wame-recommendations-on-chatgpt-and-chatbots-in-relation-to-scholarly-publications/

Colombia Médica (Cali). 2023; 54(3):e1015868. http://doi.org/10.25100/cm.v54i3.5868 https://colombiamedica.univalle.edu.co/index.php/comedica/article/view/5868/5761

Afro-Egyptian Journal of Infectious and Endemic Diseases. 2023;13(1):75-79. DOI: 10.21608/AEJI.2023.282936   https://aeji.journals.ekb.eg/article_282936.html

Current Medical Research and Opinion. 2024; 40:1, 11-13, DOI: 10.1080/03007995.2023.2286102 https://www.tandfonline.com/doi/full/10.1080/03007995.2023.2286102

Spanish:

Recomendaciones de WAME sobre “chatbots” e inteligencia artificial generativa en relación con las publicaciones académicas. Colombia Médica. 2023;54(3):e1015868. https://colombiamedica.univalle.edu.co/index.php/comedica/article/view/5868/5764

 

WAME (2023), Creative Commons BY-NC-ND