A recent preprint by Rong Ni & Ludo Waltman (1) surveyed authors on their experiences and attitudes to preprinting. A number of interesting points come out of this data but I wanted to focus on one in particular here; training. Figure 3 in the article looks at the sources of learning about preprints and “in a training event” comes very low (less than 10% of respondents). Now I’ve touched upon my thoughts on the current system of “training” grad students and PhD’s before; it’s outdated and frankly, not up to scratch. I’ve also tried for a few years in the places I’ve worked to replace journal clubs with a more useful and structured training program, that would include various elements, one of which is the publication system, how it works, it’s history, where preprints fit in and then a useful journal club where a preprint is reviewed publicly.
To that end, I have been part of a team in the past where we developed a training course focussed around preprints and publishing in the life and biomedical sciences (2). In hindsight, there are a few things I think that course is missing but it’s a good set of materials that could be used, by anyone, immediately.
However I’ve also recently been playing around with ChatGPT and thought it might be interesting to see what kind of preprint focussed course AI would design. I began by simply asking ChatGPT to “design a training course on the use of preprints in bioscience”. The initial “course” was rather simple, but not a bad starting point. I refined things with subsequent, more specific, additions and then I compiled things into a slightly more sensible order. Note that I’ve not edited any of the outputs, simply rearranged the order of the sections.
What was eventually produced could be refined better and is by no means perfect but it’s incredibly interesting to see just what AI can do, given the right inputs — and by right inputs, I was on a train when doing this so it’s somewhat rushed & messy on the human end (I know, if only we could remove those useless sacks of water)!
So here we go, a (mostly) ChatGPT designed training course for preprints in the biosciences:
Course Title: “Using Preprints in Bioscience: A Practical Guide”
Course Overview: Preprints are an increasingly popular way for researchers to share their work quickly and get feedback from the scientific community. However, many bioscience researchers are not yet familiar with preprints and may be hesitant to use them. This course aims to provide an introduction to preprints, their benefits and drawbacks, and how to use them in bioscience research.
Course Objectives:
- Understand what preprints are and how they differ from peer-reviewed publications
- Learn the benefits and drawbacks of using preprints in bioscience research
- Understand the impact of preprints on scientific communication and publishing
- Develop the skills necessary to upload and share preprints effectively
- Learn how to navigate preprint servers and find relevant preprints
- Understand the ethical considerations of preprints in bioscience research
Course Format: The course will be delivered through a combination of lectures, case studies, and hands-on exercises. Participants will have the opportunity to upload and share their own preprints, as well as evaluate preprints from other researchers. The course will be offered in-person or online, with interactive elements such as group discussions and Q&A sessions.
Target Audience: This course is designed for bioscience researchers at all career stages who want to learn about preprints and how to use them effectively. It is also suitable for librarians, journal editors, and other professionals involved in scientific communication and publishing.
1. History of Peer Review and Publishing in the Life and Biosciences
- Overview of the history of scientific publishing and peer review in the life and biosciences
- Key milestones and turning points in the development of scientific publishing and peer review
- Understanding how the history of peer review and publishing has shaped the current scientific publishing landscape
- Introduction to the different models of scientific publishing in the life and biosciences, including traditional peer review, open access, and preprints
This section will provide a historical perspective on scientific publishing and peer review in the life and biosciences, starting with the early scientific societies and the advent of the scientific journal in the 17th century. Participants will learn about key milestones and turning points in the development of scientific publishing and peer review, including the establishment of the first peer-reviewed scientific journal and the introduction of the double-blind peer review process. The section will also explore how the history of peer review and publishing has shaped the current scientific publishing landscape, and how the traditional model of peer review is being challenged by new models of publishing, such as open access and preprints. Participants will gain a deeper understanding of the different models of scientific publishing in the life and biosciences and their advantages and disadvantages.
2. Introduction to Preprints, their Benefits and Limitations, Finding and Using Preprints, and Considerations when Reading or Citing Preprints
- Definition of preprints and how they differ from peer-reviewed publications
- Benefits of preprints including rapid dissemination, increased visibility, and feedback from the scientific community
- Limitations of preprints including lack of peer review and potential for misinformation
- Overview of preprint servers and how to find relevant preprints
- Best practices for reading and citing preprints including evaluating the quality of the preprint and identifying any limitations or uncertainties
- Importance of acknowledging preprints in publications and understanding their impact on future publication
This section will provide a comprehensive introduction to preprints in bioscience. Participants will learn what preprints are and how they differ from peer-reviewed publications. The section will also discuss the benefits of preprints, including their rapid dissemination, increased visibility, and feedback from the scientific community, as well as the limitations of preprints, such as their lack of peer review and potential for misinformation. Participants will be introduced to preprint servers, such as bioRxiv and medRxiv, and learn how to find relevant preprints. Additionally, the section will cover best practices for reading and citing preprints, including evaluating the quality of the preprint and identifying any limitations or uncertainties. Participants will also learn about the importance of acknowledging preprints in publications and understanding their impact on future publication. This section will emphasize the importance of critical evaluation when reading or citing preprints, and provide participants with the tools to make informed decisions about using preprints in their research.Top of FormBottom of Form
3. Preprint Peer Review and Post-Publication Peer Review
- Overview of preprint peer review and the different models used by preprint servers
- Advantages and disadvantages of preprint peer review
- Introduction to post-publication peer review and its role in scientific publishing
- Comparison between preprint peer review and post-publication peer review
- Discussion of the strengths and weaknesses of the post-publication peer review movement
- Examples of successful post-publication peer review initiatives in bioscience
This section will provide an in-depth analysis of preprint peer review and the different models used by preprint servers. Participants will learn about the advantages and disadvantages of preprint peer review, as well as the various ways that preprint servers are experimenting with new models of peer review. The section will also introduce the concept of post-publication peer review, which has gained popularity in recent years as a way to address some of the limitations of preprint peer review. Participants will learn about the different models of post-publication peer review and the role it can play in scientific publishing. The section will conclude with a discussion of the strengths and weaknesses of the post-publication peer review movement, as well as examples of successful initiatives in bioscience.
4. Preprint Review Task and Public Sharing on a Preprint Platform
- Introduction to preprint review and the concept of a preprint journal club
- Overview of the task to review a preprint and share that review publicly on a preprint platform, such as bioRxiv
- Best practices for preprint review, including evaluating the scientific soundness of the preprint and identifying any limitations or uncertainties
- Discussion of the importance of open science and sharing research findings with the wider scientific community
- Overview of the preprint sharing process on bioRxiv, including guidelines and recommendations for posting a preprint review
- Tips for participating in and leading a preprint journal club
This section will provide participants with an opportunity to engage in the preprint review process and share their review publicly on a preprint platform, such as bioRxiv, in the style of a journal club. Participants will learn about the concept of a preprint journal club and its role in promoting open science and sharing research findings with the wider scientific community. The section will provide an overview of the task to review a preprint and share that review publicly on a preprint platform, and provide best practices for preprint review, including evaluating the scientific soundness of the preprint and identifying any limitations or uncertainties. Participants will also gain an understanding of the importance of open science and sharing research findings with the wider scientific community.
The section will cover the preprint sharing process on bioRxiv, including guidelines and recommendations for posting a preprint review, and provide tips for participating in and leading a preprint journal club. Participants will be encouraged to engage in constructive discussions and provide thoughtful feedback to their peers, fostering a sense of community and collaboration in the scientific publishing process. This section will provide participants with practical experience in the preprint review process and the opportunity to engage in open science practices that can benefit the wider scientific community.
There you have it, a 4-week course on preprints that could be easily delivered as part of a structured and common training program to all 1st year grad/PhD students. What do you think, did the AI do a good job or are there glaring omissions?
I might play around more with this when I have some real time to spend on it properly to expand this out to match my idea of what I think we should have for all student scientists.
(1) https://dapp.orvium.io/deposits/6442f782b2b5580ba561406b/view
(2) https://fischertad.github.io/Preprints_and_Publishing_in_Life_Biomedical_Sciences/
Rippling Ideas 