By Carrie Levinson, MSLIS
Every month, our AI blog provides a selection of literature on artificial intelligence in teaching and learning. Here’s the roundup for March 2024:
Warner J. Resist generative AI FOMO. Inside Higher Ed [Internet]. 2024 Mar 6. Available from: https://www.insidehighered.com/opinion/blogs/just-visiting/2024/03/06/generative-ai-will-be-there-when-you-need-it
Excerpt: “I fear that institutions are going to fall prey to generative AI FOMO—fear of missing out—and this is going to lead to some very bad decisions. I would like to suggest that for all the amazement and wonder we have experienced as Google, Meta, OpenAI and Anthropic sell their wares to the public with a series of eye-popping demonstrations, with the promise of more wonders to come, we actually have no idea what this technology means at this time.”
Note: Create a free account on the Inside Higher Ed site to access articles.
Smith G & Funk J. When it comes to critical thinking, AI flunks the test. The Chronicle of Higher Education [Internet]. 2024 Mar 12. Available from: https://www-chronicle-com.us1.proxy.openathens.net/article/when-it-comes-to-critical-thinking-ai-flunks-the-test
Excerpt: “AI enthusiasts have chronically overpromised and underdelivered.”
Note: Login when prompted with your Mount Sinai email and password to access full article.
Chen L, Zaharia M, Zou J. How is ChatGPT’s behavior changing over time? Harvard Data Science Review [Internet]. 2024 Mar 12. Available from: https://hdsr.mitpress.mit.edu/pub/y95zitmz
Excerpt: “GPT-3.5 and GPT-4 are the two most widely used large language model (LLM) services. However, when and how these models are updated over time is opaque...We find that the performance and behavior of both GPT-3.5 and GPT-4 can vary greatly over time.”
Schroeder R. Uncharted territory: Artificial General Intelligence and Higher Ed. Inside Higher Ed [Internet]. 2024 Mar 13. Available from: https://www.insidehighered.com/opinion/blogs/online-trending-now/2024/03/13/artificial-general-intelligence-and-higher-education
Excerpt: “Imagine a time in the not-too-distant future in which AGI is firmly established in society and higher education faces the pressing need to reconfigure and reinvent itself.”
Note: Create a free account on the Inside Higher Ed site to access articles.
Mitrano T. Information policy and A.I. Inside Higher Ed [Internet]. 2024 Mar 18. Available from: https://www.insidehighered.com/opinion/blogs/law-policy-and-it/2024/03/18/information-policy-age-artificial-intelligence
Excerpt: “Who gave OpenAI permission to scrape the internet? Is permission necessary if one has the technical means to do it? Is information free so long as it is freely available on the internet?”
Note: Create a free account on the Inside Higher Ed site to access articles.
Crotty D. 2024 Mar 20. The latest “crisis” — Is the research literature overrun with ChatGPT- and LLM-generated articles? In: Society for Scholarly Publishing. Scholarly Kitchen [Internet]. Mount Laurel, NJ: Society for Scholarly Publishing. Available from: https://scholarlykitchen.sspnet.org/2024/03/20/the-latest-crisis-is-the-research-literature-overrun-with-chatgpt-and-llm-generated-articles
Excerpt: “Elsevier has been under the spotlight this month for publishing a paper that contains a clearly ChatGPT-written portion of its introduction. The first sentence of the paper’s Introduction reads, ‘Certainly, here is a possible introduction for your topic:…’ To date, the article remains unchanged, and unretracted.”
Warner J. When ChatGPT comes for scholarship. Inside Higher Ed [Internet]. 2024 Mar 20. Available from: https://www.insidehighered.com/opinion/blogs/just-visiting/2024/03/20/chatgpt-offers-choosing-moment-higher-ed
Excerpt: “The inevitable has now happened and what is clearly unedited generative AI content is finding its way into (apparently) peer-reviewed publications.”
Note: Create a free account on the Inside Higher Ed site to access articles.
Coffey L. Universities build their own ChatGPT-like tools. Inside Higher Ed [Internet]. 2024 Mar 21. Available from: https://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/03/21/universities-build-their-own-chatgpt-ai
Excerpt: “As concerns mount over the ethical and intellectual property implications of AI tools, universities are launching their own chatbots for faculty and students.”
Note: Create a free account on the Inside Higher Ed site to access articles.
Johnson SK. Text-to-video AI could change how we think. Inside Higher Ed [Internet]. 2024 Mar 21. Available from: https://www.insidehighered.com/opinion/views/2024/03/21/text-video-ai-could-change-how-we-think-opinion
Excerpt: “Text-to-video technology could supplant writing as a primary mode of thinking and communication...”
Note: Create a free account on the Inside Higher Ed site to access articles.
Williams T. Student chatbot use ‘could be increasing loneliness’. Inside Higher Ed [Internet]. 2024 Mar 28. Available from: https://www.insidehighered.com/news/global/2024/03/28/student-chatbot-use-could-be-increasing-loneliness
Excerpt: “Study finds students who rely on ChatGPT for academic tasks feel socially supported by artificial intelligence at the expense of their real-life relationships.”
Note: Create a free account on the Inside Higher Ed site to access articles.
In the dynamic world of healthcare and AI, researchers have access to tools that can retrieve citations and links to relevant articles. However, critical questions have been circulating within research and publishing communities: are these AI-generated citations formatted correctly, accurately representing the source material, and indeed published works?
Potential benefits are clear – these tools can help users quickly access citations and links to studies. Yet, the concerns about dissemination of false information or referencing nonexistent papers allude to aspects of academic discourse where integrity may be compromised.
Responsible use of AI is of high priority when integrating it with scholarship. When using AI to generate citations, it is crucial to keep the following in mind:
Be mindful to safeguard novel and sensitive information.
Carefully appraise the sources of any AI-generated citation through verifying author credentials and publisher information.
Cross-check citations against other reliable sources to ensure consistency and use of the most appropriate citation format and edition.
Maintain a critical eye by acknowledging AI systems occasionally produce erroneous outputs and staying current on data and privacy policies.
Document the steps taken and the output generated.
Perplexity.AI, OpenEvidence, and Scribbr are three AI platforms that aid in citation generation. Below, I’ve complied a comparison table, detailing key information about each platform.
User-Friendly Interface
Free Account Registration
Opting out of Data Collection
Developers
Notes & Features
Perplexity.AI
✔
✔
✔
Three engineers with backgrounds in AI, search engines, and databases. Aravind Srinivas, Perplexity's CEO, previously worked at OpenAI [1].
• Perplexity.AI cites websites, open access, and published articles.
• Users are allowed 5 free Pro searches per day (Pro version asks users follow up questions before generating output).
• Filter search for “Academic,” “Writing,” “YouTube,” or “Reddit.”
OpenEvidence
✔
✔
✔
Accomplished and diverse Founding Team and Medical Advisory Board [2].
• Specifically designed for healthcare professionals.
• First AI to score above 90% on USMLE.
• API (Application Programming Interface) allows users to integrate preexisting software (e.g., Epic).
• Filter search for “Guidelines & Standard of Care” or “Clinical Evidence” references.
• Elsevier partnered with OpenEvidence in Nov 2023 to develop ClinicalKey AI, a subscription-based, evidence-based tool[4].
• Users who would like to search more than twice a day must create an account with their National Provider Identifier and are prompted to enter this information before submitting their first question.
Scribbr Citation Generator
✔
✔
(account not required to generate citations)
Data collection for the Citation Generator is not mentioned on their website.
Global team of editors that undergo a rigorous interview process [3].
• Scribbr caters to other services, such as Proofreading & Editing and Plagiarism Checking.
• Option to export citations to Word.
• Scribbr’s Citation Generator is built using the same citation software as Mendeley and Zotero[5].
All platforms have a user-friendly interface and are free to use. Perplexity.AI allows users to search anonymously by not requiring the creation of an account, or they can save their threads by creating an account. OpenEvidence requires account registration, however, users are limited to two questions per day if they do not sign up with their National Provider Identifier (NPI). Scribbr does not require an account to generate citations; however, if users want to save a list of their generated citations, then an account may be useful to save the information.
When it comes to data security and privacy, Perplexity.AI and OpenEvidence allow users to turn off data collection in account settings. On their website, Scribbr provides a statement on how they handle confidential documents when they are uploaded, and pledge they are committed to protecting personal information[6], but do not make a statement on the information retained when using their citation generator.
The Developers column in the table highlights the educational backgrounds of the individuals involved, comprising diverse and accomplished teams. By showcasing a variety of disciplines, backgrounds, and accomplishments, OpenEvidence and Scribbr enhance their transparency, signal their team’s capacity for interdisciplinary work and strengthen the creditability of the teams involved. Perplexity.AI does not point to a developer or team of the platform directly on their website, but it’s not difficult to find information on the three engineers who are largely involved. Perplexity.AI CEO Aravind Srinivas has previously worked for OpenAI, the engine for ChatGPT.
The Notes & Features column touches on AI’s capabilities. OpenEvidence is a tool designed specifically for healthcare professionals, whereas Perplexity.AI and Scibbr are designed for the layperson. OpenEvidence also powers ClinicalKey AI, a product of Elsevier that must be subscribed to in order to use.
Regardless of the chosen platform, conducting thorough research on AI citation generation is crucial. This involves documenting steps taken to be able to replicate the process. Upholding moral and ethical responsibilities as researchers is paramount, so be sure to carry out your due diligence and learn how these tools work. The Levy Library is committed to assisting students, researchers and healthcare professionals navigate this new landscape. Librarians are available to schedule one-on-one consultations and are happy to collaborate with departments and professors to deliver tailored instructional material. Contact us today!
[1] Palazzolo S. This One-Year-Old Startup Is Hoping to be the Next Google—Can It Succeed? The Information [Internet]. 2024 Jan 9; Available from: https://www.theinformation.com/articles/this-one-year-old-startup-is-hoping-to-be-the-next-google-can-they-succeed
[2] OpenEvidence - about. OpenEvidence. Available from: https://www.openevidence.com/about
[3] Scribbr. Our editors can proofread and edit your thesis or dissertation [Internet]. Scribbr. 2022. Available from: https://www.scribbr.com/about-us/editors/
[4] Elsevier Health partners with OpenEvidence to deliver trusted evidence-based clinical content powered by responsible AI to support physicians’ clinical decisions. www.elsevier.com. 2023. Available from: https://www.elsevier.com/about/press-releases/elsevier-health-partners-with-openevidence-to-deliver-trusted-evidence-based
[5] Scribbr. Scribbr - Your path to academic success [Internet]. Scribbr. 2023. Available from: https://www.scribbr.com/
[6] Scribbr. Frequently asked questions [Internet]. Scribbr. 2023a. Available from: https://www.scribbr.com/frequently-asked-questions/