In the dynamic world of healthcare and AI, researchers have access to tools that can retrieve citations and links to relevant articles. However, critical questions have been circulating within research and publishing communities: are these AI-generated citations formatted correctly, accurately representing the source material, and indeed published works?
Potential benefits are clear – these tools can help users quickly access citations and links to studies. Yet, the concerns about dissemination of false information or referencing nonexistent papers allude to aspects of academic discourse where integrity may be compromised.
Responsible use of AI is of high priority when integrating it with scholarship. When using AI to generate citations, it is crucial to keep the following in mind:
Be mindful to safeguard novel and sensitive information.
Carefully appraise the sources of any AI-generated citation through verifying author credentials and publisher information.
Cross-check citations against other reliable sources to ensure consistency and use of the most appropriate citation format and edition.
Maintain a critical eye by acknowledging AI systems occasionally produce erroneous outputs and staying current on data and privacy policies.
Document the steps taken and the output generated.
Perplexity.AI, OpenEvidence, and Scribbr are three AI platforms that aid in citation generation. Below, I’ve complied a comparison table, detailing key information about each platform.
|
|
User-Friendly Interface |
Free Account Registration |
Opting out of Data Collection |
Developers
|
Notes & Features |
|
Perplexity.AI |
✔ |
✔ |
✔
|
Three engineers with backgrounds in AI, search engines, and databases. Aravind Srinivas, Perplexity's CEO, previously worked at OpenAI [1]. |
• Perplexity.AI cites websites, open access, and published articles. • Users are allowed 5 free Pro searches per day (Pro version asks users follow up questions before generating output). • Filter search for “Academic,” “Writing,” “YouTube,” or “Reddit.” |
|
OpenEvidence |
✔ |
✔ |
✔ |
Accomplished and diverse Founding Team and Medical Advisory Board [2]. |
• Specifically designed for healthcare professionals. • First AI to score above 90% on USMLE. • API (Application Programming Interface) allows users to integrate preexisting software (e.g., Epic). • Filter search for “Guidelines & Standard of Care” or “Clinical Evidence” references. • Elsevier partnered with OpenEvidence in Nov 2023 to develop ClinicalKey AI, a subscription-based, evidence-based tool[4]. • Users who would like to search more than twice a day must create an account with their National Provider Identifier and are prompted to enter this information before submitting their first question. |
|
Scribbr Citation Generator |
✔
|
✔ (account not required to generate citations)
|
Data collection for the Citation Generator is not mentioned on their website. |
Global team of editors that undergo a rigorous interview process [3]. |
• Scribbr caters to other services, such as Proofreading & Editing and Plagiarism Checking. • Option to export citations to Word. • Scribbr’s Citation Generator is built using the same citation software as Mendeley and Zotero[5].
|
All platforms have a user-friendly interface and are free to use. Perplexity.AI allows users to search anonymously by not requiring the creation of an account, or they can save their threads by creating an account. OpenEvidence requires account registration, however, users are limited to two questions per day if they do not sign up with their National Provider Identifier (NPI). Scribbr does not require an account to generate citations; however, if users want to save a list of their generated citations, then an account may be useful to save the information.
When it comes to data security and privacy, Perplexity.AI and OpenEvidence allow users to turn off data collection in account settings. On their website, Scribbr provides a statement on how they handle confidential documents when they are uploaded, and pledge they are committed to protecting personal information[6], but do not make a statement on the information retained when using their citation generator.
The Developers column in the table highlights the educational backgrounds of the individuals involved, comprising diverse and accomplished teams. By showcasing a variety of disciplines, backgrounds, and accomplishments, OpenEvidence and Scribbr enhance their transparency, signal their team’s capacity for interdisciplinary work and strengthen the creditability of the teams involved. Perplexity.AI does not point to a developer or team of the platform directly on their website, but it’s not difficult to find information on the three engineers who are largely involved. Perplexity.AI CEO Aravind Srinivas has previously worked for OpenAI, the engine for ChatGPT.
The Notes & Features column touches on AI’s capabilities. OpenEvidence is a tool designed specifically for healthcare professionals, whereas Perplexity.AI and Scibbr are designed for the layperson. OpenEvidence also powers ClinicalKey AI, a product of Elsevier that must be subscribed to in order to use.
Regardless of the chosen platform, conducting thorough research on AI citation generation is crucial. This involves documenting steps taken to be able to replicate the process. Upholding moral and ethical responsibilities as researchers is paramount, so be sure to carry out your due diligence and learn how these tools work. The Levy Library is committed to assisting students, researchers and healthcare professionals navigate this new landscape. Librarians are available to schedule one-on-one consultations and are happy to collaborate with departments and professors to deliver tailored instructional material. Contact us today!
[1] Palazzolo S. This One-Year-Old Startup Is Hoping to be the Next Google—Can It Succeed? The Information [Internet]. 2024 Jan 9; Available from: https://www.theinformation.com/articles/this-one-year-old-startup-is-hoping-to-be-the-next-google-can-they-succeed
[2] OpenEvidence - about. OpenEvidence. Available from: https://www.openevidence.com/about
[3] Scribbr. Our editors can proofread and edit your thesis or dissertation [Internet]. Scribbr. 2022. Available from: https://www.scribbr.com/about-us/editors/
[4] Elsevier Health partners with OpenEvidence to deliver trusted evidence-based clinical content powered by responsible AI to support physicians’ clinical decisions. www.elsevier.com. 2023. Available from: https://www.elsevier.com/about/press-releases/elsevier-health-partners-with-openevidence-to-deliver-trusted-evidence-based
[5] Scribbr. Scribbr - Your path to academic success [Internet]. Scribbr. 2023. Available from: https://www.scribbr.com/
[6] Scribbr. Frequently asked questions [Internet]. Scribbr. 2023a. Available from: https://www.scribbr.com/frequently-asked-questions/
0 Comments.