Elsevier Unveils Rigorous Evaluation Framework to Mitigate Risk in Generative AI Clinical Decision Support Tools 

Elsevier, a global leader in medical information and data analytics, unveiled a groundbreaking evaluation framework for assessing the performance and safety of generative AI-powered clinical reference tools. This innovative approach has been developed for all Elsevier Health generative AI solutions, including ClinicalKey AI, Elsevier's advanced clinical decision support platform, and sets a new standard for responsible AI integration in healthcare. It will be featured in a future issue of the Open Access Journal of the American Medical Informatics Association (JAMIA).  

The framework, designed with input from clinical subject matter experts across multiple specialties, evaluates AI-generated responses along five critical dimensions: query comprehension, response helpfulness, correctness, completeness, and potential for clinical harm. It serves as a comprehensive assessment to ensure that AI-powered tools not only provide accurate and relevant information but also align with the practical and current needs of healthcare professionals at the point of care. 

Omry Bigger, President of Clinical Solutions at Elsevier: “This evaluation framework not only supports innovation and advancements to improve patient care but adds an extra layer of review and assessment to ensure physicians are armed with the most accurate information possible. It’s a critical step in the implementation of responsible AI for healthcare providers and patients.”  

In a recent evaluation study of ClinicalKey AI, Elsevier worked with a panel of 41-board certified physicians and clinical pharmacists to rigorously test responses generated by the tool for a diverse set of clinical queries. That panel evaluated 426 query-response pairs, and results demonstrated impressive performance, with 94.4% of responses rated as helpful, 95.5% assessed as completely correct, with just 0.47% flagged for potential improvements. 

Leah Livingston, Director of Generative AI Evaluation for Health Markets at Elsevier, said: “These results reflect not just strong performance, but the real value of bringing clinicians into the evaluation process. By designing an evaluation framework around what matters most to physicians—accuracy, relevance, and clinical safety —we’re helping ensure that AI tools truly add value to care delivery. This approach supports clinicians in quickly accessing the right information, ultimately reducing cognitive burden.” 

Elsevier is continuing to implement AI responsibly in its portfolio of AI solutions and is also involved in industry-wide initiatives. As a proud partner of the Coalition for Health AI, the company is actively contributing to industry-wide standards for responsible AI deployment in healthcare settings. 

The release of the evaluation framework represents a significant step forward in the responsible integration of AI technologies in healthcare, paving the way for more efficient, accurate, and patient-centered clinical decision-making.  

To learn more details about the evaluation framework, a white paper is available for download: Evaluation framework for generative AI tools used for clinical decision support. 

エルゼビアについて

エルゼビアは情報分析を専門としたグローバル企業として、研究者や医療専門家の方々を支援し、社会にとっての利益最大化に向けて、科学や医療の進展を支えています。これは、信頼できるエビデンスによるコンテンツと高度なAI対応によるデジタル技術に基づく革新的なソリューションにより、知見の集積や重要な意思決定を支援することで実現されています。

エルゼビアは、全世界で9,700人の従業員（うち技術者2,300人以上）を抱え、140年以上にわたって、研究者、図書館員、アカデミックリーダー、資金提供者、政府、研究開発集約型企業、医師、看護師、将来の医療専門家、教育者など研究・医療分野におけるパートナーの重要な活動を支援してきました。エルゼビアが刊行する3,000誌以上の科学ジャーナルと代表的な参考書には、The Lancet 新しいタブ／ウィンドウで開く、Cell Press 新しいタブ／ウィンドウで開くおよびGray’s Anatomyなどをはじめとする、各分野を代表する主要なタイトルが含まれています。 エルゼビア・ファンデーション 新しいタブ／ウィンドウで開くとの活動を通し、私たちがサービスを提供する地域社会と連携して、開発途上国を含む世界中の医学、研究、医療分野における、インクルージョン＆ダイバーシティ（I&D）の改善に努めています。

エルゼビアは、専門家および企業向けの情報分析および意思決定ツールのグローバルプロバイダーであるRELX Group 新しいタブ／ウィンドウで開くの一事業を担っています。エルゼビアの事業内容、デジタルソリューション、コンテンツなどの詳細については、www.elsevier.comをご覧ください。