New artificial intelligence system can empower medical professionals in diagnosing skin diseases

Researchers have developed an AI algorithm capable of diagnosing 134 skin disorders and supporting specialists by augmenting the accuracy of diagnoses and predicting treatment options, reports the Journal of Investigative Dermatology


Philadelphia, March 31, 2020

Researchers in Korea have developed a deep learning-based artificial intelligence (AI) algorithm that can accurately classify cutaneous skin disorders, predict malignancy, suggest primary treatment options, and serve as an ancillary tool to enhance the diagnostic accuracy of clinicians. With the assistance of this system, the diagnostic accuracy of dermatologists as well as the general public was significantly improved. This novel study is reported in the Journal of Investigative Dermatology.

Skin diseases are common, but it is not always easy to visit a dermatologist quickly or distinguish malignant from benign conditions. “Recently, there have been remarkable advances in the use of AI in medicine. For specific problems, such as distinguishing between melanoma and nevi, AI has shown results comparable to those of human dermatologists. However, for these systems to be practically useful, their performance needs to be tested in an environment similar to real practice, which requires not only classifying malignant versus benign lesion, but also distinguishing skin cancer from numerous other skin disorders including inflammatory and infectious conditions,” explained lead investigator Jung-Im Na, MD, PhD, Department of Dermatology, Seoul National University, Seoul, Korea.

Using a “convolutional neural network,” a specialized AI algorithm, investigators developed an AI system capable of predicting malignancy, suggesting treatment options, and classifying skin disorders. Investigators collected 220,000 images of Asians and Caucasians with 174 skin diseases and trained neural networks to interpret those images. They found that the algorithm could diagnose 134 skin disorders and suggest primary treatment options, render multi-class classification among disorders, and enhance the performance of medical professionals through Augmented Intelligence. Most prior studies have been limited to specific binary tasks, such as differentiating melanoma from nevi.

The algorithm’s performance was initially compared with the performance of 21 dermatologists, 26 dermatology residents, and 23 members of the general public. Its performance was similar to that of the dermatology residents but slightly below that of the dermatologists. After the initial test, the test participants were informed of the results of the algorithm and subsequently modified their answers. The sensitivity of the malignancy diagnosis of the 47 clinicians improved from 77.4 percent to 86.8 percent. Similarly, the sensitivity of the diagnosis of malignancy by the 23 members of the general public improved markedly from 47.6 percent to 87.5 percent. Notably, based on the initial result, half of the malignancies would have been missed by the general public without referral to specialists.

Sample screenshots of skin diseases on two mocked-up smartphone screens, side-by-side.
Examples of output from Model Dermatology, showing the top-three choices for each skin lesion. Left: a case of basal cell carcinoma that is commonly misdiagnosed as nevus. Right: a case of eczema herpeticum that is commonly misdiagnosed as atopic dermatitis. In both cases, the authors’ algorithm correctly diagnosed the condition (top choice).

“Our results suggest that our algorithm may serve as an Augmented Intelligence that can empower medical professionals in diagnostic dermatology,” noted Dr. Na. “Rather than AI replacing humans, we expect AI to support humans as Augmented Intelligence to reach diagnoses faster and more accurately.”

The researchers caution that AI cannot definitively interpret images that it is not trained to interpret even when the problem presented is straightforward. For example, an algorithm trained only to differentiate between melanoma and nevi cannot differentiate between an image of a nail hematoma and either a melanoma or a nevus. If the shape of the hematoma is irregular, the algorithm may diagnose it as melanoma. They also point out that the algorithm was trained and tested using high quality images and its performance is generally suboptimal if the input images are of low quality.

In addition, a diagnosis made with only one image with the most optimal composition may present inherent limitations compared to diagnoses made in a clinical setting. In a real practice, a dermatological diagnosis is made based on the combination of multiple sources of information including past medical history, symptoms, appearance compared to other lesions on the patient and the texture of the lesion assessed by physical contact.

“We anticipate that the use of our algorithm with a smartphone could encourage the public to visit specialists for cancerous lesions such as melanoma that might have been neglected otherwise,” commented Dr. Na. “However, there are issues with the quality or composition of photographs taken by the general public that may affect the results of the algorithm. If the algorithm’s performance can be reproduced in the clinical setting, it will be promising for the early detection of skin cancer with a smartphone. We hope that future studies will evaluate the utility and performance of our algorithms in a clinical setting.”

An early demo version of the team’s deep learning approach is available via its website. By analyzing data through the website, the researchers hope to identify possible problems that could still arise if the AI were used via telemedicine, which relies more heavily upon clinical photography to diagnose skin disorders. However, such diagnoses will still need to be verified by dermatologists along with the patient’s medical history and physical examination.

Dr. Na and Sung Eun Chang, MD, Department of Dermatology, Asan Medical Center, Ulsan University College of Medicine, Seoul, Korea, made equal and critical contributions to this study. In addition, primary researchers in the group included Seung Seog Han, I Dermatology Clinic, and Ilwoo Park, Chonnam National University.

---

Notes for editors
The article is “Augmented Intelligence Dermatology: Deep Neural Networks Empower Medical Professionals in Diagnosing Skin Cancer and Predicting Treatment Options for 134 Skin Disorders,” by Seung Seog Han, Ilwoo Park, Sung Eun Chang, Woohyung Lim, Myoung Shin Kim, Gyeong Hun Park, Je Byeong Chae, Chang Hun Huh, and Jung-Im Na (https://doi.org/10.1016/j.jid.2020.01.019). It appears in the Journal of Investigative Dermatology published by Elsevier. The article will be openly available upon publication.

Full text of this article is available to credentialed journalists upon request; contact Theresa Monturano, Senior Publisher, Elsevier, at +1 215 239 3711 or hmsmedia@elsevier.com. Journalists wishing to interview the authors should contact Jung-Im Na at +82-10-2674-8759 or jina1@snu.ac.kr.

About Journal of Investigative Dermatology
The Journal of Investigative Dermatology(JID) publishes high impact reports describing original research related to all aspects of cutaneous biology and skin disease. Descriptions of important findings that result from basic, translational, or clinical research are published. Clinical research can include, but is not limited to, interventional trials, genetics studies, epidemiology, and health services research. www.jidonline.org

About Elsevier
Elsevier is a global information analytics business that helps scientists and clinicians to find new answers, reshape human knowledge, and tackle the most urgent human crises. For 140 years, we have partnered with the research world to curate and verify scientific knowledge. Today, we’re committed to bringing that rigor to a new generation of platforms. Elsevier provides digital solutions and tools in the areas of strategic research management, R&D performance, clinical decision support, and professional education; including ScienceDirect, Scopus, SciVal, ClinicalKey and Sherpath. Elsevier publishes over 2,500 digitized journals, including The Lancet and Cell, 39,000 e-book titles and many iconic reference works, including Gray's Anatomy. Elsevier is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers. www.elsevier.com

Media contact
Theresa Monturano, Senior Publisher
Elsevier
+1 215 239 3711
hmsmedia@elsevier.com