Performance of Canvas Dx, a Novel Software-based Autism Spectrum Disorder Diagnosis Aid for Use in a Primary Care Setting
Jonathan T Megerian1, Sangeeta Dey2,3, Raun D. Melmed4, Daniel L. Coury5,6, Marc Lerner7,8, Christopher Nicholls9,10, Kristin Sohl11, Rambod Rouhbakhsh12,13, Anandhi Narasimhan, Jonathan Romain7, Sailaja Golla14, Safiullah Shareef15, Andrey Ostrovsky16,17, Jennifer Shannon18, Colleen Kraft18, Stuart Liu-Mayo18, Halim Abbas18, Diana E. Gal-Szabo18, Dennis P. Wall18,19, Sharief Taraman20,21,22
1Thompson Autism Center at CHOC Children’s, 2Bay Area Neuropsychological and Developmental Services, 3Lucile Packard Children's Hospital, 4Melmed Center, 5Nationwide Children's Hospital, 6The Ohio State University, College of Medicine, 7CHOC Children’s, 8University of California, Irvine School of Medicine, 9The Nicholls Group, 10Psychology, Arizona State University, 11University of Missouri, School of Medicine, 12Forrest General Hospital, Family Medicine Residency Program, 13Hattiesburg Clinic, MediSync Clinical Research, 14Texas Institute for neurological disorders, 15Texas Child Neurology, 16Social Innovation Ventures, 17Children’s National Health System, 18Cognoa, Inc., 19Stanford University,, 20CHOC Children's Hospital and Cognoa, Inc, 21Cognoa, 22Pediatrics, University of California Irvine School of Medicine
Objective:

Objectives: The lack of diagnostic tools for Autism Spectrum Disorder in primary care settings and long wait lists for specialist assessment contribute to an average delay of 3 years between first parental concern and diagnosis. This study examined the performance of an artificial intelligence-based device intended to aid PCPs in the diagnosis of ASD.

Background:
NA
Design/Methods:

Methods: This was a prospective multi-site pivotal study conducted in 6 states using a double-blind active comparator design with 425 completed subjects (36% female) ages 18-72 months with concern for developmental delay. Previous research developed, tuned, and tested a device that uses a gradient boosted decision tree machine learning algorithm which analyzes 64 behavioral features from 3 distinct inputs: 1) Caregiver questionnaire 2) two, 90 second minimum home videos analyzed by trained video analysts 3) PCP questionnaire.

Results:

Device results were compared to diagnosis by independent agreement of specialist clinicians based on clinical assessment, including a modified CARS-2 and DSM-5 criteria. Specialists were child psychiatrists, child psychologists, pediatric neurologists, and developmental behavioral pediatricians experienced in diagnosing ASD.

Results Comparison of device results to specialist diagnosis found the PPV: 80.8% [95%CI, 70.3%-88.8%], NPV: 98.3% [90.6%-100%], sensitivity: 98.4% [91.6%-100%], specificity: 78.9% [67.6%-87.7%] for subjects with determinate device results. There was no evidence that device performance significantly varied when PCP used the device remotely compared to in-person.

Conclusions:
Conclusions: Using this device, PCPs could efficiently, accurately, and equitably diagnose a subset of children 18-72 months old, thereby streamlining specialist referrals and facilitating earlier ASD diagnosis and interventions. The results further provide preliminary evidence that PCP evaluation of the child can be done via telemedicine or in-person with no degradation in device performance.