ACR Meeting Abstracts

ACR Meeting Abstracts

  • Meetings
    • ACR Convergence 2024
    • ACR Convergence 2023
    • 2023 ACR/ARP PRSYM
    • ACR Convergence 2022
    • ACR Convergence 2021
    • ACR Convergence 2020
    • 2020 ACR/ARP PRSYM
    • 2019 ACR/ARP Annual Meeting
    • 2018-2009 Meetings
    • Download Abstracts
  • Keyword Index
  • Advanced Search
  • Your Favorites
    • Favorites
    • Login
    • View and print all favorites
    • Clear all your favorites
  • ACR Meetings

Abstract Number: 201

Computer Learning (artificial intelligence) to Create a Computer-Based Triage Tool Classifying Referrals As Inflammatory or Non-Inflammatory Requiring Only Patient Reported Information

Cindy Kim1, Tanner Bohn2, Charles X. Ling3, Nikhil Chopra4 and Janet E. Pope5, 1Faculty of Medicine, University of Western Ontaro, London, ON, Canada, 2University of Western Ontario, London, ON, Canada, 3Computer Sciences, University of Western Ontario, London, ON, Canada, 4Rheumatology, Private Practice, London, ON, Canada, 5Department of Medicine, Division of Rheumatology, University of Western Ontario, St Joseph's Health Care, London, ON, Canada

Meeting: 2017 ACR/ARHP Annual Meeting

Date of first publication: September 18, 2017

Keywords: rheumatic disease and rheumatic education, Triage

  • Tweet
  • Click to email a link to a friend (Opens in new window) Email
  • Click to print (Opens in new window) Print
Session Information

Date: Sunday, November 5, 2017

Title: Health Services Research Poster I

Session Type: ACR Poster Session A

Session Time: 9:00AM-11:00AM

Background/Purpose: To determine if a computer-based triage tool can accurately classify referrals as inflammatory or non-inflammatory using information obtained from the patient; not requiring assessment by healthcare workers.

Methods: Patient referrals to a single rheumatologist were studied. Patient lists for 11 commonly encountered diagnoses [rheumatoid arthritis (RA), psoriatic arthritis, lupus, osteoarthritis, gout, soft tissue rheumatism (i.e. arthralgia NYD, tendonitis, mechanical low back pain), ankylosing spondylitis (AS), polymyalgia rheumatica (PMR), and fibromyalgia] were created. The diagnoses of RA, lupus, AS, PMR, and other seronegative spondyloarthropathies were classified as inflammatory arthritis (non-crystalline) (IA). At least five patient charts for each diagnosis were reviewed and eligible for study if a self-reported patient pain diagram was also completed. The following patient-reported information was collected from each referral: age, sex, symptom duration, and pain diagram. Lab results for ESR, CRP, ANA, ENA, anti-DNA, anti-CCP antibodies, urate, and rheumatoid factor were also collected where available. Machine learning techniques were used to create a logistic regression model to classify referrals as inflammatory or non-inflammatory. Backward feature selection was used to enhance model performance by identifying features most predictive of referral state. Leave-one-out cross-validation was used to predict model performance. The models were subsequently evaluated on prospectively collected patient data from 20 new referrals seen after the creation of the triage tool, where data was coded blindly to patients’ diagnosis.

Results: In creation of the triage tool, 168 patient charts were used; 73 were classified as IA after being seen by a rheumatologist. The triage tool correctly classified 65 of 73 referrals as inflammatory using patient-reported information (model 1) (sensitivity 89%, specificity 52%). When the referral tool was reevaluated using laboratory markers in addition to the information obtained from the patient (model 2), 67 referrals were correctly classified as inflammatory (sensitivity 92%, specificity 63%). When model 1 was tested on 20 prospective patients, all 6 patients with IA were correctly classified (sensitivity 100%, specificity 52%). Model 2 correctly classified 14 patients (who had lab values present) including 5 patients with IA (sensitivity 83%, specificity 64%). The results are shown in table. Further prospective multi-site testing is ongoing.

Conclusion: A referral tool that can be entered into a database for computer assessment has good sensitivity to detect high priority referrals from data that can be obtained directly from patients and ascertained by non-healthcare workers. This may be of benefit in areas of limited resources and long waiting lists to see a rheumatologist.

Model 1

Model 2

Predicted (N=168)

Actual (N=20)

Predicted (N=168)

Actual (N=20)

Sensitivity

89.0%

100%

91.8%

83.3%

Specificity

51.6%

35.7%

63.2%

64.3%

NPV

86.0%

100%

90.9%

90.0%

PPV

58.6%

40.0%

65.7%

50.0%

IA Referrals Correctly Classified

65/73

6/6

67/73

5/6


Disclosure: C. Kim, None; T. Bohn, None; C. X. Ling, Director of Data Mining and Business Intelligence Lab, 6; N. Chopra, Amgen, Novartis, UCB, AbbVie, Janssen, 5; J. E. Pope, AbbVie, Amgen, Bayer, BMS, Celtrion, Eli Lilly and Company, Merck, Novartis, Pfizer, Roche, UCB, 5,Amgen, Bayer, BMS, GSK, Merck, Novartis, Pfizer, Roche, UCB, 2.

To cite this abstract in AMA style:

Kim C, Bohn T, Ling CX, Chopra N, Pope JE. Computer Learning (artificial intelligence) to Create a Computer-Based Triage Tool Classifying Referrals As Inflammatory or Non-Inflammatory Requiring Only Patient Reported Information [abstract]. Arthritis Rheumatol. 2017; 69 (suppl 10). https://acrabstracts.org/abstract/computer-learning-artificial-intelligence-to-create-a-computer-based-triage-tool-classifying-referrals-as-inflammatory-or-non-inflammatory-requiring-only-patient-reported-information/. Accessed .
  • Tweet
  • Click to email a link to a friend (Opens in new window) Email
  • Click to print (Opens in new window) Print

« Back to 2017 ACR/ARHP Annual Meeting

ACR Meeting Abstracts - https://acrabstracts.org/abstract/computer-learning-artificial-intelligence-to-create-a-computer-based-triage-tool-classifying-referrals-as-inflammatory-or-non-inflammatory-requiring-only-patient-reported-information/

Advanced Search

Your Favorites

You can save and print a list of your favorite abstracts during your browser session by clicking the “Favorite” button at the bottom of any abstract. View your favorites »

All abstracts accepted to ACR Convergence are under media embargo once the ACR has notified presenters of their abstract’s acceptance. They may be presented at other meetings or published as manuscripts after this time but should not be discussed in non-scholarly venues or outlets. The following embargo policies are strictly enforced by the ACR.

Accepted abstracts are made available to the public online in advance of the meeting and are published in a special online supplement of our scientific journal, Arthritis & Rheumatology. Information contained in those abstracts may not be released until the abstracts appear online. In an exception to the media embargo, academic institutions, private organizations, and companies with products whose value may be influenced by information contained in an abstract may issue a press release to coincide with the availability of an ACR abstract on the ACR website. However, the ACR continues to require that information that goes beyond that contained in the abstract (e.g., discussion of the abstract done as part of editorial news coverage) is under media embargo until 10:00 AM ET on November 14, 2024. Journalists with access to embargoed information cannot release articles or editorial news coverage before this time. Editorial news coverage is considered original articles/videos developed by employed journalists to report facts, commentary, and subject matter expert quotes in a narrative form using a variety of sources (e.g., research, announcements, press releases, events, etc.).

Violation of this policy may result in the abstract being withdrawn from the meeting and other measures deemed appropriate. Authors are responsible for notifying colleagues, institutions, communications firms, and all other stakeholders related to the development or promotion of the abstract about this policy. If you have questions about the ACR abstract embargo policy, please contact ACR abstracts staff at [email protected].

Wiley

  • Online Journal
  • Privacy Policy
  • Permissions Policies
  • Cookie Preferences

© Copyright 2025 American College of Rheumatology