ACR Meeting Abstracts

ACR Meeting Abstracts

  • Meetings
    • ACR Convergence 2024
    • ACR Convergence 2023
    • 2023 ACR/ARP PRSYM
    • ACR Convergence 2022
    • ACR Convergence 2021
    • ACR Convergence 2020
    • 2020 ACR/ARP PRSYM
    • 2019 ACR/ARP Annual Meeting
    • 2018-2009 Meetings
    • Download Abstracts
  • Keyword Index
  • Advanced Search
  • Your Favorites
    • Favorites
    • Login
    • View and print all favorites
    • Clear all your favorites
  • ACR Meetings

Abstract Number: 1732

Machine Learning Coupled with Patient Reported Outcome Data to Classify & Predict RA Disease Activity

Jeffrey R Curtis1, Fenglong Xie2, Shelly Kafka3 and Shawn Black3, 1Division of Clinical Immunology and Rheumatology, University of Alabama at Birmingham, Birmingham, AL, 2University of Alabama at Birmingham, Birmingham, AL, 3Janssen Scientific Affairs, LLC, Horsham, PA

Meeting: ACR Convergence 2020

Keywords: Disease Activity, rheumatoid arthritis

  • Tweet
  • Click to email a link to a friend (Opens in new window) Email
  • Click to print (Opens in new window) Print
Session Information

Date: Monday, November 9, 2020

Title: RA – Diagnosis, Manifestations, & Outcomes Poster IV: Lifespan of a Disease

Session Type: Poster Session D

Session Time: 9:00AM-11:00AM

Background/Purpose: Patient reported outcome (PRO) data have assumed increasing importance in the care of rheumatoid arthritis (RA) patients. However, physician-derived disease activity measures such as CDAI remain the most-accepted metrics to assess RA. The possibility that newer, longitudinal PRO might proxy for the CDAI has not been evaluated.

Methods: Using data from the Comparative and Pragmatic Study of Golimumab IV vs. Infliximab (AWARE), we evaluated RA patients initiating one of these two therapies who started in moderate or high disease activity and remained under observation through 6 months or stopped due to lack of efficacy. The prediction target was CDAI and CDAI disease activity category at Month 6. Candidate predictors included baseline CDAI, baseline PROs including those from the NIH PROMIS system (e.g. Pain Interference, Fatigue, Physical Function, Sleep Disturbance), and followup PROs at month 1 and 6 (+-30 days). Data were randomly partitioned into training (2/3) and test (1/3) datasets. Multiple machine learning (ML) methods (e.g. Gradient Boosting: XGBoost, Random Forests: RF, elasticnet regularization: ER, support vector machine: SVM) were used to both predict CDAI, and classify CDAI disease activity category (remission/low vs. moderate/high). Feature selection was conducted using R package mlr3 and hyper-parameter tuning was conducted using a random search method. Model performance evaluated cross-validated error comparing different ML approaches using both train and test data.

Results: A total of 391 AWARE patients were analyzed. Of these, the distribution of disease activity by CDAI at month 6 was remission (4.9%), low (26.6%), moderate (31.4%), and high (37.1%). In univariate analysis examining outcomes at 6 months (Table 1), and depending on which modeling method was used, the most important features included pain intensity, PROMIS measures (social participation, pain interference, pain intensity, and physical function), baseline CDAI, and age. Among all ML methods , random forest performed best.  To classify LDA/remission vs. moderate/high based on regression, accuracy ranged from 0.69 (XGBoost) to 0.80 (RF) (Table 2, left). VM, ER, and RF had high specificity, ranging from 0.93 for SVM to 0.99 for RF; but low sensitivity, ranging from 0.26 for RF to 0.38 for ER. XGBoost had adequate sensitivity (0.65) and specificity (0.71).  Predicted vs. observed CDAI (Figure) showed some patients had higher observed than predicted CDAI at month 6. Direct classification generated somewhat similar or lower model performance (Table 2, right).

Conclusion: Machine learning methods coupled with longitudinal PRO data appear useful and can achieve 80-90% accuracy to classify RA disease activity among patients starting a new biologic. This approach has promise for real-world evidence generation in the common circumstance where physician-derived disease activity data is not available yet PRO measures are.

Table 1: Factors associated with attaining remission or low disease activity (CDAI ≤10) at visit 3 (month 6)

Table 2: Model performance in Test data

Figure: Predicted vs. Observed CDAI at visit 3 (month 6) by RandomForest


Disclosure: J. Curtis, AbbVie, 2, 5, Amgen, 2, 5, Bristol-Myers Squibb, 2, 5, Corrona, 2, 5, Janssen, 2, 5, Lilly, 2, 5, Myriad, 2, 5, Pfizer, 2, 5, Regeneron, 2, 5, Roche, 2, 5, UCB, 2, 5, Gilead Sciences, Inc., 5, Sanofi, 5; F. Xie, None; S. Kafka, Janssen Scientific Affairs, LLC, 1, 3; S. Black, Janssen Scientific Affairs, LLC, 1, 3.

To cite this abstract in AMA style:

Curtis J, Xie F, Kafka S, Black S. Machine Learning Coupled with Patient Reported Outcome Data to Classify & Predict RA Disease Activity [abstract]. Arthritis Rheumatol. 2020; 72 (suppl 10). https://acrabstracts.org/abstract/machine-learning-coupled-with-patient-reported-outcome-data-to-classify-predict-ra-disease-activity/. Accessed .
  • Tweet
  • Click to email a link to a friend (Opens in new window) Email
  • Click to print (Opens in new window) Print

« Back to ACR Convergence 2020

ACR Meeting Abstracts - https://acrabstracts.org/abstract/machine-learning-coupled-with-patient-reported-outcome-data-to-classify-predict-ra-disease-activity/

Advanced Search

Your Favorites

You can save and print a list of your favorite abstracts during your browser session by clicking the “Favorite” button at the bottom of any abstract. View your favorites »

All abstracts accepted to ACR Convergence are under media embargo once the ACR has notified presenters of their abstract’s acceptance. They may be presented at other meetings or published as manuscripts after this time but should not be discussed in non-scholarly venues or outlets. The following embargo policies are strictly enforced by the ACR.

Accepted abstracts are made available to the public online in advance of the meeting and are published in a special online supplement of our scientific journal, Arthritis & Rheumatology. Information contained in those abstracts may not be released until the abstracts appear online. In an exception to the media embargo, academic institutions, private organizations, and companies with products whose value may be influenced by information contained in an abstract may issue a press release to coincide with the availability of an ACR abstract on the ACR website. However, the ACR continues to require that information that goes beyond that contained in the abstract (e.g., discussion of the abstract done as part of editorial news coverage) is under media embargo until 10:00 AM ET on November 14, 2024. Journalists with access to embargoed information cannot release articles or editorial news coverage before this time. Editorial news coverage is considered original articles/videos developed by employed journalists to report facts, commentary, and subject matter expert quotes in a narrative form using a variety of sources (e.g., research, announcements, press releases, events, etc.).

Violation of this policy may result in the abstract being withdrawn from the meeting and other measures deemed appropriate. Authors are responsible for notifying colleagues, institutions, communications firms, and all other stakeholders related to the development or promotion of the abstract about this policy. If you have questions about the ACR abstract embargo policy, please contact ACR abstracts staff at [email protected].

Wiley

  • Online Journal
  • Privacy Policy
  • Permissions Policies
  • Cookie Preferences

© Copyright 2025 American College of Rheumatology