ACR Meeting Abstracts

ACR Meeting Abstracts

  • Meetings
    • ACR Convergence 2024
    • ACR Convergence 2023
    • 2023 ACR/ARP PRSYM
    • ACR Convergence 2022
    • ACR Convergence 2021
    • ACR Convergence 2020
    • 2020 ACR/ARP PRSYM
    • 2019 ACR/ARP Annual Meeting
    • 2018-2009 Meetings
    • Download Abstracts
  • Keyword Index
  • Advanced Search
  • Your Favorites
    • Favorites
    • Login
    • View and print all favorites
    • Clear all your favorites
  • ACR Meetings

Abstract Number: 1005

Increasing the Proficiency for Scoring Sacroiliac Joint Radiographs According to the Modified New York Criteria for Ankylosing Spondylitis by Using an Online Real-time Iterative Calibration (RETIC) Module

Anna Hadsbjerg1, Mikkel Østergaard2, Joel Paschke3, Adrian Ciurea4, Michael Nissen5, Stephanie Wichuk6, Ashish J Mathew7, Marie Wetterslev8, Raphael Micheroli9, Susanne Pedersen10, Simon Krabbe10, Kristyna Bubova11, Monika gregova12, Alexander Bernatschek4, Maurice Donzallaz4, Burkhard Moeller13, Ziga Snoj14, Karlo Pintaric14, Manouk de Hooge15, Karel Gorican16, Robert G Lambert6 and Walter P Maksymowych17, 1Copenhagen Center for Arthritis Research, COPECARE, Rigshospitalet, Glostrup, Denmark, 2Rigshospitalet, University of Copenhagen, Glostrup, Denmark, 3CARE Arthritis LTD, Edmonton, AB, Canada, 4University Hospital Zurich, Zürich, Switzerland, 5Hopitaux Universitaires de Genève, Geneva, Switzerland, 6University of Alberta, Edmonton, AB, Canada, 7Rigshospitalet, Copenhagen, Denmark, 8Rigshospitalet, Copenhagen, Glostrup, Denmark, 9University Hospital Zurich, Department of Rheumatology, Zürich, Switzerland, 10Rigshospitalet, København, Denmark, 11First Faculty of Medicine, Charles University,, Prague, Czech Republic, 12Institue of Rheumatology, Prague, 13Inselspital - University Hospital Bern, Bern, Switzerland, 14Radiology, University Medical Centre Ljubljana, Ljubljana, Slovenia, 15Ghent University Hospital, Luxembourg, Luxembourg, 16MSK radiology unit, Radiology section – Diagnostic department, Geneva University Hospitals, Geneva, Switzerland, 17Department of Medicine, University of Alberta, Edmonton, AB, Canada

Meeting: ACR Convergence 2022

Keywords: Ankylosing spondylitis (AS), Diagnostic criteria, Imaging, X-ray

  • Tweet
  • Click to email a link to a friend (Opens in new window) Email
  • Click to print (Opens in new window) Print
Session Information

Date: Sunday, November 13, 2022

Title: Spondyloarthritis Including PsA – Diagnosis, Manifestations, and Outcomes Poster II

Session Type: Poster Session B

Session Time: 9:00AM-10:30AM

Background/Purpose: Radiographic assessment of the sacroiliac joints (SIJ) according to the modified New York (mNY) criteria is essential in the classification of ankylosing spondylitis, but low to moderate inter-reader agreement and limited improvement by training have been reported. A web-based real-time iterative calibration (RETIC) module for scoring SIJ radiographs according to the mNY criteria has been developed by experienced readers to allow remote standardized training. In this study, we aimed to test the performance of this online RETIC training module in enhancing scoring proficiency with an expert reader as gold standard reference.

Methods: The RETIC module for scoring according to the mNY criteria consisted of 50 cases with radiographs of the SIJ at one timepoint with an integrated scoring interface with real time feedback to the reader’s grading compared to the expert readers’ grading. The mNY grade (0-4) is assessed for each joint. Reliability for fulfilling (mNY+) versus not fulfilling (mNY-) mNY criteria was assessed in real-time by kappa data being provided every 10 cases, until proficiency targets (kappa > 0.5) were achieved. In this study, participants (n=17) from the EuroSpA Imaging project were randomized to one of two reader training strategies (groups A and B) that comprised of 3 training steps, each followed by a reading exercise (Exercises 1-3; 25 patients per exercise). Training steps were as follows: Group A. 1. Review of original manuscripts describing the mNY method. 2. Review of PowerPoint summary of mNY method and video with grading examples PLUS completion of mNYRETIC module. 3. Re-review of PowerPoint summary and video. Group B. Same 3-step strategy as group A except that the mNYRETIC module was completed at step 3, i.e. immediately before Exercise 3. The reliability of scoring was compared to an expert radiologist (RL), using kappa statistics for positivity of mNY criteria and intraclass correlation coefficients (ICCs) for the grades of the mNY criteria.

Results: The mean agreement for all readers on fulfillment of the mNY criteria (mNY+ vs mNY-) with kappa was 0.69 in exercise 1, 0.72 in exercise 2 and 0.83 in exercise 3. Corresponding ICCs for mNY scoring 0-4 were 0.77, 0.77 and 0.82 in exercises 1, 2 and 3, respectively, see Table. For Reader Group A (performed RETIC module before exercise 2), kappas for exercises 1-3 were 0.65, 0.76 and 0.83, respectively and ICCs 0.71, 0.82 and 0.81 (exercise 3). Interestingly, the main increase in agreement occurred between Exercises 1 and 2, i.e. after the RETIC module was performed. For Reader group B (performed RETIC module before exercise 3), corresponding kappa’s were 0.71, 0.77 and 0.83 and ICCs 0.80, 0.72 and 0.80, for exercises 1-3, respectively. Similarly, agreements predominantly improved directly after the RETIC module was performed.

Conclusion: Agreement on scoring radiographs of the SIJ according to the mNY criteria was noticeably improved when using a systematic online training module and in general readers achieved very good agreement with experts implying that systematic training of readers before scoring of images can enhance scoring proficiency.

Supporting image 1


Disclosures: A. Hadsbjerg, Novartis; M. Østergaard, AbbVie/Abbott, Amgen, Bristol-Myers Squibb(BMS), Celgene, Eli Lilly, Janssen, Gilead, Novartis, Pfizer, UCB; J. Paschke, None; A. Ciurea, AbbVie, Novartis, Merck/MSD; M. Nissen, AbbVie/Abbott, Pfizer, Amgen, Novartis, Janssen; S. Wichuk, None; A. Mathew, None; M. Wetterslev, None; R. Micheroli, None; S. Pedersen, Novartis, AbbVie/Abbott, UCB, Pfizer, Merck/MSD; S. Krabbe, Novartis; K. Bubova, None; M. gregova, None; A. Bernatschek, None; M. Donzallaz, None; B. Moeller, None; Z. Snoj, None; K. Pintaric, None; M. de Hooge, None; K. Gorican, None; R. Lambert, Calyx, CARE Arthritis, Image Analysis Group; W. Maksymowych, AbbVie, Boehringer-Ingelheim, Celgene, Eli Lilly, Galapagos, Janssen, Novartis, Pfizer, UCB, CARE Arthritis Limited.

To cite this abstract in AMA style:

Hadsbjerg A, Østergaard M, Paschke J, Ciurea A, Nissen M, Wichuk S, Mathew A, Wetterslev M, Micheroli R, Pedersen S, Krabbe S, Bubova K, gregova M, Bernatschek A, Donzallaz M, Moeller B, Snoj Z, Pintaric K, de Hooge M, Gorican K, Lambert R, Maksymowych W. Increasing the Proficiency for Scoring Sacroiliac Joint Radiographs According to the Modified New York Criteria for Ankylosing Spondylitis by Using an Online Real-time Iterative Calibration (RETIC) Module [abstract]. Arthritis Rheumatol. 2022; 74 (suppl 9). https://acrabstracts.org/abstract/increasing-the-proficiency-for-scoring-sacroiliac-joint-radiographs-according-to-the-modified-new-york-criteria-for-ankylosing-spondylitis-by-using-an-online-real-time-iterative-calibration-retic-mo/. Accessed .
  • Tweet
  • Click to email a link to a friend (Opens in new window) Email
  • Click to print (Opens in new window) Print

« Back to ACR Convergence 2022

ACR Meeting Abstracts - https://acrabstracts.org/abstract/increasing-the-proficiency-for-scoring-sacroiliac-joint-radiographs-according-to-the-modified-new-york-criteria-for-ankylosing-spondylitis-by-using-an-online-real-time-iterative-calibration-retic-mo/

Advanced Search

Your Favorites

You can save and print a list of your favorite abstracts during your browser session by clicking the “Favorite” button at the bottom of any abstract. View your favorites »

All abstracts accepted to ACR Convergence are under media embargo once the ACR has notified presenters of their abstract’s acceptance. They may be presented at other meetings or published as manuscripts after this time but should not be discussed in non-scholarly venues or outlets. The following embargo policies are strictly enforced by the ACR.

Accepted abstracts are made available to the public online in advance of the meeting and are published in a special online supplement of our scientific journal, Arthritis & Rheumatology. Information contained in those abstracts may not be released until the abstracts appear online. In an exception to the media embargo, academic institutions, private organizations, and companies with products whose value may be influenced by information contained in an abstract may issue a press release to coincide with the availability of an ACR abstract on the ACR website. However, the ACR continues to require that information that goes beyond that contained in the abstract (e.g., discussion of the abstract done as part of editorial news coverage) is under media embargo until 10:00 AM ET on November 14, 2024. Journalists with access to embargoed information cannot release articles or editorial news coverage before this time. Editorial news coverage is considered original articles/videos developed by employed journalists to report facts, commentary, and subject matter expert quotes in a narrative form using a variety of sources (e.g., research, announcements, press releases, events, etc.).

Violation of this policy may result in the abstract being withdrawn from the meeting and other measures deemed appropriate. Authors are responsible for notifying colleagues, institutions, communications firms, and all other stakeholders related to the development or promotion of the abstract about this policy. If you have questions about the ACR abstract embargo policy, please contact ACR abstracts staff at [email protected].

Wiley

  • Online Journal
  • Privacy Policy
  • Permissions Policies
  • Cookie Preferences

© Copyright 2025 American College of Rheumatology