ACR Meeting Abstracts

ACR Meeting Abstracts

  • Home
  • Meetings Archive
    • ACR Convergence 2020
    • 2020 ACR/ARP PRSYM
    • 2019 ACR/ARP Annual Meeting
    • 2018 ACR/ARHP Annual Meeting
    • 2017 ACR/ARHP Annual Meeting
    • 2017 ACR/ARHP PRSYM
    • 2016-2009 Meetings
    • Download Abstracts
  • Keyword Index
  • Advanced Search
  • Your Favorites
    • Favorites
    • Login
    • Register
    • View and print all favorites
    • Clear all your favorites
  • Meeting Resource Center

Abstract Number: 2817

Objective Assessment Of Musculoskeletal Physical Examination Skills During Continuing Education Programs For Primary Care Providers Adds Significant Information Not Obtained Through Self-Assessment

Andrea M. Barker1, Michael J. Battistone2, J Peter Beck3, Jorie Butler4, Marissa Grotzke5, Timothy A. Huhtala6, Amy C. Cannella7, David I. Daikh8, Meika A Fang9, Antonio A. Lazzari10, Pedro Roldan11, Joan Marie Von Feldt12 and Grant W. Cannon2, 1General Internal Medicine, Salt Lake City VA and University of Utah, Salt Lake City, UT, 2Division of Rheumatology, Salt Lake City VA and University of Utah, Salt Lake City, UT, 3Salt Lake City VA and University of Utah, Salt Lake City, UT, 4Salt Lake City VA, Salt Lake City, UT, 5Division of Endocrinology, Salt Lake City VA and University of Utah, Salt Lake City, UT, 6Division of General Internal Medicine, Salt Lake City VA and University of Utah, Salt Lake City, UT, 7Divison of Rheumatology, Omaha Veterans Affairs Hospital and University of Nebraska Medical Center, Omaha, NE, 8Rheumatology, University of California, San Francisco, San Francisco, CA, 9Rheumatology, VA Greater Los Angeles Healthcare System, Los Angeles, CA, 10Prim Care/Rheumatology, Boston VA Medical Center, Boston, MA, 11Leesburg VA CBOC, Leesburg, FL, 12Rheumatology, Univ of Pennsylvania/Philadelphia VAMC, Philadelphia, PA

Meeting: 2013 ACR/ARHP Annual Meeting

Keywords: Assessment, competency, Musculoskeletal, musculoskeletal curriculum and physical examination

  • Tweet
  • Email
  • Print
Save to PDF
Session Information

Session Title: Medical Education

Session Type: Abstract Submissions (ACR)

Background/Purpose: Self-assessment is the most frequently used method in the evaluation of continuing medical education (CME) programs. This multi-institutional project was designed to examine convergent validity of learners’ self-assessment competency ratings with their scores on a 2-station objective structured clinical examination (OSCE) during a musculoskeletal (MSK) CME program.

Methods: The VA Salt Lake City Health Care System developed a 3-day MSK Mini-Residency program in collaboration with six other VA facilities.  This program for primary providers emphasizes physical examination and clinical management of common shoulder and knee disorders. Curriculum was introduced through focused didactics followed by small group hands-on practice sessions involving simulated patients. At the conclusion of the program, participants completed a self-reported competency assessment utilizing a 5-point Likert scale and an OSCE for both the shoulder and knee with a rater unaware of the self-reported competency. Self-assessment ratings were classified as low (<4.0), medium (4.0-4.5), and high (>4.5). OSCE ratings were classified with the same numerical boundaries based on a weighted scoring system for each component of the physical exam and then percentage of exam completed correctly (low <80%, medium 80%-90%, high >90%).

Results: A total of 107 and 109 participants completed all components of the shoulder and knee assessments, respectively. Over half the participants were rated high on both self-assessment and OSCE for the shoulder, though correlation was weak (Pearson coefficient = 0.28). For the knee, the OSCE ratings were more variable with approximately one-third of participants in each category while the majority of the participants assessed themselves as being highly competent. Correlation was again weak (Pearson coefficient = 0.05).

Table 1. Self-assessment ratings compared to OSCE ratings for shoulder. 

SHOULDER

 

OSCE Rating

 

Low

Med

High

Self-Assessment

Rating

Low

0

1 (0.9%)

0

1 (0.9%)

Med

5 (4.7%)

8 (7.5%)

10 (9.3%)

23 (21.5%)

High

9 (8.4%)

18 (16.8%)

56 (52.3%)

83 (77.6%)

 

14 (13.1%)

27 (25.2%)

66 (61.7%)

107

Table 2. Self-assessment ratings compared to OSCE ratings for knee. 

KNEE

OSCE Rating

 

Low

Med

High

Self-Assessment

Rating

Low

0

0

1 (0.9%)

1 (0.9%)

Med

13 (11.9%)

7 (6.4%)

8 (7.3%)

28 (25.7%)

High

26 (23.9%)

28 (25.7%)

26 (23.9%)

80 (73.4%)

 

39 (35.8%)

35 (32.1%)

35 (32.1%)

109

Conclusion: Following an intense MSK CME program, the majority of participants rated themselves as highly competent for the shoulder and knee. However, correlation of self-reported competency and OSCE rating was weak, particularly for the knee. Greater variability in the knee OSCE rating and correlation coefficient may be due to the exam maneuvers being more technically difficult to perform as they require more “hands-on” skills of the examiner. These data suggest that an OSCE should be included in evaluation of participants in CME programs to assess competency in the clinical skills being taught.


Disclosure:

A. M. Barker,
None;

M. J. Battistone,
None;

J. P. Beck,
None;

J. Butler,
None;

M. Grotzke,
None;

T. A. Huhtala,
None;

A. C. Cannella,
None;

D. I. Daikh,
None;

M. A. Fang,
None;

A. A. Lazzari,
None;

P. Roldan,
None;

J. M. Von Feldt,
None;

G. W. Cannon,
None.

  • Tweet
  • Email
  • Print
Save to PDF

« Back to 2013 ACR/ARHP Annual Meeting

ACR Meeting Abstracts - https://acrabstracts.org/abstract/objective-assessment-of-musculoskeletal-physical-examination-skills-during-continuing-education-programs-for-primary-care-providers-adds-significant-information-not-obtained-through-self-assessment/

Advanced Search

Your Favorites

You can save and print a list of your favorite abstracts by clicking the “Favorite” button at the bottom of any abstract. View your favorites »

ACR Convergence: Where Rheumatology Meets. All Virtual. November 5-9.

ACR Pediatric Rheumatology Symposium 2020

© COPYRIGHT 2021 AMERICAN COLLEGE OF RHEUMATOLOGY

Wiley

  • Home
  • Meetings Archive
  • Advanced Search
  • Meeting Resource Center
  • Online Journal
  • Privacy Policy
  • Permissions Policies
loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.
This site uses cookies: Find out more.