ACR Meeting Abstracts

ACR Meeting Abstracts

  • Meetings
    • ACR Convergence 2024
    • ACR Convergence 2023
    • 2023 ACR/ARP PRSYM
    • ACR Convergence 2022
    • ACR Convergence 2021
    • ACR Convergence 2020
    • 2020 ACR/ARP PRSYM
    • 2019 ACR/ARP Annual Meeting
    • 2018-2009 Meetings
    • Download Abstracts
  • Keyword Index
  • Advanced Search
  • Your Favorites
    • Favorites
    • Login
    • View and print all favorites
    • Clear all your favorites
  • ACR Meetings

Abstract Number: 0226

Linguistics Biases in Letters of Recommendation Written for Rheumatology Fellowship Applicants

Margaret Kramer1, Amy Cannella1, Harlan Sayles2 and Michelene Hearth-Holmes1, 1University of Nebraska Medical Center/Division of Rheumatology, Omaha, NE, 2University of Nebraska Medical Center, Omaha, NE

Meeting: ACR Convergence 2022

Keywords: Administrative Data, Disparities, education, medical

  • Tweet
  • Email
  • Print
Session Information

Date: Saturday, November 12, 2022

Title: Professional Education Poster

Session Type: Poster Session A

Session Time: 1:00PM-3:00PM

Background/Purpose:

  • The importance of letters of recommendation (LoR) grow each year. It is more important than ever that LoR are written in an unbiased manner and objectively evaluate the quality of each candidate.
  • In a recent study of LoR written for individuals applying to a single transplant surgery fellowship from 2007 to 2017, female applicants’ letters were significantly more likely to contain communal terms (i.e. compassionate, nurturing, humble) than LoR for males. These terms have been suggested to negatively impact the hiring and promoting process when included in LoR, as compared to the use of agentic terms (i.e. superb, intelligent, exceptional).
  • A 2020 study found that applicants from ethnic/cultural backgrounds that are underrepresented in medicine were significantly less likely to contain standout descriptors ( i.e. outstanding, remarkable).

To investigate for implicit linguistic biases in letters of recommendation written for applicants applying to our rheumatology program, and to determine if differences in gender and race exist between the applicants. Additionally, compare these results to the gender, race, academic rank, and position of the letter writers.

Methods:

  1. Letters of recommendation were blinded by an independent party to prevent implicit bias on the part of the researcher
  2. The letters were then analyzed using the Linguistic Inquiry and Word Count (LIWC2015) software program, which automatically scans the letters for words and phrases of our choosing (agentic and communal terms)
  3. The letters were then run through a publicly available gender calculator (http://slowe.github.io/genderbias/) to find any gender specific terms that the LIWC2015 might have missed
  4. Each letter was read by a researcher to find any linguistic nuances unable to be unearthed by a computer program

Results:

  • As shown in Figure 1, our preliminary results indicate that contrary to published studies, in UNMC’s rheumatology department, letters of recommendation (LoR) written for female applicants were more likely to contain agentic terms, and LoR written for male students were more likely to contain communal terms. However, overall letter writers were more likely to use agentic terms than they were to use communal terms, regardless of gender.
  • Figure 2 indicates that the differences in use of agentic and communal terms were consistent across most ranks.
  • ”Without Hesitation/Reservation” was a standout phrase noticed during analysis. Table 1 indicates that as comparable to the LIWC results, female letters were more likely than male letters to contain this phrase.
  • In review of our demographic data, it was revealed that our applicants’ races were 46% white, 14% Indian, and more than 10 other nationalities. Our applicants came from 9 various countries, with 68% coming from the US and 10% from the Indian sub-continent. The mean age of our applicants was 32.9.

Conclusion: This small sample size of 50 letters limits the extent of our conclusions. However, results were consistent across multiple analytical platforms, suggesting the need for further study to determine if letters of recommendation and letter writers for applicants applying to the UNMC division of Rheumatology are different than that of other disciplines.

Supporting image 1

Figure 1 : Differences in Agentic and Communal terms used based on gender

Supporting image 2

Figure 2 : Differences in Agentic and Communal terms used based on writer’s academic or professional rank

Supporting image 3

Table 1 : The Use of Without Hesitation/Reservation within letters of recommendation regardless of gender


Disclosures: M. Kramer, None; A. Cannella, None; H. Sayles, None; M. Hearth-Holmes, None.

To cite this abstract in AMA style:

Kramer M, Cannella A, Sayles H, Hearth-Holmes M. Linguistics Biases in Letters of Recommendation Written for Rheumatology Fellowship Applicants [abstract]. Arthritis Rheumatol. 2022; 74 (suppl 9). https://acrabstracts.org/abstract/linguistics-biases-in-letters-of-recommendation-written-for-rheumatology-fellowship-applicants/. Accessed .
  • Tweet
  • Email
  • Print

« Back to ACR Convergence 2022

ACR Meeting Abstracts - https://acrabstracts.org/abstract/linguistics-biases-in-letters-of-recommendation-written-for-rheumatology-fellowship-applicants/

Advanced Search

Your Favorites

You can save and print a list of your favorite abstracts during your browser session by clicking the “Favorite” button at the bottom of any abstract. View your favorites »

All abstracts accepted to ACR Convergence are under media embargo once the ACR has notified presenters of their abstract’s acceptance. They may be presented at other meetings or published as manuscripts after this time but should not be discussed in non-scholarly venues or outlets. The following embargo policies are strictly enforced by the ACR.

Accepted abstracts are made available to the public online in advance of the meeting and are published in a special online supplement of our scientific journal, Arthritis & Rheumatology. Information contained in those abstracts may not be released until the abstracts appear online. In an exception to the media embargo, academic institutions, private organizations, and companies with products whose value may be influenced by information contained in an abstract may issue a press release to coincide with the availability of an ACR abstract on the ACR website. However, the ACR continues to require that information that goes beyond that contained in the abstract (e.g., discussion of the abstract done as part of editorial news coverage) is under media embargo until 10:00 AM ET on November 14, 2024. Journalists with access to embargoed information cannot release articles or editorial news coverage before this time. Editorial news coverage is considered original articles/videos developed by employed journalists to report facts, commentary, and subject matter expert quotes in a narrative form using a variety of sources (e.g., research, announcements, press releases, events, etc.).

Violation of this policy may result in the abstract being withdrawn from the meeting and other measures deemed appropriate. Authors are responsible for notifying colleagues, institutions, communications firms, and all other stakeholders related to the development or promotion of the abstract about this policy. If you have questions about the ACR abstract embargo policy, please contact ACR abstracts staff at [email protected].

Wiley

  • Online Journal
  • Privacy Policy
  • Permissions Policies
  • Cookie Preferences

© Copyright 2025 American College of Rheumatology