A simplified, 2-question grading system for evaluating abstracts in orthopedic scientific meetings: a serial randomization study

Acta Orthopaedica, vol. 95, pp. 180–185

Abstract

BACKGROUND AND PURPOSE: Efficient abstract scoring for congress presentation is important. Given the emergence of new study methodologies, a scoring system that accommodates all study designs is warranted. We aimed to assess the equivalence of a simplified, 2-question abstract grading system with a more complex currently used system in assessing abstracts submitted for orthopedic scientific meetings in a serial randomized study. METHODS: Dutch Orthopedic Association Scientific Committee (DOASC) members were randomized to grade abstracts using either the current grading system, which includes up to 7 scoring categories, or the new grading system, which consists of only 2 questions. Pearson correlation coefficient and mean abstract score with 95% confidence intervals (CI) were calculated. RESULTS: Analysis included the scoring of 195 abstracts by 12-14 DOASC members. The average score for an abstract using the current system was 60 points (CI 58-62), compared with 63 points (CI 62-64) using the new system. By using the new system, abstracts were scored higher by 3.3 points (CI 1.7-5.0). Pearson correlation was poor with coefficient 0.38 (P < 0.001). CONCLUSION: The simplified abstract grading system exhibited a poor correlation with the current scoring system, while the new system offers a more inclusive evaluation of varying study designs and is preferred by almost all DOASC members.

Authors 6

1. Walter van der Weegen
   Affiliation as printed

   Department of Orthopedics, Sint Anna Ziekenhuis, Eindhoven

2. Jeroen C. van Egmond

   Bravis Ziekenhuis

   Affiliation as printed

   Department of Orthopedics, Bravis Ziekenhuis, Roosendaal. j.vanegmond@bravis.nl

   Department of Orthopedics, Bravis Ziekenhuis, Roosendaal

3. Ruth E. Geuze

   Elisabeth-TweeSteden Ziekenhuis

   Affiliation as printed

   Department of Orthopedics, Elisabeth-Tweesteden Ziekenhuis, Tilburg

4. Taco Gosens

   Elisabeth-TweeSteden Ziekenhuis

   Affiliation as printed

   Department of Orthopedics, Elisabeth-Tweesteden Ziekenhuis, Tilburg

5. Barbara A. M. Snoeker

   Amsterdam UMC Location University of Amsterdam · Amsterdam University Medical Centers · University of Amsterdam

   Affiliation as printed

   Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam Medical Center, University of Amsterdam

6. Rudolf Wilhelm Poolman Aachen Department of Orthopedics, Leiden University Medical Center

   Leiden University Medical Center · OLVG

   Affiliation as printed

   Department of Orthopedics, Leiden University Medical Center, Leiden; Department of Orthopedics, Joint Research, OLVG, Amsterdam, the Netherlands

   Department of Orthopedics, Joint Research, OLVG, Amsterdam, the Netherlands

   Department of Orthopedics, Leiden University Medical Center, Leiden