Challenges in measuring dorsal comminution in distal radius fractures using plain radiography: an observational study

Article information

Arch Hand Microsurg. 2025;30(2):104-109
Publication date (electronic) : 2025 May 30
doi : https://doi.org/10.12790/ahm.24.0057
1Department of Orthopedic Surgery, Wellson Hospital, Siheung, Korea
2Department of Orthopedic Surgery, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Korea
3Gohyeon Seoul Samsung Orthopedic Clinic, Geoje, Korea
Corresponding author: Hyun Il Lee Department of Orthopedic Surgery, Inje University Ilsan Paik Hospital, Inje University College of Medicine, 170 Juhwa-ro, Ilsanseo-gu, Goyang 10380, Korea Tel: +82-2-2270-0949 Fax: +82-33-641-8050 E-mail: I0388@paik.ac.kr
Received 2024 November 4; Revised 2025 February 21; Accepted 2025 February 23.

Abstract

Purpose

Dorsal comminution is widely accepted as a prognostic factor for reduction loss in the nonoperative treatment of distal radius fractures. However, the reliability of measuring dorsal comminution in simple radiographs has not been adequately studied. This study investigated the reliability of dorsal comminution measurements from simple radiographs, based on inter- and intra-rater reliability indices.

Methods

We included 40 patients with distal radius fractures who underwent operative treatment from March 2016 to March 2017. We established three definitions for dorsal comminution: first, the rater’s subjective judgment; second, the presence of a free-floating piece of dorsal cortex; and third, the presence of a dorsal cortical defect of 5 mm or greater. Reliability was measured using Fleiss’ or Cohen’s kappa.

Results

Based on Cohen’s kappa values, the intra-rater reliability of dorsal comminution assessment demonstrated fair to good agreement. In contrast, inter-rater reliability was generally poor to fair, and subgroup analysis by rater experience revealed poor agreement among less experienced surgeons.

Conclusion

The radiological predictors of dorsal comminution exhibited overall low reliability, limiting their usefulness in predicting reduction loss in distal radius fractures. A more precise definition of dorsal comminution is necessary, and additional methods, such as computed tomography and artificial intelligence, should be considered to increase reliability.

Introduction

Distal radius fracture (DRF) is one of the most common fractures worldwide. In Korea, the annual incidence of DRF is reported to be about 130,000 [1]. Although the incidence of conservative treatment compared to surgery is decreasing, conservative treatment remains an important option, especially for elderly patients [2,3]. However, a major issue encountered after closed reduction for conservative management is the redisplacement of the fracture. Redisplacement after a closed reduction of DRF has been reported in 58% to 89% of cases [4]. Even in the absence of early reduction loss, late reduction loss is commonly reported in elderly patients [5]. When the clinical treatment plan changes to surgery due to loss of reduction, patients often express disappointment due to the increased overall cost and treatment duration. Therefore, predicting reduction loss is critical for the success of conservative treatment. Previous studies using plain radiography have shown that factors such as dorsal comminution, associated ulnar fracture, volar cortical integrity, radial shortening, and intra-articular fracture are related to the redisplacement of DRF [5-8]. Among these, previous meta-analyses have indicated that only dorsal comminution and age over 60 years are significant risk factors for secondary displacement [9,10]. However, we believe there are challenges with measuring dorsal comminution on plain radiographs. First, there is no consensus on the definition of dorsal comminution. Second, the interpretation of plain radiography can be vague and subjective. Third, there has been a lack of reliable research regarding each predictive factor.

Therefore, in this study, we aimed to evaluate and compare the reliability of dorsal metaphyseal comminution as a predictive factor of DRF in plain radiography.

Methods

Ethics statement: The protocol of this study was approved by the Institutional Review Board of Inje University Ilsan Paik Hospital (No. 2024-09-013). The requirement for informed consent was waived due to the retrospective study design.

1. Patient selection

We retrospectively reviewed data from 40 patients with DRF treated between March 2016 to March 2017. The inclusion criteria were patients who were (1) aged 20 years or older and (2) underwent operative treatment due to redisplacement of the fracture after closed reduction at Inje University Ilsan Paik Hospital. We selected patients who underwent surgery, as it is generally expected that patients undergoing surgical treatment have a higher degree of dorsal comminution compared to those treated nonoperatively.

We excluded (1) patients who received conservative management with minimal displacement on initial radiographs; (2) those without adequate initial or post-reduction X-rays; or (3) those with DRF associated with partial intra-articular fractures, volar Barton fractures, or chauffeur’s fractures.

2. Radiograph analysis

We conducted a retrospective radiological review of DRF patients by four raters, including two orthopedic residents and two upper extremity surgeons with 15 and 10 years of experience in hand and upper extremity surgery, respectively. All raters analyzed initial and post-reduction X-rays, including wrist posteroanterior (PA), and lateral views to assess indicators of dorsal comminution. The initial X-rays were used to identify the fracture patterns and the presence of indicators. Reliability analysis was based on the post-reduction X-rays. In determining surgical management, we considered various factors, including age, socioeconomic status, and conventional radiologic criteria such as dorsal tilting ≥10°, ulnar positive variance ≥2 mm, and intra-articular fracture displacement ≥2 mm on post-reduction radiography [11].

Because the definition of dorsal metaphyseal comminution in DRF varies across studies and lacks a standardized definition [6], we applied three radiographic criteria for dorsal comminution: (1) the raters’ subjective criteria based on their intuitive assessments (DCs); (2) the presence of a free-floating piece of dorsal cortex (DC1) [10] (Fig. 1); and (3) the presence of a dorsal cortical defect of 5 mm or greater that accounts for at least one-third of the anterior-posterior depth (DC2) (Fig. 2) [6].

Fig. 1.

The fragment detached from the distal radius is an example of a free-floating piece of the dorsal cortex (DC1), outlined by the dashed circle.

Fig. 2.

(A) A dorsal cortical defect measuring 32.6 mm, exceeding the 5 mm threshold. (B) The defect spans at least one-third of the anteroposterior depth of the articular surface, with measurements of 11.12 mm and 18.07 mm, as indicated. These measurements meet the criteria for a significant dorsal cortical defect (DC2).

3. Statistics

We measured inter-rater and intra-rater reliability using Fleiss’s or Cohen’s kappa values to determine the radiologic reliability of the predictors mentioned above [12]. Intra-rater reliability was assessed using the following protocol. In the primary analysis, an observer analyzed the initial and post-reduction wrist PA and lateral X-rays taken on the day the patient arrived at the emergency room. A second analysis was performed by the same observer on the same images two months later. Four observers evaluated the corresponding plain radiography according to the same protocol, and the results were used to determine inter-rater reliability.

Sample size estimation was performed prior to the study to ensure sufficient power for the reliability analysis. Assuming an initial kappa value (K1) of approximately 0.4 (from preliminary data) and aiming for a substantial agreement with a kappa value (K2) of 0.6, we calculated that a minimum of 40 patients would be required. This calculation was based on a 95% confidence level and 80% statistical power.

Results

We found the incidence of dorsal comminution to be 198 of 440 (45.0%) in plain radiographs analyzed by four raters. When applying the three criteria mentioned above (DC, DC1, and DC2), the frequency of dorsal comminution showed a relatively wide difference among the four raters, ranging from 25.0% to 55.0% (Table 1).

Frequency of dorsal comminution observed by each rater

Based on Fleiss’s or Cohen’s kappa values, all predictors of intra-rater reliability were higher than inter-rater reliability. The DCs criterion showed fair to good reliability, while DC1 was found to have fair reliability in both inter-rater (kappa value, 0.265) and intra-rater (kappa value, 0.346) assessments. The intra-rater reliability of DC2 showed the highest kappa value of 0.737, but the inter-rater reliability of DC2 was the lowest (0.175) (Table 2).

Reliability analysis based on Cohen’s kappa values

The inter-rater kappa values in Table 2 were calculated based on data from all raters. We further compared these values according to rater experience (experienced surgeons vs. novice doctors). Notably, the inter-rater kappa values between the two experienced surgeons (range, 0.316–0.386) were significantly higher than those between the two novice surgeons (range, 0.049–0.192). Overall, all inter-rater kappa values for experienced surgeons exceeded those for novice doctors (Table 3).

Comparison of inter-rater kappa values based on rater experience

Discussion

In this study, we aimed to assess the reliability of post-reduction predictors of dorsal comminution based on plain radiography. For a predictor to be widely used in clinical decision-making, reproducibility is a critical factor, and the results should not vary across observers. However, we found that the inter-rater reliability of dorsal comminution predictors (kappa values, 0.175 to 0.386) was much lower than each intra-rater reliability (kappa values, 0.346 to 0.737) (Table 2). The low inter-rater reliability can lead to varying outcomes among researchers and confusion in interpreting research results. Moreover, discrepancies among doctors can cause patients to distrust their clinicians.

We focused particularly on dorsal comminution because it is considered one of the most important radiologic factors for predicting reduction loss. This is why the Edinburgh Wrist Calculator (EWC) includes the presence of dorsal comminution as a predictive factor, alongside age and ulnar variance. However, many previous studies have reported that the EWC is a poor predictor of fracture redisplacement [13,14]. Furthermore, some papers argue that dorsal comminution is not a risk factor for instability [10,15]. We believe that the low validity of the EWC and conflicting opinions regarding dorsal comminution as a prognostic factor can be attributed to the low reliability of the measurement index, as there are no objective tools to measure dorsal comminution [6].

Additionally, we found that clinical experience significantly influences the reliability of radiographic interpretation (Table 3). It is supported by a previous study, which found that novice students had accuracy rates ranging from 35% to 85%, whereas graduates exhibited a narrower range of 60% to 90% [16]. This difference can be attributed to the structured organization of knowledge regarding fracture pattern and surgical experience [17]. Moreover, when accounting for the surgeon’s experience, the reliability of dorsal comminution assessment decreases even further.

To overcome this limitation, Rhee and Kim [18] previously devised a quantifying tool called the metaphyseal collapse ratio (MCR). The MCR value is calculated by dividing the maximal radiolucent width by the intercortical distance. This index showed good inter- and intra-observer agreement. However, it did not provide a prognostic analysis for reduction loss. In this regard, LaMartina et al. [6] found that volar cortical integrity can be a strong predictive factor for maintaining alignment after closed reduction. However, these studies did not perform inter- or intra-observer reliability measurements and there are controversies surrounding its predictive ability in previous studies [19,20].

We believe it is difficult to accurately predict reduction loss based solely on plain radiography before conservative treatment, as many factors—including age, osteoporosis, socioeconomic status, muscle strength, and fracture pattern—affect reduction loss [21]. For a more accurate prediction, we think a new type of post-reduction predictor is needed. Computed tomography (CT) scans could serve as a valuable auxiliary tool for predicting reduction loss to address the limitations of plain radiography [22-24]. In the future, methods based on artificial intelligence (AI) and machine learning could help solve this problem [25].

This study has some limitations. First, the small number of patients could lead to statistical errors. 40 subjects were also not enough to perform power analysis. Second, this study did not include a prognostic factor analysis regarding closed reduction loss; therefore, the definitions in our study are not suitable to be used as primary predictors of instability. Third, the three definitions for dorsal comminution were assessed without intervals, which may have introduced bias in the evaluation of the X-rays. Especially, the DCs index is subjective and can vary between raters. While this approach might reflect real-world clinical practice and insight, it lacks objectivity and reproducibility.

Conclusion

The radiological predictors of dorsal comminution evaluated in this study exhibited overall low reliability, limiting the usefulness in predicting reduction loss in DRFs. A more precise definition of dorsal comminution is necessary, and additional methods, such as CT and AI, should be considered to enhance reliability.

Notes

Conflicts of interest

The authors have nothing to disclose.

Funding

None.

References

1. Jo YH, Lee BG, Kim HS, et al. Incidence and seasonal variation of distal radius fractures in Korea: a population-based study. J Korean Med Sci 2018;33e48. 10.3346/jkms.2018.33.e48. 29359536.
2. Hevonkorpi TP, Launonen AP, Huttunen TT, Kannus P, Niemi S, Mattila VM. Incidence of distal radius fracture surgery in Finns aged 50 years or more between 1998 and 2016 - too many patients are yet operated on? BMC Musculoskelet Disord 2018;19:70. 10.1186/s12891-018-1983-0. 29499673.
3. Song J, Yu AX, Li ZH. Comparison of conservative and operative treatment for distal radius fracture: a meta-analysis of randomized controlled trials. Int J Clin Exp Med 2015;8:17023–35. 26770293.
4. Makhni EC, Ewald TJ, Kelly S, Day CS. Effect of patient age on the radiographic outcomes of distal radius fractures subject to nonoperative treatment. J Hand Surg Am 2008;33:1301–8. 10.1016/j.jhsa.2008.04.031. 18929192.
5. Altissimi M, Mancini GB, Azzarà A, Ciaffoloni E. Early and late displacement of fractures of the distal radius: the prediction of instability. Int Orthop 1994;18:61–5. 10.1007/bf02484412. 8039959.
6. LaMartina J, Jawa A, Stucken C, Merlin G, Tornetta P 3rd. Predicting alignment after closed reduction and casting of distal radius fractures. J Hand Surg Am 2015;40:934–9. 10.1016/j.jhsa.2015.01.023. 25772286.
7. Mackenney PJ, McQueen MM, Elton R. Prediction of instability in distal radial fractures. J Bone Joint Surg Am 2006;88:1944–51. 10.2106/jbjs.d.02520. 16951109.
8. Wadsten MÅ, Sayed-Noor AS, Englund E, Buttazzoni GG, Sjödén GO. Cortical comminution in distal radial fractures can predict the radiological outcome: a cohort multicentre study. Bone Joint J 2014;96-B:978–83. 10.1302/0301-620x.96b7.32728. 24986954.
9. Walenkamp MM, Aydin S, Mulders MA, Goslings JC, Schep NW. Predictors of unstable distal radius fractures: a systematic review and meta-analysis. J Hand Surg Eur Vol 2016;41:501–15. 10.1177/1753193415604795. 26420817.
10. Makhni EC, Taghinia A, Ewald T, Zurakowski D, Day CS. Comminution of the dorsal metaphysis and its effects on the radiographic outcomes of distal radius fractures. J Hand Surg Eur Vol 2010;35:652–8. 10.1177/1753193409338750. 20237191.
11. Lichtman DM, Bindra RR, Boyer MI, et al. Treatment of distal radius fractures. J Am Acad Orthop Surg 2010;18:180–9. 20190108.
12. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74. 10.2307/2529310. 843571.
13. Walenkamp MM, Mulders MA, van Hilst J, Goslings JC, Schep NW. Prediction of distal radius fracture redisplacement: a validation study. J Orthop Trauma 2018;32:e92–6. 10.1097/bot.0000000000001105. 29315197.
14. Merrill RK, Ibrahim JM, Machi AS, Raphael JS. Analysis and review of automated risk calculators used to predict postoperative complications after orthopedic surgery. Curr Rev Musculoskelet Med 2020;13:298–308. 10.1007/s12178-020-09632-0. 32418072.
15. Nesbitt KS, Failla JM, Les C. Assessment of instability factors in adult distal radius fractures. J Hand Surg Am 2004;29:1128–38. 10.1016/j.jhsa.2004.06.008. 15576227.
16. Wright C, Reeves P. Image interpretation performance: a longitudinal study from novice to professional. Radiography (Lond) 2017;23:e1–7. 10.1016/j.radi.2016.08.006. 28290353.
17. Salkowski LR, Russ R. Cognitive processing differences of experts and novices when correlating anatomy and cross-sectional imaging. J Med Imaging (Bellingham) 2018;5:031411. 10.1117/1.jmi.5.3.031411. 29795777.
18. Rhee SH, Kim J. Distal radius fracture metaphyseal comminution: a new radiographic parameter for quantifying, the metaphyseal collapse ratio (MCR). Orthop Traumatol Surg Res 2013;99:713–8. 10.1016/j.otsr.2013.05.002. 24035653.
19. Leone J, Bhandari M, Adili A, McKenzie S, Moro JK, Dunlop RB. Predictors of early and late instability following conservative treatment of extra-articular distal radius fractures. Arch Orthop Trauma Surg 2004;124:38–41. 10.1007/s00402-003-0597-6. 14608466.
20. Camelot C, Ramaré S, Lemoine J, Saillant G. Orthopedic treatment of fractures of the lower extremity of the radius by the Judet technique: anatomic results in function of the type of lesion: apropos of 280 cases. Rev Chir Orthop Reparatrice Appar Mot 1998;84:124–35. 9775056.
21. Cheecharern S. Factors affecting the redisplacement of the conservatively treated extra articular fractures of distal radius. J Med Assoc Thai 2009;92 Suppl 6:S239–43. 20120693.
22. Dankelman LH, Barvelink B, Verhofstad MH, Wijffels MM, Colaris JW. Traditional radiography versus computed tomography to assess reduced distal radius fractures. Eur J Trauma Emerg Surg 2024;50:2313–21. 10.1007/s00068-024-02598-5. 38985187.
23. Hruby LA, Haider T, Laggner R, et al. Standard radiographic assessments of distal radius fractures miss involvement of the distal radioulnar joint: a diagnostic study. Arch Orthop Trauma Surg 2022;142:1075–82. 10.1007/s00402-021-03801-7. 33558991.
24. Kleinlugtenbelt YV, Madden K, Groen SR, et al. Can experienced surgeons predict the additional value of a CT scan in patients with displaced intra-articular distal radius fractures? Strategies Trauma Limb Reconstr 2017;12:91–97. 10.1007/s11751-017-0283-9. 28439818.
25. Oude Nijhuis KD, Dankelman LH, Wiersma JP, et al. AI for detection, classification and prediction of loss of alignment of distal radius fractures; a systematic review. Eur J Trauma Emerg Surg 2024;50:2819–31. 10.1007/s00068-024-02557-0. 38981869.

Article information Continued

Fig. 1.

The fragment detached from the distal radius is an example of a free-floating piece of the dorsal cortex (DC1), outlined by the dashed circle.

Fig. 2.

(A) A dorsal cortical defect measuring 32.6 mm, exceeding the 5 mm threshold. (B) The defect spans at least one-third of the anteroposterior depth of the articular surface, with measurements of 11.12 mm and 18.07 mm, as indicated. These measurements meet the criteria for a significant dorsal cortical defect (DC2).

Table 1.

Frequency of dorsal comminution observed by each rater

Variable Rater 1 (n = 40) Rater 2 (n = 40) Rater 3 (n = 40) Rater 4 (n = 40)
DCs 18 (45.0) 18 (45.0) 14 (35.0) 20 (50.0)
DC1 22 (55.0) 19 (47.5) 21 (52.5) 22 (55.0)
DC2 - 18 (45.0) 16 (40.0) 10 (25.0)

Values are presented as number (%).

DCs, dorsal comminution (subjective); DC1, dorsal comminution definition 1: the presence of a free-floating piece of dorsal cortex; DC2, dorsal comminution definition 2: the presence of a dorsal cortical defect measuring 5 mm or greater that accounted for at least one-third of the anterior to posterior depth.

Table 2.

Reliability analysis based on Cohen’s kappa values

Variable Inter-rater
Intra-rater
Kappa (95% CI)a) Strength of agreement Kappa (95% CI) Strength of agreement
DCs 0.306 (0.011 to 0.601) Fair 0.609 (0.367 to 0.854) Good
DC1 0.265 (–0.034 to 0.563) Fair 0.346 (0.056 to 0.637) Fair
DC2 0.175 (–0.130 to 0.480) Poor 0.737 (0.527 to 0.946) Good

CI, confidence interval; DCs, dorsal comminution (subjective); DC1, dorsal comminution definition 1: the presence of a free-floating piece of dorsal cortex; DC2, dorsal comminution definition 2: the presence of a dorsal cortical defect measuring 5 mm or greater that accounted for at least one-third of the anterior to posterior depth.

a)

Fleiss’s or Cohen’s kappa value.

Table 3.

Comparison of inter-rater kappa values based on rater experience

Variable Novice doctor
Experienced surgeon
Kappa (95% CI) Strength of agreement Kappa (95% CI) Strength of agreement
DCs 0.192 (–0.151 to 0.479) Poor 0.386 (0.079 to 0.670) Fair
DC1 0.049 (–0.271 to 0.346) Poor 0.346 (0.079 to 0.600) Fair
DC2 0.145 (–0.168 to 0.450) Poor 0.316 (–0.026 to 0.609) Fair

CI, confidence interval; DCs, dorsal comminution (subjective); DC1, dorsal comminution definition 1: the presence of a free-floating piece of dorsal cortex; DC2, dorsal comminution definition 2: the presence of a dorsal cortical defect measuring 5 mm or greater that accounted for at least one-third of the anterior to posterior depth.