Preprint
Article

Inter-rater Agreement for Diagnosing Adenomyosis Using Magnetic Resonance Imaging and Transvaginal Ultrasonography

Altmetrics

Downloads

125

Views

34

Comments

0

A peer-reviewed article of this preprint also exists.

Submitted:

30 May 2023

Posted:

01 June 2023

You are already at the latest version

Alerts
Abstract
Our aim was to compare the inter-rater agreement of Transvaginal ultrasonography (TVS) with Magnetic Resonance Imaging (MRI) regarding diagnosing adenomyosis and for various predefined imaging features of adenomyosis in the same set of women. MRIs were assessed by four experienced radiologists and 2D TVS videoclips and 3D ultrasound volumes were assessed by five experienced sonographers. Each rater subjectively evaluated the presence or absence of adenomyosis, assessed various imaging. Fleiss kappa (κ) was used to reflect inter-rater agreement for categorical data and the Intraclass correlation coefficient (ICC) to reflect the reliability of quantitative data. Agreement between raters for diagnosing adenomyosis was higher for TVS than for MRI (κ =0.42 vs.0.28). MRI had a higher inter-rater agreement in assessing wall asymmetry irregular Junctional Zone (JZ) presence of myometrial cysts, while TVU had a better agreement for globular shape. MRI showed a moderate-good reliability for measuring the JZ (ICC=0.57-0.82). For TVS, JZ was unmeasurable in > 50% of cases and the remaining cases had a low reliability (ICC=-0.31-0.08). We found that Inter-rater agreement for diagnosing adenomyosis was higher for TVS than for MRI, despite that MRI showed a higher inter-rater agreement in most specific features. Measurements of JZ in the coronal plane with 3D TVS were unreliable and thus unlikely to be useful for diagnosing adenomyosis.
Keywords: 
Subject: Medicine and Pharmacology  -   Obstetrics and Gynaecology

1. Introduction

Adenomyosis is a benign uterine disease characterized by the presence of ectopic endometrial glands and stroma within the myometrial layer, surrounded by an area of hypertrophic myometrium [1]. Symptomatology of adenomyosis includes heavy menstrual bleeding and pelvic pain [2-4]. Traditionally, the diagnosis of adenomyosis was only possible through histological examination after hysterectomy. However, advancements in medical imaging techniques, specifically Magnetic Resonance Imaging (MRI) and Transvaginal Ultrasonography (TVS), have enabled non-invasive diagnosis of adenomyosis
MRI has been used as a diagnostic tool for adenomyosis, with the increased thickness of the Junctional Zone (JZ) with a suggested cut-off of 12mm [5], and the presence of myometrial cysts being a common criteria[6]. The principal limitation of MRI is the absence of a definable junctional zone on imaging, which occurs in 20% of premenopausal women [5].
Later studies have suggested additional features, such as an irregular appearance of the JZ and its relationship with the thickness of the entire myometrium [7-10]. Another diagnostic feature is presence of small punctate cystic foci located within the JZ [7, 11]. The diagnosis of adenomyosis by MRI is highly reproducible [9, 12] with high inter-rater agreement for various JZ measurements [9].
TVS, on the other hand, utilizes two-dimensional (2D) and three-dimensional (3D) imaging techniques to assess adenomyosis. The sonographic features used for diagnosing adenomyosis are well describe using TVS [13-16]. A recent consensus paper by the MUSA (Morphological Uterus Sonographic Assessment) consortium distinguish between direct features of adenomyosis i.e., myometrial cysts, hyperechogenic islands and echogenic subendometrial lines and buds, indicating presence of ectopic endometrial tissue in the myometrium, and indirect features, features reflecting changes in the myometrium secondary to presence of endometrial tissue in the myometrium, i.e. globular uterus, asymmetrical myometrial thickening, fan-shaped shadowing, translesional vascularity, irregular junctional zone and interrupted junctional zone [17]. The JZ is poorly visualized with 2D TVS. Three dimensional (3D) TVS offer the possibility to assess the coronal plane and to use VCI (Volume Contrast Imaging, i.e. thick slice) to improve visualization of the JZ which facilitates evaluation of thickness and irregularity [14, 18, 19]. Reproducibility studies have shown a high level of agreement when evaluating the presence or absence of adenomyosis using TVS [17, 20-22], but less agreement when assessing different ultrasound features of the disease [20, 21].
The aim of this study was to compare the inter-rater agreement of TVS with MRI regarding diagnosing adenomyosis and regarding the assessment of predefined imaging features. By assessing both modalities in the same set of women, we aim to provide insights into their respective diagnostic capabilities and agreement levels.

2. Materials and Methods

2.1. Study Design and Eligibility Criteria

Women aged 35-50 years with heavy regular menstrual bleeding and suspected adenomyosis on clinical examination (including TVS) were recruited in a private gynecologic clinic in Stockholm between January 2014 and December 2016 and referred to MRI and expert TVS as part of the investigation. All women were clinically examined and recruited by the same gynecologist (JA). Women with adenomyoma, known endometriosis, uterine leiomyomas >4cm, multiple leiomyomas (>3) or current use of intrauterine device or hormonal contraception were not eligible for the study.
In total 67 women were recruited and referred to MRI and TVS. MRI was missing in 3 women (declined examination, n=2; wrong identification number, n=1) and TVS in 13 women (images were not pseudonymized, n=2; 3D volumes, n=6; or 2D video sequences n=5 were not recorded or of insufficient quality). Both MRI and TVS images were available in 51 women and included in the study. MRIs were assessed by four experienced radiologists and pre-recorded 2D TVS videoclips and 3D volumes were assessed by five experienced gynecological ultrasonographers. Assessment of the images was performed between December 2019 and February 2020. The raters were blinded to the clinical history, physical examination and the evaluation of MRI and TVS images made by other raters.

2.2. MRI Examination and Assessment

MRI of the pelvis was performed in an outpatient facility on a 1.5T system (Optima MR450w, GE Healthcare, Waukesha, WI, USA or Siemens Magnetom Symphony Tim, Siemens Healthineers, Erlangen, Germany). The minimum protocol included the following sequences: T2-weigthed Fast Relaxation Fast Spin Echo (FRFSE) or Turbo Spin Echo (TSE) in the axial, sagittal and coronal plane (slice thickness 4-5 mm; gap: 10-20%); T1-weigthed Fast Spin Echo (FSE) or a Gradient Echo (GRE) in the axial and coronal plane (slice thickness 5 mm; gap 10-20%). All examinations were performed with a phased array coil. The women were asked to fast for 4 hours before the examination. Antispasmodic drugs were not administered.
The images were pseudonymized and evaluated on a Picture Archiving and Communication System (PACS; IDS7 version 21.1, Sectra AB, Linköping, Sweden) at the Karolinska University Hospital by four experienced radiologists. Raters could save their assessments and resume at a later time, to reduce risk of fatigue. With regard to the presence or absence of adenomyosis, each rater based the assessment on their subjective evaluation of the radiological features. There were no standardized criteria given on when to make the diagnosis. The predefined MRI features assessed are listed in Table 1 and shown in Figure 1.

2.3. TVS Examination and Assessment

All women underwent ultrasound examination by a single expert examiner (EE) at the Karolinska University Hospital using a high-end ultrasound system Voluson E10 or E8, GE Healthcare (GE Medical Systems, Zipf, Austria) with a 5-9 MHz 3D transvaginal probe. 2D grayscale, videoclips and 3D-VCI grayscale volumes including the whole uterine body were saved. The GE 4D View software (GE Healthcare, Wood Dale, IL, USA) was used to assess the 3D-VCI volumes. The pseudonymized video-clips and 3D volumes for each case were downloaded to memory sticks and sent to five experienced ultrasonographers. The raters used their own personal computers to assess the volumes. They were encouraged to use high-resolution computer screens and to perform the assessments in a dark room to avoid glare on the screen. The raters could save their assessments and resume later, to reduce risk of fatigue. The volumes were saved in the VCI format with a 2 mm thickness and with a grey mix of 70% X-ray/30% surface smooth. The raters could modify the volume during the analysis to optimize the assessment (remove the VCI function, change slice thickness or grey mix, rotate the volume in any plane). With regard to the presence or absence of adenomyosis, each rater based the assessment on their subjective evaluation of different ultrasonographic features, using pattern recognition [13]. The measurement of the anterior and posterior wall thickness was done in a longitudinal plane and the measurement of the junctional zone (JZ max and JZ min) in the reconstructed coronal plane from the 3D volume. The predetermined TVS features assessed are listed in Table 2 and shown in Figure 2a and 2b.

2.4. Statistical Analysis

Each rater entered the assessments into the Research Electronic Data Capture (REDCap®, Vanderbilt University) data entry and management program [23, 24] hosted at the Karolinska Institutet. REDCap is a secure, web-based software platform designed to support data capture for research studies, providing automated export procedures for data downloads to common statistical packages. Statistical Data Analysis was performed using the Software (SPSS), version 26, IBM Corporation, Armonk, NY, USA.
Fleiss kappa (κ) was used as a measure of inter-rater agreement for categorical data. Kappa values were categorized as ‘Poor’ (κ≤0.20), ‘Fair’(0.21-0.40), ‘Moderate’ (0.41-0.60), ‘Good’(0.61-0.80), and ‘Very good’(0.81-1.00) [25].
The Intraclass correlation coefficient (ICC) was used as a measure of reliability for quantitative data, categorized as ‘Poor’ (≤0.5), ‘Moderate’ (0.5-0.75), ‘Good’ (0.75-0.9) and ‘Excellent’ (>0.9) and their 95% confident intervals were calculated based on individual-rating, absolute-agreement, 2-way random effects model [26, 27].

3. Results

The inter-rater agreement for diagnosing adenomyosis and for the individual imaging features are presented in Table 3 and 4.
The five raters of ultrasound images classified adenomyosis as present in 51%, 49%, 39%, 37% and 76% of the cases and the four raters of MRI classified the disease as present in 88%, 43%, 49% and 61% respectively.
The inter-rater agreement (κ=, [95% CI]) for diagnosis of adenomyosis was higher for TVS (κ =0.42, [.417-.422]) than for MRI (κ =0.28, [.28-.287]). For MRI the inter-rater agreement was moderate for wall asymmetry and irregular JZ and poor for globular uterine shape. For TVS the inter-rater agreement was moderate for wall asymmetry and globular uterine shape, fair for irregular JZ, fan-shaped shadowing, subendometrial buds and lines and hyperechogenic islands.
The assessment of cysts in the JZ/myometrium had fair agreement in MRI and cysts in the myometrium had poor agreement in TVS (κ =.327, [.324-.331] vs. κ =.192, [.19-.195]).
The reliability for JZmax was good (ICC=.821, [.709-.898]) for MRI. For TVS, the JZmax was classified as “not assessable” by one or more rater in 29/51 cases and ICC was unreliable in the remaining 22 cases (ICC=.082, [-0.11-.252]).
For other continuous data assessed with MRI, ICC showed good reliability for myometrial thickness and JZ differential (JZdiff) and a moderate reliability for JZmin and Ratio JZmax/Myometrium.
The raters of MRIs considered the quality of the images to be medium to high in 47%, 90%, 88% and 69% of the cases, while raters of TVS volumes and video clips considered medium to high quality in 82%, 86%, 67%, 76% and 88% of the cases (Table 5). In 71%, 94%, 98%, and 80% of the MRI cases and 96%, 94%, 74%, 80% and 78% of the TVS cases the raters were medium or highly confident in their evaluation (Table 5). Preprints 75201 i001

4. Discussion

We found that the inter-rater agreement for diagnosing adenomyosis was higher for TVS than for MRI, despite the inter-rater agreement for most individual imaging features being higher for MRI than for TVS. Moreover, MRI showed a clearly higher reliability than TVS for continuous variables. Since MRI had a higher agreement for most individual images features that were assessed by both TVS and MRI it is remarkable that the inter-rater agreement for diagnosing adenomyosis was lower for MRI than for TVS. Lack of standardized criteria for diagnosing adenomyosis for MRI is the most likely reason. Since ICC for JZmax was good, the agreement for diagnosing adenomyosis with MRI may have improved if a cut off for JZ max had been used as criterion. However, using the JZ as the only criteria for adenomyosis is questioned [9, 10]. Also, the absence of cysts may have affected the result. Intramyometrial cysts are pathognomonic for the disease but are found in only one third to half of affected women [7, 8, 10]. Some of the participating radiologists may have excluded the diagnosis when no cysts were found, even when altered JZ features were present. The limited agreement for cysts may negatively have affected the agreement for diagnosis. A recent meta-analysis and review on the performance of various objective criteria diagnosing adenomyosis, using MRI, conclude that most parameters have a relatively low sensitivity and a relatively high specificity [28]. JZ characteristics remain the most widely used and investigated with acceptable diagnostic accuracy. Specific research is needed into how these objective measures of adenomyosis can be correlated to clinical outcomes.
For TVS, the inter-rater agreement was fair or moderate for most of the individual ultrasound features, and moderate for diagnosing adenomyosis. This is in line with results of other studies [18, 20] showing a good reproducibility diagnosing adenomyosis using 2D TVS pattern recognition. When an ultrasound diagnosis of adenomyosis is made using pattern recognition, all the different ultrasound features are taken into account. This may explain why agreement regarding diagnosis was higher than agreement for most individual features. When combined, the subjective overall agreement if adenomyosis is present or not becomes higher than the agreement of various variables. The inter-rater agreement for cysts in the myometrium was poor. Small cysts in the myometrium may be difficult to detect with TVS, especially when other features, such as shadowing, is present. In this study, globular uterus shape and wall asymmetry showed the highest agreement between raters, whereas other studies have reported the highest agreement for irregular JZ [20, 21].
With 3D TVS, it is possible to visualize the JZ. However, JZ measurements with 3D TVS has been shown to have limited reproducibility [20-22]. In our study, there was missing data from >50% of the TVS cases, since cases were excluded from the ICC analysis if one rater classified the JZ as “not assessable”, even though the other raters measured the JZ. Moreover, results were unreliable in the cases where all the TVS raters measured the JZ, indicating low diagnostic value in clinical practice. One reason may be low quality of 3D volumes in women with adenomyosis, as the abundant scattering of the ultrasound beam results in poor image quality in the reconstructed coronal plane, making assessment difficult. Moreover, the coronal plane may not be the correct plane to measure JZ. A recent update on the MUSA consensus paper suggest to assess the regularity of the junctional zone in multiple planes (transversal, longitudinal, coronal) using 3D ultrasound, since a regular JZ can rule out adenomyosis, while measurements of the JZ was dismissed because of lack of evidence of the clinical relevance of this measurement [30].
A recent meta-analysis showed that MRI and TVS had adequate performance with regard to diagnosing adenomyosis, with a pooled sensitivity and specificity of 75% and 81% for TVS and 69% and 80% for MRI, p=0.75, when hysterectomy was used as gold standard [29]. Still, both modalities have shown unsatisfactory inter-rater agreement for the diagnosis, indicating that adenomyosis is challenging even for experts. Clear definitions and criteria along with more standardized interpretation models for imaging are needed for both MRI and TVS to make the diagnosis more reliable.
A strength of the study is the large number of cases examined with both imaging modalities and the enrollment of raters from different centers. For TVS, expert raters from different centers in Europe were included, which increases the generalizability of the study. Unfortunately, this was not possible for MRI.
Despite the TVS images were recorded off-line and a dedicated "state-of-the-art" MRI was not applied, the majority of raters considered the quality of the images medium or good and were confident in their evaluation. Although suboptimal image quality, it still appears acceptable for assessing the required parameters and reflects the reality in a clinical set-up.
The use of the RedCap database reduced human error in the handling of data to a minimum and ensured complete datasets. All questions were mandatory and thus had to be answered before moving to the next case. There is “missing data” only for the JZ measurements, where it was possible to classify the JZ as “not assessable”.
A limitation of the study is the use of stored off-line TVS videos and volumes instead of real-time examinations. However, it would be impossible to do reproducibility studies with multiple raters in TVS without using recorded material. Even for MRI, the quality of the images was not optimal. The examinations were performed in a private radiological outpatient center where neither abdominal belt nor antispasmodic agent was used to reduce motion artefacts caused by small bowel peristalsis. Several MRIs were affected by artefacts, thus hampering the quality of the images. However, consensus guidelines suggesting technical protocols for MR imaging of endometriosis were published after the enrollment of the study subjects [31, 32]. Furthermore, no oblique axial T2-weighted sequence perpendicular to the long uterine axis was included in the MRI protocol, which is useful for the assessment of adenomyosis [8, 10]. If cases with adenomyosis confirmed by histology and images with excellent quality had been chosen, the results may have been different. Since the study investigated the agreement between raters it is not necessary to have a gold standard for comparison. The current set-up gives information on a real-life setting.

5. Conclusions

The inter-rater agreement for diagnosing adenomyosis was higher for TVS than for MRI despite MRI manifesting higher inter-rater agreement in most variables, in particular variables related to measuring the junctional zone. Measurement of JZ thickness in the coronal plane with 3D TVS could only be done in less than half of the women and was found to be unreliable in the rest, and is therefore unlikely to be useful for diagnosing adenomyosis.

Author Contributions

Conceptualization, J.K.A, K.G.D. and E.E.; methodology, J.K.A, K.G.D., L.V. and E.E formal analysis, J.K.A, K.G.D. and E.E; investigation, all authors.; data curation, all authors.; writing—original draft preparation, J.K.A, K.G.D, E.E; writing—review and editing, all authors.; supervision, E.E, K.G.D project administration, J.K.A.; funding acquisition, E.E, K.G.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by This study was financed by grants from the governmental research fund Region Stockholm’s ALF-medicine ‘Stockholms Läns Landsting’ (grant 20190202), The Swedish Research Council (grant no 2020-01702).

Institutional Review Board Statement

The study was approved by the Swedish Ethical Authority ‘Etikprövningsmyndigheten’(Dnr 2016/1751-32).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Database available on request, images not available.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Bird CC, McElin TW, Manalo-Estrella P. The elusive adenomyosis of the uterus--revisited. Am J Obstet Gynecol. 1972;112(5):583-93. [CrossRef]
  2. Cockerham AZ. Adenomyosis: A Challenge in Clinical Gynecology. Journal of Midwifery & Womens Health. 2012;57(3):212-20. [CrossRef]
  3. Pinzauti S, Lazzeri L, Tosti C, Centini G, Orlandini C, Luisi S, et al. Transvaginal sonographic features of diffuse adenomyosis in 18-30-year-old nulligravid women without endometriosis: association with symptoms. Ultrasound Obstet Gynecol. 2015;46(6):730-6. [CrossRef]
  4. Sammour A, Pirwany I, Usubutun A, Arseneau J, Tulandi T. Correlations between extent and spread of adenomyosis and clinical symptoms. Gynecol Obstet Invest. 2002;54(4):213-6. [CrossRef]
  5. Bazot M, Darai E. Role of transvaginal sonography and magnetic resonance imaging in the diagnosis of uterine adenomyosis. Fertil Steril. 2018;109(3):389-97. [CrossRef]
  6. Reinhold C, McCarthy S, Bret PM, Mehio A, Atri M, Zakarian R, et al. Diffuse adenomyosis: Comparison of endovaginal US and MR imaging with histopathologic correlation. Radiology. 1996;199(1):151-8. [CrossRef]
  7. Bazot M, Cortez A, Darai E, Rouger J, Chopier J, Antoine JM, et al. Ultrasonography compared with magnetic resonance imaging for the diagnosis of adenomyosis: correlation with histopathology. Hum Reprod. 2001;16(11):2427-33. [CrossRef]
  8. Dueholm M, Lundorf E, Hansen ES, Sorensen JS, Ledertoug S, Olesen F. Magnetic resonance imaging and transvaginal ultrasonography for the diagnosis of adenomyosis. Fertil Steril. 2001;76(3):588-94. [CrossRef]
  9. Tellum T, Matic GV, Dormagen JB, Nygaard S, Viktil E, Qvigstad E, et al. Diagnosing adenomyosis with MRI: a prospective study revisiting the junctional zone thickness cutoff of 12 mm as a diagnostic marker. Eur Radiol. 2019. [CrossRef]
  10. Dueholm M, Lundorf E. Transvaginal ultrasound or MRI for diagnosis of adenornyosis. Curr Opin Obstet Gynecol. 2007;19(6):505-12.
  11. Reinhold C, Tafazoli F, Mehio A, Wang L, Atri M, Siegelman ES, et al. Uterine adenomyosis: Endovaginal US and MR imaging features with histopathologic correlation. Radiographics. 1999;19:S147-S60. [CrossRef]
  12. Dueholm M, Lundorf E, Sorensen JS, Ledertoug S, Olesen F, Laursen H. Reproducibility of evaluation of the uterus by transvaginal sonography, hysterosonographic examination, hysteroscopy and magnetic resonance imaging. Hum Reprod. 2002;17(1):195-200. [CrossRef]
  13. Exacoustos C, Brienza L, Di Giovanni A, Szabolcs B, Romanini ME, Zupi E, et al. Adenomyosis: three-dimensional sonographic findings of the junctional zone and correlation with histology. Ultrasound Obstet Gynecol. 2011;37(4):471-9. [CrossRef]
  14. van den Bosch T, Dueholm M, Leone FPG, Valentin L, Rasmussen CK, Votino A, et al. Terms, definitions and measurements to describe sonographic features of myometrium and uterine masses: a consensus opinion from the Morphological Uterus Sonographic Assessment (MUSA) group. Ultrasound Obstet Gynecol. 2015;46(3):284-98. [CrossRef]
  15. Van den Bosch T, Van Schoubroeck D. Ultrasound diagnosis of endometriosis and adenomyosis: State of the art. Best Pract Res Clin Obstet Gynaecol. 2018;51:16-24.
  16. Lazzeri L, Morosetti G, Centini G, Monti G, Zupi E, Piccione E, et al. A sonographic classification of adenomyosis: interobserver reproducibility in the evaluation of type and degree of the myometrial involvement. Fertil Steril. 2018;110(6):1154-61.e3. [CrossRef]
  17. Harmsen MJ, Van den Bosch T, de Leeuw RA, Dueholm M, Exacoustos C, Valentin L, et al. Consensus on revised definitions of Morphological Uterus Sonographic Assessment (MUSA) features of adenomyosis: results of modified Delphi procedure. Ultrasound Obstet Gynecol. 2022;60(1):118-31. [CrossRef]
  18. Naftalin J, Hoo W, Nunes N, Mavrelos D, Nicks H, Jurkovic D. Inter- and intraobserver variability in three-dimensional ultrasound assessment of the endometrial-myometrial junction and factors affecting its visualization. Ultrasound Obstet Gynecol. 2012;39(5):587-91. [CrossRef]
  19. Luciano DE, Exacoustos C, Albrecht L, LaMonica R, Proffer A, Zupi E, et al. Three-Dimensional Ultrasound in Diagnosis of Adenomyosis: Histologic Correlation With Ultrasound Targeted Biopsies of the Uterus. J Minim Invasive Gynecol. 2013;20(6):803-10. [CrossRef]
  20. Puente JM, Alcazar JL, Martinez-Ten P, Bermejo C, Troncoso MT, Garcia-Velasco JA. Interobserver agreement in the study of 2D and 3D sonographic criteria for adenomyosis. J Endometr Pelvic Pain Disord. 2017;9(3):211-5. [CrossRef]
  21. Rasmussen CK, Hansen ES, Dueholm M. Inter-rater agreement in the diagnosis of adenomyosis by 2- and 3-dimensional transvaginal ultrasonography. J Ultrasound Med. 2019;38(3):657-66.
  22. Rasmussen CK, Van den Bosch T, Exacoustos C, Manegold-Brauer G, Benacerraf BR, Froyman W, et al. Intra- and Inter-Rater Agreement Describing Myometrial Lesions Using Morphologic Uterus Sonographic Assessment: A Pilot Study. J Ultrasound Med. 2019;38(10):2673-83. [CrossRef]
  23. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-81. [CrossRef]
  24. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95:103208. [CrossRef]
  25. Brennan P, Silman A. Statistical methods for assessing observer variability in clinical measures. BMJ. 1992;304(6840):1491-4. [CrossRef]
  26. Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15(2):155-63. [CrossRef]
  27. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420-8.
  28. Rees CO, Nederend J, Mischi M, van Vliet H, Schoot BC. Objective measures of adenomyosis on MRI and their diagnostic accuracy-a systematic review & meta-analysis. Acta Obstet Gynecol Scand. 2021;100(8):1377-91. [CrossRef]
  29. Alcazar JL, Vara J, Usandizaga C, Ajossa S, Pascual MA, Guerriero S. Transvaginal ultrasound versus magnetic resonance imaging for diagnosing adenomyosis: A systematic review and head-to-head meta-analysis. Int J Gynaecol Obstet. 2023;161(2):397-405 . [CrossRef]
  30. Tellum T, Nygaard S, Lieng M. Noninvasive Diagnosis of Adenomyosis: A Structured Review and Meta-analysis of Diagnostic Accuracy in Imaging. J Minim Invasive Gynecol. 2020;27(2):408-18 e3. [CrossRef]
  31. Bazot M, Bharwani N, Huchon C, Kinkel K, Cunha TM, Guerra A, et al. European society of urogenital radiology (ESUR) guidelines: MR imaging of pelvic endometriosis. Eur Radiol. 2017;27(7):2765-75. [CrossRef]
  32. Tong A, VanBuren WM, Chamié L, Feldman M, Hindman N, Huang C, et al. Recommendations for MRI technique in the evaluation of pelvic endometriosis: consensus statement from the Society of Abdominal Radiology endometriosis disease-focused panel. Abdom Radiol (NY). 2020;45(6):1569-86. [CrossRef]
Figure 1. a-b. MRI features of adenomyosis: T2-weighted sagittal images from two different subjects with adenomyosis. Figure 1a. JZmax, the thickest part of the JZ in the midsagittal plane (orange double arrow). JZmin, the thinnest part of the JZ in the midsagittal plane (cervix excluded) (green double arrow). Myometrial thickness, measured at the same level as JZmax (orange dotted double arrow). Figure 1b. Example of a uterus with globular shape and asymmetric thickening of JZ (anterior JZ thicker than posterior JZ). The JZ is irregular due to the presence of multiple hyperintense cystic foci within the thickened JZ.
Figure 1. a-b. MRI features of adenomyosis: T2-weighted sagittal images from two different subjects with adenomyosis. Figure 1a. JZmax, the thickest part of the JZ in the midsagittal plane (orange double arrow). JZmin, the thinnest part of the JZ in the midsagittal plane (cervix excluded) (green double arrow). Myometrial thickness, measured at the same level as JZmax (orange dotted double arrow). Figure 1b. Example of a uterus with globular shape and asymmetric thickening of JZ (anterior JZ thicker than posterior JZ). The JZ is irregular due to the presence of multiple hyperintense cystic foci within the thickened JZ.
Preprints 75201 g001
Figure 2. a-b. TVS features and measurments in women with adenomyosis. 2a/ Measurement of uterine wall thickness, in longitudinal plane and junctional zone form 3D reconstructed coronal plane. 2b/ Examples of sonographic features of adenomyosis.
Figure 2. a-b. TVS features and measurments in women with adenomyosis. 2a/ Measurement of uterine wall thickness, in longitudinal plane and junctional zone form 3D reconstructed coronal plane. 2b/ Examples of sonographic features of adenomyosis.
Preprints 75201 g002
Table 1. MRI features included in the assessment.
Table 1. MRI features included in the assessment.
JZ1max Maximal JZ thickness (mm). thickest part of the JZ in the midsagittal plane.
JZmin Minimal JZ thickness (mm). Thinnest part of the JZ in the midsagittal plane.
Myometrial thickness The thickness (mm) of the uterine wall at the same level as JZmax.
JZdiff JZ differential (mm). Difference between the JZmax and JZmin.
JZmax/Myometrial thickness The extent of the uterine wall that is affected by adenomyosis (%), JZmax divided by myometrial thickness measured at the same level
Appearance of JZ a) Not visible or not assessable b) Regular JZ: the inner and outer borders of the JZ are well defined c) Irregular JZ; presence of focal thickening of the JZ and/or presence of cystic foci of high signal intensity.
Cysts Cystic changes in the JZ (defined as foci of high signal intensity on T2-weighted images). Absent/Present.
Globular uterine shape Subjective evaluation of the uterine corpus being globular shaped, and not due to fibroids. Globular yes/no.
Wall asymmetry Subjective evaluation of the anterior and posterior wall thickness. Yes/no.
Diagnosis Assessment of the images. Does the subject have adenomyosis? Yes/No
Image Quality Evaluation of the quality of the images. Low/Moderate/High
Diagnostic confidence Examiner confidence in their assessment. Low/Medium/High
1 Junctional Zone (JZ).
Table 2. TVS features included in the assessment.
Table 2. TVS features included in the assessment.
JZ1max Maximal JZ thickness (mm), measured in the reconstructed coronal plan from the 3D2 volume.
JZmin Minimal JZ thickness (mm), measured in the reconstructed coronal plane from 3D2 volume.
Globular uterine shape Subjective evaluation of the uterine corpus being globular shaped, and not due to fibroids. Yes/No.
Wall asymmetry Subjective evaluation of the anterior and posterior wall thickness. Are the walls asymmetric? Yes/No
Appearance of JZ Assessment of the JZ irregularity. Regular/Irregular
Fanshaped shadows Are fanshaped shadowing present in the myometrium? Yes/No.
Buds/Striations Are endometrial buds/striations present in the myometrium? Yes/No
Hyperechogenic Islands Are hyperechogenic islands present in the myometrium? Yes/No
Cysts Presence of myometrial cysts? Yes/No
Diagnosis Assessment of the images. Does the subject have adenomyosis? Yes/No.
Quality Evaluation of the quality of the images. Low/Moderate /High
Confidence Examiner confidence in the assessment. Low/Medium/High
1 Junctional zone (JZ), 2 Three Dimensional (3D).
Table 3. Interrater agreement for Categorical data presented with Fleiss kappa.
Table 3. Interrater agreement for Categorical data presented with Fleiss kappa.
Variable MRI TVS
Kappa 95% CI Kappa 95% CI
Globular uterus shape .199 .195-.202 .482 .48-.485
Wall asymmetry .552 .548-.556 .414 .411-.417
Irregular JZ1 .527 .522-.531 .309 .307-.312
Cysts in the JZ/Myometrium .327 .324-.331 .192 .190-.195
Fanshaped shadowing - - .357 .354-.359
Buds or Striations - - .209 .206-.211
Hyperechogenic Islands - - .289 .286-.292
Diagnosis .283 .280-.287 .420 .417-.422
1 Junctional Zone (JZ).
Table 4. Interrater reliability for continuous data presented with Intraclass correlation, ICC.
Table 4. Interrater reliability for continuous data presented with Intraclass correlation, ICC.
Variable MRI TVS
ICC 95% CI ICC 95% CI
JZ1max .8212 .709-.898 .0823 -.11- 0.252
JZmin .5722 .408-.724 -.314 -.67- -.104
JZmax/Myometrial thickness .8302 .739-.900 - -
RatioJZmax/Myometrium .5702 .382-.731 - -
JZmax-JZmin (JZdiff) .7132 .583-.823 - -
1 Junctional Zone (JZ). 2 Missing value: 15 cases are excluded since at least one rater evaluated JZ as “not assessable”. 3 Missing value: 29 cases are excluded since at least one rater evaluated JZ as “not assessable”.4 Missing value: 42 cases are excluded since at least one rater evaluated JZ as “not assessable”.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2024 MDPI (Basel, Switzerland) unless otherwise stated