Skip to main content
Erschienen in: Head and Neck Pathology 4/2022

13.07.2022 | Original Paper

Inter- and Intrarater Reliability and Agreement Among Danish Head and Neck Pathologists Assessing Extranodal Extension in Lymph Node Metastases from Oropharyngeal Squamous Cell Carcinomas

verfasst von: Chadi Nimeh Abdel-Halim, Max Rohde, Stine Rosenkilde Larsen, Tina Marie Green, Benedicte Parm Ulhøi, Nina Claire Woller, Oke Gerke, Poul Flemming Høilund-Carlsen, Jens Ahm Sørensen, Christian Godballe

Erschienen in: Head and Neck Pathology | Ausgabe 4/2022

Einloggen, um Zugang zu erhalten

Abstract

Background

Extranodal extension (ENE) in lymph node metastases is one of the most important prognostic factors in head and neck squamous cell carcinomas. Studies have shown inconsistency among pathologists in the assessment of ENE. The aims of this study were: (1) to determine the interrater and intrarater reliability and agreement in the assessment of ENE among Danish pathologists and (2) to test if a standardized assessment method may increase interrater agreement.

Methods

Four Danish head and neck pathologists assessed ENE presence or absence in 120 histological slides from lymph nodes with oropharyngeal squamous cell carcinoma metastases (first round). Subsequently, guidelines were introduced to the pathologists and a new assessment was performed (second round). Finally, two of the pathologists assessed the slides to determine intrarater reliability and agreement (third round).

Results

Interrater kappa coefficients varied between 0.57 and 0.67 in the first round and between 0.59 and 0.72 in the second round. The intrarater agreement between round 2 and 3 was 0.88 for pathologist 1 and 0.92 for pathologist 2 with resulting kappa coefficients of 0.76 (95% CI 0.64–0.88) and 0.84 (95% CI 0.74–0.94), respectively.

Conclusion

We found a moderate level of reliability and agreement among pathologists for ENE in lymph node metastases from oropharyngeal squamous cell carcinomas. The intrarater reliability and agreement was generally higher than interrater measures. Interrater agreement was slightly improved by standardized assessment.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
2.
Zurück zum Zitat Argiris A, Karamouzis MV, Raben D, Ferris RL. Head and neck cancer. Lancet. 2008;371:1695–709.CrossRef Argiris A, Karamouzis MV, Raben D, Ferris RL. Head and neck cancer. Lancet. 2008;371:1695–709.CrossRef
3.
Zurück zum Zitat Woolgar JA. Histopathological prognosticators in oral and oropharyngeal squamous cell carcinoma. Oral Oncol. 2006;42:229–39.CrossRef Woolgar JA. Histopathological prognosticators in oral and oropharyngeal squamous cell carcinoma. Oral Oncol. 2006;42:229–39.CrossRef
4.
Zurück zum Zitat Tsai TY, Iandelli A, Marchi F, Huang Y, Tai SF, Hung SY, et al. The prognostic value of lymph node burden in oral cavity cancer: systematic review and meta-analysis. Laryngoscope. 2021;132:88–95.CrossRef Tsai TY, Iandelli A, Marchi F, Huang Y, Tai SF, Hung SY, et al. The prognostic value of lymph node burden in oral cavity cancer: systematic review and meta-analysis. Laryngoscope. 2021;132:88–95.CrossRef
5.
Zurück zum Zitat Pilborough AE, Lambert DW, Khurram SA. Extranodal extension in oral cancer: a role for the nodal microenvironment? J Oral Pathol Med. 2019;48:863–70.CrossRef Pilborough AE, Lambert DW, Khurram SA. Extranodal extension in oral cancer: a role for the nodal microenvironment? J Oral Pathol Med. 2019;48:863–70.CrossRef
6.
Zurück zum Zitat Majercakova K, Valero C, Lopez M, Garcia J, Farre N, Quer M, et al. Postoperative staging of the neck dissection using extracapsular spread and lymph node ratio as prognostic factors in HPV-negative head and neck squamous cell carcinoma patients. Oral Oncol. 2018;77:37–42.CrossRef Majercakova K, Valero C, Lopez M, Garcia J, Farre N, Quer M, et al. Postoperative staging of the neck dissection using extracapsular spread and lymph node ratio as prognostic factors in HPV-negative head and neck squamous cell carcinoma patients. Oral Oncol. 2018;77:37–42.CrossRef
7.
Zurück zum Zitat Hararah MK, Stokes WA, Jones BL, Oweida A, Ding D, McDermott J, et al. Nomogram for preoperative prediction of nodal extracapsular extension or positive surgical margins in oropharyngeal squamous cell carcinoma. Oral Oncol. 2018;83:73–80.CrossRef Hararah MK, Stokes WA, Jones BL, Oweida A, Ding D, McDermott J, et al. Nomogram for preoperative prediction of nodal extracapsular extension or positive surgical margins in oropharyngeal squamous cell carcinoma. Oral Oncol. 2018;83:73–80.CrossRef
8.
Zurück zum Zitat Shevach J, Bossert A, Bakst RL, Liu J, Misiukiewicz K, Beyda J, et al. Extracapsular extension is associated with worse distant control and progression-free survival in patients with lymph node-positive human papillomavirus-related oropharyngeal carcinoma. Oral Oncol. 2017;74:56–61.CrossRef Shevach J, Bossert A, Bakst RL, Liu J, Misiukiewicz K, Beyda J, et al. Extracapsular extension is associated with worse distant control and progression-free survival in patients with lymph node-positive human papillomavirus-related oropharyngeal carcinoma. Oral Oncol. 2017;74:56–61.CrossRef
9.
Zurück zum Zitat Mermod M, Tolstonog G, Simon C, Monnier Y. Extracapsular spread in head and neck squamous cell carcinoma: a systematic review and meta-analysis. Oral Oncol. 2016;62:60–71.CrossRef Mermod M, Tolstonog G, Simon C, Monnier Y. Extracapsular spread in head and neck squamous cell carcinoma: a systematic review and meta-analysis. Oral Oncol. 2016;62:60–71.CrossRef
10.
Zurück zum Zitat Bhattacharya P, Mukherjee R. Lymph node extracapsular extension as a marker of aggressive phenotype: classification, prognosis and associated molecular biomarkers. Eur J Surg Oncol. 2021;47:721–31.CrossRef Bhattacharya P, Mukherjee R. Lymph node extracapsular extension as a marker of aggressive phenotype: classification, prognosis and associated molecular biomarkers. Eur J Surg Oncol. 2021;47:721–31.CrossRef
11.
Zurück zum Zitat Bennett SH, Futrell JW, Roth JA, Hoye RC, Ketcham AS. Prognostic significance of histologic host response in cancer of the larynx or hypopharynx. Cancer. 1971;28:1255–65.CrossRef Bennett SH, Futrell JW, Roth JA, Hoye RC, Ketcham AS. Prognostic significance of histologic host response in cancer of the larynx or hypopharynx. Cancer. 1971;28:1255–65.CrossRef
12.
Zurück zum Zitat Dunne AA, Muller HH, Eisele DW, Kessel K, Moll R, Werner JA. Meta-analysis of the prognostic significance of perinodal spread in head and neck squamous cell carcinomas (HNSCC) patients. Eur J Cancer. 2006;42:1863–8.CrossRef Dunne AA, Muller HH, Eisele DW, Kessel K, Moll R, Werner JA. Meta-analysis of the prognostic significance of perinodal spread in head and neck squamous cell carcinomas (HNSCC) patients. Eur J Cancer. 2006;42:1863–8.CrossRef
13.
Zurück zum Zitat Huang SH, O’Sullivan B. Overview of the 8th edition TNM classification for head and neck cancer. Curr Treat Opt Oncol. 2017;18:40.CrossRef Huang SH, O’Sullivan B. Overview of the 8th edition TNM classification for head and neck cancer. Curr Treat Opt Oncol. 2017;18:40.CrossRef
14.
Zurück zum Zitat Bernier J, Cooper JS, Pajak TF, van Glabbeke M, Bourhis J, Forastiere A, et al. Defining risk levels in locally advanced head and neck cancers: a comparative analysis of concurrent postoperative radiation plus chemotherapy trials of the EORTC (#22931) and RTOG (# 9501). Head Neck. 2005;27:843–50.CrossRef Bernier J, Cooper JS, Pajak TF, van Glabbeke M, Bourhis J, Forastiere A, et al. Defining risk levels in locally advanced head and neck cancers: a comparative analysis of concurrent postoperative radiation plus chemotherapy trials of the EORTC (#22931) and RTOG (# 9501). Head Neck. 2005;27:843–50.CrossRef
15.
Zurück zum Zitat Bernier J, Domenge C, Ozsahin M, Matuszewska K, Lefebvre JL, Greiner RH, et al. Postoperative irradiation with or without concomitant chemotherapy for locally advanced head and neck cancer. N Engl J Med. 2004;350:1945–52.CrossRef Bernier J, Domenge C, Ozsahin M, Matuszewska K, Lefebvre JL, Greiner RH, et al. Postoperative irradiation with or without concomitant chemotherapy for locally advanced head and neck cancer. N Engl J Med. 2004;350:1945–52.CrossRef
16.
Zurück zum Zitat Cooper JS, Pajak TF, Forastiere AA, Jacobs J, Campbell BH, Saxman SB, et al. Postoperative concurrent radiotherapy and chemotherapy for high-risk squamous-cell carcinoma of the head and neck. N Engl J Med. 2004;350:1937–44.CrossRef Cooper JS, Pajak TF, Forastiere AA, Jacobs J, Campbell BH, Saxman SB, et al. Postoperative concurrent radiotherapy and chemotherapy for high-risk squamous-cell carcinoma of the head and neck. N Engl J Med. 2004;350:1937–44.CrossRef
17.
Zurück zum Zitat van den Brekel MW, Lodder WL, Stel HV, Bloemena E, Leemans CR, van der Waal I. Observer variation in the histopathologic assessment of extranodal tumor spread in lymph node metastases in the neck. Head Neck. 2012;34:840–5.CrossRef van den Brekel MW, Lodder WL, Stel HV, Bloemena E, Leemans CR, van der Waal I. Observer variation in the histopathologic assessment of extranodal tumor spread in lymph node metastases in the neck. Head Neck. 2012;34:840–5.CrossRef
18.
Zurück zum Zitat Lewis JS Jr, Tarabishy Y, Luo J, Mani H, Bishop JA, Leon ME, et al. Inter- and intra-observer variability in the classification of extracapsular extension in p16 positive oropharyngeal squamous cell carcinoma nodal metastases. Oral Oncol. 2015;51:985–90.CrossRef Lewis JS Jr, Tarabishy Y, Luo J, Mani H, Bishop JA, Leon ME, et al. Inter- and intra-observer variability in the classification of extracapsular extension in p16 positive oropharyngeal squamous cell carcinoma nodal metastases. Oral Oncol. 2015;51:985–90.CrossRef
19.
Zurück zum Zitat Coatesworth AP, MacLennan K. Squamous cell carcinoma of the upper aerodigestive tract: the prevalence of microscopic extracapsular spread and soft tissue deposits in the clinically N0 neck. Head Neck. 2002;24:258–61.CrossRef Coatesworth AP, MacLennan K. Squamous cell carcinoma of the upper aerodigestive tract: the prevalence of microscopic extracapsular spread and soft tissue deposits in the clinically N0 neck. Head Neck. 2002;24:258–61.CrossRef
20.
Zurück zum Zitat Carter RL, Barr LC, O’Brien CJ, Soo KC, Shaw HJ. Transcapsular spread of metastatic squamous cell carcinoma from cervical lymph nodes. Am J Surg. 1985;150:495–9.CrossRef Carter RL, Barr LC, O’Brien CJ, Soo KC, Shaw HJ. Transcapsular spread of metastatic squamous cell carcinoma from cervical lymph nodes. Am J Surg. 1985;150:495–9.CrossRef
21.
Zurück zum Zitat Brannan AG, Johnstone PA, Cooper J. Extracapsular tumor extension in cervical lymph nodes: reconciling the literature and seer data. Head Neck. 2011;33:525–8.CrossRef Brannan AG, Johnstone PA, Cooper J. Extracapsular tumor extension in cervical lymph nodes: reconciling the literature and seer data. Head Neck. 2011;33:525–8.CrossRef
22.
Zurück zum Zitat Abdel-Halim CN, Rosenberg T, Dyrvig AK, Hoilund-Carlsen PF, Sorensen JA, Rohde M, et al. Diagnostic accuracy of imaging modalities in detection of histopathological extranodal extension: a systematic review and meta-analysis. Oral Oncol. 2021;114: 105169.CrossRef Abdel-Halim CN, Rosenberg T, Dyrvig AK, Hoilund-Carlsen PF, Sorensen JA, Rohde M, et al. Diagnostic accuracy of imaging modalities in detection of histopathological extranodal extension: a systematic review and meta-analysis. Oral Oncol. 2021;114: 105169.CrossRef
23.
Zurück zum Zitat Abdel-Halim CN, Rosenberg T, Larsen SR, Hoilund-Carlsen PF, Sorensen JA, Rohde M, et al. Histopathological definitions of extranodal extension: a systematic review. Head Neck Pathol. 2021;15:599–607.CrossRef Abdel-Halim CN, Rosenberg T, Larsen SR, Hoilund-Carlsen PF, Sorensen JA, Rohde M, et al. Histopathological definitions of extranodal extension: a systematic review. Head Neck Pathol. 2021;15:599–607.CrossRef
24.
Zurück zum Zitat Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.CrossRef Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.CrossRef
25.
Zurück zum Zitat Hong H, Choi Y, Hahn S, Park SK, Park BJ. Nomogram for sample size calculation on a straightforward basis for the kappa statistic. Ann Epidemiol. 2014;24:673–80.CrossRef Hong H, Choi Y, Hahn S, Park SK, Park BJ. Nomogram for sample size calculation on a straightforward basis for the kappa statistic. Ann Epidemiol. 2014;24:673–80.CrossRef
26.
Zurück zum Zitat Lewis JS Jr, Carpenter DH, Thorstad WL, Zhang Q, Haughey BH. Extracapsular extension is a poor predictor of disease recurrence in surgically treated oropharyngeal squamous cell carcinoma. Mod Pathol. 2011;24:1413–20.CrossRef Lewis JS Jr, Carpenter DH, Thorstad WL, Zhang Q, Haughey BH. Extracapsular extension is a poor predictor of disease recurrence in surgically treated oropharyngeal squamous cell carcinoma. Mod Pathol. 2011;24:1413–20.CrossRef
27.
Zurück zum Zitat Bullock MJ, Beitler JJ, Carlson DL, Fonseca I, Hunt JL, Katabi N, et al. Data set for the reporting of nodal excisions and neck dissection specimens for head and neck tumors: explanations and recommendations of the guidelines from the international collaboration on cancer reporting. Arch Pathol Lab Med. 2019;143:452–62.CrossRef Bullock MJ, Beitler JJ, Carlson DL, Fonseca I, Hunt JL, Katabi N, et al. Data set for the reporting of nodal excisions and neck dissection specimens for head and neck tumors: explanations and recommendations of the guidelines from the international collaboration on cancer reporting. Arch Pathol Lab Med. 2019;143:452–62.CrossRef
28.
Zurück zum Zitat Sinha P, Lewis JS Jr, Piccirillo JF, Kallogjeri D, Haughey BH. Extracapsular spread and adjuvant therapy in human papillomavirus-related, p16-positive oropharyngeal carcinoma. Cancer. 2012;118:3519–30.CrossRef Sinha P, Lewis JS Jr, Piccirillo JF, Kallogjeri D, Haughey BH. Extracapsular spread and adjuvant therapy in human papillomavirus-related, p16-positive oropharyngeal carcinoma. Cancer. 2012;118:3519–30.CrossRef
29.
Zurück zum Zitat Maxwell JH, Ferris RL, Gooding W, Cunningham D, Mehta V, Kim S, et al. Extracapsular spread in head and neck carcinoma: impact of site and human papillomavirus status. Cancer. 2013;119:3302–8.CrossRef Maxwell JH, Ferris RL, Gooding W, Cunningham D, Mehta V, Kim S, et al. Extracapsular spread in head and neck carcinoma: impact of site and human papillomavirus status. Cancer. 2013;119:3302–8.CrossRef
30.
Zurück zum Zitat Klozar J, Koslabova E, Kratochvil V, Salakova M, Tachezy R. Nodal status is not a prognostic factor in patients with HPV-positive oral/oropharyngeal tumors. J Surg Oncol. 2013;107:625–33.CrossRef Klozar J, Koslabova E, Kratochvil V, Salakova M, Tachezy R. Nodal status is not a prognostic factor in patients with HPV-positive oral/oropharyngeal tumors. J Surg Oncol. 2013;107:625–33.CrossRef
31.
Zurück zum Zitat Geiger JL, Lazim AF, Walsh FJ, Foote RL, Moore EJ, Okuno SH, et al. Adjuvant chemoradiation therapy with high-dose versus weekly cisplatin for resected, locally-advanced HPV/p16-positive and negative head and neck squamous cell carcinoma. Oral Oncol. 2014;50:311–8.CrossRef Geiger JL, Lazim AF, Walsh FJ, Foote RL, Moore EJ, Okuno SH, et al. Adjuvant chemoradiation therapy with high-dose versus weekly cisplatin for resected, locally-advanced HPV/p16-positive and negative head and neck squamous cell carcinoma. Oral Oncol. 2014;50:311–8.CrossRef
32.
Zurück zum Zitat Cmelak AJ, Ferris RL, Chen AM, Seiwert T, Burtness B. Treatment de-intensification for HPV-positive oropharynx cancer: what is currently acceptable? J Clin Oncol. 2021;39:2732–3.CrossRef Cmelak AJ, Ferris RL, Chen AM, Seiwert T, Burtness B. Treatment de-intensification for HPV-positive oropharynx cancer: what is currently acceptable? J Clin Oncol. 2021;39:2732–3.CrossRef
33.
Zurück zum Zitat Ma DJ, Van Abel KM. Treatment de-intensification for HPV-associated oropharyngeal cancer: a definitive surgery paradigm. Semin Radiat Oncol. 2021;31:332–8.CrossRef Ma DJ, Van Abel KM. Treatment de-intensification for HPV-associated oropharyngeal cancer: a definitive surgery paradigm. Semin Radiat Oncol. 2021;31:332–8.CrossRef
34.
Zurück zum Zitat Moore EJ, Van Abel KM, Routman DM, Lohse CM, Price KAR, Neben-Wittich M, et al. Human papillomavirus oropharynx carcinoma: aggressive de-escalation of adjuvant therapy. Head Neck. 2021;43:229–37.CrossRef Moore EJ, Van Abel KM, Routman DM, Lohse CM, Price KAR, Neben-Wittich M, et al. Human papillomavirus oropharynx carcinoma: aggressive de-escalation of adjuvant therapy. Head Neck. 2021;43:229–37.CrossRef
Metadaten
Titel
Inter- and Intrarater Reliability and Agreement Among Danish Head and Neck Pathologists Assessing Extranodal Extension in Lymph Node Metastases from Oropharyngeal Squamous Cell Carcinomas
verfasst von
Chadi Nimeh Abdel-Halim
Max Rohde
Stine Rosenkilde Larsen
Tina Marie Green
Benedicte Parm Ulhøi
Nina Claire Woller
Oke Gerke
Poul Flemming Høilund-Carlsen
Jens Ahm Sørensen
Christian Godballe
Publikationsdatum
13.07.2022
Verlag
Springer US
Erschienen in
Head and Neck Pathology / Ausgabe 4/2022
Elektronische ISSN: 1936-0568
DOI
https://doi.org/10.1007/s12105-022-01468-z

Weitere Artikel der Ausgabe 4/2022

Head and Neck Pathology 4/2022 Zur Ausgabe

Neu im Fachgebiet Pathologie

Assistierter Suizid durch Infusion von Thiopental

Thiopental Originalie

Als Folge des Urteils des Bundesverfassungsgerichts zur Sterbehilfe im Jahr 2020 wurde in den Jahren 2021–2023 eine Reihe (n = 23) von assistierten Suiziden im Landesinstitut für gerichtliche und soziale Medizin Berlin mit jeweils identischen …

Molekularpathologische Untersuchungen im Wandel der Zeit

Open Access Biomarker Leitthema

Um auch an kleinen Gewebeproben zuverlässige und reproduzierbare Ergebnisse zu gewährleisten ist eine strenge Qualitätskontrolle in jedem Schritt des Arbeitsablaufs erforderlich. Eine nicht ordnungsgemäße Prüfung oder Behandlung des …

Vergleichende Pathologie in der onkologischen Forschung

Pathologie Leitthema

Die vergleichende experimentelle Pathologie („comparative experimental pathology“) ist ein Fachbereich an der Schnittstelle von Human- und Veterinärmedizin. Sie widmet sich der vergleichenden Erforschung von Gemeinsamkeiten und Unterschieden von …

Gastrointestinale Stromatumoren

Open Access GIST CME-Artikel

Gastrointestinale Stromatumoren (GIST) stellen seit über 20 Jahren ein Paradigma für die zielgerichtete Therapie mit Tyrosinkinaseinhibitoren dar. Eine elementare Voraussetzung für eine mögliche neoadjuvante oder adjuvante Behandlung bei …