What is it about?

Deep learning models can detect tumor cells in pathology images with remarkable accuracy, but pathologists often cannot trust what they cannot understand. When a model flags a region as cancerous, clinicians need to know why — not just that it did so. This paper introduces Sharp-LIME, an improved version of the widely used LIME explainability method, specifically tailored for histopathology images. Instead of dividing images into arbitrary regions (super-pixels) as standard LIME does, Sharp-LIME uses nuclei contours — the outlines of individual cell nuclei — as the basic units of explanation. These contours can come from pre-existing annotations, be generated automatically by a Mask R-CNN segmentation model, or be drawn interactively by the pathologist themselves. Tested on the Camelyon and PanNuke benchmark datasets using an InceptionV3 classifier, Sharp-LIME consistently highlighted neoplastic (tumor) nuclei as the most relevant features for the model's decision — a finding that directly aligns with how pathologists reason clinically. Compared to standard LIME, Sharp-LIME explanations are more stable across different random initializations, more robust to constant input shifts, and more sensitive to network weight randomization (a key sanity check for explainability methods). Each explanation is generated in approximately 10 seconds, making the approach practical for interactive clinical use.

Featured Image

Why is it important?

Explainability methods for medical AI are only as useful as they are trustworthy. Standard LIME, despite its widespread adoption, produces unstable and clinically uninterpretable outputs in histopathology — a critical limitation that undermines pathologist confidence in AI-assisted diagnosis. Sharp-LIME directly addresses this gap by anchoring explanations to semantically meaningful image structures (cell nuclei) rather than arbitrary image segments. This simple but powerful change yields explanations that are quantifiably more consistent (SRCC 0.18 vs. 0.015; ICC 0.62 vs. 0.38 for LIME), more robust, and — crucially — rated as easier to understand than both standard LIME and Grad-CAM by 60% of domain experts consulted. Beyond performance metrics, Sharp-LIME opens a path toward interactive explainability: pathologists can select specific regions of interest and immediately query the model's reasoning. This positions Sharp-LIME as a practical building block for human-in-the-loop diagnostic workflows, where clinician trust and model transparency must go hand in hand.

Perspectives

This work grew from a genuine frustration with the gap between explainability research and clinical usability. Off-the-shelf methods like LIME are routinely applied in medical imaging without questioning whether their default configurations are appropriate for the domain — and in histopathology, they simply are not. What excites me most about Sharp-LIME is not just the performance gains, but the conceptual shift it represents: explanations should speak the language of the domain they serve. Nuclei are the currency of diagnostic reasoning in pathology, so it makes sense for explanations to be built around them. The interactive component — allowing pathologists to define their own regions of interest — feels especially promising for building the kind of collaborative human-AI relationship that clinical adoption ultimately requires. This collaboration between PUC-Rio and HES-SO/University of Geneva also reinforced how much cross-disciplinary work matters in this field. Combining biomedical engineering expertise with digital pathology know-how was essential to framing the right questions — and, I believe, to producing results that are both rigorous and clinically grounded.

Prof. Dr. Eduardo Costa da Silva
Pontificia Universidade Catolica do Rio de Janeiro

Read the Original

This page is a summary of: Sharpening Local Interpretable Model-Agnostic Explanations for Histopathology: Improved Understandability and Reliability, January 2021, Springer Science + Business Media,
DOI: 10.1007/978-3-030-87199-4_51.
You can read the full text:

Read

Contributors

The following have contributed to this page