Decoder-Free Supervoxel GNN for Accurate Brain-Tumor Localization in Multi-Modal MRI

Modern vision backbones for 3D medical imaging typically process dense voxel grids through parameter-heavy encoder-decoder structures, a design that allocates a significant portion of its parameters to spatial reconstruction rather than feature learning. Our approach introduces SVGFormer, a decoder-free pipeline built upon a content-aware grouping stage that partitions the volume into a semantic graph of supervoxels. Its hierarchical encoder learns rich node representations by combining a patch-level Transformer with a supervoxel-level Graph Attention Network, jointly modeling fine-grained intra-region features and broader inter-regional dependencies. This design concentrates all learnable capacity on feature encoding and provides inherent, dual-scale explainability from the patch to the region level. To validate the framework’s flexibility, we trained two specialized models on the BraTS dataset: one for node-level classification and one for tumor proportion regression. Both models achieved strong performance, with the classification model achieving a F1-score of 0.875 and the regression model a MAE of 0.028, confirming the encoder’s ability to learn discriminative and localized features. Our results establish that a graph-based, encoder-only paradigm offers an accurate and inherently interpretable alternative for 3D medical image representation.

💡 Research Summary

This paper introduces SVGFormer, a decoder‑free architecture for 3D multi‑modal brain MRI that replaces the traditional heavyweight encoder‑decoder pipelines with a purely encoding backbone built on supervoxel graph representations. The authors first segment each MRI volume into anatomically coherent supervoxels using 3D SLIC on the T1‑weighted image, then propagate this supervoxel map across all four modalities (T1‑WI, T1‑ce, T2‑WI, FLAIR) to ensure spatial consistency. Background supervoxels are pruned by a data‑driven intensity threshold, and for each retained supervoxel a continuous tumor proportion (y_reg ∈