Skip to main content
Search

Qizhen Lan

2 related articles

Subscribe to updates
  1. arXiv

    DPRD aligns ROI-masked displacement vectors so a student with ~5% of the teacher's parameters reaches 85.46% Dice on AMOS, edging out MedNeXt

    The work proposes Displacement-Preserving Relational Distillation (DPRD), which in nnU-Net aligns batch-wise pairwise displacement vectors on ROI-masked case-level embeddings with relational scale normalization, and on ISLES 2022 and AMOS 2022 lets students using about 5% of the teacher's parameters and about 3% of its FLOPs outperform Logits KD, FitNet, RKD, and CIRKD, reaching 85.46% Dice and 11.72 mm HD95 on AMOS.

  2. arXiv

    DCD raises compressed 3D MRI segmentation mDice from 63.60% to 68.51% on BraTS 2024 and to 73.95% on ISLES 2022 while cutting parameters from 101.9M to 6.4M

    The authors propose Detail Consistent Distillation (DCD), which applies a 3D discrete wavelet transform to teacher and student encoder features at every stage during training and aligns only the directional detail subband D (excluding the low-frequency approximation A and the most noise-prone extreme high-frequency band S) after inverse-wavelet reconstruction in the spatial domain, raising the mDice of a 4x channel-reduced student from 63.60% to 68.51% on BraTS 2024 and from 70.21% to 73.95% on ISLES 2022 with no inference-time overhead.

You’re all caught up