Abstract
Medical images often exhibit domain shifts owing to varying imaging protocols and scanners across different medical centres. To address this issue, Test-Time Adaptation (TTA) enables pre-trained models to adapt to test samples during inference. In this paper, we propose a novel method, termed Dynamic Normalization (DyNo), for medical image segmentation. Composed of two components, DyNo successfully alleviates domain shifts by adaptively mixing the statistics of multiple domains. We first demonstrated the feasibility of statistics-based methods which merge source and test statistics simply through a supervised toy experiment. Then, we introduce a synthetic domain that synthesizes the distribution information from both the source and target domains using moving average, thereby gradually bridging large domain shifts through the statistics of our synthetic domain. Next, we propose an adaptive fusion strategy, enabling our model to adapt to dynamically changing test data by estimating domain shifts in a fully hyperparameter-free manner. Our DyNo outperforms six competing TTA methods on two benchmark medical image segmentation tasks with multiple scenarios. Extensive ablation studies also demonstrate the effectiveness of synthetic statistics and our adaptive fusion strategy. The code and weights of pre-trained source models are available at https://github.com/Yihang-Fu/DyNo.
Y. Fu and Z. Chen—Contributed equally.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Azad, R., et al.: Medical image segmentation review: the success of u-net. arXiv preprint arXiv:2211.14830 (2022)
Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., Vilariño, F.: WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Computeriz. Med. Imag. Graph. 43, 99–111 (2015)
Chen, Z., Pan, Y., Ye, Y., Lu, M., Xia, Y.: Each test image deserves a specific prompt: continual test-time adaptation for 2d medical image segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11184–11193 (2024)
Fan, D.P., Cheng, M.M., Liu, Y., Li, T., Borji, A.: Structure-measure: a new way to evaluate foreground maps. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4548–4557 (2017)
Fan, D.P., Gong, C., Cao, Y., Ren, B., Cheng, M.M., Borji, A.: Enhanced-alignment measure for binary foreground map evaluation. arXiv preprint arXiv:1805.10421 (2018)
Fan, D.-P., et al.: PraNet: parallel reverse attention network for polyp segmentation. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12266, pp. 263–273. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59725-2_26
Fumero, F., Alayón, S., Sanchez, J.L., Sigut, J., Gonzalez-Hernandez, M.: Rim-one: an open retinal image database for optic nerve evaluation. In: 2011 24th International Symposium on Computer-Based Medical Systems (CBMS), pp. 1–6. IEEE (2011)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. PMLR (2015)
Javanmardi, M., Tasdizen, T.: Domain adaptation for biomedical image segmentation using adversarial training. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 554–558. IEEE (2018)
Jha, D., et al.: Kvasir-SEG: a segmented polyp dataset. In: Ro, Y.M., et al. (eds.) MMM 2020. LNCS, vol. 11962, pp. 451–462. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-37734-2_37
Mirza, M.J., Micorek, J., Possegger, H., Bischof, H.: The norm must go on: dynamic unsupervised domain adaptation by normalization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14765–14775 (2022)
Nado, Z., Padhy, S., Sculley, D., D’Amour, A., Lakshminarayanan, B., Snoek, J.: Evaluating prediction-time batch normalization for robustness under covariate shift. arXiv preprint arXiv:2006.10963 (2020)
Ngoc Lan, P., et al.: Neounet: towards accurate colon polyp segmentation and neoplasm detection. In: Proceedings of the Advances in Visual Computing: 16th International Symposium, ISVC 2021, Virtual Event, 4–6 October 2021, Part II, pp. 15–28. Springer (2021)
Nguyen, A.T., Nguyen-Tang, T., Lim, S.N., Torr, P.H.: Tipi: test time adaptation with transformation invariance. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 24162–24171 (2023)
Orlando, J.I., et al.: Refuge challenge: a unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med. Image Anal. 59, 101570 (2020)
Quinonero-Candela, J., Sugiyama, M., Schwaighofer, A., Lawrence, N.D.: Dataset Shift in Machine Learning. MIT Press (2008)
Silva, J., Histace, A., Romain, O., Dray, X., Granado, B.: Toward embedded detection of polyps in wce images for early diagnosis of colorectal cancer. Int. J. Comput. Assist. Radiol. Surg. 9, 283–293 (2014)
Sivaswamy, J., Krishnadas, S., Joshi, G.D., Jain, M., Tabish, A.U.S.: Drishti-GS: retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), pp. 53–56. IEEE (2014)
Sun, Y., Wang, X., Liu, Z., Miller, J., Efros, A., Hardt, M.: Test-time training with self-supervision for generalization under distribution shifts. In: International Conference on Machine Learning, pp. 9229–9248. PMLR (2020)
Wang, D., Shelhamer, E., Liu, S., Olshausen, B., Darrell, T.: Tent: Fully test-time adaptation by entropy minimization. arXiv preprint arXiv:2006.10726 (2020)
Wang, Q., Fink, O., Van Gool, L., Dai, D.: Continual test-time domain adaptation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7201–7211 (2022)
Wang, W., et al.: Dynamically instance-guided adaptation: a backward-free approach for test-time domain adaptive semantic segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 24090–24099 (2023)
Yang, H., et al.: Dltta: dynamic learning rate for test-time adaptation on cross-domain medical images. IEEE Trans. Med. Imaging 41(12), 3575–3586 (2022)
Yang, J., Dvornek, N.C., Zhang, F., Chapiro, J., Lin, M.D., Duncan, J.S.: Unsupervised domain adaptation via disentangled representations: application to cross-modality liver segmentation. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 255–263. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_29
You, F., Li, J., Zhao, Z.: Test-time batch statistics calibration for covariate shift. arXiv preprint arXiv:2110.04065 (2021)
Zhang, J., Qi, L., Shi, Y., Gao, Y.: Domainadaptor: a novel approach to test-time adaptation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 18971–18981 (2023)
Zhang, Z., et al.: Origa-light: an online retinal fundus image database for glaucoma analysis and research. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 3065–3068. IEEE (2010)
Zhao, B., Chen, C., Xia, S.T.: Delta: degradation-free fully test-time adaptation. arXiv preprint arXiv:2301.13018 (2023)
Acknowledgment
This work was supported in part by the National Natural Science Foundation of China under Grant 62171377, in part by the Ningbo Clinical Research Center for Medical Imaging under Grant 2021L003 (Open Project 2022LYKFZD06), in part by Shenzhen Science and Technology Program under Grants JCYJ20220530161616036, in part by the China Postdoctoral Science Foundation 2021M703340/BX2021333, and in part by the Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University under Grant CX2024016.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Fu, Y., Chen, Z., Ye, Y., Xia, Y. (2025). DyNo: Dynamic Normalization based Test-Time Adaptation for 2D Medical Image Segmentation. In: Xu, X., Cui, Z., Rekik, I., Ouyang, X., Sun, K. (eds) Machine Learning in Medical Imaging. MLMI 2024. Lecture Notes in Computer Science, vol 15241. Springer, Cham. https://doi.org/10.1007/978-3-031-73284-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-73284-3_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-73283-6
Online ISBN: 978-3-031-73284-3
eBook Packages: Computer ScienceComputer Science (R0)
