# Awesome-Ultrasound-Standard-Plane-Detection **Repository Path**: Yulv-git/Awesome-Ultrasound-Standard-Plane-Detection ## Basic Information - **Project Name**: Awesome-Ultrasound-Standard-Plane-Detection - **Description**: A curated list of awesome ultrasound standard plane detection/localization/localisation/extraction/classification/selection/identification/recognition. - **Primary Language**: Python - **License**: MIT - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 1 - **Forks**: 0 - **Created**: 2022-04-23 - **Last Updated**: 2022-06-06 ## Categories & Tags **Categories**: Uncategorized **Tags**: Ultrasound-Standard-Plane, detection, Code, Python, papers ## README

Awesome-Ultrasound-Standard-Plane-Detection

A curated list of awesome ultrasound standard plane detection/localization/localisation/extraction/classification/selection/identification/recognition. --- - [1. Papers](#1-papers) - [2. Public Datasets](#2-public-datasets) - [3. Practice](#3-practice) - [4. Acknowledgements](#4-acknowledgements) --- ## 1. Papers | Papers & Code | Short for Schemes | Notes | | :------------ | :---------------: | :---- | | Automated Selection of Standardized Planes from Ultrasound Volume [[MICCAI-MLMI 2011]](https://link.springer.com/content/pdf/10.1007/978-3-642-24319-6_5.pdf) | 2STC | Sliding Window, Haar, AdaBoost, AS Detection, SP Classification | | Learning-based scan plane identification from fetal head ultrasound images [[Medical Imaging 2012]](https://sci-hub.se/10.1117/12.911516) | - | Template Matching, Active Appearance Models, AS Detection, LDA, SP Classification | | Intelligent Scanning: Automated Standard Plane Selection and Biometric Measurement of Early Gestational Sac in Routine Ultrasound Examination [[Medical Physics 2012]](https://aapm.onlinelibrary.wiley.com/doi/epdf/10.1118/1.4736415?saml_referrer) | IS | Sliding Window, Haar, Cascade AdaBoost, AS Localization, Relative Position, Local Context Information, SP Classification | | Selective Search and Sequential Detection for Standard Plane Localization in Ultrasound [[MICCAI-CCCAI 2013]](https://link.springer.com/content/pdf/10.1007/978-3-642-41083-3_23.pdf) | SSSD | Haar, AdaBoost, Segmentation, Accumulative Vessel Probability Map, Selective Search, Geometric Relationship, Sequence AS Detection, SP Localization | | Standard Plane Localization in Ultrasound by Radial Component [[ISBI 2014]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6868086) | RCD | Random Forest, Geometric Constrain, Radial Component, AS Detection, SVM, SP Localization | | Automatic Recognition of Fetal Standard Plane in Ultrasound Image [[ISBI 2014]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6867815) | FV-Aug | AdaBoost, Dense Sampling Feature Transform Descriptor, Fish Vector, Spatial Pyramid Coding, Gaussian Mixture Model, SVM, SP Classification | | Standard Plane Localization in Ultrasound by Radial Component Model and Selective Search [[Ultrasound in Medicine and Biology 2014]](https://www.sciencedirect.com/science/article/pii/S0301562914004098/pdfft?md5=2f202092b37f5f31009c48b8845b10d3&pid=1-s2.0-S0301562914004098-main.pdf) | RVD | Random Forest, Geometric Constrain, Radial Component, Vessel Probability Map, Selective Search, AS Detection, SVM, SP Localization | | Diagnostic Plane Extraction from 3D Parametric Surface of the Fetal Cranium [[MIUA 2014]](http://www.bmva.org/miua/2014/miua-14-04.pdf) | - | Topological Manifold Representation, Landmark Alignment, 3D Parametric Surface Model, SP Localization | | A Constrained Regression Forests Solution to 3D Fetal Ultrasound Plane Localization for Longitudinal Analysis of Brain Growth and Maturation [[MICCAI-MLMI 2014]](https://link.springer.com/content/pdf/10.1007/978-3-319-10581-9_14.pdf) | CRF-FA-Dist | Informative Voxels, Reference Plane, Constrained Regression Forest, SP Localization | | Automatic Recognition of Fetal Facial Standard Plane in Ultrasound Image via Fisher Vector [[PLOS ONE 2015]](https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0121838&type=printable) | FV-Chi2-SDCA | Spatial Stacking, Densely Sampled Root Scale Invariant Feature Transform, Gaussian Mixture Model, Fisher Vector, Multilayer Fisher Network, SVM, SP Classification | | Plane Localization in 3-D Fetal Neurosonography for Longitudinal Analysis of the Developing Brain [[JBHI 2015]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7110508) | CRF-FA-Dist-M | Informative Voxels, Manual Reference Plane, Constrained Regression Forest, SP Localization | | Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks [[JBHI 2015]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7090943) | T-CNN | Knowledge Transfer, CNN, SP Localization | | Automatic Fetal Ultrasound Standard Plane Detection Using Knowledge Transferred Recurrent Neural Networks [[MICCAI 2015]](https://link.springer.com/content/pdf/10.1007/978-3-319-24553-9_62.pdf) | T-RNN | CNN, Knowledge Transfer, Joint Learning, Spatio-temporal Feature, RNN, SP Classification | | Fetal Facial Standard Plane Recognition via Very Deep Convolutional Networks [[EMBC 2016]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7590780) | - | DCNN, SP Classification | | Real-Time Standard Scan Plane Detection and Localisation in Fetal Ultrasound Using Fully Convolutional Neural Networks [[MICCAI 2016]](https://link.springer.com/content/pdf/10.1007/978-3-319-46723-8_24.pdf) | - | CNN, Unsupervision, Saliency Maps, AS Localization, SP Classification | | Ultrasound Standard Plane Detection Using a Composite Neural Network Framework [[Transactions on Cybernetics 2017]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7890445) | T-RNN | CNN, RNN, Composite Framework, SP Classification | | SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasound [[TMI 2017]](https://arxiv.org/pdf/1612.05601v2.pdf) [[Official Code]](https://github.com/baumgach/SonoNet-weights) [[Third-Party Code]](https://github.com/rdroste/SonoNet_PyTorch) | SonoNet | CNN, SP Classification, Weakly Supervision, AS Localization | | Automatic Detection of Standard Sagittal Plane in the First Trimester of Pregnancy Using 3-D Ultrasound Data [[Ultrasound in Medicine and Biology 2017]](https://www.sciencedirect.com/science/article/pii/S0301562916302708/pdfft?md5=cac6c0141b1bc88c489d2178a575c530&pid=1-s2.0-S0301562916302708-main.pdf) | - | Deep Belief Network, Circle Detection, SP Classification | | Attention-Gated Networks for Improving Ultrasound Scan Plane Detection [[MIDL 2018]](https://arxiv.org/pdf/1804.05338v1.pdf) [[Official Code]](https://github.com/ozan-oktay/Attention-Gated-Networks) | AG-SonoNet | CNN, Attention, SP Classification, Weakly Supervision, AS Localization | | Standard Plane Localisation in 3D Fetal Ultrasound Using Network with Geometric and Image Loss [[MIDL 2018]](https://openreview.net/pdf?id=BykcN8siz) | - | CNN, Rigid Transformation, Geometric Loss, Image Loss, SP Localization | | Standard Plane Detection in 3D Fetal Ultrasound Using an Iterative Transformation Network [[MICCAI 2018]](https://arxiv.org/pdf/1806.07486v2.pdf) [[Official Code]](https://github.com/yuanwei1989/plane-detection) | ITN | CNN, Rigid Transformation, SP Localization | | Automatic and Efficient Standard Plane Recognition in Fetal Ultrasound Images via Multi-scale Dense Networks [[MICCAI-DATRA/PIPPI 2018]](https://link.springer.com/content/pdf/10.1007/978-3-030-00807-9_16.pdf) | MSDNet | Multi-scale, Cascade, Dense Connection, CNN, SP Classification | | SonoEyeNet: Standardized fetal ultrasound plane detection informed by eye tracking [[ISBI 2018]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8363851) | SonoEyeNet | CNN, Eye Tracking, Visual Heatmap, Information Fusion, SP Classification | | Multi-task SonoEyeNet: Detection of Fetal Standardized Planes Assisted by Generated Sonographer Attention Maps [[MICCAI 2018]](https://link.springer.com/content/pdf/10.1007/978-3-030-00928-1_98.pdf) | M-SonoEyeNet | Multi-task, CNN, Eye Tracking, GAN, Generator, Sonographer Attention, Discriminator, Predicted Attention, SP Classification | | Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasound [[MICCAI 2019]](https://link.springer.com/content/pdf/10.1007/978-3-030-32254-0_33.pdf) | DDQN-AT | Landmark Alignment, Reinforcement Learning, CNN, RNN, SP Localization | | SPRNet: Automatic Fetal Standard Plane Recognition Network for Ultrasound Images [[MICCAI-PIPPI/SUSI 2019]](https://link.springer.com/content/pdf/10.1007/978-3-030-32875-7_5.pdf) | SPRNet | CNN, Weight-share, Transfer Learning, SP Classification | | Deep Learning-Based Methodology for Recognition of Fetal Brain Standard Scan Planes in 2D Ultrasound Images [[IEEE Access 2019]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8887441) | - | Data Augmentation, DCNN, Domain Transfer, SP Classification | | Standard Plane Identification in Fetal Brain Ultrasound Scans Using A Differential Convolutional Neural Network [[IEEE Access 2020]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9084099) | Different-CNN | Differential Operator, Differential CNN, SP Classification | | Evaluation of Deep Convolutional Neural Networks for Automatic Classification of Common Maternal Fetal Ultrasound Planes [[Scientific Reports 2020]](https://www.nature.com/articles/s41598-020-67076-5.pdf) [[Third-Party Code]](https://github.com/Oussamayousre/automatic-classification-of-common-maternal-fetal-ultrasound-planes) | - | Data Augmentation, PCA, Hog, Boosting, VGG, MobileNet, Inception-v3, ResNet, SENet, SE-ResNet, DenseNet, SP Classification | | Automatic Fetal Middle Sagittal Plane Detection in Ultrasound Using Generative Adversarial Network [[Diagnostics 2020]](https://www.mdpi.com/2075-4418/11/1/21/pdf) | - | Segmentation, Object Detection, Seed Point, GAN, SP Localization | | Recognition of Fetal Facial Ultrasound Standard Plane Based on Texture Feature Fusion [[CMMM 2021]](https://downloads.hindawi.com/journals/cmmm/2021/6656942.pdf) | LH-SVM | Local Binary Pattern, Histogram of Oriented Gradient, Feature Fusion, SVM, SP Classification | | Principled Ultrasound Data Augmentation for Classification of Standard Planes [[IPMI 2021]](https://link.springer.com/content/pdf/10.1007/978-3-030-78191-0_56.pdf) | - | Data Augmentation, Augmentation Policy Search, CNN, SP Classification | | Generative Adversarial Networks to Improve Fetal Brain Fine-Grained Plane Classification [[Sensors 2021]](https://www.mdpi.com/1424-8220/21/23/7975/pdf) | - | GAN, Data Augmentation, CNN, SP Classification | | Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound [[TMI 2021]](https://arxiv.org/pdf/2103.14502v1.pdf) [[Official Code]](https://github.com/wulalago/AgentSPL) | AgentSPL | Landmark Alignment, Reinforcement Learning, CNN, RNN, SP Localization | | Autonomous Navigation of An Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learning [[ICRA 2021]](https://arxiv.org/pdf/2103.00718) | SonoRL | Reinforcement Learning, Probe Navigation, Confidence-aware Agent, CNN, SP Localization | | Searching Collaborative Agents for Multi-plane Localization in 3D Ultrasound [[MIA 2021]](https://www.sciencedirect.com/science/article/pii/S1361841521001651/pdfft?md5=90294c4378d07e341fe92307a01d19e3&pid=1-s2.0-S1361841521001651-main.pdf) | MARL | Multi-agent, Reinforcement Learning, RNN, NAS, SP Localization | | Automatic Fetal Ultrasound Standard Plane Recognition Based on Deep Learning and IIoT [[Transactions on Industrial Informatics 2021]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9389489) | FUSPR | CNN, RNN, Spatial-temporal Feature, SP Classification | | Automatic quality assessment for 2D fetal sonographic standard plane based on multitask learning [[Medicine 2021]](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7850658/pdf/medi-100-e24427.pdf) | - | CNN, AS Classification, Object Detection, AS Localization, SP Quality Control | | Statistical Dependency Guided Contrastive Learning for Multiple Labeling in Prenatal Ultrasound [[MICCAI-MLMI 2021]](https://arxiv.org/pdf/2108.05055) | MLL-GCN-CRC | Word Embedding, GCN, CNN, Cluster Relabeled Contrastive Learning, Multi-label, AS Classification, SP Classification | Tags: Standard Plane --> SP | Anatomical Structure --> AS ## 2. Public Datasets - **FETAL_PLANES_DB**: Common maternal-fetal ultrasound images. | [Official](https://zenodo.org/record/3904280#) | [Here](./data/FETAL_PLANES_DB/) - 6 Classes: - Fetal Anatomical Planes: Abdomen, Brain (Further categorized into the 3 most common fetal brain planes: Trans-thalamic, Trans-cerebellum, Trans-ventricular), Femur, Thorax. - Mother’s Cervix. - General Category: Including any other less common image plane. - Meta Information: Patient number, US machine, Operator. - Training-test split used in the Nature Sci Rep paper. ## 3. Practice - [SonoNet](./src/SonoNet/): [infer.py](./src/SonoNet/infer.py) - [ITN](./src/ITN/): [train.py](./src/ITN/train.py), [infer.py](./src/ITN/infer.py) - [AG-SonoNet](./src/AG-SonoNet/): [train_FPD.py](./src/AG-SonoNet/train_FPD.py) - [AgentSPL](./src/AgentSPL/) - [DCNN-MF-SP](./src/DCNN-MF-SP/): [main.py](./src/DCNN-MF-SP/main.py) ## 4. Acknowledgements Thanks to the contributors of all the above papers, code, public datasets, and other resources.