肾脏结构细分是计算机辅助诊断基于手术的肾癌的至关重要但具有挑战性的任务。尽管许多深度学习模型在许多医学图像分割任务中取得了显着的成功，但由于肾脏肿瘤的尺寸可变，肾脏肿瘤及其周围环境之间的歧义范围可变，因此对计算机层析造影血管造影（CTA）图像的肾脏结构的准确分割仍然具有挑战性。 。在本文中，我们在CTA扫描中提出了一个边界感知网络（BA-NET），以分段肾脏，肾脏肿瘤，动脉和静脉。该模型包含共享编码器，边界解码器和分割解码器。两个解码器都采用了多尺度的深度监督策略，这可以减轻肿瘤大小可变的问题。边界解码器在每个量表上产生的边界概率图被用作提高分割特征图的注意。我们在肾脏解析（KIPA）挑战数据集上评估了BA-NET，并通过使用4倍的交叉验证来实现CTA扫描的肾脏结构细分的平均骰子得分为89.65 $ \％$。结果证明了BA-NET的有效性。

自动化的腹部多器官分割是计算机辅助诊断腹部器官相关疾病的至关重要但具有挑战性的任务。尽管许多深度学习模型在许多医学图像分割任务中取得了显着的成功，但由于腹部器官的不同大小以及它们之间的含糊界限，腹部器官的准确分割仍然具有挑战性。在本文中，我们提出了一个边界感知网络（BA-NET），以分段CT扫描和MRI扫描进行腹部器官。该模型包含共享编码器，边界解码器和分割解码器。两个解码器都采用了多尺度的深度监督策略，这可以减轻可变器官尺寸引起的问题。边界解码器在每个量表上产生的边界概率图被用作提高分割特征图的注意。我们评估了腹部多器官细分（AMOS）挑战数据集的BA-NET，并获得了CT扫描的多器官分割的平均骰子分数为89.29 $ \％$，平均骰子得分为71.92 $ \％$ \％$ \％ MRI扫描。结果表明，在两个分割任务上，BA-NET优于NNUNET。

Fully Convolutional Neural Networks (FCNNs) with contracting and expanding paths have shown prominence for the majority of medical image segmentation applications since the past decade. In FCNNs, the encoder plays an integral role by learning both global and local features and contextual representations which can be utilized for semantic output prediction by the decoder. Despite their success, the locality of convolutional layers in FCNNs, limits the capability of learning long-range spatial dependencies. Inspired by the recent success of transformers for Natural Language Processing (NLP) in long-range sequence learning, we reformulate the task of volumetric (3D) medical image segmentation as a sequence-to-sequence prediction problem. We introduce a novel architecture, dubbed as UNEt TRansformers (UNETR), that utilizes a transformer as the encoder to learn sequence representations of the input volume and effectively capture the global multi-scale information, while also following the successful "U-shaped" network design for the encoder and decoder. The transformer encoder is directly connected to a decoder via skip connections at different resolutions to compute the final semantic segmentation output. We have validated the performance of our method on the Multi Atlas Labeling Beyond The Cranial Vault (BTCV) dataset for multiorgan segmentation and the Medical Segmentation Decathlon (MSD) dataset for brain tumor and spleen segmentation tasks. Our benchmarks demonstrate new state-of-the-art performance on the BTCV leaderboard. Code: https://monai.io/research/unetr

U-NET一直是医疗图像分割任务的首选架构，但是将U-NET体系结构扩展到3D图像时会出现计算挑战。我们提出了隐式U-NET体系结构，该体系结构将有效的隐式表示范式适应监督的图像分割任务。通过将卷积特征提取器与隐式定位网络相结合，我们隐式U-NET的参数比等效的U-NET少40％。此外，我们提出了培训和推理程序，以利用稀疏的预测。与等效的完全卷积U-NET相比，隐式U-NET减少了约30％的推理和训练时间以及训练记忆足迹，同时在我们的两个不同的腹部CT扫描数据集中取得了可比的结果。

Achieving accurate and automated tumor segmentation plays an important role in both clinical practice and radiomics research. Segmentation in medicine is now often performed manually by experts, which is a laborious, expensive and error-prone task. Manual annotation relies heavily on the experience and knowledge of these experts. In addition, there is much intra- and interobserver variation. Therefore, it is of great significance to develop a method that can automatically segment tumor target regions. In this paper, we propose a deep learning segmentation method based on multimodal positron emission tomography-computed tomography (PET-CT), which combines the high sensitivity of PET and the precise anatomical information of CT. We design an improved spatial attention network(ISA-Net) to increase the accuracy of PET or CT in detecting tumors, which uses multi-scale convolution operation to extract feature information and can highlight the tumor region location information and suppress the non-tumor region location information. In addition, our network uses dual-channel inputs in the coding stage and fuses them in the decoding stage, which can take advantage of the differences and complementarities between PET and CT. We validated the proposed ISA-Net method on two clinical datasets, a soft tissue sarcoma(STS) and a head and neck tumor(HECKTOR) dataset, and compared with other attention methods for tumor segmentation. The DSC score of 0.8378 on STS dataset and 0.8076 on HECKTOR dataset show that ISA-Net method achieves better segmentation performance and has better generalization. Conclusions: The method proposed in this paper is based on multi-modal medical image tumor segmentation, which can effectively utilize the difference and complementarity of different modes. The method can also be applied to other multi-modal data or single-modal data by proper adjustment.

Automatic segmentation is essential for the brain tumor diagnosis, disease prognosis, and follow-up therapy of patients with gliomas. Still, accurate detection of gliomas and their sub-regions in multimodal MRI is very challenging due to the variety of scanners and imaging protocols. Over the last years, the BraTS Challenge has provided a large number of multi-institutional MRI scans as a benchmark for glioma segmentation algorithms. This paper describes our contribution to the BraTS 2022 Continuous Evaluation challenge. We propose a new ensemble of multiple deep learning frameworks namely, DeepSeg, nnU-Net, and DeepSCAN for automatic glioma boundaries detection in pre-operative MRI. It is worth noting that our ensemble models took first place in the final evaluation on the BraTS testing dataset with Dice scores of 0.9294, 0.8788, and 0.8803, and Hausdorf distance of 5.23, 13.54, and 12.05, for the whole tumor, tumor core, and enhancing tumor, respectively. Furthermore, the proposed ensemble method ranked first in the final ranking on another unseen test dataset, namely Sub-Saharan Africa dataset, achieving mean Dice scores of 0.9737, 0.9593, and 0.9022, and HD95 of 2.66, 1.72, 3.32 for the whole tumor, tumor core, and enhancing tumor, respectively. The docker image for the winning submission is publicly available at (https://hub.docker.com/r/razeineldin/camed22).

域间隙主要由可变的医学图像质量引起的构成，这是训练实验室中的分割模型与应用训练的模型在未见临床数据之间的路径上的主要障碍。为了解决这个问题，已经提出了域泛化方法，但是通常使用静态卷积，并且灵活性较低。在本文中，我们提出了一个基于域和内容自适应卷积（DCAC）的多源域概括模型，以分割不同模式的医学图像。具体而言，我们设计了域自适应卷积（DAC）模块和内容自适应卷积（CAC）模块，并将两者都合并到编码器解码器中。在DAC模块中，动态卷积头是根据输入的预测域代码进行的，以使我们的模型适应看不见的目标域。在CAC模块中，动态卷积头在全局图像特征上进行条件，以使我们的模型适应测试图像。我们针对基线的DCAC模型和针对前列腺分割，COVID-19病变分段和视频杯/视盘分段任务的四种最先进的域概括方法评估了DCAC模型。我们的结果不仅表明所提出的DCAC模型在每个分割任务上都优于所有竞争方法，而且还证明了DAC和CAC模块的有效性。代码可在\ url {https://git.io/dcac}上获得。

医学成像的病变分割是临床研究中的一个重要课题。研究人员提出了各种检测和分段算法来解决这项任务。最近，基于深度学习的方法显着提高了传统方法的性能。然而，大多数最先进的深度学习方法需要手动设计多个网络组件和培训策略。在本文中，我们提出了一种新的自动化机器学习算法T-Automl，不仅搜索最佳神经结构，而且还可以同时找到超参数和数据增强策略的最佳组合。该方法采用现代变压器模型，引入了适应搜索空间嵌入的动态长度，并且可以显着提高搜索能力。我们在几个大型公共病变分割数据集上验证T-Automl并实现最先进的性能。

计算机断层扫描（CT）图像中腹部器官的自动分割可以支持放射治疗和图像引导的手术工作流程。这种自动解决方案的开发仍然挑战，主要是由于CT图像中的复杂器官相互作用和模糊边界。为了解决这些问题，我们专注于有效的空间上下文建模和显式边缘分段前提。因此，我们提出了一个3D网络，其中四个主要组件训练了端到端，包括共享编码器，边缘检测器，具有边缘跳过连接的解码器（ESC）和复制特征传播头（RFP-head）。为了捕获宽范围的空间依赖性，RFP-磁头通过以有效的切片方式配制的定向非循环图（DAG）传播和收集局部特征，以高效的切片方式，关于图像单元的空间排列。为了利用边缘信息，边缘探测器通过利用边缘监控来学习专门针对语义分割专门调整的边缘知识。然后，ESC通过多级解码器特征聚合边缘知识，以学习判别特征的层次结构明确地建模器官内部和边缘之间的互补性进行分割。我们对具有八个带电器官的两个挑战性腹部CT数据集进行了广泛的实验。实验结果表明，所提出的网络优于几种最先进的模型，特别是对于小而复杂的结构（胆囊，食道，胃，胰腺和十二指肠）的分割。该代码将公开。

Glioblastomas是最具侵略性的快速生长的主要脑癌，起源于大脑的胶质细胞。准确鉴定恶性脑肿瘤及其子区域仍然是医学图像分割中最具挑战性问题之一。脑肿瘤分割挑战（Brats）是自动脑胶质细胞瘤分割算法的流行基准，自于其启动。在今年的挑战中，Brats 2021提供了2,000名术前患者的最大多参数（MPMRI）数据集。在本文中，我们提出了两个深度学习框架的新聚合，即在术前MPMRI中的自动胶质母细胞瘤识别的Deepseg和NNU-Net。我们的集合方法获得了92.00,87.33和84.10和Hausdorff距离为3.81,8.91和16.02的骰子相似度分数，用于增强肿瘤，肿瘤核心和全肿瘤区域，单独进行。这些实验结果提供了证据表明它可以在临床上容易地应用，从而助攻脑癌预后，治疗计划和治疗反应监测。

我们为Brats21挑战中的脑肿瘤分割任务提出了优化的U-Net架构。为了找到最佳模型架构和学习时间表，我们运行了一个广泛的消融研究来测试：深度监督损失，焦点，解码器注意，下降块和残余连接。此外，我们搜索了U-Net编码器的最佳深度，卷积通道数量和后处理策略。我们的方法赢得了验证阶段，并在测试阶段进行了第三位。我们已开放源代码以在NVIDIA深度学习示例GitHub存储库中重现我们的Brats21提交。

从侵入性冠状动脉造影（ICA）中准确提取冠状动脉（ICA）在临床决策中对于冠状动脉疾病的诊断和风险分层（CAD）很重要。在这项研究中，我们开发了一种使用深度学习来自动提取冠状动脉腔的方法。方法。提出了一个深度学习模型U-NET 3+，其中包含了全面的跳过连接和深度监督，以自动从ICAS中自动提取冠状动脉。在这个新型的冠状动脉提取框架中采用了转移学习和混合损失功能。结果。使用了一个包含从210名患者获得的616个ICA的数据集。在技​​术评估中，U-NET 3+的骰子得分为0.8942，灵敏度为0.8735，高于U-NET ++（骰子得分：0.8814：0.8814，灵敏度为0.8331）和U-net（骰子分数） ：0.8799，灵敏度为0.8305）。结论。我们的研究表明，U-NET 3+优于其他分割框架，用于自动从ICA中提取冠状动脉。该结果表明了临床使用的巨大希望。

Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into separate patches and realize global communication via the self-attention mechanism. However, positional information between patches is hard to preserve in such 1D sequences, and loss of it can lead to sub-optimal performance when dealing with large amounts of heterogeneous tissues of various sizes in 3D medical image segmentation. Additionally, current methods are not robust and efficient for heavy-duty medical segmentation tasks such as predicting a large number of tissue classes or modeling globally inter-connected tissues structures. Inspired by the nested hierarchical structures in vision transformer, we proposed a novel 3D medical image segmentation method (UNesT), employing a simplified and faster-converging transformer encoder design that achieves local communication among spatially adjacent patch sequences by aggregating them hierarchically. We extensively validate our method on multiple challenging datasets, consisting anatomies of 133 structures in brain, 14 organs in abdomen, 4 hierarchical components in kidney, and inter-connected kidney tumors). We show that UNesT consistently achieves state-of-the-art performance and evaluate its generalizability and data efficiency. Particularly, the model achieves whole brain segmentation task complete ROI with 133 tissue classes in single network, outperforms prior state-of-the-art method SLANT27 ensembled with 27 network tiles, our model performance increases the mean DSC score of the publicly available Colin and CANDI dataset from 0.7264 to 0.7444 and from 0.6968 to 0.7025, respectively.

我们实施了两个不同的三维深度学习神经网络，并评估了它们在非对比度计算机断层扫描（CT）上看到的颅内出血（ICH）的能力。一种模型，称为“沿正交关注u-net沿正交级别的素隔离”（Viola-Unet），其体系结构元素可适应2022年实例的数据挑战。第二个比较模型是从No-New U-NET（NNU-NET）得出的。输入图像和地面真理分割图用于以监督方式分别训练两个网络。验证数据随后用于半监督培训。在5倍交叉验证期间比较了模型预测。中提琴 - UNET的表现优于四个性能指标中的两个（即NSD和RVD）的比较网络。将中提琴和NNU-NET网络组合的合奏模型在DSC和HD方面的性能最高。我们证明，与3D U-NET相关的ICH分割性能优势有效地合并了U-NET的解码分支期间的空间正交特征。 Viola-Unet AI工具的代码基础，预估计的权重和Docker图像将在https://github.com/samleoqh/viola-unet上公开获得。

卷积神经网络（CNNS）在3D医学图像上自动分割器官或病变取得了显着的成功。最近，视觉变压器网络在2D图像分类任务中表现出卓越的性能。与CNN相比，变压器网络由于其自我关注算法而提取远程特征的吸引力。因此，我们提出了一种称为Bitr-UNET的CNN变压器组合模型，对多模态MRI扫描进行脑肿瘤分割的具体修饰。我们的Bitr-UNET在BRATS2021验证数据集中实现了良好的性能，中值骰子得分0.9335,0.9304和0.8899，以及整个肿瘤，肿瘤核心和增强肿瘤的中位Hausdorff距离2.8284,2.2361和1.4142。在BRATS2021测试数据集上，骰子评分的相应结果为0.9257,0.9350和0.8874，对于Hausdorff距离为3,2.2361和1.4142。该代码在https://github.com/justatinydot/bitr-unet上公开使用。

在医学图像分割任务中，脑肿瘤分割仍然是一个挑战。随着变压器在各种计算机视觉任务中的应用，变压器块显示了在全球空间中学习长距离依赖性的能力，这是与CNN互补的。在本文中，我们提出了一个新型的基于变压器的生成对抗网络，以自动分割具有多模式MRI的脑肿瘤。我们的架构由一个发电机和一个歧视器组成，这些发电机和歧视器接受了最小游戏进度的培训。发电机基于典型的“ U形”编码器架构，其底层由带有Resnet的变压器块组成。此外，发电机还接受了深度监督技术的培训。我们设计的鉴别器是一个基于CNN的网络，具有多尺度$ L_ {1} $损失，事实证明，这对于医学语义图像分割是有效的。为了验证我们方法的有效性，我们对BRATS2015数据集进行了实验，比以前的最新方法实现了可比或更好的性能。

Brain tumor imaging has been part of the clinical routine for many years to perform non-invasive detection and grading of tumors. Tumor segmentation is a crucial step for managing primary brain tumors because it allows a volumetric analysis to have a longitudinal follow-up of tumor growth or shrinkage to monitor disease progression and therapy response. In addition, it facilitates further quantitative analysis such as radiomics. Deep learning models, in particular CNNs, have been a methodology of choice in many applications of medical image analysis including brain tumor segmentation. In this study, we investigated the main design aspects of CNN models for the specific task of MRI-based brain tumor segmentation. Two commonly used CNN architectures (i.e. DeepMedic and U-Net) were used to evaluate the impact of the essential parameters such as learning rate, batch size, loss function, and optimizer. The performance of CNN models using different configurations was assessed with the BraTS 2018 dataset to determine the most performant model. Then, the generalization ability of the model was assessed using our in-house dataset. For all experiments, U-Net achieved a higher DSC compared to the DeepMedic. However, the difference was only statistically significant for whole tumor segmentation using FLAIR sequence data and tumor core segmentation using T1w sequence data. Adam and SGD both with the initial learning rate set to 0.001 provided the highest segmentation DSC when training the CNN model using U-Net and DeepMedic architectures, respectively. No significant difference was observed when using different normalization approaches. In terms of loss functions, a weighted combination of soft Dice and cross-entropy loss with the weighting term set to 0.5 resulted in an improved segmentation performance and training stability for both DeepMedic and U-Net models.

视觉变形金刚（VIT）S表现出可观的全球和本地陈述的自我监督学习表现，可以转移到下游应用程序。灵感来自这些结果，我们介绍了一种新的自我监督学习框架，具有用于医学图像分析的定制代理任务。具体而言，我们提出：（i）以新的3D变压器为基础的型号，被称为往返变压器（Swin Unet），具有分层编码器，用于自我监督的预训练; （ii）用于学习人类解剖学潜在模式的定制代理任务。我们展示了来自各种身体器官的5,050个公共可用的计算机断层扫描（CT）图像的提出模型的成功预培训。通过微调超出颅穹窿（BTCV）分割挑战的预先调整训练模型和来自医疗细分牌组（MSD）数据集的分割任务，通过微调训练有素的模型来验证我们的方法的有效性。我们的模型目前是MSD和BTCV数据集的公共测试排行榜上的最先进的（即第1号）。代码：https://monai.io/research/swin-unetr.

In medical image analysis, automated segmentation of multi-component anatomical structures, which often have a spectrum of potential anomalies and pathologies, is a challenging task. In this work, we develop a multi-step approach using U-Net-based neural networks to initially detect anomalies (bone marrow lesions, bone cysts) in the distal femur, proximal tibia and patella from 3D magnetic resonance (MR) images of the knee in individuals with varying grades of osteoarthritis. Subsequently, the extracted data are used for downstream tasks involving semantic segmentation of individual bone and cartilage volumes as well as bone anomalies. For anomaly detection, the U-Net-based models were developed to reconstruct the bone profiles of the femur and tibia in images via inpainting so anomalous bone regions could be replaced with close to normal appearances. The reconstruction error was used to detect bone anomalies. A second anomaly-aware network, which was compared to anomaly-na\"ive segmentation networks, was used to provide a final automated segmentation of the femoral, tibial and patellar bones and cartilages from the knee MR images containing a spectrum of bone anomalies. The anomaly-aware segmentation approach provided up to 58% reduction in Hausdorff distances for bone segmentations compared to the results from the anomaly-na\"ive segmentation networks. In addition, the anomaly-aware networks were able to detect bone lesions in the MR images with greater sensitivity and specificity (area under the receiver operating characteristic curve [AUC] up to 0.896) compared to the anomaly-na\"ive segmentation networks (AUC up to 0.874).

头部和颈部（H \＆N）肿瘤的分割和患者结果的预测对于患者的疾病诊断和治疗监测至关重要。强大的深度学习模型的当前发展受到缺乏大型多中心，多模态数据的阻碍，质量注释。 Miccai 2021头部和颈部肿瘤（Hecktor）分割和结果预测挑战产生了一种平台，用于比较氟 - 脱氧葡萄糖（FDG）-PET上的初级总体目标体积的分段方法和计算的断层摄影图像和预测H中的无进展生存对于细分任务，我们提出了一种基于编码器 - 解码器架构的新网络，具有完整的和跳过连接，以利用全尺度的低级和高级语义。此外，我们使用条件随机字段作为优化预测分段映射的后处理步骤。我们训练了多个用于肿瘤体积分割的神经网络，并且这些分段被整合在交叉验证中实现了0.75的平均骰子相似度系数，并在挑战测试数据集中实现了0.76。为了预测患者进展免费生存任务，我们提出了一种组合临床，辐射和深层学习特征的Cox比例危害回归。我们的生存预测模型在交叉验证中实现了0.82的一致性指数，并在挑战测试数据集中获得0.62。