最近，已经研究了通过CNN进行超像素分割的无监督学习的概念。从本质上讲，这种方法通过在单个图像上使用的卷积神经网络（CNN）生成超像素，并且对此类CNN进行了培训，而无需任何标签或更多信息。因此，这种方法依赖于先验的掺入，通常是通过设计一个目标函数，该目标函数可以指导解决方案实现有意义的超像素分割。在本文中，我们提出了三个关键要素，以提高此类网络的功效：（i）与输入图像相比，\ emph {soft} super像素化图像的相似性，（ii）对象边缘和边界和边界和（（iii）基于非常卷积的修改架构，该体系结构允许更广泛的视野，可作为我们网络中的多尺度组件的功能。通过尝试BSDS500数据集，我们在定性和定量上找到了提案的重要性的证据。

Partitioning an image into superpixels based on the similarity of pixels with respect to features such as colour or spatial location can significantly reduce data complexity and improve subsequent image processing tasks. Initial algorithms for unsupervised superpixel generation solely relied on local cues without prioritizing significant edges over arbitrary ones. On the other hand, more recent methods based on unsupervised deep learning either fail to properly address the trade-off between superpixel edge adherence and compactness or lack control over the generated number of superpixels. By using random images with strong spatial correlation as input, \ie, blurred noise images, in a non-convolutional image decoder we can reduce the expected number of contrasts and enforce smooth, connected edges in the reconstructed image. We generate edge-sparse pixel embeddings by encoding additional spatial information into the piece-wise smooth activation maps from the decoder's last hidden layer and use a standard clustering algorithm to extract high quality superpixels. Our proposed method reaches state-of-the-art performance on the BSDS500, PASCAL-Context and a microscopy dataset.

Superpixels在众多计算机视觉任务中用作强大的预处理工具。通过使用Superpixel表示，图像基元的数量可以大大降低倍数。随着近年来深度学习的兴起，少数作品试图将深受学习的特征/图饲养成现有的经典超像素技术。然而，他们都没有能够在近乎实时生产超像素，这对超像素在实践中适用性至关重要。在这项工作中，我们提出了一个基于图形的基于图形的Superpixel分割框架。在第一阶段，我们介绍了一种高效的深度亲和学习（DAL）网络，通过聚合多尺度信息来学习成对像素亲和力。在第二阶段，我们提出了一种称为分层熵速率分割（HERS）的高效超像素方法。使用来自第一阶段的学习亲和力，HERS构建了一个分层树结构，可以瞬间产生任何数量的高度自适应超像素。我们通过视觉和数值实验证明，我们的方法的有效性和效率与各种最先进的超像素方法相比。

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for only a fraction of the nodes. Typically, the optimization process, through the objective function, considers only labelled nodes while ignoring the rest. In this paper, we propose novel objective terms for the training of GNNs for node classification, aiming to exploit all the available data and improve accuracy. Our first term seeks to maximize the mutual information between node and label features, considering both labelled and unlabelled nodes in the optimization process. Our second term promotes anisotropic smoothness in the prediction maps. Lastly, we propose a cross-validating gradients approach to enhance the learning from labelled data. Our proposed objectives are general and can be applied to various GNNs and require no architectural modifications. Extensive experiments demonstrate our approach using popular GNNs like GCN, GAT and GCNII, reading a consistent and significant accuracy improvement on 10 real-world node classification datasets.

本文探讨了管状结构提取任务的点集表示。与传统的掩码表示相比，点集表示享有其灵活性和表示能力，这不会受到固定网格作为掩模的限制。受此启发，我们提出了PointCatter，这是管状结构提取任务的分割模型的替代方法。PointCatter将图像分为散射区域，并对每个散点区域预测点。我们进一步提出了基于贪婪的区域的两分匹配算法，以端到端训练网络。我们在四个公共管状数据集上基准测试了点刻表，并且有关管状结构分割和中心线提取任务的广泛实验证明了我们方法的有效性。代码可在https://github.com/zhangzhao2022/pointscatter上找到。

在实际的工业生产中，评估钢板焊接效果是一项重要任务，焊接部分的分割是评估的基础。本文提出了一个工业焊接分割网络，基于与热图详细信息指导和图像垫子融合的深度学习语义分割算法，以解决焊接区域的自动分割问题。在现有的语义分割网络中，可以通过融合高级和低级层的特征来保留边界信息。但是，此方法可能导致低级层中空间信息的表达不足，从而导致分割边界定位不准确。我们提出了一个基于热图的详细指导模块，以完全表达低级网络中的分段区域边界信息以解决此问题。具体而言，可以通过添加详细的分支来预测分段边界，然后将其与蒙版标签生成的边界热图匹配以计算均方误差损失，从而增强边界信息的表达。此外，尽管深度学习在语义分割领域取得了巨大的成功，但由于在编码和解码过程中，由于经典分割网络引起的详细信息丢失，分割边界区域的精度并不高。本文介绍了一种矩阵算法，以校准语义分割网络的分割区域的边界以解决此问题。通过许多关于工业焊接数据集的实验，我们证明了我们方法的有效性，MIOU达到97.93％。值得注意的是，这种性能与人的手动细分相当（MIOU 97.96％）。

立体类像素细分旨在通过左右视图将离散的像素分组为感知区域，以更加协作和高效地分组。现有的Superpixel分割算法主要利用颜色和空间特征作为输入，这可能会对空间信息施加强大的约束，同时利用立体声图像对的差异信息。为了减轻此问题，我们提出了一种立体声超级像素细分方法，并在本工作中具有空间信息的脱钩机制。为了解除立体视差信息和空间信息，在融合立体声图像对的特征之前，暂时删除空间信息，并提出了脱钩的立体声融合模块（DSFM），以处理立体声的特征特征特征对齐和遮挡问题。此外，由于空间信息对于超像素分割至关重要，因此我们进一步设计一个动态空间嵌入模块（DSEM）以重新添加空间信息，并且将通过DSEM中的DSEM进行自适应调整空间信息的权重（DF）用于实现更好的细分。全面的实验结果表明，我们的方法可以在KITTI2015和CityScapes数据集上实现最新性能，并且还可以在NJU2K数据集上的显着对象检测中验证效率。源代码将在接受纸张后公开提供。

点云的Panoptic分割是一种重要的任务，使自动车辆能够使用高精度可靠的激光雷达传感器来理解其附近。现有的自上而下方法通过将独立的任务特定网络或转换方法从图像域转换为忽略激光雷达数据的复杂性，因此通常会导致次优性性能来解决这个问题。在本文中，我们提出了新的自上而下的高效激光乐光线分割（有效的LID）架构，该架构解决了分段激光雷达云中的多种挑战，包括距离依赖性稀疏性，严重的闭塞，大规模变化和重新投影误差。高效地板包括一种新型共享骨干，可以通过加强的几何变换建模容量进行编码，并聚合语义丰富的范围感知多尺度特征。它结合了新的不变语义和实例分段头以及由我们提出的Panoptic外围损耗功能监督的Panoptic Fusion模块。此外，我们制定了正则化的伪标签框架，通过对未标记数据的培训进行进一步提高高效性的性能。我们在两个大型LIDAR数据集中建议模型基准：NUSCENES，我们还提供了地面真相注释和Semantickitti。值得注意的是，高效地将在两个数据集上设置新的最先进状态。

图像平滑是一项基本的低级视觉任务，旨在保留图像的显着结构，同时删除微不足道的细节。图像平滑中已经探索了深度学习，以应对语义结构和琐碎细节的复杂纠缠。但是，当前的方法忽略了平滑方面的两个重要事实：1）受限数量的高质量平滑地面真相监督的幼稚像素级回归可能会导致域的转移，并导致对现实世界图像的概括问题； 2）纹理外观与对象语义密切相关，因此图像平滑需要意识到语义差异以应用自适应平滑强度。为了解决这些问题，我们提出了一个新颖的对比语义引导的图像平滑网络（CSGIS-NET），该网络在促进强大的图像平滑之前结合了对比的先验和语义。通过利用不希望的平滑效应作为负面教师，并结合分段任务以鼓励语义独特性来增强监督信号。为了实现所提出的网络，我们还使用纹理增强和平滑标签（即VOC-Smooth）丰富了原始的VOC数据集，它们首先桥接图像平滑和语义分割。广泛的实验表明，所提出的CSGI-NET大量优于最先进的算法。代码和数据集可在https://github.com/wangjie6866/csgis-net上找到。

We pose video object segmentation as spectral graph clustering in space and time, with one graph node for each pixel and edges forming local space-time neighborhoods. We claim that the strongest cluster in this video graph represents the salient object. We start by introducing a novel and efficient method based on 3D filtering for approximating the spectral solution, as the principal eigenvector of the graph's adjacency matrix, without explicitly building the matrix. This key property allows us to have a fast parallel implementation on GPU, orders of magnitude faster than classical approaches for computing the eigenvector. Our motivation for a spectral space-time clustering approach, unique in video semantic segmentation literature, is that such clustering is dedicated to preserving object consistency over time, which we evaluate using our novel segmentation consistency measure. Further on, we show how to efficiently learn the solution over multiple input feature channels. Finally, we extend the formulation of our approach beyond the segmentation task, into the realm of object tracking. In extensive experiments we show significant improvements over top methods, as well as over powerful ensembles that combine them, achieving state-of-the-art on multiple benchmarks, both for tracking and segmentation.

One of the main challenges in deep learning-based underwater image enhancement is the limited availability of high-quality training data. Underwater images are difficult to capture and are often of poor quality due to the distortion and loss of colour and contrast in water. This makes it difficult to train supervised deep learning models on large and diverse datasets, which can limit the model's performance. In this paper, we explore an alternative approach to supervised underwater image enhancement. Specifically, we propose a novel unsupervised underwater image enhancement framework that employs a conditional variational autoencoder (cVAE) to train a deep learning model with probabilistic adaptive instance normalization (PAdaIN) and statistically guided multi-colour space stretch that produces realistic underwater images. The resulting framework is composed of a U-Net as a feature extractor and a PAdaIN to encode the uncertainty, which we call UDnet. To improve the visual quality of the images generated by UDnet, we use a statistically guided multi-colour space stretch module that ensures visual consistency with the input image and provides an alternative to training using a ground truth image. The proposed model does not need manual human annotation and can learn with a limited amount of data and achieves state-of-the-art results on underwater images. We evaluated our proposed framework on eight publicly-available datasets. The results show that our proposed framework yields competitive performance compared to other state-of-the-art approaches in quantitative as well as qualitative metrics. Code available at https://github.com/alzayats/UDnet .

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information from multimodal images into a single image. This technique will prevent radiologists switch back and forth between different images and save lots of time in the diagnostic process. In this paper, we introduce a novel Dilated Residual Attention Network for the medical image fusion task. Our network is capable to extract multi-scale deep semantic features. Furthermore, we propose a novel fixed fusion strategy termed Softmax-based weighted strategy based on the Softmax weights and matrix nuclear norm. Extensive experiments show our proposed network and fusion strategy exceed the state-of-the-art performance compared with reference image fusion methods on four commonly used fusion metrics.

Camouflaged object detection (COD) aims to detect/segment camouflaged objects embedded in the environment, which has attracted increasing attention over the past decades. Although several COD methods have been developed, they still suffer from unsatisfactory performance due to the intrinsic similarities between the foreground objects and background surroundings. In this paper, we propose a novel Feature Aggregation and Propagation Network (FAP-Net) for camouflaged object detection. Specifically, we propose a Boundary Guidance Module (BGM) to explicitly model the boundary characteristic, which can provide boundary-enhanced features to boost the COD performance. To capture the scale variations of the camouflaged objects, we propose a Multi-scale Feature Aggregation Module (MFAM) to characterize the multi-scale information from each layer and obtain the aggregated feature representations. Furthermore, we propose a Cross-level Fusion and Propagation Module (CFPM). In the CFPM, the feature fusion part can effectively integrate the features from adjacent layers to exploit the cross-level correlations, and the feature propagation part can transmit valuable context information from the encoder to the decoder network via a gate unit. Finally, we formulate a unified and end-to-end trainable framework where cross-level features can be effectively fused and propagated for capturing rich context information. Extensive experiments on three benchmark camouflaged datasets demonstrate that our FAP-Net outperforms other state-of-the-art COD models. Moreover, our model can be extended to the polyp segmentation task, and the comparison results further validate the effectiveness of the proposed model in segmenting polyps. The source code and results will be released at https://github.com/taozh2017/FAPNet.

Semantic segmentation is a classic computer vision problem dedicated to labeling each pixel with its corresponding category. As a basic task for advanced tasks such as industrial quality inspection, remote sensing information extraction, medical diagnostic aid, and autonomous driving, semantic segmentation has been developed for a long time in combination with deep learning, and a lot of works have been accumulated. However, neither the classic FCN-based works nor the popular Transformer-based works have attained fine-grained localization of pixel labels, which remains the main challenge in this field. Recently, with the popularity of autonomous driving, the segmentation of road scenes has received increasing attention. Based on the cross-task consistency theory, we incorporate edge priors into semantic segmentation tasks to obtain better results. The main contribution is that we provide a model-agnostic method that improves the accuracy of semantic segmentation models with zero extra inference runtime overhead, verified on the datasets of road and non-road scenes. From our experimental results, our method can effectively improve semantic segmentation accuracy.

In this work we address the task of semantic image segmentation with Deep Learning and make three main contributions that are experimentally shown to have substantial practical merit. First, we highlight convolution with upsampled filters, or 'atrous convolution', as a powerful tool in dense prediction tasks. Atrous convolution allows us to explicitly control the resolution at which feature responses are computed within Deep Convolutional Neural Networks. It also allows us to effectively enlarge the field of view of filters to incorporate larger context without increasing the number of parameters or the amount of computation. Second, we propose atrous spatial pyramid pooling (ASPP) to robustly segment objects at multiple scales. ASPP probes an incoming convolutional feature layer with filters at multiple sampling rates and effective fields-of-views, thus capturing objects as well as image context at multiple scales. Third, we improve the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. The commonly deployed combination of max-pooling and downsampling in DCNNs achieves invariance but has a toll on localization accuracy. We overcome this by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF), which is shown both qualitatively and quantitatively to improve localization performance. Our proposed "DeepLab" system sets the new state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching 79.7% mIOU in the test set, and advances the results on three other datasets: PASCAL-Context, PASCAL-Person-Part, and Cityscapes. All of our code is made publicly available online.

基于深度学习的低光图像增强方法通常需要巨大的配对训练数据，这对于在现实世界的场景中捕获是不切实际的。最近，已经探索了无监督的方法来消除对成对训练数据的依赖。然而，由于没有前衣，它们在不同的现实情景中表现得不稳定。为了解决这个问题，我们提出了一种基于先前（HEP）的有效预期直方图均衡的无监督的低光图像增强方法。我们的作品受到了有趣的观察，即直方图均衡增强图像的特征图和地面真理是相似的。具体而言，我们制定了HEP，提供了丰富的纹理和亮度信息。嵌入一​​个亮度模块（LUM），它有助于将低光图像分解为照明和反射率图，并且反射率图可以被视为恢复的图像。然而，基于Retinex理论的推导揭示了反射率图被噪声污染。我们介绍了一个噪声解剖学模块（NDM），以解除反射率图中的噪声和内容，具有不配对清洁图像的可靠帮助。通过直方图均衡的先前和噪声解剖，我们的方法可以恢复更精细的细节，更有能力抑制现实世界低光场景中的噪声。广泛的实验表明，我们的方法对最先进的无监督的低光增强算法有利地表现出甚至与最先进的监督算法匹配。

现有的深度嵌入聚类工作仅考虑最深层的学习功能嵌入，因此未能利用来自群集分配的可用辨别信息，从而产生性能限制。为此，我们提出了一种新颖的方法，即深入关注引导的图形聚类与双自我监督（DAGC）。具体地，DAGC首先利用异质性 - 方向融合模块，以便于在每个层中自适应地集成自动编码器的特征和图形卷积网络，然后使用尺度明智的融合模块动态地连接不同层中的多尺度特征。这种模块能够通过基于注意的机制学习歧视特征。此外，我们设计了一种分配明智的融合模块，它利用群集分配直接获取聚类结果。为了更好地探索集群分配的歧视信息，我们开发了一种双重自我监督解决方案，包括软自我监督策略，具有三联kullback-Leibler发散损失和具有伪监督损失的硬自我监督策略。广泛的实验验证了我们的方法在六个基准数据集中始终如一地优于最先进的方法。特别是，我们的方法通过最佳基线超过18.14％的方法将ARI提高。

在过去十年中，深度学习的出现极大地帮助进步了图像。尽管实现了有希望的性能，但基于深度学习的载体算法仍然因结构和上下文特征的融合而造成的失真而挣扎，这些特征通常是从卷积编码器的深层和浅层层中获得的。在这一观察过程中，我们提出了一个新型的渐进式介绍网络，该网络维持了处理的图像的结构和上下文完整性。更具体地说，受高斯和拉普拉斯金字塔的启发，提出的网络的核心是一个名为GLE的特征提取模块。堆叠GLE模块使网络能够从不同的图像频率组件中提取图像特征。这种能力对于维持结构和上下文完整性很重要，对于高频组件对应于结构信息，而低频组件对应于上下文信息。提出的网络利用GLE功能以迭代方式逐渐以损坏的图像填充缺失区域。我们的基准测试实验表明，所提出的方法在许多最先进的介绍算法上取得了明显的改善。

我们提出了一种多移民通道（MGIC）方法，该方法可以解决参数数量相对于标准卷积神经网络（CNN）中的通道数的二次增长。因此，我们的方法解决了CNN中的冗余，这也被轻量级CNN的成功所揭示。轻巧的CNN可以达到与参数较少的标准CNN的可比精度。但是，权重的数量仍然随CNN的宽度四倍地缩放。我们的MGIC体系结构用MGIC对应物代替了每个CNN块，该块利用了小组大小的嵌套分组卷积的层次结构来解决此问题。因此，我们提出的架构相对于网络的宽度线性扩展，同时保留了通道的完整耦合，如标准CNN中。我们对图像分类，分割和点云分类进行的广泛实验表明，将此策略应用于Resnet和MobilenetV3等不同体系结构，可以减少参数的数量，同时获得相似或更好的准确性。

Fully convolutional neural networks (FCNs) have shown their advantages in the salient object detection task. However, most existing FCNs-based methods still suffer from coarse object boundaries. In this paper, to solve this problem, we focus on the complementarity between salient edge information and salient object information. Accordingly, we present an edge guidance network (EGNet) for salient object detection with three steps to simultaneously model these two kinds of complementary information in a single network. In the first step, we extract the salient object features by a progressive fusion way. In the second step, we integrate the local edge information and global location information to obtain the salient edge features. Finally, to sufficiently leverage these complementary features, we couple the same salient edge features with salient object features at various resolutions. Benefiting from the rich edge information and location information in salient edge features, the fused features can help locate salient objects, especially their boundaries more accurately. Experimental results demonstrate that the proposed method performs favorably against the state-of-the-art methods on six widely used datasets without any pre-processing and post-processing. The source code is available at http: //mmcheng.net/egnet/.