我们为半监督学习设置提供了一种新的数据增强技术,该技术强调从功能空间最具挑战性的地区学习。从完全监督的参考模型开始,我们首先确定较低的置信度预测。然后,这些样品用于训练变异自动编码器(VAE),该变量可以生成具有相似分布的无限额外图像。最后,使用最初标记的数据和合成生成的标记和未标记的数据,我们以半监视的方式重新训练了一个新模型。我们对两个基准RGB数据集进行实验:CIFAR-100和STL-10,并表明所提出的方案在准确性和鲁棒性方面提高了分类性能,同时就现有的完全监督的方法而产生可比或优越的结果。
translated by 谷歌翻译
Satellite image change detection aims at finding occurrences of targeted changes in a given scene taken at different instants. This task is highly challenging due to the acquisition conditions and also to the subjectivity of changes. In this paper, we investigate satellite image change detection using active learning. Our method is interactive and relies on a question and answer model which asks the oracle (user) questions about the most informative display (dubbed as virtual exemplars), and according to the user's responses, updates change detections. The main contribution of our method consists in a novel adversarial model that allows frugally probing the oracle with only the most representative, diverse and uncertain virtual exemplars. The latter are learned to challenge the most the trained change decision criteria which ultimately leads to a better re-estimate of these criteria in the following iterations of active learning. Conducted experiments show the out-performance of our proposed adversarial display model against other display strategies as well as the related work.
translated by 谷歌翻译
In this paper, we design lightweight graph convolutional networks (GCNs) using a particular class of regularizers, dubbed as phase-field models (PFMs). PFMs exhibit a bi-phase behavior using a particular ultra-local term that allows training both the topology and the weight parameters of GCNs as a part of a single "end-to-end" optimization problem. Our proposed solution also relies on a reparametrization that pushes the mask of the topology towards binary values leading to effective topology selection and high generalization while implementing any targeted pruning rate. Both masks and weights share the same set of latent variables and this further enhances the generalization power of the resulting lightweight GCNs. Extensive experiments conducted on the challenging task of skeleton-based recognition show the outperformance of PFMs against other staple regularizers as well as related lightweight design methods.
translated by 谷歌翻译
Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on large collections of labeled data. Among the existing solutions, deep active learning is currently witnessing a major interest and its purpose is to train deep networks using as few labeled samples as possible. However, the success of active learning is highly dependent on how critical are these samples when training models. In this paper, we devise a novel active learning approach for label-efficient training. The proposed method is iterative and aims at minimizing a constrained objective function that mixes diversity, representativity and uncertainty criteria. The proposed approach is probabilistic and unifies all these criteria in a single objective function whose solution models the probability of relevance of samples (i.e., how critical) when learning a decision function. We also introduce a novel weighting mechanism based on reinforcement learning, which adaptively balances these criteria at each training iteration, using a particular stateless Q-learning model. Extensive experiments conducted on staple image classification data, including Object-DOTA, show the effectiveness of our proposed model w.r.t. several baselines including random, uncertainty and flat as well as other work.
translated by 谷歌翻译
学习在未知环境中安全导航是监视和救援操作中使用的自动无人机的重要任务。近年来,已经提出了许多基于学习的同时定位和映射(SLAM)系统,这些系统依靠深神经网络(DNN)(DNNS)提出了用于传统功能描述符表现不佳的应用。但是,这种基于学习的SLAM系统依靠DNN功能编码在典型的深度学习环境中训练有素的离线训练。这使得它们不太适合在训练中未见的环境中部署的无人机,在训练中,持续适应至关重要。在本文中,我们提出了一种新的方法,可以通过调节低复杂性词典学习和稀疏编码(DLSC)管道,并使用新提出的二次贝叶斯惊喜(QBS)因素调节,以学习在未知环境中即时猛烈抨击。我们通过在充满挑战的仓库场景中通过无人机收集的数据来实验验证我们的方法,在这种情况下,大量模棱两可的场景使视觉上的歧义很难。
translated by 谷歌翻译
成功的数据表示是基于机器学习的医学成像分析的基本因素。深度学习(DL)在强大的表示学习中起着至关重要的作用。但是,深层模型无法概括地看不见的数据可以快速过度拟合复杂的模式。因此,我们可以方便地实施策略,以帮助深入模型,从数据中发现有用的先验,以了解其内在属性。我们称之为双重角色网络(DRN)的模型使用基于最小平方相互信息(LSMI)的依赖关系最大化方法。 LSMI利用依赖度量来确保表示不变性和局部平滑度。尽管先前的工作使用了信息理论诸如相互信息(由于密度估计步骤)在计算上很昂贵的信息理论,但我们的LSMI公式减轻了棘手的相互信息估计的问题,可以用来近似它。基于CT的COVID-19检测和COVID-19的严重程度检测基准的实验证明了我们方法的有效性。
translated by 谷歌翻译
大型和性能的神经网络通常过度参数化,并且由于修剪而可以大大降低大小和复杂性。修剪是一组方法,它试图消除网络中的冗余或不必要的权重或权重。这些技术允许创建轻型网络,这对于嵌入式或移动应用程序特别重要。在本文中,我们设计了一种替代修剪方法,允许从较大未训练的方法中提取有效的子网。我们的方法是随机的,并通过探索使用Gumbel SoftMax采样的不同拓扑来提取子网。后者还用于训练概率分布,以衡量样品中权重的相关性。使用高效的重新恢复机制进一步增强了最终的子网,从而减少训练时间并提高性能。在CIFAR上进行的广泛实验表明,针对相关工作,我们的子网络提取方法的表现要优于表现。
translated by 谷歌翻译
学习图形卷积网络(GCNS)是一种新兴领域,其旨在将卷积操作概括为任意非常规域。特别地,与光谱域相比,在空间域操作的GCNS显示出优异的性能,但它们的成功高度依赖于如何定义输入图的拓扑。在本文中,我们向图表卷积网络介绍了一个新颖的框架,了解图形的拓扑属性。我们的方法的设计原理基于约束目标函数的优化,该函数不仅在GCNS中的常用卷积参数中学习,而且是传达这些图中最相关的拓扑关系的转换基础。基于骨架的动作识别的具有挑战性任务进行的实验表明,与手工图形设计以及相关工作相比,所提出的方法的优越性。
translated by 谷歌翻译
深度神经网络(DNN)最近在计算机视觉和几个相关领域取得了巨大成功。尽管如此,目前的神经结构仍然遭受灾难性干扰(A.K.A.忘记),这阻碍了DNN不断学习。虽然已经提出了几种最先进的方法来缓解遗忘,但这些现有解决方案是高度僵化的(正则化)或时间/内存要求(作为重播)。在文献中提出了一种基于动态网络的中等方法,并在文献中提出了在任务记忆和计算足迹之间提供合理的平衡。在本文中,我们基于一种基于新颖的无遗忘神经块(FFNB)来设计用于持续学习的动态网络架构。使用新的程序实现新任务的FFNB功能,该程序可以通过在前一个任务的空空间中约束底层参数,而训练分类器参数等同于Fisher判别分析。后者提供了一种有效的增量过程,这也是贝叶斯视角的最佳。使用增量的“端到端”微调进一步增强了训练有素的功能和分类器。在不同具有挑战性的分类问题上进行的大量实验,表明了该方法的高效性。
translated by 谷歌翻译
我们介绍了基于优化的理论,描述了在视觉皮质中的经验观察到的尖刺皮质组合,其配备有尖峰定时依赖性塑性(STDP)学习。使用我们的方法,我们为基于事件的相机构建了一类完全连接的,基于卷积和动作的特征描述符,即我们分别评估N-Mnist,挑战Cifar10-DVS以及IBM DVS128手势数据集。与传统的最先进的事件的特征描述符相比,我们报告了显着的准确性改进(CIFAR10-DVS上的+ 8%)。与最先进的STDP的系统(在N-MNIST上+ 10%+ 10%+ 10%,在IBM DVS128手势上举报的准确性提高了大量改进)。除了神经形态边缘装置的超低功率学习之外,我们的作品还有助于铺平朝向基于生物学 - 基于的皮质视觉理论的方式。
translated by 谷歌翻译