在过去的几十年里，有关超光图像的密集有了密集的研究。诸如NMF，VCA和N-FindR等一些方法已成为标准，因为它们表明在处理超细图像的解密时的稳健性。然而，关于多光谱图像的混合物的研究相对稀缺。因此，我们将一些解密方法扩展到多光谱图像。在本文中，我们创建了两个模拟的多光谱数据集，其两个高光谱数据集被给出了其基本真理。然后我们将解密方法（VCA，NMF，N-FINDR）应用于这两个数据集。通过比较和分析结果，我们能够用多光谱数据集使用VCA，NMF和N-FindR的一些有趣的结果。此外，这也证明了将这些解密方法扩展到多光谱成像领域的可能性。

在本文中，我们引入了一种新算法，该算法基于原型分析，用于假设末日成员的线性混合，用于盲目的高光谱脉冲。原型分析是该任务的自然表述。该方法不需要存在纯像素（即包含单个材料的像素），而是将末端成员表示为原始高光谱图像中几个像素的凸组合。我们的方法利用了熵梯度下降策略，（i）比传统的原型分析算法为高光谱脉冲提供更好的解决方案，并且（ii）导致有效的GPU实现。由于运行我们算法的单个实例很快，我们还提出了一个结合机制以及适当的模型选择程序，该过程使我们的方法可鲁棒性到超参数选择，同时保持计算复杂性合理。通过使用六个标准的真实数据集，我们表明我们的方法的表现优于最先进的矩阵分解和最新的深度学习方法。我们还提供开源pytorch实施：https：//github.com/inria-thoth/edaa。

测量金属粉的纯度对于保留添加剂制造产品的质量至关重要。污染是最头痛的问题之一，可能是由于多种原因引起的，并导致造成的成分破裂和故障。冶金条件评估的现有方法主要是耗时的，主要集中于结构的物理完整性，而不是材料组成。通过捕获广泛频率范围的光谱数据以及空间信息，高光谱成像（HSI）可以检测到温度，水分和化学成分方面的较小差异。因此，HSI可以提供一种应对这一挑战的独特方法。在本文中，通过使用近红外HSI相机，引入了HSI用于非破坏性检查金属粉末的应用。详细介绍了三个分步案例研究的技术假设和解决方案，包括粉末表征，污染检测和带选择分析。实验结果已经完全证明了HSI和相关的AI技术对粉末冶金的NDT的潜力，尤其是满足工业制造环境的潜力。

高光谱成像由于其在捕获丰富的空间和光谱信息的能力上提供了多功能应用，这对于识别物质至关重要。但是，获取高光谱图像的设备昂贵且复杂。因此，已经通过直接从低成本，更多可用的RGB图像重建高光谱信息来提出了许多替代光谱成像方法。我们详细研究了来自广泛的RGB图像的这些最先进的光谱重建方法。对25种方法的系统研究和比较表明，尽管速度较低，但大多数数据驱动的深度学习方法在重建精度和质量方面都优于先前的方法。这项全面的审查可以成为同伴研究人员的富有成果的参考来源，从而进一步启发了相关领域的未来发展方向。

近年来，新发现的矿物沉积物数量和不同矿物质需求的增加有LED探索地质学家，寻找在矿物勘探的每个阶段加工不同数据类型的更有效和创新的方法。作为主要步骤，诸如岩性单元，改变类型，结构和指示剂矿物的各种特征被映射以辅助靶向矿床的决策。不同类型的遥感数据集如卫星和空气传播数据，使得可以克服与映射地质特征相关的常见问题。从不同平台获得的遥感数据量的快速增加鼓励科学家培养先进，创新和强大的数据处理方法。机器学习方法可以帮助处理广泛的遥感数据集，并确定诸如反射连续体和感兴趣的特征的组件之间的关系。这些方法在处理频谱和地面真理测量中是稳健的，用于噪声和不确定性。近年来，通过补充与遥感数据集的地质调查进行了许多研究，现在在地球科学研究中突出。本文对一些流行的和最近建立的机器学习方法的实施和适应提供了全面的审查，用于处理不同类型的遥感数据，并调查其用于检测各种矿床类型的应用。我们展示了组合遥感数据和机器学习方法的高能力，以映射对于提供潜在地图至关重要的不同地质特征。此外，我们发现高级方法的范围来处理新一代遥感数据，以创建改进的矿物前景图。

Hyperspectral pixel intensities result from a mixing of reflectances from several materials. This paper develops a method of hyperspectral pixel unmixing that aims to recover the "pure" spectral signal of each material (hereafter referred to as endmembers) together with the mixing ratios (abundances) given the spectrum of a single pixel. The unmixing problem is particularly relevant in the case of low-resolution hyperspectral images captured in a remote sensing setting, where individual pixels can cover large regions of the scene. Under the assumptions that (1) a multivariate Normal distribution can represent the spectra of an endmember and (2) a Dirichlet distribution can encode abundances of different endmembers, we develop a Latent Dirichlet Variational Autoencoder for hyperspectral pixel unmixing. Our approach achieves state-of-the-art results on standard benchmarks and on synthetic data generated using United States Geological Survey spectral library.

近年来，由于海洋漏油事故严重影响环境，自然资源和沿海居民的生活，近年来，漏油事件引起了人们的关注。高光谱遥感图像提供了丰富的光谱信息，这对在复杂的海洋场景中监测漏油物有益。但是，大多数现有方法都是基于受监督和半监督的框架来检测高光谱图像（HSIS）的漏油事件，这些框架需要大量努力来注释一定数量的高质量训练集。在这项研究中，我们首次尝试基于HSIS的隔离森林开发无监督的漏油检测方法。首先，考虑到噪声水平在不同的频段之间有所不同，因此利用了噪声方差估计方法来评估不同频段的噪声水平，并且消除了因严重噪声而损坏的频段。其次，使用内核主成分分析（KPCA）来降低HSIS的高维度。然后，用隔离林估计属于海水和油泄漏之一的每个像素的概率，并且使用群集算法在检测到的概率上自动生产一组伪标记的训练样品。最后，可以通过在减少尺寸的数据上执行支持向量机（SVM）来获得初始检测图，然后，使用扩展的随机Walker（ERW）模型进一步优化初始检测结果，以改善检测检测漏油的准确性。关于我们自己创建的空气传播高光谱漏油数据（HOSD）的实验表明，该方法在其他最先进的检测方法方面获得了卓越的检测性能。

Spatially varying spectral modulation can be implemented using a liquid crystal spatial light modulator (SLM) since it provides an array of liquid crystal cells, each of which can be purposed to act as a programmable spectral filter array. However, such an optical setup suffers from strong optical aberrations due to the unintended phase modulation, precluding spectral modulation at high spatial resolutions. In this work, we propose a novel computational approach for the practical implementation of phase SLMs for implementing spatially varying spectral filters. We provide a careful and systematic analysis of the aberrations arising out of phase SLMs for the purposes of spatially varying spectral modulation. The analysis naturally leads us to a set of "good patterns" that minimize the optical aberrations. We then train a deep network that overcomes any residual aberrations, thereby achieving ideal spectral modulation at high spatial resolution. We show a number of unique operating points with our prototype including dynamic spectral filtering, material classification, and single- and multi-image hyperspectral imaging.

We present a simple but novel hybrid approach to hyperspectral data cube reconstruction from computed tomography imaging spectrometry (CTIS) images that sequentially combines neural networks and the iterative Expectation Maximization (EM) algorithm. We train and test the ability of the method to reconstruct data cubes of $100\times100\times25$ and $100\times100\times100$ voxels, corresponding to 25 and 100 spectral channels, from simulated CTIS images generated by our CTIS simulator. The hybrid approach utilizes the inherent strength of the Convolutional Neural Network (CNN) with regard to noise and its ability to yield consistent reconstructions and make use of the EM algorithm's ability to generalize to spectral images of any object without training. The hybrid approach achieves better performance than both the CNNs and EM alone for seen (included in CNN training) and unseen (excluded from CNN training) cubes for both the 25- and 100-channel cases. For the 25 spectral channels, the improvements from CNN to the hybrid model (CNN + EM) in terms of the mean-squared errors are between 14-26%. For 100 spectral channels, the improvements between 19-40% are attained with the largest improvement of 40% for the unseen data, to which the CNNs are not exposed during the training.

光谱超分辨率（SSR）是指从RGB对应物中恢复的高光谱图像（HSI）。由于SSR问题的一对多性，可以将单个RGB图像恢复到许多HSIS。解决这个暗示问题的关键是插入多源以前的信息，如自然RGB空间上下文的上下文，深度特征或固有的HSI统计事先等，以提高重建的置信度和保真度光谱。然而，大多数目前的方法只考虑设计定制的卷积神经网络（CNN）的一般和有限的前瞻，这导致无法有效地减轻不良程度。为解决有问题的问题，我们为SSR提出了一个新颖的全面的先前嵌入关系网络（HPRN）。基本上，核心框架由几个多剩余关系块（MRB）进行多种组装，其完全便于RGB信号之前的低频内容的传输和利用。创新性地，引入了RGB输入的语义之前，以识别类别属性，并且向前提出了语义驱动的空间关系模块（SSRM）以使用语义嵌入关系矩阵在聚类的类似特征之间执行特征聚合。此外，我们开发了一种基于变换器的通道关系模块（TCRM），其习惯使用标量作为先前深度特征中的频道方面关系的描述符，并用某些向量替换为变换器特征交互，支持表示更加歧视。为了保持高光谱频带之间的数学相关和光谱一致性，将二阶的先前约束（SOPC）结合到丢失功能中以引导HSI重建过程。

Fruit is a key crop in worldwide agriculture feeding millions of people. The standard supply chain of fruit products involves quality checks to guarantee freshness, taste, and, most of all, safety. An important factor that determines fruit quality is its stage of ripening. This is usually manually classified by experts in the field, which makes it a labor-intensive and error-prone process. Thus, there is an arising need for automation in the process of fruit ripeness classification. Many automatic methods have been proposed that employ a variety of feature descriptors for the food item to be graded. Machine learning and deep learning techniques dominate the top-performing methods. Furthermore, deep learning can operate on raw data and thus relieve the users from having to compute complex engineered features, which are often crop-specific. In this survey, we review the latest methods proposed in the literature to automatize fruit ripeness classification, highlighting the most common feature descriptors they operate on.

Lensless cameras are a class of imaging devices that shrink the physical dimensions to the very close vicinity of the image sensor by replacing conventional compound lenses with integrated flat optics and computational algorithms. Here we report a diffractive lensless camera with spatially-coded Voronoi-Fresnel phase to achieve superior image quality. We propose a design principle of maximizing the acquired information in optics to facilitate the computational reconstruction. By introducing an easy-to-optimize Fourier domain metric, Modulation Transfer Function volume (MTFv), which is related to the Strehl ratio, we devise an optimization framework to guide the optimization of the diffractive optical element. The resulting Voronoi-Fresnel phase features an irregular array of quasi-Centroidal Voronoi cells containing a base first-order Fresnel phase function. We demonstrate and verify the imaging performance for photography applications with a prototype Voronoi-Fresnel lensless camera on a 1.6-megapixel image sensor in various illumination conditions. Results show that the proposed design outperforms existing lensless cameras, and could benefit the development of compact imaging systems that work in extreme physical conditions.

Deconvolution is a widely used strategy to mitigate the blurring and noisy degradation of hyperspectral images~(HSI) generated by the acquisition devices. This issue is usually addressed by solving an ill-posed inverse problem. While investigating proper image priors can enhance the deconvolution performance, it is not trivial to handcraft a powerful regularizer and to set the regularization parameters. To address these issues, in this paper we introduce a tuning-free Plug-and-Play (PnP) algorithm for HSI deconvolution. Specifically, we use the alternating direction method of multipliers (ADMM) to decompose the optimization problem into two iterative sub-problems. A flexible blind 3D denoising network (B3DDN) is designed to learn deep priors and to solve the denoising sub-problem with different noise levels. A measure of 3D residual whiteness is then investigated to adjust the penalty parameters when solving the quadratic sub-problems, as well as a stopping criterion. Experimental results on both simulated and real-world data with ground-truth demonstrate the superiority of the proposed method.

极化是横向波的独特特征，由Stokes参数表示。极化状态的分析可以揭示有关来源的宝贵信息。在本文中，我们提出了一个可分离的低级别四元素线性混合模型对极化信号：我们假设源因子矩阵的每一列等于极化数据矩阵的一列，并将相应的问题称为可分离的Quaternion矩阵分解（SQMF）。我们讨论了SQMF可以分解的矩阵的一些属性。为了确定季节空间中的源因子矩阵，我们提出了一种受连续投影算法启发的称为Quaternion连续投影算法（QSPA）的启发式算法。为了确保QSPA的有效性，为Quaternion矩阵提出了一个新的归一化操作员。我们使用块坐标下降算法来计算实际数字空间中的非负因子激活矩阵。我们在极化图像表示和光偏光成像的应用中测试我们的方法，以验证其有效性。

在本文中，我们提出了一种无监督的方法，用于高光谱遥感图像分割。该方法利用了平均移位聚类算法，该算法将作为输入的初步高光谱超像素分割以及光谱像素信息。所提出的方法不需要分割类的数量作为输入参数，也不需要利用有关要分割的土地覆盖或土地使用类型的A-Priori知识（例如水，植被，建筑等）。进行了Salinas，Salinasa，Pavia Center和Pavia University数据集的实验。绩效是根据归一化信息，调整后的RAND指数和F1得分来衡量的。结果证明了该方法与艺术状态相比的有效性。

有效的早期检测马铃薯晚枯萎病（PLB）是马铃薯栽培的必要方面。然而，由于缺乏在冠层水平上缺乏视觉线索，在具有传统成像方法的领域的早期阶段来检测晚期枯萎是一项挑战。高光谱成像可以，捕获来自宽范围波长的光谱信号也在视觉波长之外。在这种情况下，通过将2D卷积神经网络（2D-CNN）和3D-CNN与深度合作的网络（PLB-2D-3D-A）组合来提出高光谱图像的深度学习分类架构。首先，2D-CNN和3D-CNN用于提取丰富的光谱空间特征，然后使用注意力块和SE-RESET用于强调特征图中的突出特征，并提高模型的泛化能力。数据集采用15,360张图像（64x64x204）构建，从在实验领域捕获的240个原始图像裁剪，具有超过20种马铃薯基因型。 2000年图像的测试数据集中的精度在全带中达到0.739，特定带中的0.790（492nm，519nm，560nm，592nm，717nm和765nm）。本研究表明，具有深入学习和近端高光谱成像的早期检测PLB的令人鼓舞的结果。

Changes in real-world dynamic processes are often described in terms of differences in energies $\textbf{E}(\underline{\alpha})$ of a set of spectral-bands $\underline{\alpha}$. Given continuous spectra of two classes $A$ and $B$, or in general, two stochastic processes $S^{(A)}(f)$ and $S^{(B)}(f)$, $f \in \mathbb{R}^+$, we address the ubiquitous problem of identifying a subset of intervals of $f$ called spectral-bands $\underline{\alpha} \subset \mathbb{R}^+$ such that the energies $\textbf{E}(\underline{\alpha})$ of these bands can optimally discriminate between the two classes. We introduce EGO-MDA, an unsupervised method to identify optimal spectral-bands $\underline{\alpha}^*$ for given samples of spectra from two classes. EGO-MDA employs a statistical approach that iteratively minimizes an adjusted multinomial log-likelihood (deviance) criterion $\mathcal{D}(\underline{\alpha},\mathcal{M})$. Here, Mixture Discriminant Analysis (MDA) aims to derive MLE of two GMM distribution parameters, i.e., $\mathcal{M}^* = \underset{\mathcal{M}}{\rm argmin}~\mathcal{D}(\underline{\alpha}, \mathcal{M})$ and identify a classifier that optimally discriminates between two classes for a given spectral representation. The Efficient Global Optimization (EGO) finds the spectral-bands $\underline{\alpha}^* = \underset{\underline{\alpha}}{\rm argmin}~\mathcal{D}(\underline{\alpha},\mathcal{M})$ for given GMM parameters $\mathcal{M}$. For pathological cases of low separation between mixtures and model misspecification, we discuss the effect of the sample size and the number of iterations on the estimates of parameters $\mathcal{M}$ and therefore the classifier performance. A case study on a synthetic data set is provided. In an engineering application of optimal spectral-banding for anomaly tracking, EGO-MDA achieved at least 70% improvement in the median deviance relative to other methods tested.

自动化驾驶系统（广告）开辟了汽车行业的新领域，为未来的运输提供了更高的效率和舒适体验的新可能性。然而，在恶劣天气条件下的自主驾驶已经存在，使自动车辆（AVS）长时间保持自主车辆（AVS）或更高的自主权。本文评估了天气在分析和统计方式中为广告传感器带来的影响和挑战，并对恶劣天气条件进行了解决方案。彻底报道了关于对每种天气的感知增强的最先进技术。外部辅助解决方案如V2X技术，当前可用的数据集，模拟器和天气腔室的实验设施中的天气条件覆盖范围明显。通过指出各种主要天气问题，自主驾驶场目前正在面临，近年来审查硬件和计算机科学解决方案，这项调查概述了在不利的天气驾驶条件方面的障碍和方向的障碍和方向。

In recent hyperspectral unmixing (HU) literature, the application of deep learning (DL) has become more prominent, especially with the autoencoder (AE) architecture. We propose a split architecture and use a pseudo-ground truth for abundances to guide the `unmixing network' (UN) optimization. Preceding the UN, an `approximation network' (AN) is proposed, which will improve the association between the centre pixel and its neighbourhood. Hence, it will accentuate spatial correlation in the abundances as its output is the input to the UN and the reference for the `mixing network' (MN). In the Guided Encoder-Decoder Architecture for Hyperspectral Unmixing with Spatial Smoothness (GAUSS), we proposed using one-hot encoded abundances as the pseudo-ground truth to guide the UN; computed using the k-means algorithm to exclude the use of prior HU methods. Furthermore, we release the single-layer constraint on MN by introducing the UN generated abundances in contrast to the standard AE for HU. Secondly, we experimented with two modifications on the pre-trained network using the GAUSS method. In GAUSS$_\textit{blind}$, we have concatenated the UN and the MN to back-propagate the reconstruction error gradients to the encoder. Then, in the GAUSS$_\textit{prime}$, abundance results of a signal processing (SP) method with reliable abundance results were used as the pseudo-ground truth with the GAUSS architecture. According to quantitative and graphical results for four experimental datasets, the three architectures either transcended or equated the performance of existing HU algorithms from both DL and SP domains.

遥感是通过测量其反射和发射辐射在距离处检测和监测区域物理特征的过程。它广泛用于监测生态系统，主要用于保存。不断增长的入侵物种报告影响了生态系统的自然平衡。当引入新的生态系统时，外来的入侵物种会产生关键的影响，并可能导致本地物种的灭绝。在这项研究中，我们专注于欧盟被认为是一种水生侵入性物种的普发剂。它的存在会对周围的生态系统和人类活动（例如农业，捕鱼和航行）产生负面影响。我们的目标是开发一种识别物种存在的方法。我们使用了由无人机安装的多光谱传感器收集的图像来实现这一目标，从而创建了我们的Ludvision数据集。为了鉴定收集图像上的靶向物种，我们提出了一种检测路德维希亚p的新方法。在多光谱图像中。该方法基于修改以处理多光谱数据的现有最新语义分割方法。提出的方法达到了生产商的准确性0.799，用户的准确性为0.955。