最近，图形神经网络（GNN）显着提高了图形上机器学习任务的性能。但是，这一技术突破使人们感到奇怪：GNN如何做出这样的决定，我们可以高度信心信任它的预测吗？当涉及到一些关键领域（例如生物医学）时，做出错误的决策可能会产生严重的后果，在应用它们之前解释GNN的内部工作机制至关重要。在本文中，我们为遵循消息传递方案GnnInterPreter的不同GNN的新型模型模型级解释方法提出了一种新颖的模型级解释方法，以解释GNN模型的高级决策过程。更具体地说，通过图形的连续放松和重新聚集技巧，GnnInterPreter学习了概率生成图分布，该分布在GNN模型的眼中生成了目标预测的最具代表性图。与唯一的现有作品相比，GnnInterPreter在生成具有不同类型的节点功能和边缘功能的解释图时更加有效，更灵活，而无需引入另一个Blackbox来解释GNN，而无需特定领域的知识。此外，在四个不同数据集上进行的实验研究表明，当模型是理想的情况下，GnnInterPreter生成的解释图可以匹配所需的图形模式，并揭示了如果存在任何模型。

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs. GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating both graph structure and feature information leads to complex models and explaining predictions made by GNNs remains unsolved. Here we propose GNNEXPLAINER, the first general, model-agnostic approach for providing interpretable explanations for predictions of any GNN-based model on any graph-based machine learning task. Given an instance, GNNEXPLAINER identifies a compact subgraph structure and a small subset of node features that have a crucial role in GNN's prediction. Further, GNNEXPLAINER can generate consistent and concise explanations for an entire class of instances. We formulate GNNEXPLAINER as an optimization task that maximizes the mutual information between a GNN's prediction and distribution of possible subgraph structures. Experiments on synthetic and real-world graphs show that our approach can identify important graph structures as well as node features, and outperforms alternative baseline approaches by up to 43.0% in explanation accuracy. GNNEXPLAINER provides a variety of benefits, from the ability to visualize semantically relevant structures to interpretability, to giving insights into errors of faulty GNNs.

我们研究了图神经网络（GNN）的解释性，作为阐明其工作机制的一步。尽管大多数当前方法都集中在解释图节点，边缘或功能上，但我们认为，作为GNNS的固有功能机制，消息流对执行解释性更为自然。为此，我们在这里提出了一种新颖的方法，即FlowX，以通过识别重要的消息流来解释GNN。为了量化流量的重要性，我们建议遵循合作游戏理论中沙普利价值观的哲学。为了解决计算所有联盟边际贡献的复杂性，我们提出了一个近似方案，以计算类似沙普利的值，作为进一步再分配训练的初步评估。然后，我们提出一种学习算法来训练流量评分并提高解释性。关于合成和现实世界数据集的实验研究表明，我们提出的FlowX导致GNN的解释性提高。

图神经网络（GNN）是一类流行的机器学习模型。受到学习解释（L2X）范式的启发，我们提出了L2XGNN，这是一个可解释的GNN的框架，该框架通过设计提供了忠实的解释。L2XGNN学习了一种选择解释性子图（主题）的机制，该机制仅在GNNS消息通话操作中使用。L2XGNN能够为每个输入图选择具有特定属性的子图，例如稀疏和连接。对主题施加这种限制通常会导致更容易解释和有效的解释。几个数据集的实验表明，L2XGNN使用整个输入图实现了与基线方法相同的分类精度，同时确保仅使用提供的解释来进行预测。此外，我们表明L2XGNN能够识别负责预测图形属性的主题。

在高措施应用中大量部署图神经网络（GNNS）对对噪声的强大解释产生了强烈的需求，这些解释与人类的直觉很好。大多数现有方法通过识别与预测有很强相关性的输入图的子图来生成解释。这些解释对噪声并不强大，因为独立优化单个输入的相关性很容易过分拟合噪声。此外，它们与人类直觉并不十分吻合，因为从输入图中删除已识别的子图并不一定会改变预测结果。在本文中，我们提出了一种新颖的方法，可以通过在类似的输入图上明确建模GNNS的共同决策逻辑来生成对GNN的强大反事实解释。我们的解释自然对噪声是强大的，因为它们是由控制许多类似输入图的GNN的共同决策边界产生的。该解释也与人类的直觉很好地吻合，因为从输入图中的解释中删除了一组边缘，从而显着改变了预测。许多公共数据集上的详尽实验证明了我们方法的出色性能。

In this paper, we investigate the degree of explainability of graph neural networks (GNNs). Existing explainers work by finding global/local subgraphs to explain a prediction, but they are applied after a GNN has already been trained. Here, we propose a meta-learning framework for improving the level of explainability of a GNN directly at training time, by steering the optimization procedure towards what we call `interpretable minima'. Our framework (called MATE, MetA-Train to Explain) jointly trains a model to solve the original task, e.g., node classification, and to provide easily processable outputs for downstream algorithms that explain the model's decisions in a human-friendly way. In particular, we meta-train the model's parameters to quickly minimize the error of an instance-level GNNExplainer trained on-the-fly on randomly sampled nodes. The final internal representation relies upon a set of features that can be `better' understood by an explanation algorithm, e.g., another instance of GNNExplainer. Our model-agnostic approach can improve the explanations produced for different GNN architectures and use any instance-based explainer to drive this process. Experiments on synthetic and real-world datasets for node and graph classification show that we can produce models that are consistently easier to explain by different algorithms. Furthermore, this increase in explainability comes at no cost for the accuracy of the model.

深度学习方法正在实现许多人工智能任务上的不断增长。深层模型的一个主要局限性是它们不适合可解释性。可以通过开发事后技术来解释预测，从而产生解释性领域，从而规避这种限制。最近，关于图像和文本的深层模型的解释性取得了重大进展。在图数据的领域，图形神经网络（GNN）及其解释性正在迅速发展。但是，既没有对GNN解释性方法的统一处理，也没有标准的基准和测试床。在这项调查中，我们提供了当前GNN解释性方法的统一和分类观点。我们对这一主题的统一和分类治疗对现有方法的共同性和差异阐明了灯光，并为进一步的方法论发展奠定了基础。为了促进评估，我们生成了一组专门用于GNN解释性的基准图数据集。我们总结了当前的数据集和指标，以评估GNN的解释性。总的来说，这项工作提供了GNN解释性和评估标准化测试床的统一方法论。

With the rapid deployment of graph neural networks (GNNs) based techniques into a wide range of applications such as link prediction, node classification, and graph classification the explainability of GNNs has become an indispensable component for predictive and trustworthy decision-making. Thus, it is critical to explain why graph neural network (GNN) makes particular predictions for them to be believed in many applications. Some GNNs explainers have been proposed recently. However, they lack to generate accurate and real explanations. To mitigate these limitations, we propose GANExplainer, based on Generative Adversarial Network (GAN) architecture. GANExplainer is composed of a generator to create explanations and a discriminator to assist with the Generator development. We investigate the explanation accuracy of our models by comparing the performance of GANExplainer with other state-of-the-art methods. Our empirical results on synthetic datasets indicate that GANExplainer improves explanation accuracy by up to 35\% compared to its alternatives.

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, like nodes or edges, that the target GNN relies upon for making predictions. Though various algorithms are proposed, most of them formalize this task by searching the minimal subgraph which can preserve original predictions. However, an inductive bias is deep-rooted in this framework: several subgraphs can result in the same or similar outputs as the original graphs. Consequently, they have the danger of providing spurious explanations and fail to provide consistent explanations. Applying them to explain weakly-performed GNNs would further amplify these issues. To address this problem, we theoretically examine the predictions of GNNs from the causality perspective. Two typical reasons of spurious explanations are identified: confounding effect of latent variables like distribution shift, and causal factors distinct from the original input. Observing that both confounding effects and diverse causal rationales are encoded in internal representations, we propose a simple yet effective countermeasure by aligning embeddings. Concretely, concerning potential shifts in the high-dimensional space, we design a distribution-aware alignment algorithm based on anchors. This new objective is easy to compute and can be incorporated into existing techniques with no or little effort. Theoretical analysis shows that it is in effect optimizing a more faithful explanation objective in design, which further justifies the proposed approach.

With the increasing use of Graph Neural Networks (GNNs) in critical real-world applications, several post hoc explanation methods have been proposed to understand their predictions. However, there has been no work in generating explanations on the fly during model training and utilizing them to improve the expressive power of the underlying GNN models. In this work, we introduce a novel explanation-directed neural message passing framework for GNNs, EXPASS (EXplainable message PASSing), which aggregates only embeddings from nodes and edges identified as important by a GNN explanation method. EXPASS can be used with any existing GNN architecture and subgraph-optimizing explainer to learn accurate graph embeddings. We theoretically show that EXPASS alleviates the oversmoothing problem in GNNs by slowing the layer wise loss of Dirichlet energy and that the embedding difference between the vanilla message passing and EXPASS framework can be upper bounded by the difference of their respective model weights. Our empirical results show that graph embeddings learned using EXPASS improve the predictive performance and alleviate the oversmoothing problems of GNNs, opening up new frontiers in graph machine learning to develop explanation-based training frameworks.

Explaining machine learning models is an important and increasingly popular area of research interest. The Shapley value from game theory has been proposed as a prime approach to compute feature importance towards model predictions on images, text, tabular data, and recently graph neural networks (GNNs) on graphs. In this work, we revisit the appropriateness of the Shapley value for GNN explanation, where the task is to identify the most important subgraph and constituent nodes for GNN predictions. We claim that the Shapley value is a non-ideal choice for graph data because it is by definition not structure-aware. We propose a Graph Structure-aware eXplanation (GStarX) method to leverage the critical graph structure information to improve the explanation. Specifically, we define a scoring function based on a new structure-aware value from the cooperative game theory proposed by Hamiache and Navarro (HN). When used to score node importance, the HN value utilizes graph structures to attribute cooperation surplus between neighbor nodes, resembling message passing in GNNs, so that node importance scores reflect not only the node feature importance, but also the node structural roles. We demonstrate that GStarX produces qualitatively more intuitive explanations, and quantitatively improves explanation fidelity over strong baselines on chemical graph property prediction and text graph sentiment classification.

尽管近期图形神经网络（GNN）进展，但解释了GNN的预测仍然具有挑战性。现有的解释方法主要专注于后性后解释，其中采用另一种解释模型提供培训的GNN的解释。后HOC方法未能揭示GNN的原始推理过程的事实引发了建立GNN与内置解释性的需求。在这项工作中，我们提出了原型图形神经网络（Protgnn），其将原型学习与GNNS相结合，并提供了对GNN的解释的新视角。在Protgnn中，解释自然地从基于案例的推理过程衍生，并且实际在分类期间使用。通过将输入与潜伏空间中的一些学习原型的输入进行比较来获得ProtGnn的预测。此外，为了更好地解释性和更高的效率，结合了一种新颖的条件子图采样模块，以指示输入图的哪个部分与ProtGnn +中的每个原型最相似。最后，我们在各种数据集中评估我们的方法并进行具体的案例研究。广泛的结果表明，Protgnn和Protgnn +可以提供固有的解释性，同时实现与非可解释对方的准确性有关的准确性。

已经在图形图上进行了大量研究，但是许多现有方法仅着重于优化图形布局的特定美学方面。给定图形，生成满足某些人类美学偏好的良好布局仍然是一项具有挑战性的任务，尤其是如果无法将这种偏好表示为可区分的目标函数。在本文中，我们提出了一个基于学生教师GAN的图形绘图框架SmartGD，该框架学会了绘制图形，就像人类学习执行任务一样。 SmartGD中的学生网络通过模仿良好的布局示例来学习图形，而SmartGD的教师网络负责提供有关生成布局优点的评分。当缺乏具体的审美标准来指定构成良好布局的内容时，学生网络可以从良好的布局示例中学习。另一方面，如果可以通过定量标准评估布局的好处（即使不是可区分的），学生网络可以将其用作优化目标美学的具体目标。为了实现目标，我们提出了一种新颖的gan变体，自挑战的gan，以了解有关任何审美标准的最佳布局分布，无论标准是否可区分。所提出的图形绘图框架不仅可以以与良好的布局示例相似的样式绘制图形，而且还可以根据任何给定的美学标准优化图形布局。一旦训练了模型，就可以根据示例布局的样式或所选美学标准可视化任意图。全面的实验研究表明，根据普通商定的指标，SMARTGD优于12种基准方法。

图表学习目的旨在将节点内容与图形结构集成以学习节点/图表示。然而，发现许多现有的图形学习方法在具有高异性级别的数据上不能很好地工作，这是不同类标签之间很大比例的边缘。解决这个问题的最新努力集中在改善消息传递机制上。但是，尚不清楚异质性是否确实会损害图神经网络（GNNS）的性能。关键是要展现一个节点与其直接邻居之间的关系，例如它们是异性还是同质性？从这个角度来看，我们在这里研究了杂质表示在披露连接节点之间的关系之前/之后的杂音表示的作用。特别是，我们提出了一个端到端框架，该框架既学习边缘的类型（即异性/同质性），并利用边缘类型的信息来提高图形神经网络的表现力。我们以两种不同的方式实施此框架。具体而言，为了避免通过异质边缘传递的消息，我们可以通过删除边缘分类器鉴定的异性边缘来优化图形结构。另外，可以利用有关异性邻居的存在的信息进行特征学习，因此，设计了一种混合消息传递方法来汇总同质性邻居，并根据边缘分类使异性邻居多样化。广泛的实验表明，在整个同质级别的多个数据集上，通过在多个数据集上提出的框架对GNN的绩效提高了显着提高。

作为当今最受欢迎的机器学习模型之一，Graph神经网络（GNN）最近引起了激烈的兴趣，其解释性也引起了人们的兴趣。用户对更好地了解GNN模型及其结果越来越感兴趣。不幸的是，当今的GNN评估框架通常依赖于合成数据集，从而得出有限范围的结论，因为问题实例缺乏复杂性。由于GNN模型被部署到更关键的任务应用程序中，因此我们迫切需要使用GNN解释性方法的共同评估协议。在本文中，据我们最大的知识，我们提出了针对GNN解释性的第一个系统评估框架，考虑了三种不同的“用户需求”的解释性：解释焦点，掩盖性质和掩蔽转换。我们提出了一个独特的指标，该指标将忠诚度措施结合在一起，并根据其足够或必要的质量对解释进行分类。我们将自己范围用于节点分类任务，并比较GNN的输入级解释性领域中最具代表性的技术。对于广泛使用的合成基准测试，令人惊讶的是，诸如个性化Pagerank之类的浅水技术在最小计算时间内具有最佳性能。但是，当图形结构更加复杂并且节点具有有意义的特征时，根据我们的评估标准，基于梯度的方法，尤其是显着性。但是，没有人在所有评估维度上占主导地位，而且总会有一个权衡。我们在eBay图上的案例研究中进一步应用了我们的评估协议，以反映生产环境。

由于事后解释越来越多地用于了解图神经网络（GNN）的行为，因此评估GNN解释的质量和可靠性至关重要。但是，评估GNN解释的质量是具有挑战性的，因为现有的图形数据集对给定任务没有或不可靠的基础真相解释。在这里，我们介绍了一个合成图数据生成器ShapeGgen，该生成可以生成各种基准数据集（例如，不同的图形大小，度分布，同粒细胞与异性图）以及伴随着地面真相解释。此外，生成各种合成数据集和相应的基础真相解释的灵活性使我们能够模仿各种现实世界应用程序生成的数据。我们将ShapeGgen和几个现实图形数据集包括在开源图形图库GraphXai中。除了带有基础真相说明的合成和现实图形数据集外，GraphXAI还提供数据加载程序，数据处理功能，可视化器，GNN模型实现和评估指标，以基准基准GNN解释性方法的性能。

Deep learning has revolutionized many machine learning tasks in recent years, ranging from image classification and video processing to speech recognition and natural language understanding. The data in these tasks are typically represented in the Euclidean space. However, there is an increasing number of applications where data are generated from non-Euclidean domains and are represented as graphs with complex relationships and interdependency between objects. The complexity of graph data has imposed significant challenges on existing machine learning algorithms. Recently, many studies on extending deep learning approaches for graph data have emerged. In this survey, we provide a comprehensive overview of graph neural networks (GNNs) in data mining and machine learning fields. We propose a new taxonomy to divide the state-of-the-art graph neural networks into four categories, namely recurrent graph neural networks, convolutional graph neural networks, graph autoencoders, and spatial-temporal graph neural networks. We further discuss the applications of graph neural networks across various domains and summarize the open source codes, benchmark data sets, and model evaluation of graph neural networks. Finally, we propose potential research directions in this rapidly growing field.

组合优化是运营研究和计算机科学领域的一个公认领域。直到最近，它的方法一直集中在孤立地解决问题实例，而忽略了它们通常源于实践中的相关数据分布。但是，近年来，人们对使用机器学习，尤其是图形神经网络（GNN）的兴趣激增，作为组合任务的关键构件，直接作为求解器或通过增强确切的求解器。GNN的电感偏差有效地编码了组合和关系输入，因为它们对排列和对输入稀疏性的意识的不变性。本文介绍了对这个新兴领域的最新主要进步的概念回顾，旨在优化和机器学习研究人员。

由于图形神经网络（GNN）在各个域中的出色性能，因此对GNN解释问题越来越感兴趣“ \ emph {输入图的哪一部分是决定模型决定的最关键？}“现有的解释？方法集中在监督的设置，例如节点分类和图形分类上，而无监督的图形表示学习的解释仍未探索。当部署高级决策情况时，图表表示的不透明可能会导致意外风险。在本文中，我们推进了信息瓶颈原理（IB），以解决无监督的图表表示所提出的解释问题，这导致了一个新颖的原理，\ textit {无监督的子图表信息瓶颈}（USIB）。我们还理论上分析了标签空间上图表和解释子图之间的联系，这表明表示的表现力和鲁棒性有益于解释性子图的保真度。合成和现实世界数据集的实验结果证明了我们发达的解释器的优越性以及我们的理论分析的有效性。

解释机器学习决策的问题是经过深入研究和重要的。我们对一种涉及称为图形神经网络的图形数据的特定类型的机器学习模型感兴趣。众所周知，由于缺乏公认的基准，评估图形神经网络（GNN）的可解释性方法是具有挑战性的。鉴于GNN模型，存在几种可解释性方法来解释具有多种（有时相互矛盾的）方法论的GNN模型。在本文中，我们提出了一个基准，用于评估称为Bagel的GNN的解释性方法。在百吉饼中，我们首先提出了四种不同的GNN解释评估制度 - 1）忠诚，2）稀疏性，3）正确性。 4）合理性。我们在现有文献中调和多个评估指标，并涵盖了各种概念以进行整体评估。我们的图数据集范围从引文网络，文档图，到分子和蛋白质的图。我们对四个GNN模型和九个有关节点和图形分类任务的事后解释方法进行了广泛的实证研究。我们打开基准和参考实现，并在https://github.com/mandeep-rathee/bagel-benchmark上提供它们。