论文标题

一种可解释的针对尖峰神经网络的可解释的分布检测方法

A Novel Explainable Out-of-Distribution Detection Approach for Spiking Neural Networks

论文作者

Seras, Aitor Martinez, Del Ser, Javier, Lobo, Jesus L., Garcia-Bringas, Pablo, Kasabov, Nikola

论文摘要

与传统的神经网络相比,围绕尖峰神经网络的研究在过去几年中引起了人们的注意,包括它们的有效处理和对复杂的时间动态建模的固有能力。尽管存在这些差异,但在现实世界中部署时,尖峰神经网络面临与其他神经计算相似的问题。这项工作涉及可能阻碍该模型家族的可信赖性的实际情况之一:与培训数据分布相去甚远的样本训练模型的可能性(也称为分发或OOD数据)。具体而言,这项工作提出了一种新型的OOD检测器,该检测器可以识别出对尖峰神经网络的测试示例是否属于训练数据的数据的分布。为此,我们以尖峰计数模式的形式表征了网络隐藏层的内部激活,这为确定何时由测试实例引起的激活是非典型的基础。此外,设计了一种局部解释方法来产生归因图,以揭示输入实例的哪些部分最多推向将示例作为OOD样本的检测。实验结果是在几个图像分类数据集上进行的,以将所提出的检测器与文献中的其他OOD检测方案进行比较。正如获得的结果清楚地表明的那样,拟议的检测器对此类替代方案进行了竞争性的作用,并产生了符合合成创建的OOD实例的期望的相关归因图。

Research around Spiking Neural Networks has ignited during the last years due to their advantages when compared to traditional neural networks, including their efficient processing and inherent ability to model complex temporal dynamics. Despite these differences, Spiking Neural Networks face similar issues than other neural computation counterparts when deployed in real-world settings. This work addresses one of the practical circumstances that can hinder the trustworthiness of this family of models: the possibility of querying a trained model with samples far from the distribution of its training data (also referred to as Out-of-Distribution or OoD data). Specifically, this work presents a novel OoD detector that can identify whether test examples input to a Spiking Neural Network belong to the distribution of the data over which it was trained. For this purpose, we characterize the internal activations of the hidden layers of the network in the form of spike count patterns, which lay a basis for determining when the activations induced by a test instance is atypical. Furthermore, a local explanation method is devised to produce attribution maps revealing which parts of the input instance push most towards the detection of an example as an OoD sample. Experimental results are performed over several image classification datasets to compare the proposed detector to other OoD detection schemes from the literature. As the obtained results clearly show, the proposed detector performs competitively against such alternative schemes, and produces relevance attribution maps that conform to expectations for synthetically created OoD instances.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源