论文标题
猜测:脑电图响应中的歌曲识别
GuessTheMusic: Song Identification from Electroencephalography response
论文作者
论文摘要
音乐信号包括节奏,音色,旋律,和谐等不同功能。在过去的几十年中,它对人脑的影响一直是一个令人兴奋的研究主题。脑电图(EEG)信号可实现对脑活动的无创测量。利用深度学习的最新进展,我们提出了一种新颖的方法,使用卷积神经网络进行脑电图(EEG)响应,以进行歌曲识别。我们在听一组12首歌曲剪辑的同时,记录了来自20名参与者的EEG信号,大约2分钟,这些剪辑以随机顺序呈现。将音乐的重复性质通过数据切片方法来捕获,考虑到每个歌曲剪辑的代表1秒的大脑信号。更具体地说,我们预测与EEG数据的一秒钟相对应的歌曲,而不是完整的两分钟响应。我们还讨论了处理数据集和各种CNN体系结构的大幅度的预处理步骤。对于所有实验,我们都考虑了每位参与者在火车和测试数据中对每首歌曲的脑电图响应。我们获得了84.96 \%的精度。观察到的表演对这样的观念有适当的影响,即听一首歌在大脑中创造了特定的模式,而这些模式因人而异。
The music signal comprises of different features like rhythm, timbre, melody, harmony. Its impact on the human brain has been an exciting research topic for the past several decades. Electroencephalography (EEG) signal enables non-invasive measurement of brain activity. Leveraging the recent advancements in deep learning, we proposed a novel approach for song identification using a Convolution Neural network given the electroencephalography (EEG) responses. We recorded the EEG signals from a group of 20 participants while listening to a set of 12 song clips, each of approximately 2 minutes, that were presented in random order. The repeating nature of Music is captured by a data slicing approach considering brain signals of 1 second duration as representative of each song clip. More specifically, we predict the song corresponding to one second of EEG data when given as input rather than a complete two-minute response. We have also discussed pre-processing steps to handle large dimensions of a dataset and various CNN architectures. For all the experiments, we have considered each participant's EEG response for each song in both train and test data. We have obtained 84.96\% accuracy for the same. The performance observed gives appropriate implication towards the notion that listening to a song creates specific patterns in the brain, and these patterns vary from person to person.