论文标题
使用深度学习和BERT嵌入域的特定单词来检测白人至上主义的仇恨言论
Detecting White Supremacist Hate Speech using Domain Specific Word Embedding with Deep Learning and BERT
论文作者
论文摘要
白人至上主义者拥护一种激进的意识形态,认为白人优于其他种族的人。这些群体的关键影响不再限于社交媒体。通过促进种族仇恨和暴力,他们在许多方面也对社会产生了重大影响。白人至上主义仇恨言论是最近观察到的有害内容之一。报告仇恨言论的传统渠道由于信息的巨大爆炸而被证明是不足的,因此,有必要找到一种自动方式来及时检测这种言论。这项研究调查了通过使用深度学习和自然语言处理技术在Twitter上自动检测白人至上主义仇恨言论的生存能力。通过我们的实验,我们使用了两种方法,第一种方法是使用域特异性嵌入,这些嵌入是从白人至上主义者语料库中提取的,以捕获这种白人至上主义者语的含义,并具有双向长期短期记忆(LSTM)深度学习模型,这种方法达到了0.74890 F1-SCORE。第二种方法是使用BERT最近的语言模型之一,BERT模型提供了大多数NLP任务的艺术状态。达到0.79605 F1得分。考虑到我们的实验仅基于文本数据,两种方法均在平衡数据集上进行了测试。该数据集是由由Twitter创建的数据集组合在一起的,并根据该白人至上主义论坛编译的Stormfront数据集组合。
White supremacists embrace a radical ideology that considers white people superior to people of other races. The critical influence of these groups is no longer limited to social media; they also have a significant effect on society in many ways by promoting racial hatred and violence. White supremacist hate speech is one of the most recently observed harmful content on social media.Traditional channels of reporting hate speech have proved inadequate due to the tremendous explosion of information, and therefore, it is necessary to find an automatic way to detect such speech in a timely manner. This research investigates the viability of automatically detecting white supremacist hate speech on Twitter by using deep learning and natural language processing techniques. Through our experiments, we used two approaches, the first approach is by using domain-specific embeddings which are extracted from white supremacist corpus in order to catch the meaning of this white supremacist slang with bidirectional Long Short-Term Memory (LSTM) deep learning model, this approach reached a 0.74890 F1-score. The second approach is by using the one of the most recent language model which is BERT, BERT model provides the state of the art of most NLP tasks. It reached to a 0.79605 F1-score. Both approaches are tested on a balanced dataset given that our experiments were based on textual data only. The dataset was combined from dataset created from Twitter and a Stormfront dataset compiled from that white supremacist forum.