텍스트 마이닝을 이용한 감정 유발 요인‘Emotion Trigger’에 관한 연구 = A Study of 'Emotion Trigger' by Text Mining Techniques

다국어 초록 (Multilingual Abstract)

The explosion of social media data has led to apply text–mining techniques to analyze big social media data in a more rigorous manner. Even if social media text analysis algorithms were improved, previous approaches to social media text analysis have some limitations. In the field of sentiment analysis of social media written in Korean, there are two typical approaches. One is the linguistic approach using machine learning, which is the most common approach. Some studies have been conducted by adding grammatical factors to feature sets for training classification model. The other approach adopts the semantic analysis method to sentiment analysis, but this approach is mainly applied to English texts. To overcome these limitations, this study applies the Word2Vec algorithm which is an extension of the neural network algorithms to deal with more extensive semantic features that were underestimated in existing sentiment analysis. The result from adopting the Word2Vec algorithm is compared to the result from co-occurrence analysis to identify the difference between two approaches. The results show that the distribution related word extracted by Word2Vec algorithm in that the words represent some emotion about the keyword used are three times more than extracted by co-occurrence analysis. The reason of the difference between two results comes from Word2Vec’s semantic features vectorization. Therefore, it is possible to say that Word2Vec algorithm is able to catch the hidden related words which have not been found in traditional analysis. In addition, Part Of Speech (POS) tagging for Korean is used to detect adjective as "emotional word" in Korean. In addition, the emotion words extracted from the text are converted into word vector by the Word2Vec algorithm to find related words. Among these related words, noun words are selected because each word of them would have causal relationship with “emotional word” in the sentence. The process of extracting these trigger factor of emotional word is named “Emotion Trigger” in this study. As a case study, the datasets used in the study are collected by searching using three keywords: professor, prosecutor, and doctor in that these keywords contain rich public emotion and opinion. Advanced data collecting was conducted to select secondary keywords for data gathering. The secondary keywords for each keyword used to gather the data to be used in actual analysis are followed: Professor (sexual assault, misappropriation of research money, recruitment irregularities, polifessor), Doctor (Shin hae-chul sky hospital, drinking and plastic surgery, rebate) Prosecutor (lewd behavior, sponsor). The size of the text data is about to 100,000(Professor: 25720, Doctor: 35110, Prosecutor: 43225) and the data are gathered from news, blog, and twitter to reflect various level of public emotion into text data analysis. As a visualization method, Gephi (http://gephi.github.io) was used and every program used in text processing and analysis are java coding. The contributions of this study are as follows: First, different approaches for sentiment analysis are integrated to overcome the limitations of existing approaches. Secondly, finding Emotion Trigger can detect the hidden connections to public emotion which existing method cannot detect. Finally, the approach used in this study could be generalized regardless of types of text data. The limitation of this study is that it is hard to say the word extracted by Emotion Trigger processing has significantly causal relationship with emotional word in a sentence. The future study will be conducted to clarify the causal relationship between emotional words and the words extracted by Emotion Trigger by comparing with the relationships manually tagged. Furthermore, the text data used in Emotion Trigger are twitter, so the data have a number of distinct features which we did not deal with in this study. These features will be considered in further study.

국문 초록 (Abstract)

최근 소셜 미디어의 사용이 폭발적으로 증가함에 따라 이용자가 직접 생성하는 방대한 데이터를 분석하기 위한 다양한 텍스트 마이닝(text mining) 기법들에 대한 연구가 활발히 이루어지고 있다. 이에 따라 텍스트 분석을 위한 알고리듬(algorithm)의 정확도와 수준 역시 높아지고 있으나, 특히 감성 분석(sentimental analysis)의 영역에서 언어의 문법적 요소만을 적용하는데 그쳐 화용론적·의미론적 요소를 고려하지 못한다는 한계를 지닌다. 본 연구는 이러한 한계를 보완하기 위해 기존의 알고리듬 보다 의미 자질을 폭 넓게 고려할 수 있는 Word2Vec 기법을 적용하였다. 또한 한국어 품사 중 형용사를 감정을 표현하는 ‘감정어휘’로 분류하고, Word2Vec 모델을 통해 추출된 감정어휘의 연관어 중 명사를 해당 감정을 유발하는 요인이라고 정의하여 이 전체 과정을 ‘Emotion Trigger'라 명명하였다. 본 연구는 사례 연구(case study)로 사회적 이슈가 된 세 직업군(교수, 검사, 의사)의 특정 사건들을 연구 대상으로 선정하고, 이 사건들에 대한 대중들의 인식에 대해 분석하고자 한다. 특정 사건들에 대한 일반 여론과 직접적으로 표출된 개인 의견 모두를 고려하기 위하여 뉴스(news), 블로그(blog), 트위터(twitter)를 데이터 수집 대상으로 선정하였고, 수집된 데이터는 유의미한 연구 결과를 보여줄 수 있을 정도로 그 규모가 크며, 추후 다양한 연구가 가능한 시계열(time series) 데이터이다. 본 연구의 의의는 키워드(keyword)간의 관계를 밝힘에 있어, 기존 감성 분석의 한계를 극복하기 위해 Word2Vec 기법을 적용하여 의미론적 요소를 결합했다는 점이다. 그 과정에서 감정을 유발하는 Emotion Trigger를 찾아낼 수 있었으며, 이는 사회적 이슈에 대한 일반 대중의 반응을 파악하고, 그 원인을 찾아 사회적 문제를 해결하는데 도움이 될 수 있을 것이다.

참고문헌 (Reference)

• 1 김진옥, "한글 텍스트의 오피니언 분류 자동화 기법" 한국정보과학회 38 (38): 423-428, 2011
• 2 이철성, "한글 마이크로블로그 텍스트의 감정 분류 및 분석" 한국정보과학회 40 (40): 159-167, 2013
• 3 서지훈, "한국 문법의 반의어 규칙을 적용한 오피니언 감성사전 설계" 한국정보기술학회 13 (13): 109-117, 2015
• 4 장경애, "인터넷 감정기호를 이용한 긍정/부정 말뭉치구축 및 감정분류 자동화" 한국정보과학회 42 (42): 512-521, 2015
• 5 송종석, "상품평 극성 분류를 위한 특징별 서술어 긍정/부정 사전 자동 구축" 한국정보과학회 38 (38): 157-168, 2011
• 6 최석재, "빅데이터 분석을 위한 한국어 SentiWordNet 개발 방안 연구: 분노 감정을 중심으로" 한국전자거래학회 19 (19): 1-19, 2014
• 7 홍소라, "대용량 소셜 미디어 감성분석을 위한 반감독 학습 기법" 한국지능시스템학회 24 (24): 482-488, 2014
• 8 Hung, C., "Using objective words in SentiWordNet to improve word-of-mouth sentiment classification" 28 (28): 47-54, 2013
• 9 Go, A., "Twitter sentiment classification using distant supervision, CS224N Project Report" 1-12, 2009
• 10 Kouloumpis, E., "Twitter sentiment analysis: The good the bad and the omg!" 11 : 538-541, 2011
• 11 Ohana, B., "Sentiment classification of reviews using SentiWordNet" 13-, 2009
• 12 Narayanan, R., "Sentiment analysis of conditional sentences" 1 : 180-189, 2009
• 13 Liu, B, "Sentiment analysis and subjectivity" 2 : 627-666, 2010
• 14 Kim, K. M, "Sentiment Analysis of Twitter using Lexical Functional Information" 734-736, 2014
• 15 Sadamitsu, K, "Sentiment Analysis Based on Probabilistic Models Using Inter-Sentence Information" 2008
• 16 Kang, H. H., "Sentilexicon and improved Naïve Bayes algorithms for sentiment analysis of restaurant reviews" 39 (39): 6000-6010, 2012
• 17 Saif, H, "Semantic sentiment analysis of twitter" 508-524, 2012
• 18 Hamouda, A., "Reviews classification using sentiwordnet lexicon" 2011
• 19 Kim, Y. S., "Journal of Korea Entertainment Industry Association" 206-210, 2013
• 20 Saggionα, H, "Interpreting Senti WordNet for opinion classification" 1129-1133, 2010
• 21 Mikolov, T., "Efficient estimation of word representations in vector space"
• 22 Harris, Zellig S., "Distributional structure" Word 1954
• 23 Kang, H. H., "Design and Implementation of System for Classifying Review of Product Attribute to Positive/Negative" 36 (36): 1-6, 2009
• 24 Jang, H. J, "Classification System for Emotional Verbs and Adjectives" 29-34, 2001
• 25 An, J. K., "Building a Korean Sentiment Dictionary and Applications of Natural Language Processing" 177-182, 2014
• 26 Seo, J. R., "Big Data Analysis by Sensitivity Analysis" 2 (2): 15-21, 2014
• 27 Saif, H., "Alleviating data sparsity for twitter sentiment analysis" 2-9, 2012
• 28 Kim, S. W., "A Study on the Effect of Using Sentiment Lexicon in Opinion Classification" 121-128, 2013