인공 신경망에서 은닉 유닛 명확화를 이용한 효율적인 규칙추출 방법 = A Efficient Rule Extraction Method Using Hidden Unit Clarification in Trained Neural Network

국문 초록 (Abstract)

인공 신경망은 최근 다양한 분야에서 뛰어난 성능을 보여주고 있다. 하지만 인공 신경망이 학습한 지식이 정확히 어떤 내용인지를 사람이 파악하기 어렵다는 문제점이 존재하는데, 이를 해결하기 위한 방법 중 하나로 학습된 인공 신경망에서 규칙을 추출하는 방법들이 연구되고 있다. 본 연구에서는 학습된 인공 신경망으로부터 규칙을 추출하는 방법 중 하나인 ordered-attribute search(OAS) 알고리즘을 사용하여 인공 신경망으로부터 규칙을 추출해보고, 추출된 규칙을 개선하기 위해 규칙들을 분석하였다. 그 결과로 은닉 층의 출력값 분포가 OAS 알고리즘을 이용해 추출된 규칙의 정확도에 영향을 주는 것을 파악하였고, 은닉 유닛 명확화 기법을 통해 은닉 층 출력값을 이진화하여 효율적인 규칙을 추출할 수 있음을 제시하였다.

다국어 초록 (Multilingual Abstract)

Recently artificial neural networks have shown excellent performance in various fields. However, there is a problem that it is difficult for a person to understand what is the knowledge that artificial neural network trained. One of the methods to solve these problems is an algorithm for extracting rules from trained neural network. In this paper, we extracted rules from artificial neural networks using ordered-attribute search(OAS) algorithm, which is one of the methods of extracting rules, and analyzed result to improve extracted rules. As a result, we have found that the distribution of output values of the hidden layer unit affects the accuracy of rules extracted by using OAS algorithm, and it is suggested that efficient rules can be extracted by binarizing hidden layer output values using hidden unit clarification.

참고문헌 (Reference)

• 1 I. A., "Symbolic interpretation of artificial neural network" 11 (11): 448-463, 1999
• 2 Andrews, R., "Survey and critique of techniques for extracting rules from trained artificial neural networks" 8 (8): 373-389, 1995
• 3 Ishikawa, M., "Structural Learning with Forgetting" 9 (9): 509-521, 1996
• 4 T. Hailesilassie, "Rule extraction algorithm for deep neural networks: A review" 14 (14): 376-, 2016
• 5 L. M. Fu, "Rule Learning by Searching on Adapted Nets" 590-595, 1991
• 6 L. M. Fu, "Rule Generation from Neural Networks" 24 (24): 1114-1124, 1994
• 7 L. M. Fu, "Knowledge-based connectionism for revising domain theories" 23 (23): 173-182, 1993
• 8 R. Setiono, "FERNN:An algorithm for fast extraction" 12 (12): 15-25, 2000
• 9 S. Thrun, "Extracting rules from artificial neural networks with distributed representations" 505-512, 1995
• 10 G. G. Towell, "Extracting refined rules from knowledge-based neural networks" 13 (13): 71-101, 1993
• 11 Kim H., "Computationally Efficient Heuristics for If-Then Rule Extraction from Feed-Forward Neural Networks" Springer 1967 : 2000
• 12 G. P. Schmitz, "ANN-DT : an algorithm for extraction of decision trees from artificial neural networks" 10 (10): 1392-1401, 1999