소셜미디어 사진 게시물의 딥러닝을 활용한 도시공원 이용자 활동 이미지 분류모델 개발 = Development of Image Classification Model for Urban Park User Activity Using Deep Learning of Social Media Photo Posts

다국어 초록 (Multilingual Abstract)

This study aims to create a basic model for classifying the activity photos that urban park users shared on social media using Deep Learning through Artificial Intelligence. Regarding the social media data, photos related to urban parks were collected through a Naver search, were collected, and used for the classification model. Based on the indicators of Naturalness, Potential Attraction, and Activity, which can be used to evaluate the characteristics of urban parks, 21 classification categories were created. Urban park photos shared on Naver were collected by category, and annotated datasets were created. A custom CNN model and a transfer learning model utilizing a CNN pre-trained on the collected photo datasets were designed and subsequently analyzed. As a result of the study, the Xception transfer learning model, which demonstrated the best performance, was selected as the urban park user activity image classification model and evaluated through several evaluation indicators. This study is meaningful in that it has built AI as an index that can evaluate the characteristics of urban parks by using user-shared photos on social media. The classification model using Deep Learning mitigates the limitations of manual classification, and it can efficiently classify large amounts of urban park photos. So, it can be said to be a useful method that can be used for the monitoring and management of city parks in the future.

국문 초록 (Abstract)

본 연구의 목적은 인공지능의 딥러닝을 활용하여 소셜미디어에서 공유되는 도시공원 이용자 활동사진을 분류하는 기초 모델을 만드는 것이다. 소셜미디어 데이터는 네이버 검색을 통해 수집된 도시공원 관련 사진들을 수집하여 분류모델에 활용하였다. 도시공원 특성 평가에 활용할 수 있는 지표인 자연성(naturalness), 잠재적 매력성(potential attraction), 활동(activity)을 기반으로 최종 21개의 분류 항목체계를 만들고, 항목별로 네이버에서 공유되는 실제 도시공원 사진을 수집하여 주석이 달린 데이터 세트를 구축했다. 수집한 사진 데이터 세트에 대해 커스텀(cuntom) CNN 모델과 사전 훈련된 CNN의 전이학습 모델을 설계하고 분석하였다. 연구결과, 가장 우수한 성능을 보였던 Xception 전이학습 모델이 최종적으로 도시공원 이용자 활동 이미지 분류모델로 선정되었으며, 그 외 다양한 평가 지표를 통해 모델을 평가했다. 본 연구는 소셜미디어에 공유되는 이용자 사진을 활용하여 도시공원 특성을 평가할 수 있는 지표로서 AI를 구축한 것에 의의가 있다. 딥러닝을 활용한 분류모델은 수동분류에 대한 한계를 보완하고, 대량의 도시공원 사진을 효율적으로 분류할 수 있어서 향후 도시공원의 모니터링 및 관리에 활용할 수 있는 유용한 방법이라고 할 수 있다.

참고문헌 (Reference)

• 1 강영옥 ; 조나혜 ; 박소연 ; 김지연, "합성곱신경망을 활용한 SNS 사진 분류 및 관광객과 거주자의 관광 활동 특성 분석" 대한지리학회 56 (56): 247-264, 2021
• 2 김지영 ; 손용훈, "지오태그 이미지를 활용한 북한산국립공원의 경관미 평가 및 맵핑" 한국조경학회 49 (49): 64-73, 2021
• 3 김인희 ; 김재희, "전력 수요량에 대한 다변량 시계열 군집분석" 한국데이터정보과학회 32 (32): 569-584, 2021
• 4 송민경 ; 장훈, "군집분석을 이용한 수도권 도시의 유형화에 관한 연구" 대한공간정보학회 18 (18): 83-88, 2010
• 5 이주경 ; 손용훈, "구글맵리뷰 텍스트마이닝을 활용한 공원 이용자의 인식 및 평가- 서울숲, 보라매공원, 올림픽공원을 대상으로 -" 한국조경학회 49 (49): 15-29, 2021
• 6 Egorova, E., "sing textual volunteered geographic information to model nature-based activities: A case study from Aotearoa New Zealand" (23) : 25-63, 2021
• 7 Chollet, F., "Xception: Deep Learning with Depthwise Separable Convolutions" 1251-1258, 2017
• 8 Dunkel, A., "Visualizing the perceived environment using crowdsourced photo geodata" 142 : 173-186, 2015
• 9 Gosal, A. S., "Using social media, machine learning and natural language processing to map multiple recreational beneficiaries" 38 : 100958-, 2019
• 10 Wood, S. A., "Using social media to quantify nature-based tourism and recreation" 3 (3): 1-7, 2013
• 11 Oteros-Rozas, E., "Using social media photos to explore the relation between cultural ecosystem services and landscape features across five European sites" 94 : 74-86, 2018
• 12 Lyu, F., "Using multi-source big data to understand the factors affecting urban park use in Wuhan" 43 : 126367-, 2019
• 13 Richards, D. R., "Using image recognition to automate assessment of cultural ecosystem services from social media photographs" 31 : 318-325, 2018
• 14 Muñoz, L., "Using crowdsourced spatial data from Flickr vs. PPGIS for understanding nature's contribution to people in Southern Norway" 2 (2): 437-449, 2020
• 15 Cetin, M., "Using GIS analysis to assess urban green space in terms of accessibility : Case study in Kutahya" 22 (22): 420-424, 2015
• 16 Larson, L. R., "Urban park use during the COVID-19pandemic: Are socially vulnerable communities disproportionately impacted?" 3 : 2021
• 17 Alizadehtazi, B., "Urban park usage during the COVID-19 pandemic" 7 (7): 2150008-, 2020
• 18 Dongeun Kim ; 강영옥 ; Yerim Park ; Nayeon Kim ; Juyoon Lee, "Understanding tourists’ urban images with geotagged photos using convolutional neural networks" 대한공간정보학회 28 (28): 241-255, 2020
• 19 Chiesura, A., "The role of urban parks for the sustainable city" 68 (68): 129-138, 2004
• 20 Schnell, I., "The benefits of discrete visits in urban parks" 41 : 179-184, 2019
• 21 Jang, Y., "Technology trend for image analysis based on deep learning" 17 (17): 113-122, 2019
• 22 Jiang, T., "Supervised machine learning : A brief primer" 51 (51): 675-687, 2020
• 23 Martínez Pastur, G., "Spatial patterns of cultural ecosystem services provision in Southern Patagonia" 31 (31): 383-399, 2016
• 24 Tenerelli, P., "Spatial assessment of aesthetic services in a complex mountain region : Combining visual landscape properties with crowdsourced geographic information" 32 (32): 1097-1115, 2017
• 25 "Social Media·Portal Site Trend Report 2022"
• 26 Szegedy, C., "Rethinking the inception architecture for computer vision" 2818-2826, 2016
• 27 Chen, M., "Quantifying the characteristics of the local urban environment through geotagged flickr photographs and image recognition" 9 (9): 264-, 2020
• 28 Stedman, R. C., "Place Attachment: Advances in Theory, Methods and Applications" Routledge 2014
• 29 "New Product Development Trend Newsletter: Artificial Intelligence(AI) Healthcare"
• 30 MA., "Millennium Ecosystem Assessment" New Island 2005
• 31 Chiang, Y. C., "Metric or topological proximity? The associations among proximity to parks, the frequency of residents’ visits to parks, and perceived stress" 38 : 205-214, 2019
• 32 Gosal, A. S., "Landscape aesthetics : Spatial modelling and mapping using social media images and machine learning" 117 : 106638-, 2020
• 33 Praveenkumar, G. D., "Inventive Communication and Computational Technologies" Springer 695-708, 2022
• 34 Yi, H. M., "Interpreting the Spatial Politics of the Changing Process of Urban Park: Focus on Seoul Childrens Grand Park" The Graduate School Seoul National University 2010
• 35 Tveit, M. S., "Indicators of visual scale as predictors of landscape preference : A comparison between groups" 90 (90): 2882-2888, 2009
• 36 Geng, D. C., "Impacts of COVID-19 pandemic on urban park visitation : A global analysis" 32 (32): 553-567, 2021
• 37 García-Palomares, J. C., "Identification of tourist hot spots based on social networks : A comparative analysis of European metropolises using photo-sharing services and GIS" 63 : 408-417, 2015
• 38 Wang, Y., "How do urban park features affect cultural ecosystem services : Quantified evidence for design practices" 76 : 127713-, 2022
• 39 Aghdam, H. H., "Guide to Convolutional Neural Networks" Springer 978-973, 2017
• 40 "Google Cloud"
• 41 Nanni, L., "Exploiting Adam-like Optimization Algorithms to Improve the Performance of Convolutional Neural Networks"
• 42 Wang, S., "Escaping the gradient vanishing : Periodic alternatives of softmax in attention mechanism" 9 : 168749-168759, 2021
• 43 Kaczynski, A. T., "Environmental correlates of physical activity : A review of evidence about parks and recreation" 29 (29): 315-354, 2007
• 44 Chen, Y., "Emerging social media data on measuring urban park use" 31 : 130-141, 2018
• 45 Zhang, K., "Discovering the tourists' behaviors and perceptions in a tourism destination by analyzing photos’ visual content with a computer deep learning model : The case of Beijing" 75 : 595-608, 2019
• 46 Zhang, K., "Differing perceptions of the youth and the elderly regarding cultural ecosystem services in urban parks : An exploration of the tour experience" 821 : 153388-, 2022
• 47 Wang, R., "Developing an artificial intelligence framework for online destination image photos identification" 18 : 100512-, 2020
• 48 Angradi, T. R., "Determining preferences for ecosystem benefits in Great Lakes areas of concern from photographs posted to social media" 44 (44): 340-351, 2018
• 49 Huang, G., "Densely connected convolutional networks" 4700-4708, 2017
• 50 Yoshimura, N., "Demand and supply of cultural ecosystem services : Use of geotagged photos to map the aesthetic value of landscapes in Hokkaido" 24 : 68-78, 2017
• 51 Ilic, L., "Deep mapping gentrification in a large Canadian city using deep learning and Google Street View" 14 (14): e0212814-, 2019
• 52 LeCun, Y., "Deep learning" 521 (521): 436-444, 2015
• 53 Van Zanten, B. T., "Continental-scale quantification of landscape values using social media data" 113 (113): 12974-12979, 2016
• 54 Clemente, P., "Combining social media photographs and species distribution models to map cultural ecosystem services : The case of a Natural Park in Portugal" 96 : 59-68, 2019
• 55 Vesal, S., "Classification of breast cancer histology images using transfer learning" Springer 812-819, 2018
• 56 Goodchild, M. F., "Citizens as sensors : The world of volunteered geography" 69 (69): 211-221, 2007
• 57 윤지영 ; 강영옥, "CNN 기반 다중레이블 전이학습을 통한 관광 이미지 분석" 대한공간정보학회 29 (29): 15-26, 2021
• 58 Rajoub, B., "Biomedical Signal Processing and Artificial Intelligence in Healthcare" Academic Press 51-89, 2020
• 59 Millward, A. A., "Benefits of a forested urban park: What is the value of Allan Gardens to the city of Toronto, Canada?" 100 (100): 177-188, 2011
• 60 Schipperijn, J., "Associations between physical activity and characteristics of urban green space" 12 (12): 109-116, 2013
• 61 Retka, J., "Assessing cultural ecosystem services of a large marine protected area through social media photographs" 176 : 40-48, 2019
• 62 Huang, M. H., "Artificial intelligence in service" 21 (21): 155-172, 2018
• 63 Jeong, K. R., "An Extended Theory of Planned Behavior Approach to Analyzing the Impact of COVID19 on Urban Park Users’ Behavioral Decision-making" The Graduate School Seoul National University. 2021
• 64 Jais, I. K. M., "Adam optimization algorithm for wide and deep neural network" 2 (2): 41-46, 2019
• 65 Sinclair, M., "A crowdsourced valuation of recreational ecosystem services using social media data : An application to a tropical wetland in India" 642 : 356-365, 2018
• 66 Chae, I. Y., "A Method for Analysis of Preferences of Places Based on Sentimental Analysis Using SNS Data: Case Study on Theme Parks in Seoul" Seoul University 2017
• 67 "2021 Naver Blog Report"