Application of Network Crawling Spatial Data based on ArcGIS 

Lanlan Ding 

Chongqing Jiaotong University, Chongqing, 400074, China 

Abstract: Today, with the "big data storm" swept away, web crawler technology is becoming more and more popular and practical at present, and the combination of data mining and extracting information with ArcGIS processing spatial data is in line with the problems that many industries will involve. How to correctly use the crawling data and set the correct coordinate system is the key. Through this research, we can understand the data mining channels, ｍａｓｔｅｒ the process of setting and transforming the network crawling space data and the subsequent processing and analysis. This paper uses the network to crawl the relevant information of the hot pot restaurant in Chongqing, the public comment network, as a data ｓｏｕｒｃｅ, analyzes the density distribution of hot pot restaurants in the main city of Chongqing, and produces the heat map of the distribution of hot pot restaurants in Chongqing, and discusses the distribution of hot pot restaurants.The GeoSharp network was used to climb the raw data of the hot pot store in Chongqing. The data was imported into ArcGIS software to set up the coordinate system and convert the projection. The distribution of the hot pot restaurant in the main city of Chongqing was analyzed through density analysis. The results show that the hottest place in the main city is the most densely distributed place in the Yuzhong District, as well as the junction of Shapingba District, Dadukou District, Nan'an District and Jiulongpo District.

Keywords: ArcGIS; Network crawling; Projection conversion