Analysis of information in the tasks of consolidating from open sources

DOI №________________

Abstract

The article discusses the issues and possibilities of using existing parsing algorithms for obtaining and consolidating data from open sources for monitoring the ecological situation in Ukraine. A study was conducted on the time of operation and the use of memory, depending on the number of iterations. Thanks to this research, it is possible to choose the best algorithm for tasks, when data consolidation is necessary.

Keywords: consolidating data, open sources, monitoring, parsing algorithms, number of iterations.

References (MLA)
1. Koval O., Kuzminykh V., Khaustov D. "Using stochastic automation for data consolidation." Research Bulletin of NTUU "KPI". Engineering 2 (2017): 29-36.
2. Shakhovska N. B. "Methods for processing consolidated data using data spaces." Problemy prohramuvannia 4 (2011): 72-84.
3. Chernyak L. "Big data ‒ a new theory and practice." Moskva: Open Systems 10 (2011): 3641.
4. Schrenk M. "Webbots, spiders, and screen scrapers 2nd Edition: a guide to developing internet agents with PHP/CURL." No starch press inc. (2012): 362.
5. "Benchmark HTML parsers/" [Electronic resource] The site of "Habrahabr". (2012): URL: https://habrahabr.ru/post/163979/.
6. "Morgan C. XML for PHP developers: Part 2. Advanced XML parsing techniques." [Electronic resource] Community developerWorks (2010): URL: http://www.ibm.com/developerworks/ru/library/x-xmlphp2/index.html.
7. Rasti Harold E. "XML Parsing Analysis in PHP." [Electronic resource] Community developerWorks (2007. 11 October (2007): URL: http://www.ibm.com/developerworks/ru/library/xpullparsingphp/index.html
8. Kuzminykh V. O., Koval A. V., Osypenko M. V. "Methods of machine training on the basis of stochastic automatic devices in the tasks of consolidation of data from unsealed sources." [Electronic resource] CEUR workshop proceedings - Vol-2067 urn:nbn:de:0074-2067-8 (2017): 6368. URL: [http://ceur-ws.org/Vol-2067/paper9.pdf]