Optimal organisation of a big data training course: big data processing with BigQuery and setting up a Dataproc Hadoop framework
Serik M. Nurbekova G. Mukhambetova M.
2021World Institute for Engineering and Technology Education
World Transactions on Engineering and Technology Education
2021#19Issue 4417 - 422 pp.
Nowadays, a high growth rate of data flows stored in various computing devices creates the need for big data analysis and increases the demand for specialists with competencies in this area in the socio-economic sphere. The training of big data specialists requires a comprehensive approach and the introduction of innovative technologies, hardware and software, programming environments into the content of education. In this article, the authors present a training course on big data processing and analysis prepared by them. During the preparation, they examined and selected optimal solutions for its implementation using modern hardware and software complexes, including cloud technologies. The authors describe data processing from various sources, data collection using ERA 500 controllers and sensors, processing and analysing big data through the BigQuery service from Google Cloud Platform (GCP), the Google Data Studio visualisation tool, configuring and using the Hadoop framework for high-performance computing distributed through the Dataproc service. The training course was conducted for students in Kazakhstan universities
Text of the article Перейти на текст статьи
L.N. Gumilyev Eurasian National University, Nur-Sultan, Kazakhstan
Khalel Dosmukhamedov Atyrau University, Atyrau, Kazakhstan
L.N. Gumilyev Eurasian National University
Khalel Dosmukhamedov Atyrau University
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026