Advanced Analytics with PySpark

This book is dedicated to practical methods of analyzing large volumes of data using the Python programming language and the Spark framework. It introduces the Spark programming model and the basics of the open-source system PySpark. Each chapter describes a separate aspect of data analysis, covering the fundamentals of data processing in PySpark and Python using data cleaning as an example. It provides an in-depth exploration of machine learning with Spark. The book will help the reader understand how the entire PySpark pipeline works for comprehensive analytics of large datasets: from model creation and evaluation to data cleaning, preprocessing, and exploration, with a special emphasis on production applications. Separate chapters are dedicated to image processing and the Spark NLP library.