Scala, Spark/pyspark

Key Responsibilities: Big Data Spark Development Design and implement scalable data pipelines using Apache Spark Scala and or PySpark Work extensively with Spark Core Spark SQL DataFrames and Datasets Develop batch and real time data processing solutions using Spark Streaming Structured Streaming Op