Sr. Spark Big Data Developer

Job Summary

We are seeking a highly skilled Senior Spark Engineer with 5-7+ years of experience in big data development. The role requires strong expertise in Spark (batch and streaming), PySpark, Hadoop, Hive, Kafka, and ETL processes, with proficiency in Java/Scala/Python and data engineering on cloud environments. The ideal candidate will develop and deploy end-to-end data pipelines and possess excellent communication and logical skills.

Job Roles & Responsibilities

• Strong Experience in Spark development with batch and streaming
• Intermediate level expertise in HDFS and Hive
• Experience with Pyspark and Data Engineering
• Proficiency in at least one of the following programming languages: Java/Scala/Python
• Good understanding of SQL
• Python, PySpark, Data Bricks developer with knowledge of cloud
• Experience of development and deployment of at least one end-to-end data storage/processing pipeline
• Experience with using Jupyter notebooks or any other developer tool
• Experience with Airflow or other workflow engines
• Good communication skills and logical skills