Databricks Architect

Job Summary

We are looking for an experienced Data Architect (Databricks) to work onsite at our client location in Pune. The role requires 10–15 years of overall experience with strong expertise in Databricks, SQL, Spark, and cloud platforms. You will be responsible for designing and implementing scalable, secure, and high-performance data solutions, while ensuring best practices in governance, DevOps, and orchestration.

Job Roles & Responsibilities

• Design and implement end-to-end data architecture solutions using Databricks, Spark (PySpark/Scala), and cloud services (Azure/AWS/GCP).
• Lead data ingestion, transformation, and orchestration workflows using ADF, Airflow, or dbt.
• Optimize SQL queries and Spark jobs for high performance and scalability.
• Collaborate with cross-functional teams (engineering, business, DevOps) to deliver robust data solutions.
• Establish and maintain CI/CD pipelines, Git workflows, and Infrastructure-as-Code for data platforms.
• Define and enforce data governance, security, and quality frameworks.
• Provide technical leadership, mentorship, and documentation to teams and stakeholders.

Cultural Expectations

• Technical Depth: 8–10+ years in data engineering/architecture with at least 5 years on Databricks.
• Hands-On Expertise: Strong in Spark (PySpark/Scala), SQL performance tuning, and Python.
• Cloud Experience: Proven ability to build on Azure/AWS/GCP data services.
• Best Practices: Strong grasp of DevOps, IaC, and secure data platform design.
• Leadership: Ability to guide teams, review solutions, and ensure delivery at enterprise scale.
• Communication: Excellent ability to explain technical concepts, document solutions, and engage with stakeholders.

Hiring Process

• Interview with hiring manager to assess technical skills.
• Technical interview with senior member from the technical team.
• Final interview with Tech Lead/CTO.