Hadoop Admin

Job Summary

We are looking for a Hadoop Administrator with 4–7 years of experience in managing Hadoop ecosystems, Cloudera/Hortonworks distributions, and Linux-based environments. The role requires expertise in YARN, HDFS, Hive, Spark, HBase, cluster security, encryption, and AWS-based Hadoop deployments, along with scripting skills for automation.

Job Roles & Responsibilities

• Set up, configure, and administer Hadoop clusters in both cloud (AWS) and on-premises environments.
• Implement Kerberos authentication, data-at-rest encryption, and security policies using tools like Ranger and Atlas.
• Manage and troubleshoot data replication policies and cluster performance issues.
• Support and maintain Hadoop components including HDFS, YARN, Hive, HBase, Zookeeper, Spark.
• Automate operational tasks using shell scripts or Python.
• Monitor system health, perform audits, and ensure high availability and reliability.
• Collaborate with infrastructure, networking, and application development teams.
• Participate in a 24x7 rotating on-call schedule, including weekends and holidays.

Cultural Expectations

• Minimum 4+ years of hands-on experience in Hadoop administration and Linux systems.
• Strong knowledge of Unix OS internals, security configurations, and scripting for automation.
• Proven experience with Cloudera CDP/CDH, Hortonworks HDP, and big data security best practices.
• Ability to work under pressure in a mission-critical production environment.
• Excellent troubleshooting, documentation, and communication skills.
• Willingness to work in rotating shifts and handle production support responsibilities.
• Experience setting up Hadoop platforms on AWS cloud-native services is a strong advantage.

Hiring Process

• Live coding task to evaluate coding proficiency.
• Technical interview with senior member from the technical team.
• Final interview with Tech Lead/CTO.