Hadoop Administrator

Hadoop Administrator



Hadoop Administrator - GCP Migration Project



o Bachelor's degree in Computer Science, Information Technology, or a related field (Master's preferred).

o Proven experience as a Hadoop Administrator, with a focus on cloud migrations.

o Strong expertise in managing Hadoop clusters (HDFS, YARN, Hive, Spark, etc.).

o Proficiency in cloud platforms such as AWS and Google Cloud.

o Solid understanding of Big Data technologies and best practices.

o Experience with automation and scripting (e.g., Bash, Python).

o Excellent problem-solving skills and attention to detail.

o Strong communication and teamwork skills.

o Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Solutions Architect) is a plus.



Key Responsibilities:



o Deploy, configure, and maintain Hadoop clusters in a cloud environment (e.g., AWS, Azure, Google Cloud).

o Monitor cluster performance, health, and resource utilization.

o Implement best practices for Hadoop cluster security and data governance.

o Optimize Hadoop clusters for maximum performance and resource utilization.

o Identify and resolve performance bottlenecks.

o Implement and maintain automation scripts for routine tasks.

o Implement security measures, including access controls, encryption, and authentication mechanisms, to safeguard data in the cloud

o Develop and maintain backup and disaster recovery strategies for Hadoop data in the cloud.

o Conduct regular data backups and perform recovery tests.

o Create and maintain documentation for Hadoop configurations, procedures, and best practices.