Big Data Administrator - Hadoop/Spark (7-10 yrs)

As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :

Hadoop Installation and Deployment :

- Install Hadoop in Linux environments.

- Deploy and maintain Hadoop clusters.

- Monitor cluster health to ensure continuous uptime.

- Analyze storage data volume and allocate space in HDFS.

- Manage cluster resources, including node creation and removal.

- Configure NameNode for high availability.

Hadoop Administration :

- Implement and administer Hadoop infrastructure on an ongoing basis.

- Deploy and configure required hardware and software.

- Expand existing Hadoop environments.

- Install and configure software components.

- Perform database backup, recovery, and security measures.

- Monitor and optimize database performance.

- Manage and optimize disk space for data handling.

- Install patches and upgrade software as needed.

- Automate manual tasks for improved efficiency.

Requirements :

- 7+ years of experience as a Big Data Admin.

- In-depth knowledge of Hadoop and Spark ecosystems.

- Strong Linux administration skills.

- Experience with distributed file systems (HDFS).

- Familiarity with big data tools and technologies (Hive, Pig, Impala, etc.).

- Understanding of data warehousing and data modeling concepts.

- Excellent problem-solving and analytical skills.

- Ability to work independently and as part of a team.

Preferred Qualifications :

- Experience with cloud platforms (AWS, GCP, Azure).

- Knowledge of scripting languages (Python, Bash).

- Certification in Hadoop or Spark.