NITOR - Lead Data Engineer - Big Data Solutions (5-9 yrs)

Job Role/Title : Lead Data Engineer/ Senior Software Engineer

Experience Range : 5-9 Years

Location : Pune

Job Description :

- Extract, Clean, transform, and analyse vast amounts of raw data from various Data Sources.

- Build data pipelines and API integrations with various internal systems.

- Work Across all stages of Data Lifecycle

- Implement best practices across all Data Analytics Processes

- Estimate effort, identify risks, and plan execution.

- Proactively monitor, identify, and escalate issues or root causes of systemic issues.

- Enable data scientists, business, and product partners to fully leverage our platform.

- Engage with business stakeholders to understand client requirements and build technical solutions and delivery plans.

- Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality.

- Provide end to end big data solution and design details to data engineering teams.

- Excellent analytical & problem-solving skills

- Excellent communication skills, experience communicating with Snr. Business stakeholders

- Leading technical delivery on use-cases, able to plan and delegate tasks to more junior team members, oversee the work from inception to final product.

Candidate Profile :

- Design, build, test and deploy innovative Big Data solutions at scale.

- Extract, Clean, transform, and analyse vast amounts of raw data from various Data Sources.

- Build data pipelines and API integrations with various internal systems.

- Work Across all stages of Data Lifecycle

- Implement best practices across all Data Analytics Processes

- Estimate effort, identify risks, and plan execution.

- Proactively monitor, identify, and escalate issues or root causes of systemic issues.

- Enable data scientists, business, and product partners to fully leverage our platform.

- Engage with business stakeholders to understand client requirements and build technical solutions and delivery plans.

- Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality.

- Provide end to end big data solution and design details to data engineering teams.

- Excellent analytical & problem-solving skills

- Excellent communication skills, experience communicating with Snr. Business stakeholders

- Leading technical delivery on use-cases, able to plan and delegate tasks to more junior team members, oversee the work from inception to final product.

Key Required Skills : Apache Airflow, Kafka, SQL, Data Engineering, CI CD pipelines , Big Data, Apache Spark, Logical Data Model, Physical Data Model