Northern Arc Capital - Senior Data Engineer - ETL/Apache NiFi (7-11 yrs)

Job Title :

Senior Data Engineer

Education criteria is BE/ B.Tech

Location: Bangalore / Chennai

Experience: 7 - 11 Years

Education : Bachelors or Masters in Computer Science, Information Technology, or a related field

Role Overview :

As a Senior Data Engineer, you will play a key role in designing, developing, and managing complex data pipelines and systems. You will work closely with cross-functional teams to ensure high-quality, secure, and efficient data flow across the organization. This role requires both strong technical expertise and the ability to collaborate effectively with business stakeholders.

Key Responsibilities :

- Design, build, and maintain scalable and reliable ETL pipelines for structured and unstructured data

- Develop and manage data integration solutions across various internal and external systems

- Implement data orchestration workflows using tools like Apache NiFi and Apache Airflow

- Optimize data storage, processing, and query performance for analytics and reporting

- Model and manage data warehouses using SQL and NoSQL databases

- Leverage big data technologies such as Hadoop and Spark for large-scale data processing

- Deploy and manage data pipelines on cloud platforms like AWS, Azure, or Google Cloud

- Write high-quality, efficient code in Python, SQL, Java, Scala, R, or Go

- Ensure data quality, governance, versioning, and compliance with data security standards

- Collaborate with data scientists, analysts, and engineering teams to meet project goals

- Troubleshoot data-related issues and implement long-term solutions

- Mentor junior engineers and contribute to technical architecture and decision-making

Required Qualifications and Skills :

- 9+ years of experience in data engineering, ETL development, and data integration

- Strong expertise in data pipeline orchestration tools (Apache NiFi, Apache Airflow)

- In-depth understanding of SQL and NoSQL databases, data modeling, and warehousing concepts

- Practical experience with big data frameworks (Hadoop, Spark)

- Hands-on experience with cloud data platforms: AWS, Azure, or GCP

- Proficiency in one or more programming languages: Python, Java, Scala, SQL, R, Go

- Experience using version control systems like Git and managing data versioning

- Understanding of data security, privacy standards, and compliance requirements

- Strong analytical and problem-solving skills

- Excellent verbal and written communication skills

- Ability to work independently and collaboratively within cross-functional teams