Data Engineer - ETL/Python (3-4 yrs)

Role : Data Engineer

Candidate with ETL and IAC expertise.

Experience 3 - 4 years.

Key Responsibilities :

- Design and implement data pipelines and ETL workflows using AWS Glue, migrating from legacy Python scripts on EC2.

- Work with AWS Organizations to manage and optimize a multi-account strategy with centralized governance and billing.

- Develop and enforce network and security policies including NACLs, VPCs, and VPN configurations.

- Implement and manage Infrastructure as Code (IaC) using tools like Terraform or AWS CloudFormation.

- Design, monitor, and maintain long-running ETL processes (16+ hours), ensuring fault tolerance and recovery.

- Migrate and integrate data using AWS DMS (Database Migration Service).

- Ensure proper data encryption and masking of sensitive data, including PII and PCI data, following best practices and compliance standards.

- Collaborate with security teams to enhance data security and governance frameworks.

- Integrate with tools like Coalesce for data modeling and transformation workflows.

- Optimize data storage and retrieval processes for scalability and performance.

Required Skills & Experience :

- 4+ years of experience in data engineering roles.

- Strong expertise in AWS services including Glue, DMS, EC2, VPC, IAM, S3, CloudWatch, and KMS.

- Solid understanding of networking and security in AWS, including NACLs, security groups, and VPNs.

- Hands-on experience with Python for scripting and data processing.

- Proven track record of migrating ETL workflows to serverless architectures.

- Experience with data masking, encryption, and compliance frameworks (e.g., GDPR, PCI-DSS).

- Familiarity with IaC tools like Terraform or AWS CloudFormation.

- Working knowledge of Coalesce or similar data orchestration platforms is a plus.

- Experience managing long-running data jobs and optimizing for cost and performance.