Data Engineer - ETL/Data Warehousing (3-5 yrs)

Job Description :

We are seeking a skilled Data Engineer to design, develop, and maintain real-time data pipelines supporting mission-critical financial data systems. This role focuses on building scalable, high-performance infrastructure that ensures data is accurate, available, and secure. Youll work closely with engineering, analytics, and product teams to deliver robust data solutions that power decision-making and innovation.

Key Responsibilities :

- Design, develop, and manage real-time and batch ETL pipelines to ingest, process, and store financial data from various sources.

- Ensure data integrity, accuracy, and consistency across multiple systems and environments.

- Build and maintain data lakes and data warehouses optimized for analytical workloads.

- Leverage big data tools and cloud infrastructure (especially AWS) to scale data systems for growing business needs.

- Monitor and optimize performance of data pipelines, resolving bottlenecks and ensuring low-latency data delivery.

- Implement and uphold data governance, security, and compliance standards.

- Collaborate with cross-functional teams including data analysts, software engineers, and product stakeholders.

- Maintain thorough documentation for data architecture, ETL processes, and data lineage.

Required Skills and Qualifications :

- 3+ years of professional experience in data engineering or a similar role.

- Proficiency with cloud platforms, particularly AWS (S3, Lambda, Redshift, EMR, etc.).

- Hands-on experience with Apache Kafka for real-time data streaming and messaging.

- Strong programming skills in Python or Scala, and fluency in SQL for data manipulation and querying.

- Experience working with big data technologies such as Apache Spark, Snowflake, or similar tools.

- Solid understanding of data modeling, ETL architecture, and data warehousing concepts.

- Familiarity with data governance, privacy standards, and compliance requirements (e.g., GDPR, SOC 2).

- Proven ability to build scalable, fault-tolerant systems that can evolve with business needs.