Innovation Incubator - Senior Data Engineer - Python/SQL/ETL (5-8 yrs)

Key Responsibilities :

Data Engineering :

- Lead the design, development, and implementation of data pipelines and ETL processes to extract, transform, and load data from various sources (e.g., databases, APIs, cloud platforms) into data warehouses and data lakes.

- Develop and implement data quality checks and validation procedures to ensure data accuracy and integrity.

- Build and maintain data models and schemas for optimal data storage and retrieval.

- Collaborate with data scientists and analysts to support data exploration, analysis, and modeling.

- Automate data processes to improve efficiency and reduce manual effort.

Team Leadership :

- Lead and mentor a team of data engineers.

- Assign tasks, provide guidance, and ensure project deadlines are met.

- Foster a collaborative and productive team environment.

- Conduct performance reviews and provide constructive feedback.

Technical Leadership :

- Stay abreast of the latest data engineering technologies and best practices.

- Evaluate and recommend new technologies and tools to improve data infrastructure and processes.

- Contribute to the development and improvement of data engineering standards and best practices within the organization.

Required Skills :

Technical Skills :

- Strong proficiency in SQL and Python.

- Extensive experience with PostgreSQL (including performance tuning and optimization).

- Experience with data warehousing and data lake technologies (e.g., Snowflake, AWS Redshift, Azure Data Lake).

- Experience with cloud platforms (e.g., AWS a strong plus).

- Experience with ETL/ELT tools (e.g., Apache Airflow, dbt, Matillion).

- Experience with data visualization tools (e.g., Tableau, Power BI).

- Knowledge of data modeling techniques (e.g., star schema, snowflake schema).

- Experience with Agile methodologies