Data Engineer - Hadoop/Spark (5-7 yrs)

Qualifications :

- Bachelor's degree in Computer Science/Engineering or similar

- 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines

- Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure Data factory and/or other orchestration tools.

- Proficiency in scripting languages like SQL, Pyspark and/or scala, Snowflakedb ,python is essential, with hands on experience in Databricks preferred.

- Strong experience with bug data technologies such as Hadoop, Spark, Hive, Snowflake or Kafka is required

- Strong knowledge in dimensional modeling principles and experience in designing data warehouses and data marts.

- Experience with monitoring and logging tools such as Prometheus, Grafana or Splunk for system performance and troubleshooting

- Comfortable working in complex and large-scale production environments

- Familiarity with project management and collaboration tools like JIRA and/or Azure

- Devops for tracking tasks, managing workflows and facilitating communications within the team

- Proficiency in Power BI or similar data visualization tools to create meaningful reports and dashboards

Must haves :

- Acknowledges the presence of choice in every moment and takes personal responsibility for their life.

- Possesses an entrepreneurial spirit and continuously innovates to achieve great results.

- Communicates with honesty and kindness, and creates the space for others to do the same.

- Leads with courage, knowing the possibility of greatness is bigger than the fear of failure.

- Fosters connection by putting people first and building trusting relationships.

- Integrates fun and joy as a way of being and working, aka doesn't take themselves too seriously.