Lead Data Engineer/ Data Architect

Educational Qualifications

1. Lead and mentor the team, define goals, ensure timely project delivery, and manage code reviews.
2. Design scalable data architectures, select appropriate technologies, and ensure compliance with data security regulations.
3. Build and optimize ETL/ELT pipelines, automate workflows, and ensure data quality.
4. Hands-on experience with Databricks for building and managing scalable data pipelines.
5. Manage cloud-based infrastructure, implement IaC, and optimize costs and availability.
6. Work with business stakeholders to translate requirements into technical solutions, track project
7. milestones, and manage risks using Agile.
8. Stay updated on new technologies, drive innovation, and optimize existing systems.
9. Maintain documentation, share knowledge, and conduct team training sessions.

Educational Qualifications

1. Bachelors or Masters degree in Computer Science, Data Engineering, or related field
2. 9+ years of experience in Data Engineering, with at least 3+ years in an architectural role
3. Strong expertise in data engineering tools and technologies (e.g., Apache Spark, 1 Cloud (AWS or GCP or Azure), SQL, Python).
4. Proficiency in any cloud platforms (e.g., AWS, Azure, GCP) and their data services.
5. Experience with data modeling, ETL/ELT processes, and data warehousing solutions.
6. Knowledge of distributed systems, big data technologies, and real-time data processing.
7. Strong leadership, communication, and problem-solving skills.
8. Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes, Terraform).
9. Understanding of data governance, security, and compliance requirements.