14 MoreYeahs Jobs
Lead Data Engineer - ETL/PySpark (7-12 yrs)
MoreYeahs
posted 1mon ago
Fixed timing
Key skills for the job
Job Title : Lead Data Engineer
Location : Indore Madhya Pradesh
Employment Type : Full-time
Experience : 7to12 years
Hybrid Model
Job Overview :
We are seeking a talented and enthusiastic Data Engineers with 7+ years of experience to join our data engineering team. The ideal candidate will have a strong background in ETL processes, data warehousing, and big data technologies, and will play a key role in building and maintaining our data infrastructure to support analytics and business intelligence needs.
Key Responsibilities :
ETL Development :
- Design, develop, and maintain efficient ETL pipelines to process and transform large volumes of data from various sources.
- Implement data transformation and cleansing processes to ensure high-quality data.
Data Warehouse Development :
- Assist in building and optimizing scalable data warehouse solutions using Snowflake, Data bricks, Redshift, or similar technologies.
- Ensure that data models are efficient, scalable, and support the needs of analytics teams.
Big Data & Cloud Technologies :
- Utilize AWS Glue and PySpark to process and transform large datasets in the cloud.
- Implement data pipelines using Apache Airflow for scheduling and orchestration.
Database Management :
- Manage and optimize relational databases (RDBMS) to support both transactional and analytical workloads.
- Write efficient SQL queries to support data extraction, reporting, and analytics.
Collaboration :
- Work closely with your lead and other stakeholders to understand data requirements and deliver reliable data solutions.
- Contribute to the design and architecture of data systems, ensuring alignment with business needs and technical best practices.
Data Quality & Governance :
- Ensure data integrity, accuracy, and availability through rigorous testing, validation, and monitoring of ETL processes.
- Support data governance initiatives by implementing best practices for data management and security.
Experience :
- 6 to7 years of experience in data engineering, with a strong focus on ETL processes and data warehousing.
- Hands-on experience with ETL tools and frameworks, as well as Python and PySpark for data processing.
- Experience with cloud-based data platforms such as AWS Glue, Snowflake, Databricks, or Redshift.
- Proficiency in SQL and experience with RDBMS platforms (e.g., MySQL, PostgreSQL, Oracle).
- Familiarity with data orchestration tools like Apache Airflow.
Technical Skills :
- Strong understanding of data warehousing concepts and best practices.
- Experience in building and optimizing data pipelines and workflows.
- Knowledge of cloud infrastructure (AWS, Azure, GCP) and data processing technologies.
Soft Skills :
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Ability to work in a fast-paced environment and manage multiple tasks simultaneously.
Functional Areas: Software/Testing/Networking
Read full job descriptionPrepare for Lead Data Engineer roles with real interview advice
7-12 Yrs
Indore
Data Engineering, SQL, ETL +4 more
3-10 Yrs
Indore
Python, Clinical Data Management, ETL Testing +4 more
2-5 Yrs
Indore
Software Configuration Management, Computer Networking, SQL +7 more
5-8 Yrs
Indore
Power BI, Data Analytics, Python +6 more
0-2 Yrs
Indore
Sales, IT Sales, Lead Generation +3 more
0-1 Yrs
Indore
Digital Marketing, SEO, Social Media Marketing +6 more
1-4 Yrs
Indore
Medical Coding, Software Configuration Management, Salesforce +4 more
2-5 Yrs
Indore
Digital Marketing, Data Analysis, Salesforce +6 more
1-4 Yrs
Indore
Salesforce, Cloud Computing, Cloud Services +6 more