i
TalentBox
Labs
6 TalentBox Labs Jobs
Senior Data Engineer - ETL Tools (7-10 yrs)
TalentBox Labs
posted 3+ weeks ago
Key skills for the job
Job Description :
- Design and implement scalable data migration pipelines from relational databases and teradata to AWS Databricks.
- Experience using IBM Data Stage, FiveTran, Airflow, and Databaricks Workflow
- Optimize ETL processes, performance tuning, and data transformations using Spark and SQL.
- Develop automation for data ingestion, validation, and quality checks in a cloud environment.
- Collaborate with architects and stakeholders to ensure a secure, efficient, and seamless migration.
Required Skills & Technologies :
- Databricks (Delta Lake, Unity Catalog, Workflows, Lakehouse Architecture)
- Apache Spark & SQL for large-scale data processing
- AWS Cloud Services (S3, Glue, Lambda, Redshift)
- Relational Databases (Oracle, SQL Server, DB2, Teradata)
- ETL/ELT tools (IBM DataStage, Apache Airflow, FiveTran)
- Data Modeling, Performance Tuning, and Query Optimization
- Automation, Data Quality, and Governance Best Practices
Functional Areas: Software/Testing/Networking
Read full job description7-10 Yrs
Data Engineering, Big Data, MySQL +1 more
8-11 Yrs
Python, AWS, SQL +2 more
12-15 Yrs
Data Engineering, .NET, SQL +4 more
7-9 Yrs
SQL Server, ASP.NET, C# +6 more
14-18 Yrs
Python, Java, API Integration +1 more
2-5 Yrs
DevOps, AWS, Cloud Services +3 more