Databricks SQL Engineer - Python/PySpark (5-7 yrs)
TALPRO
posted 2 weeks ago
Mandatory Skills :
- Databricks
- SQL
- PySpark
- Pharma or Life Sciences domain experience
Role Overview/Job Summary :
- We are looking for an experienced Databricks SQL Engineer with a Pharma or Life Sciences background to join our offshore Data Engineering team.
- This role focuses on building efficient, scalable SQL-based data models and pipelines using Databricks SQL, Spark SQL, and Delta Lake.
- The ideal candidate will play a key role in transforming raw data into valuable analytical insights, enabling critical decision-making across pharma-related business functions.
Key Responsibilities/Job Responsibilities :
- Design and optimize SQL queries and data models in Databricks for large-scale datasets
- Develop and maintain robust ETL/ELT pipelines using Databricks workflows
- Implement Delta Lake and Unity Catalog for secure and governed data assets
- Ensure data quality via validation, testing, and monitoring mechanisms
- Optimize performance and cost for the data lakehouse environment
- Collaborate with stakeholders to support analytics and business needs
- Deploy notebooks and SQL workflows using CI/CD best practices
- Document pipelines, queries, and data models to foster self-service
Functional Areas: Software/Testing/Networking
Read full job description5-7 Yrs
Python, SQL, ETL +2 more
8-12 Yrs
SAP BW, SAP Analytics Cloud, SAP HANA +3 more
5-12 Yrs
Servicenow, VMware, SCCM +4 more
7-10 Yrs
SAP GRC, SAP SCM, SAP Support +2 more
5-7 Yrs
Maximo, WebLogic, Apache Tomcat +1 more
5-8 Yrs
Data Engineering, Python, Java +8 more
6-8 Yrs
Embedded Software, Embedded Systems, Data Structures and Algorithms +6 more
10-11 Yrs
Golang, Shopify, Nestjs +3 more