Azure Data Engineer

Company Description

Our Client in India is one of the leading providers of risk, financial services and business advisory, internal audit, corporate governance, and tax and regulatory services.

Our Client was established in India in September 1993, and has rapidly built a significant competitive presence in the country. The firm operates from its offices in Mumbai, Pune, Delhi, Kolkata, Chennai, Bangalore, Hyderabad , Kochi, Chandigarh and Ahmedabad, and offers its clients a full range of services, including financial and business advisory, tax and regulatory.

Our client has their client base of over 2700 companies. Their global approach to service delivery helps provide value-added services to clients. The firm serves leading information technology companies and has a strong presence in the financial services sector in India while serving a number of market leaders in other industry segments.

Job Description

Job Requirements
Mandatory Skills

Bachelor s or higher degree in Computer Science or a related discipline; or equivalent (minimum 7+ years work experience).
At least 6+ years of consulting or client service delivery experience on Azure Microsoft data engineering.
At least 4+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks, Microsoft Fabric
Hands-on experience implementing data ingestion, ETL and data processing using Azure services: Fabric, onelake, ADLS, Azure Data Factory, Azure Functions, services in Microsoft Fabric etc.
Minimum of 5+ years of hands-on experience in Azure and Big Data technologies such as Fabric, databricks, Python, SQL, ADLS/Blob, pyspark/SparkSQL.
Minimum of 3+ years of RDBMS experience
Experience in using Big Data File Formats and compression techniques.
Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, etc.

Preferred Skills
Technical Leadership & Demo Delivery:
oProvide technical leadership to the data engineering team, guiding the design and implementation of data solutions.
oDeliver compelling and clear demonstrations of data engineering solutions to stakeholders and clients, showcasing functionality and business value.
oCommunicate fluently in English with clients, translating complex technical concepts into business-friendly language during presentations, meetings, and consultations.
ETL Development & Deployment on Azure Cloud:
oDesign, develop, and deploy robust ETL (Extract, Transform, Load) pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, Azure Notebooks, Azure Functions, and other Azure services.
oEnsure scalable, efficient, and secure data integration workflows that meet business requirements.
oPreferably to have following skills Azure doc intelligence, custom app, blob storage
oDesign and develop data quality frameworks to validate, cleanse, and monitor data integrity.
oPerform advanced data transformations, including Slowly Changing Dimensions (SCD Type 1 and Type 2), using Fabric Notebooks or Databricks.
oPreferably to have following skills Azure doc intelligence, custom app, blob storage

Microsoft Certifications:
oHold relevant role-based Microsoft certifications, such as:
DP-203: Data Engineering on Microsoft Azure
AI-900: Microsoft Azure AI Fundamentals.
oAdditional certifications in related areas (e. g. , PL-300 for Power BI) are a plus.
Azure Security & Access Management:
oStrong knowledge of Azure Role-Based Access Control (RBAC) and Identity and Access Management (IAM).
oImplement and manage access controls, ensuring data security and compliance with organizational and regulatory standards on Azure Cloud.
Additional Responsibilities & Skills:
oTeam Collaboration: Mentor junior engineers, fostering a culture of continuous learning and knowledge sharing within the team.
oProject Management: Oversee data engineering projects, ensuring timely delivery within scope and budget, while coordinating with cross-functional teams.
oData Governance: Implement data governance practices, including data lineage, cataloging, and compliance with standards like GDPR or CCPA.
oPerformance Optimization: Optimize ETL pipelines and data workflows for performance, cost-efficiency, and scalability on Azure platforms.
oCross-Platform Knowledge: Familiarity with integrating Azure services with other cloud platforms (e. g. , AWS, GCP) or hybrid environments is an added advantage.
Soft Skills & Client Engagement:
oExceptional problem-solving skills with a proactive approach to addressing technical challenges.
oStrong interpersonal skills to build trusted relationships with clients and stakeholders.
Ability to manage multiple priorities in a fast-paced environment, ensuring high-quality deliverables.