Data Engineer - Microsoft Fabric (5-7 yrs)

Job Title : Microsoft Fabric Data Engineer

Experience : 5+ Years

Location : Bangalore

Job Type : Contract (24 Months)

Job Overview :

We are seeking a highly skilled and experienced Microsoft Fabric Data Engineer/Architect to design, develop, and maintain robust, scalable, and secure data solutions within the Microsoft Fabric ecosystem. This contract role, based in Bangalore for 24 months, requires deep expertise in leveraging the full suite of Microsoft Azure data services, including Azure Databricks, Azure Data Factory, and Azure Data Lake, to build end-to-end data pipelines, data warehouses, and data lakehouses that enable advanced analytics and business intelligence.

Responsibilities :

- Design, develop, and implement end-to-end data solutions within the Microsoft Fabric ecosystem, including Lakehouse, Data Warehouse, and Real-Time Analytics components.

- Leverage extensive experience with Microsoft Azure data services, specifically Azure Databricks (for data processing and transformation), Azure Data Factory (for orchestration and ETL/ELT), and Azure

Data Lake Storage (Gen2) (for data storage).

- Architect and implement robust, scalable, and secure data pipelines for data ingestion, transformation, and curation from diverse sources.

- Develop and optimize data models within Microsoft Fabric, adhering to best practices for performance and scalability.

- Design and implement data quality, validation, and reconciliation processes to ensure data integrity and accuracy.

- Collaborate closely with data architects, data scientists, business intelligence developers, and business stakeholders to understand data requirements and translate them into technical solutions.

- Utilize Spark (Python/Scala) within Azure Databricks for complex data transformations and analytical workloads.

- Implement CI/CD pipelines for data solutions within Azure DevOps or similar tools, ensuring automated deployment and version control.

- Monitor and optimize the performance of data pipelines and data solutions within Microsoft Fabric.

- Troubleshoot and resolve complex data-related issues and performance bottlenecks.

- Maintain comprehensive documentation for data architectures, pipelines, data models, and processes.

- Stay updated with the latest advancements in Microsoft Fabric, Azure data services, and data engineering best practices.

Required Skills & Qualifications :

- 5+ years of experience as a Data Engineer or Data Architect.

- Mandatory hands-on experience with Microsoft Fabric, including its core components (Lakehouse, Data Warehouse, Real-Time Analytics).

- Strong expertise in Microsoft Azure data services, including:

- Azure Databricks (PySpark/Scala for data processing).

- Azure Data Factory (for ETL/ELT orchestration).

- Azure Data Lake Storage (Gen2).

- Proven experience in designing, developing, and maintaining scalable data pipelines.

- Solid understanding of data warehousing concepts, data modeling (dimensional, relational), and data lakehouse architectures.

- Proficiency in SQL for data manipulation and querying.

- Experience with version control systems (e.g., Git, Azure Repos).

- Strong analytical and problem-solving skills, with a keen eye for detail.

- Excellent communication skills (written and verbal) and ability to collaborate effectively with cross-functional teams.

- Bachelors degree in Computer Science, Information Technology, or a related fieldor equivalent practical experience.

Preferred Skills :

- Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Azure Solutions Architect Expert.

- Experience with other components of Microsoft Fabric like Power BI (for data visualization) or Synapse Analytics.

- Familiarity with streaming data technologies (e.g., Azure Event Hubs, Azure Stream Analytics).

- Knowledge of data governance and data security practices within Azure/Fabric.

- Experience with PowerShell or Python scripting for automation.

- Exposure to other cloud platforms (AWS, GCP).