Azure Data Engineer

Working experience in Python, Scala, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet
Experience in creating ADF Pipelines to source and process data sets, Experience in creating Databricks notebooks to cleanse, transform and enrich data sets, Good understanding about SQL, Databases, NO-SQL DBs, Data Warehouse, Hadoop and various data storage options on the cloud, Development experience in orchestration of pipelines
Experience in deployment and monitoring techniques
Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources, Experience in handling operations/Integration with source repository

Must have good knowledge on Datawarehouse concepts and Datawarehouse modelling
Good to Have Skills:
Familiarity with DevOps, Agile Scrum methodologies and CI/CD
Domain-driven development exposure
Analytical / problem solving skills
Strong communication skills
Good experience with unit, integration and UAT support
Able to design and code reusable components and functions
Should able to review design, code & provide review comments with justification
Zeal to learn new tool/technologies and adoption
Power BI and Data Catalog experience

Be aware of phishing scams involving fraudulent career recruiting and fictitious job postings; visit our Phishing Scams page to learn more, Neudesic is an Equal Opportunity Employer
Neudesic provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by local laws, Neudesic is an IBM subsidiary which has been acquired by IBM and will be integrated into the IBM organization
Neudesic will be the hiring entity

By proceeding with this application, you understand that Neudesic will share your personal information with other IBM companies involved in your recruitment process, wherever these are located