Upload Button Icon Add office photos
Engaged Employer

i

This company page is being actively managed by IBM Team. If you also belong to the team, you can get access from here

IBM Verified Tick

Compare button icon Compare button icon Compare
4.1

based on 20.6k Reviews

filter salaries All Filters

2719 IBM Jobs

Data Engineer: Data Platforms

5-9 years

₹ 5.2 - 30.5L/yr (AmbitionBox estimate)

tooltip
This is an estimate of the average salary range for this position. It has not been reviewed by the company, and the actual salary may differ.

Bangalore / Bengaluru

Data Engineer: Data Platforms

IBM

posted 22d ago

Job Role Insights

Flexible timing

Job Description



A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.

Your Role and Responsibilities
As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.

Your primary responsibilities include:
  • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
  • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
  • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.


Required Technical and Professional Expertise
  • Must have 5+ years exp in Big Data -Hadoop Spark -Scala ,Python
  • Hbase, Hive Good to have Aws -S3,
  • athena ,Dynomo DB, Lambda, Jenkins GIT
  • Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..


Preferred Technical and Professional Expertise
  • Understanding of Devops.
  • Experience in building scalable end-to-end data ingestion and processing solutions
  • Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala"


Employment Type: Full Time, Permanent

Functional Areas: Software/Testing/Networking

Read full job description

IBM Interview Questions & Tips

Prepare for IBM Data Engineer roles with real interview advice

Top IBM Data Engineer Interview Questions

Q1. 1) How to handle data skewness in spark.
View answers (5)
Q2. 5) How to create a kafka topic with replication factor 2
View answer (1)
Q3. 4) How to read json data using spark
View answers (3)
View all 24 questions

What people at IBM are saying

What IBM employees are saying about work life

based on 20.6k employees
78%
84%
66%
79%
Flexible timing
Monday to Friday
No travel
Day Shift
View more insights

IBM Benefits

Work From Home
Soft Skill Training
Health Insurance
Job Training
Cafeteria
Free Transport +6 more
View more benefits

Compare IBM with

Oracle

3.8
Compare

TCS

3.7
Compare

Cognizant

3.8
Compare

Accenture

4.0
Compare

Infosys

3.8
Compare

Capgemini

3.8
Compare

Wipro

3.8
Compare

Deloitte

3.9
Compare

Google

4.4
Compare

Amazon

4.1
Compare

Amdocs

3.9
Compare

SAP

4.3
Compare

Microsoft Corporation

4.1
Compare

Tech Mahindra

3.6
Compare

PwC

3.5
Compare

Ernst & Young

3.5
Compare

Nagarro

4.1
Compare

NetApp

4.0
Compare

Salesforce

4.1
Compare

SAS

4.3
Compare

Similar Jobs for you

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

5-9 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

2-5 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

5-9 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

2-5 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

5-7 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

2-5 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

5-7 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

5-10 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Bangalore / Bengaluru

5-10 Yrs

Not Disclosed

Data Engineer at IBM India Pvt. Limited

Hyderabad / Secunderabad

5-9 Yrs

Not Disclosed

IBM Bangalore / Bengaluru Office Locations

View all
Bangalore Office
Headquarter
IBM India Pvt Ltd, No. 4/1, Tower D, 2nd & 3rd Floor, Dairy Circle, Bannerghatta Main Road Bangalore
Karnataka 560029
Bengaluru Office
IBM, No.12, Subramanya Arcade, Bannerghatta Road Bengaluru
Karnataka 560029

Data Engineer: Data Platforms

5-9 Yrs

Bangalore / Bengaluru

hive, scala, pyspark +24 more

22d ago·via naukri.com

Infrastructure Specialist: System Administration

3-6 Yrs

Pune

security management, continuous integration, kubernetes +18 more

20hr ago·via naukri.com

Business Transformation Consultant: IoT & PLM

5-9 Yrs

Bangalore / Bengaluru

project management, program management, cad +15 more

20hr ago·via naukri.com

Project Manager: Application Operations

6-10 Yrs

Navi Mumbai

six sigma, project management, team management +13 more

20hr ago·via naukri.com

SW Architect / Storage Infrastructure Architect

12-16 Yrs

Pune, Bangalore / Bengaluru, Hyderabad / Secunderabad

san, nas, python +19 more

20hr ago·via naukri.com

Software Developer: DevOps

3-6 Yrs

Bangalore / Bengaluru, Hyderabad / Secunderabad

kubernetes, redhat openshift, software development +15 more

20hr ago·via naukri.com

Quality Engineer: Automation

4-8 Yrs

Hyderabad / Secunderabad

junit, software development, bdd +17 more

20hr ago·via naukri.com

Data Engineer: Big Data-Azure

7-11 Yrs

Bangalore / Bengaluru

azure databricks, sql dw, python +15 more

20hr ago·via naukri.com

Back-end developer

3-5 Yrs

Bangalore / Bengaluru

c++, file system, sql +24 more

20hr ago·via naukri.com

Full Stack Developer

10-14 Yrs

Bangalore / Bengaluru

continuous integration, kubernetes, scipy +21 more

20hr ago·via naukri.com