Sr Data Engineer I

We are looking for a highly skilled and experienced Senior Engineer with a history of building Bigdata, GCP Cloud, Python and Spark applications. The Senior Engineer will play a crucial role in designing, implementing, and optimizing data solutions to support our organizations data-driven initiatives. This role requires expertise in data engineering, strong problem-solving abilities, and a collaborative mindset to work effectively with various stakeholders.

Joining the Enterprise Marketing team, this role will be focused on the delivery of innovative solutions to satisfy the needs of our business. As an agile team we work closely with our business partners to understand what they require, and we strive to continuously improve as a team.

We pride ourselves on a culture of kindness and positivity, and a continuous focus on supporting colleague development to help you achieve your career goals. We lead with integrity, and we emphasize work/life balance for all of our teammates.

How will you make an impact in this role

There are hundreds of opportunities to make your mark on technology and life at American Express. Heres just some of what you'll be doing:

As a part of our team, you will be developing innovative, high quality, and robust operational engineering capabilities.

Develop software in our technology stack which is constantly evolving but currently includes Big data, Spark, Python, Scala, GCP, Adobe Suit ( like Customer Journey Analytics ).

Work with Business partners and stakeholders to understand functional requirements, architecture dependencies, and business capability roadmaps.

Create technical solution designs to meet business requirements.

Define best practices to be followed by team.

Taking your place as a core member of an Agile team driving the latest development practices Identify and drive reengineering opportunities, and opportunities for adopting new technologies and methods.

Suggest and recommend solution architecture to resolve business problems.

Perform peer code review and participate in technical discussions with the team on the best solutions possible.

Minimum Qualifications :

BS or MS degree in computer science, computer engineering, or other technical discipline, or equivalent work experience.

8+ years of hands-on software development experience with Big Data Analytics solutions Hadoop Hive, Spark, Scala, Hive, Python, shell scripting, GCP Cloud Big query, Big Table, Airflow.

Working knowledge of Adobe suit like Adobe Experience Platform, Adobe Customer Journey Analytics

Proficiency in SQL and database systems, with experience in designing and optimizing data models for performance and scalability.

Design and development experience with Kafka, Real time ETL pipeline, API is desirable.

Experience in designing, developing, and optimizing data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.

Certifications in cloud platform (GCP Professional Data Engineer) is a plus.

Understanding of distributed (multi-tiered) systems, data structures, algorithms Design Patterns.

Strong Object-Oriented Programming skills and design patterns.

Experience with CICD pipelines, Automated test frameworks, and source code management tools (XLR, Jenkins, Git, Maven).

Good knowledge and experience with configuration management tools like GitHub

Ability to analyze complex data engineering problems, propose effective solutions, and implement them effectively.

Looks proactively beyond the obvious for continuous improvement opportunities.

Communicates effectively with product and cross functional team.

Willingness to learn new technologies and leverage them to their optimal potential.

Understanding of various SDLC methodologies, familiarity with Agile scrum ceremonies.

We back you with benefits that support your holistic we'll-being so you can be and deliver your best. This means caring for you and your loved ones physical, financial, and mental health, as we'll as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries
• Bonus incentives
• Support for financial-we'll-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site we'llness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities