Sr Software Engineer (Data Engineer)

Responsibilities

Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice
Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production
We develop real products. You need to be an expert in design, coding, and scripting
Facilitate problem diagnosis and resolution in technical and functional areas
Encourage change, especially in support of data engineering best practices and developer satisfaction
Write high-quality code that is consistent with our standards, creating new standards as necessary
Demonstrate correctness with pragmatic automated tests
Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices
Develop strong working relationships with others across levels and functions
Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest
Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain
Serve as a member of an agile engineering team and participate in the teams workflow

Criteria

5 years of experience as a professional software engineer
3 - 5 years of experience with big data technologies
Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time
Strong knowledge of programming languages/tools including Spark, SQL, Python, Java, Scala, Hive, and Elasticsearch
Experience with streaming technologies such as Spark streaming, Flink, or Apache Beam
Experience with various messaging systems such as Kafka
Experience in implementing Lambda Architecture
Working experience with various SQL and NoSQL databases such as Snowflake, Cassandra, HBase, MongoDB, and/or Couchbase
Working experience with various time-series databases such as OpenTSDB and Apache Druid
Familiarity with ML and Deep Learning
Working knowledge of various columnar storage such as Parquet, Kudu, and ORC
An understanding of software development best practice
Enthusiasm for constant improvement as a Data Engineer
Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion
Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood
Ability to work independently on complex problems of varying complexity and scope
Bachelors degree in Computer Science, Engineering or equivalent work experience