Sr. Data Engineer

Primary skills- Python, SQL Coding skills, Big Query, Dataflow, Airflow, Kafka and Airflow Dags.

Bachelors Degree or equivalent experience in Computer Science or related field

Required- Immediate or 15 days

Job Description

7+ years experience as a software engineer or equivalent designing large data-heavy distributed systems and/or high-traffic web-apps

Experience in at least one programming language (Python strongly preferred)

Hands-on experience designing & managing large data models, writing performant SQL queries, and working with large datasets and related technologies

Experience designing & interacting with APIs (REST/GraphQL)

Experience working with cloud platforms such as AWS, GCP, or Azure (GCP preferred)

Experience in DevOps processes/tooling (CI/CD, GitHub Actions), using version control systems (Git strongly preferred), and working in a remote software development environment

Strong analytical, problem solving and interpersonal skills, have a hunger to learn, and the ability to operate in a self-guided manner in a fast-paced rapidly changing environment

Preferred: Experience using infrastructure as code frameworks (Terraform)

Preferred: Experience using big data tools such as Spark/PySpark

Preferred: Experience using or deploying MLOps systems/tooling (eg. MLFlow)

Preferred: Experience in pipeline orchestration (eg. Airflow)

Preferred: Experience using infrastructure as code frameworks (Terraform)

Preferred: Experience in an additional programming language (JavaScript, Java, etc)

Preferred: Experience developing UI/UX with modern tools (React, etc)

Preferred: Experience using data science/machine learning technologies.