Data Engineer

Job Title: Consultant Data Engineer Location: Remote Job Summary: We're looking for a Senior Data Engineer with strong data platform experience to help with support of existing AWS/dbt platform and that can help with standing up our new GCP platform, working with data engineer. Duties/Responsibilities:

Design, build, and maintain scalable systems for ingestion, transformation, and storage of data, with a focus on testing and observability

Implement frameworks, tooling, and automation to safely increase development velocity

Develop data pipelines, optimize pipelines, SQL or other data workflows from (1) source ingestion and preparation, (2) training and tuning and (3) downstream systems integration (EHR modules, micro-services, dashboards)

Required Skills

Proficiency in SQL and Python with strong familiarity towards modern data engineering frameworks, infrastructure, and tooling

Knowledge of dbt, PySpark, Glue , Terraform to support current infrastructure on AWS

Great to have experience setting up GCP infra : Iceberg, Dataplex, Terraform to help with initial steps of GCP migration project.

A collaborative mindset, dependable execution, drive to reflect and improve, and humility to ask questions and learn.

Education & Experience

Bachelor's degree (or equivalent) in Computer Science, Data Science, Statistics, Engineering or a related field

5+ years of experience in data engineering, platform engineering, or ML engineering

Preferred experience

Healthcare, behavioral health, EHR systems, and/or regulated industries

Specific expertise with: AWS/GCP, dbt, Airflow, Airbyte, Redshift/BigQuery

Originally posted on Himalayas