Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr Data Engineer

$84k - $128.67k

Protective Services LLC

Data Engineer

The work we do has an impact on millions of lives, and you can be a part of it. We help protect our customers against life's uncertainties. Regardless of where you work within the company, you'll be helping provide protection and peace of mind when our customers need it most.

Protective is looking for Data Engineers to design, build, and operate production data pipelines on Voyager, our Databricks lakehouse on Azure. You will own the end-to-end flow of data through a medallion architecture — ingesting source data into the Raw layer, applying cleansing, validation, and conformance in the Prep layer, and publishing trusted, consumption-ready data products in the Prod layer.

This role sits at the intersection of engineering, analytics, and platform operations. You will write production-grade Python and SQL, enforce data contracts, and help Protective treat data as a product with named owners and real consumers. You will be embedded on a delivery pod that owns its data products end to end, rather than servicing tickets from a queue.

Key Responsibilities

  • Design, develop, and maintain production data pipelines on Databricks using Python, SQL, Apache Spark, and Delta Lake.
  • Build Raw-layer ingestion that reliably captures data from APIs, relational databases, flat files, cloud storage, and SaaS platforms — using dlt (dltHub) and Databricks-native ingestion where each fits — including incremental loading, pagination, watermarking, state management, and replay after failure.
  • Develop Prep-layer transformations in dbt and Python over Delta Lake that cleanse, standardize, type, deduplicate, validate, conform, and enrich data so that it is reusable across domains. A meaningful share of this role is making messy source data trustworthy.
  • Create Prod-layer data products: dimensional models, slowly changing dimensions, fact and bridge tables, aggregates, and serving tables aligned to how consumers actually query.
  • Produce and maintain the curated datasets ML engineering trains and serves models from — feature and training tables that are versioned and reproducible, not one-off extracts.
  • Author and maintain data contracts using the Open Data Contract Standard (ODCS) — schema with real semantics, named owner, known consumers, quality rules, and freshness expectations — and assess backward compatibility before every change.
  • Implement data quality as code: uniqueness and not-null on keys at minimum, plus referential, accepted-value, freshness, and custom business-rule tests, surfaced to producers and consumers rather than buried in logs.
  • Orchestrate ingestion and transformation as assets in Dagster, deployed to Dagster Cloud, and operate what you build across development, branch, and production deployments — schedules and sensors, asset dependencies, backfills, and run observability.
  • Apply governance through Unity Catalog — catalogs, schemas, external locations, grants, row- and column-level security, and lineage — and handle credentials through Azure Key Vault rather than in code.
  • Implement incremental and merge-based processing with Delta Lake (MERGE, schema evolution, time travel, OPTIMIZE) and tune Spark jobs, table layouts, and compute for performance and cost.
  • Troubleshoot production failures, data-quality issues, source-system changes, and late-arriving or duplicate data — including backfills and recovery — and take part in the pod's on-call rotation for the pipelines it owns, with root-cause analysis that closes the gap rather than reopening the ticket.
  • Build and maintain CI/CD for data assets in Azure DevOps — automated tests and CI checks on dlt, dbt, and Dagster changes, promotion from development through branch deployments to production, and releases that are repeatable and auditable.
  • Instrument what you own for observability: freshness, volume, quality, latency, and cost, with alerting tied to the SLAs and SLOs your contract commits to instead of depending on someone noticing.
  • Work inside the platform's control expectations — least-privilege access, secrets in Azure Key Vault, change management through pull request and pipeline, and audit evidence that falls out of the deployment path rather than being reconstructed later.
  • Participate in code review and document architecture, runbooks, and data products so others can discover, trust, and reuse them.
  • Work with data architects, analysts, product owners, and business stakeholders to translate requirements into maintainable data solutions.

Qualifications Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field; equivalent practical experience considered.
  • 3+ years building and supporting production data pipelines in a cloud data platform environment.
  • Strong hands-on Python and SQL. Both are used daily and neither substitutes for the other.
  • Hands-on experience with Databricks or a comparable Spark-based lakehouse, including Delta Lake tables, MERGE, and incremental load patterns.
  • Practical understanding of medallion / multi-layer lakehouse design, and the judgment to say what belongs in Raw versus Prep versus Prod.
  • Experience ingesting data from APIs, relational databases, files, or SaaS applications, including the incremental and state-management problems that come with it.
  • Working knowledge of dimensional modeling — grain, keys, facts and dimensions, slowly changing dimensions — and of ELT design patterns and data quality practice.
  • Experience with orchestration and scheduling using Dagster, Databricks Workflows, Airflow, Azure Data Factory, or similar.
  • Git-based source control, pull request review, automated testing, and CI/CD as normal practice — Azure DevOps or comparable.
  • Experience troubleshooting production data failures, performance bottlenecks, and source-system changes.
  • Experience with pipeline monitoring and alerting, and a working understanding of what a freshness or quality SLA means once real consumers depend on it.
  • Ability to explain technical designs and trade-offs to both technical and non-technical partners.

Preferred Qualifications

  • Databricks certification (Data Engineer Associate or Professional) or equivalent demonstrated depth.
  • Unity Catalog experience: catalogs, schemas, volumes, external locations, storage credentials, permissions, and lineage.
  • dbt on Databricks, or another transformation framework used alongside Spark.
  • Python-based modeling frameworks over Delta Lake, and experience implementing Type 2 history, surrogate keys, and merge strategies in code.
  • Experience with a declarative Python ingestion framework such as dlt (dltHub), Airbyte, Meltano, or Fivetran.
  • Dagster experience specifically, including assets, asset checks, sensors, schedules, and branch deployments.

$84,000 - $128,667 a year Protective's targeted salary range for this position is $84,000 to $128,667. Actual salaries may vary depending on factors, including but not limited to, job location, skills, and experience. The range listed is just one component of Protective's total compensation package for employees. This position also offers additional incentive opportunities through an annual incentive based on individual and Company performance.

Employee Benefits:

We aim to protect the wellbeing of our employees and their families with a broad benefits offering. In addition to offering comprehensive health, dental and vision insurance, we support emotional wellbeing through mental health benefits and an employee assistance program. Work/life balance is important and Protective offers a variety of paid time away benefits ( e.g., paid time off, paid parental leave, short-term disability, and a cultural observance day). The financial health of our employees is just as important as physical and emotional health. Some of the financial wellbeing benefits include contributions to healthcare accounts, a pension plan, and a 401(k) plan with Company matching. All employees are encouraged to protect their overall wellbeing by engaging in ProHealth Rewards, Protective's platform to improve wellbeing while earning cash rewards.

Eligibility for certain benefits may vary by position in accordance with the terms of the Company's benefit plans.

Accommodations for Applicants with a Disability :

If you require an accommodation to complete the application and recruitment process due to a disability, please email View email address on click.appcast.io. This information will be held in confidence and used only to determine an appropriate accommodation for the application and recruitment process.

We are proud to be an equal opportunity employer committed to being inclusive and attracting, retaining, and growing an inclusive workforce.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr Data Engineer in United States vacancy
  • $116k - $209k

     ...other. Ready to join a mission that matters? The future of cybersecurity starts with you. About the Role: As a Sr. Data Infrastructure Engineer, you will be a key member of the Data Platform Operations team, responsible for building out the AWS GovCloud environment... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    13 days ago
  • $60 - $65 per hour

     ...USC or GC ONLY HYBRID WORK SETUP   Job Summary: · Lead end-to-end design and delivery of scalable data engineering solutions using Snowflake, dbt and Python, ensuring high-performance data pipelines and robust data warehousing practices. · Drive data modeling... 
    Senior
    Contract work

    Long Finch Technologies

    Denver, CO
    a month ago
  •  ...Job Description: Sr. Data Engineer – Data Ingestion Framework Python, DBT, and orchestration technologies such as Dagster or Control-M. The solution will utilize AWS S3 as the data Lakehouse storage layer and Snowflake as the target data platform.   Experience:... 
    Senior
    Contract work
    Local area
    Remote work

    Long Finch Technologies

    Boston, MA
    3 days ago
  •  ...Position Overview We are seeking a Data Engineer to provide data engineering, advanced analytics, and visualization support to senior DoD stakeholders. This individual will work with complex datasets, develop analytical solutions and dashboards, and translate technical... 
    Senior

    Centurion

    Alexandria, VA
    16 days ago
  • $136k - $245k

     ...a mission that matters? The future of cybersecurity starts with you. About the Role: We're seeking an experienced Sr. Platform Data Engineer to architect, deploy, and operate the core data infrastructure and platform services underpinning CrowdStrike's analytics... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    a month ago
  • $67.14 - $77.14 per hour

    job summary: For this contractor assignment, we are seeking a Senior Data Engineer with demonstrated success designing and implementing enterprise-scale data integration and migration solutions. This engineer will play a key role on an Enterprise Data delivery team... 
    Senior
    Hourly pay
    Contract work
    Temporary work
    For contractors
    Work experience placement
    Remote work

    Randstad Digital

    Cleveland, OH
    2 days ago
  • $140k - $160k

    Our client, a defense contractor, is seeking a Secret Cleared Senior Data Analysis Engineer for a full-time position in Point Mugu, CA. The Senior Data Analysis Engineer will work onsite daily and will be responsible for processing, analyzing, and evaluating ground laboratory... 
    Senior
    Full time
    For contractors

    ClearBridge Technology Group

    California
    7 hours ago
  •  ...Role: Sr. Data Engineer Location: Seattle, WA (Remote is okay, but as per the client's policy, a monthly office visit is mandatory) Type: Contract to Hire Key Skills: AWS, MDM, Python, SQL, Reltio (not mandatory but it should be good to have) Responsibilities... 
    Senior
    Contract work
    Work experience placement
    Work at office
    Remote work

    Canvendor

    Seattle, WA
    9 days ago
  •  ...Glue, EMR (PySpark), and Lambda functions Implement real-time data streaming solutions using Confluent Kafka with source and sink...  ...Qualifications Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field Strong understanding... 
    Senior
    Contract work
    Remote work
    Shift work

    US Tech Solutions

    Charlotte, NC
    16 days ago
  •  ...Contract positions for a major investment firm. Hybrid work environment in Newark, NJ. Data Engineer (AWS) Job Summary: We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible for designing... 
    Senior
    Contract work

    JSR Tech Consulting

    Newark, NJ
    8 days ago
  • Job Title As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the Operational Risk team to meet the increasing demands from the various trading desks.
    Senior

    Samprasoft

    Charlotte, NC
    3 days ago
  •  ...We are looking for a skilled Data Engineer to design, build, and maintain our enterprise Data Warehouse (DWH) and analytics ecosystem — with a growing focus on enabling AI-driven insights, automation, and enterprise-grade AI usage. In this role, you will architect scalable... 
    Senior

    Tenth Revolution Group

    Commack, NY
    4 days ago
  •  ...Strong understanding of system design principle and data storage structures, ideally in a cloud-based environment (Azure, SnowPro...  ...certifications in: Microsoft Certified: (or equivalent cloud) Azure Data Engineer Microsoft Certified: Azure Fundamentals Snowflake... 
    Senior

    Saxon Global

    Hopkins, MN
    1 day ago
  •  ...Job Title: Senior Data Engineer (Databricks) Primary Location: Chicago, IL (Hybrid – 3 days onsite / 2 days remote) Position Type: Full-Time, Direct Hire Must Be Citizen or Green Card OVERVIEW A Senior Data Engineer. This is a full-time, direct hire... 
    Senior
    Full time
    Remote work
    3 days per week

    BinaryBees Business Solutions LLC

    Chicago, IL
    1 day ago
  •  ...POsition : Data Engineer Location : Minnetonka, MN AND Raleigh, NC Duration : 6 Months to hire Experience and Required qualifications: To be considered for this position, applicants need to meet the qualifications listed in this posting.... 
    Senior

    3B Staffing LLC

    Hopkins, MN
    7 hours ago
  •  ...Senior Data Engineer Experience developing, debugging, and maintaining code in Spark, Databricks, Python Deep knowledge in SQL Server databases, Azure data technologies Proficiency in NoSQL (Cosmos DB) is preferred Experience in cloud services (Azure) is preferred... 
    Senior
    Temporary work
    Work experience placement
    Relocation

    Software Technology Inc

    Kansas City, MO
    1 day ago
  • $110k - $150k

     ...Sr. Data Engineer Onsite: Hampton Roads, VA Blu Omega is seeking a Sr. Data Engineer to support the Navy enterprise data initiatives. This role is responsible for designing, developing, and maintaining scalable data solutions within complex enterprise environments... 
    Senior

    Blu Omega

    Suffolk, VA
    2 days ago
  •  ...Sr. Data Engineer Location: Remote Project Duration: Long Term Contract Job Description: Minimum 8+ years of experience with a bachelor's degree in computer science or equivalent. Skills: Databricks, Azure Data Factory, Databricks workflows, PySpark... 
    Senior
    Long term contract
    Remote work

    Highbrow Technology Inc

    United States
    3 days ago
  • $71.03 per hour

     ...Sr. Data Engineer Client: US Bank Location: 100 percent remote Position: Senior Data Engineer Rate: $71.03/hr on apex w-2 Status: Anything is fine Contract: 6 months extendable or perm Interview process: Apex tech screen then 3 interviews with client... 
    Senior
    Permanent employment
    Contract work
    Remote work

    Anveta

    United States
    4 days ago
  •  ...Job Title: Sr. Data Engineer Location: Chicago, IL (Onsite) Must-Have Qualifications: ~8+ years proven experience building and maintaining ETL pipelines in production environments. ~ Proficiency in Python and SQL for data transformation and scripting.... 
    Senior

    Jobs via Dice

    Chicago, IL
    3 days ago
  •  ...Job Description Summary Responsible for designing, developing, testing and implementing data engineering processes to generate analytical and reporting solutions. Responsible for analyzing and preparing the data needed for data science based outcomes. Also responsible... 
    Senior
    Permanent employment
    Visa sponsorship
    Work visa
    Relocation package

    GE Aerospace

    Dayton, OH
    2 days ago
  • $141.8k - $173.3k

     ...time off + donation match IMPACT YOU'LL MAKE Senior Data Engineer is responsible for writing data workflows according to design specifications...  ...data engineers, business analysts, and systems analysts, the Sr Data Engineer builds and supports enterprise-class data... 
    Senior
    Work experience placement
    Remote work

    Boeing Employees Credit Union

    Virginia, IL
    1 day ago
  • $104.61k - $161.9k

     ...hiring and supporting active-duty and veteran employees. Responsibilities Position Summary We are seeking a Senior Data Engineer to implement and operate reliable, secure, and scalable data solutions supporting GSA applications, integrations, migration, and... 
    Senior
    Full time
    For contractors

    Empower AI Inc.

    Remote
    2 days ago
  •  ...Sr. Data Engineer Location: Plano, TX OR Atlanta, GA (Onsite from Day 1 & F2F Required) Type: Long Term Job Description: ~5+ years of software/data engineering experience using Java, Scala, and/or Python, with at least 3 years’ experience in a data and BI... 
    Senior

    Yochana

    Atlanta, GA
    4 days ago
  •  ...Job Title Data Solution Consultant Responsibilities Data Solution Consulting & Delivery Participate in the agile planning process by understanding data consumers’ needs and technical aspects (not just an order taker, must be proactive and think critically... 
    Senior
    Contract work

    Software Technology Inc

    Richmond, VA
    1 day ago
  • $99.83k - $135k

     ...experience, knowledge, skills and abilities, as well as internal equity and alignment with market data Job Summary: The Senior Research Facility Data Management Engineer is a senior-level individual contributor responsible for designing, implementing, and... 
    Senior
    Work at office

    Northwestern University

    Evanston, IL
    7 hours ago
  •  ...Sr. Data Engineer Location: Remote till Covid (Primary location- Durham(NC), Other Options-Boston(MA), Smithfield(RI), Merrimack (NH) And Westlake(TX)) Duration: long term contract Job Description: The Expertise You Have and the Skills You Bring Bachelor... 
    Senior
    Long term contract
    Remote work

    Samprasoft

    Smithfield, RI
    2 days ago
  • $120k - $160k

     ...fulfill the position’s purpose. If possible, please include the percentage of time spent on each key responsibility. Advanced Data Engineering and Solution Design (80%) Architect and implement scalable data pipelines to process and integrate structured and... 
    Senior
    Contract work

    ProArch

    Remote
    8 days ago
  • $111k - $138.7k

     ...for future generations. Role Summary Our data is at the core of our mission. As a Data Engineer at Rivian, you will have an opportunity to learn, build...  ...will be located in Atlanta, GA and report to our Sr. Director of Data. Responsibilities Build... 
    Senior
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Shift work

    Rivian

    Atlanta, GA
    1 day ago
  •  ...Job DescriptionJob DescriptionSr. Data Analytics Engineer Full Time Westchester County, NY - Hybrid This role is a highly technical, business-facing...  ...analyses, dashboards, and data-driven recommendations. The Sr. Data Analytics Engineer operates with a high degree of... 
    Senior
    Full time

    PRI Technology

    Rye, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Data Engineer. Be the first to apply!