Lead DataOps Engineer

Job Description

Role: Lead DataOps Engineer

\n

Location: Hybrid – Short Hills, NJ strongly preferred; Charlotte, NC considered

\n

Duration: 6-month contract-to-hire

\n

Interview Process: 2–3 interviews, likely video; final interview may be onsite

\n

Background Check: Required

\n

Employment Type: W2 Only

\n

Work Authorization: Candidates must be authorized to work in the U.S. without sponsorship.

\n

\n

Required Qualifications

\n

\n
1. 8+ years of experience in data engineering, analytics engineering, or platform engineering.
\n
2. A hands-on data engineering lead with 8+ years of experience, strong Databricks/lakehouse, PySpark, SQL, and cloud skills—ideally Azure—who has led engineers and owned complex technical delivery.
\n
3. Hands on P&C (Property & Casualty) Insurance experience is mandatory.
\n
4. Demonstrated experience leading engineers and taking ownership of complex deliverables.
\n
5. Strong communication and stakeholder collaboration skills.
\n
6. Strong experience with Azure, AWS, or GCP.
\n
7. Experience with Databricks or modern lakehouse architecture.
\n
8. Strong PySpark, SQL, data modeling, and modern data architecture skills.
\n
9. Experience building and orchestrating data pipelines using tools such as Azure Data Factory, Airflow, Dagster, or dbt.
\n
10. Experience with CI/CD tools such as Azure DevOps, GitHub Actions, or GitLab.
\n
11. Experience implementing DataOps or other automation frameworks.
\n

\n

Preferred Qualifications

\n

\n
1. Azure ecosystem experience.
\n
2. Experience supporting AI or machine learning workloads in production.
\n
3. Familiarity with Event Hubs, Kafka, or Kinesis.
\n
4. Property and casualty insurance experience.
\n
5. SAFe or similar Agile delivery experience.
\n
6. Degree in Computer Science, Management Information Systems, or a related field.
\n

\n