Big Data Engineer

Responsibilities

Kforce has a client that is seeking a Big Data Engineer in Parsippany, NJ.Summary:This role is responsible for designing and building enterprise-scale data pipelines that ingest information from business systems, operational technology environments, and industrial data sources into a unified analytics platform. The position develops and optimizes data models, semantic layers, and curated datasets that support reporting, APIs, AI, and advanced analytics. The Engineer works closely with the plant and controls teams to securely integrate OT data using industry-standard architectures while ensuring production systems remain protected. A key focus is maintaining high data quality, security, governance, monitoring, and reliability through testing, observability, lineage tracking, and access controls. The role also drives CI/CD automation, performance optimization, and cloud cost management to ensure scalable and efficient data platform operations.

Skills

• Minimum 5 years in data engineering building production pipelines at scale (batch/CDC/streaming)
• Hands-on with Azure data stack: Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault
• Experience implementing tests/observability (freshness, schema, expectations), and Git-based CI/CD
• Familiarity with SAP S/4HANA structures and SAP DataSphere semantic modeling
• Understanding of Power BI consumption (semantic models, RLS) and APIs for downstream AI/ML apps/agents
• Strong SQL and Python/PySpark; comfort with Spark Structured Streaming and performance tuning
• OT concepts: historians (PHD/PI), OPC UA/MQTT, event/batch frames, ISA-95/99 basics

Preferred Qualifications:

• Time-series/data-quality tooling (e.g., Great Expectations or equivalent patterns), feature/metric stores
• MDM concepts (keys, survivorship), lineage/catalog tooling
• TMS/WMS, LIMS, Historian, HSE domain exposure; Lean/Six Sigma mindset; FinOps awareness

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.


We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.


Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.


This job is not eligible for bonuses, incentives or commissions.


Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.


By clicking "Apply Today" you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Kforce is a professional staffing services firm offering Technology and Finance & Accounting jobs with top employers nationwide. We specialize in providing contract, contract-to-hire and direct placement opportunities, with over 50 years of experience in the staffing industry. Kforce offers many consultants comprehensive benefits depending on employment status, including medical, dental, 401(K), life insurance and disability. Our vision is to be "the firm most respected by those we serve."