Government Representative 1 Senior Data Platform Engineer #464-26

Job Title: Government Representative 1

Senior Data Platform Engineer (464-26)

SALARY

$120,000 - $150,000

The Senior Data Platform Engineer reports to the Assistant Director in the Data Platform Unit of the Office of Data Management and Reporting. The Senior Data Platform Engineer designs, builds, and operates cloud native data pipelines, storage, compute, and serving layers. Applies expertise in distributed processing, orchestration, and cloud engineering to deliver scalable, high quality data products and services. This role is hands-on, code oriented, and production focused, capable of deep-diving into performance, reliability, and cost optimization while ensuring consistency, security, and data integrity across the platform. Responsibilities include:

Data Engineering

• Design, develop, and optimize data pipelines that extract, process, and deliver data from diverse structured and unstructured sources.
• Apply distributed computing frameworks (e.g., Spark) for large-scale transformation and processing operations, ensuring performance, reliability, and scalability.
• Build and maintain batch, streaming, API, and CDC ingestion patterns.
• Integrate data from databases, data warehouses, APIs, and external systems while ensuring data consistency and integrity.
• Apply data cleansing, enrichment, aggregation, and filtering techniques as part of transformation workflows.
• Tune and optimize data pipelines by identifying performance bottlenecks and applying techniques such as efficient partitioning, indexing, and caching.

Cloud Platform Engineering & Infrastructure Automation

• Contribute to the strategic direction for implementation of Infrastructure-as-Code (Terraform/Bicep/CloudFormation) to provision, manage, and secure cloud resources.
• Build robust CI/CD pipelines to automate deployment of data pipelines, models, and transformations.
• Recommend cloud security best practices including RBAC/ABAC, key management, secrets management, encryption, network controls, and data access patterns.
• Monitor and tune cloud resource utilization for both cost efficiency and performance.

Observability, Reliability & Production Operations

• Implement platform observability using logs, metrics, traces, dashboards, and end-to-end lineage.
• Configure runtime orchestration and workflow management (Airflow, ADF, Databricks Jobs, Step Functions, etc.).
• Provide on-call support for production systems; lead incident response, triage, and root-cause analysis.
• Establish and maintain SLOs for latency, data freshness, reliability, and resource efficiency.

Data Quality, Lineage & Governance Integration

• Implement automated data validation, quality checks, and integrity rules within pipelines.
• Ensure lineage is captured and integrated with enterprise metadata/catalog platforms.
• Work closely with the Data Governance team to apply definitions, steward rules, and classification policies.
• Help enforce data consistency and quality standards across all ingestion and transformation workflows.

Collaboration, Leadership & Reuse

• Collaborate with analytics, data governance, MDM, and data product teams to ensure alignment with organizational standards.
• Mentor junior engineers and contribute to establishing engineering best practices.
• Develop reusable templates, modules, libraries, and patterns to increase engineering productivity and consistency.
• Participate actively in release readiness, code review, and change control processes.

General Responsibilities

• Perform additional duties as assigned.

REQUIREMENTS:

EXPERIENCE:  

Minimum Qualifications

· 5–8+ years in cloud data engineering roles.

· Strong hands-on proficiency in Python, SQL, Spark, orchestration frameworks, and CI/CD.

· Experience integrating and validating data from multiple storage systems, APIs, and external systems.

· Experience with data quality, data validation, and lineage tooling.

· Hands-on experience with Azure or AWS data services (e.g., ADLS/S3, ADF/Glue, Databricks/EMR).

Preferred Qualifications

· Prior experience with Oracle GoldenGate is strongly desired.

· Experience with dbt, Delta Lake, and data observability or monitoring platforms.

· Familiarity with event-driven architectures (Kafka/EventHub/Kinesis).

· Public sector or HHS program experience.

· Expertise in pipeline tuning and performance optimization.

· Experience with BI/analytics tools to support downstream modeling efforts.

RESUME NOTE: Eligibility determinations will be based upon information presented on the resume only along with other supporting documents. Applicants who possess a degree from a college or university outside the United States must provide an evaluation of one's transcripts from a recognized evaluation service at the time of submission by the above closing date. Failure to do so may result in your ineligibility.

LICENSE: Appointees will be required to possess a driver's license valid in New Jersey only if the operation of a vehicle, rather than employee mobility, is necessary to perform the essential duties of the position.

IMPORTANT NOTICES

EMPLOYEE BENEFITS: The Department of Children and Families provides many employee benefits, including but not limited to:

• Alternative Workweek Program*

• Deferred Compensation

• Health, Dental and Life Insurance

• Flexible and Health Spending Accounts

• Pension

• Telework*

• Public Service Loan Forgiveness

• Benefit Leave (Vacation, Sick, Administrative Leave)

• 13 Paid Holidays

*Pursuant to Department policy, procedures and/or guidelines

PUBLIC SERVICE LOAN FORGIVENESS: As a prospective employee of the State of New Jersey, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education's website at StudentAid.gov/PSLF

SAME APPLICANTS: If you are applying under the NJ "SAME" program, you must submit any of the supporting documentation specified in N.J.S.A. 11A:7-13.3 along with your resume by the closing date indicated above.

RESIDENCY LAW  

Please refer to the New Jersey Department of Children and Families' website at

TO APPLY: You must submit a cover letter and resume as a single PDF document, saving the file by your Last Name, First Name. Please indicate in your cover letter where you found this job opportunity and send the file to

Email: View email address on talent.com

The Department of Children and Families is an Equal Employment Opportunity Employer and is committed to fostering a respectful and inclusive work environment which reflects the diversity of the state we serve.