Lead Data Engineer

The Company

NorthMark Compute & Cloud (NMC²) is backed by dedicated leadership and investment, with a clear mission as it operates at the bleeding edge of technology. Its goal is to scale and enhance the high-performance computing (HPC) and cloud infrastructure that supports its clients' research, production, and delivery, enabling breakthroughs that shape the industries of tomorrow. Its engineers build critical infrastructure to eliminate friction in scientific research, simulations, analysis, and decision-making, accelerating discovery and driving faster innovation.

The Position

We are seeking a Lead Data Engineer to play a critical role in advancing NMC²'s big data engineering and analytics capabilities. This role will lead the design, development, and optimization of scalable data platforms, real time data pipelines, and analytics ready data products.

As part of the Big Data Engineering and Analytics organization, this role will focus on enabling a modern data lake and data mesh architecture that supports high volume, high velocity, and high variety data across enterprise and platform domains.

The Lead Data Engineer will bring deep hands-on expertise in Kubernetes, Kafka streaming platforms, and multi cloud ecosystems including AWS, Azure, and GCP. This role partners closely with data architects, analytics teams, and platform engineering to deliver reliable, governed, and high-quality data solutions.

Responsibilities

• Lead the design and implementation of scalable big data pipelines for batch and real time processing
• Build and operate streaming data platforms using Kafka
• Design and deploy cloud native data solutions across AWS, Azure, and GCP
• Develop and manage containerized workloads using Kubernetes
• Enable data mesh architecture with domain oriented data products
• Design and implement data lake and lakehouse architectures
• Ensure data quality, reliability, and observability
• Implement governance capabilities including metadata and lineage
• Collaborate with analytics, AI, and business teams
• Optimize performance and cost efficiency
• Mentor engineering teams

Requirements

• 15+ years of experience in big data engineering
• Strong experience with Kafka
• Strong experience with Kubernetes
• Experience with AWS, Azure, and GCP
• Experience building data lakes or lakehouse platforms
• Experience with data mesh concepts
• Strong programming skills in Python, Scala, or Java
• Experience with Spark, Flink, or Beam
• Experience with Airflow or orchestration tools
• Understanding of data modeling and governance
• Experience with CICD and infrastructure automation
• Experience supporting AI and machine learning workloads including large language models such as Claude or similar platforms
• Strong communication and leadership skills

It is impossible to list every requirement for, or responsibility of, any position. Similarly, we cannot identify all the skills a position may require since job responsibilities and the Company's needs may change over time. Therefore, the above job description is not comprehensive or exhaustive. The Company reserves the right to adjust, add to or eliminate any aspect of the above description. The Company also retains the right to require all employees to undertake additional or different job responsibilities when necessary to meet business needs.

Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.

Benefits & Perks:

• Company-Paid Lunch Stipend : Lunch is provided via GrubHub
• Company-Paid Benefits: 100% Employer-Paid Medical in our High Deductible Health Plan, Dental and Vision benefits for employees and their families, 16 weeks of Paid Parental Leave, Employee Assistance Program, Life insurance, Short-Term Disability and Long-Term Disability
• 401(k): Company will match 100% of your contributions up to 6%
• Optional Employee-Paid Benefits: Medical insurance in our PPO plan and a variety of other benefits such as Health Savings Accounts (with Company Contribution!), Flexible Spending Accounts, Supplemental Life Insurance, Wellhub and more.
• Time Off: 25 days of Paid Time Off plus 12 company holidays

EQUAL OPPORTUNITY EMPLOYER

NORTHMARK STRATEGIES LLC IS AN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER. THE COMPANY'S POLICY IS NOT TO DISCRIMINATE AGAINST ANY APPLICANT OR EMPLOYEE BASED ON RACE, COLOR, RELIGION, NATIONAL ORIGIN, GENDER, AGE, SEXUAL ORIENTATION, GENDER IDENTITY OR EXPRESSION, MARITAL STATUS, MENTAL OR PHYSICAL DISABILITY, AND GENETIC INFORMATION, OR ANY OTHER BASIS PROTECTED BY APPLICABLE LAW. THE FIRM ALSO PROHIBITS HARASSMENT OF APPLICANTS OR EMPLOYEES BASED ON ANY OF THESE PROTECTED CATEGORIES.