Lead Flink Data Engineer - IoT

Maintec Technologies

United States

Lead Flink Data Engineer - IoT

New York City, NY (Remote)

Job Description:

This is a role responsible for designing, building, and maintaining the real-time streaming infrastructure required for sensor data integration, complex state processing, and alerting in the Industrial IoT / Smart Buildings domain.
We are seeking a Lead Data Engineer with expert-level Apache Flink (Java and SQL) skills, and proven implementation of custom ProcessFunctions, state management, and real-time data quality gates, delivering Data and Analytics products using Agile methodology. The ideal candidate will possess strong technical, analytical, and interpersonal skills.

Qualification / Skill Set Requirement:

5+ years of hands-on data engineering experience with deep expertise in the Azure ecosystem.
5+ years in Java (backend) with 3+ years deep specialization in Apache Flink (DataStream API & SQL).
Experience with Flink State Management, Checkpointing, and Watermark strategies.
Experience upgrading to or using Flink 2.0/2.x.
Experience with Azure Event Hubs or Kafka.
Understanding of "Sensor/IoT" data patterns (out-of-order and missing events).
Proficient in Java, SQL, and writing optimized data integration and processing code.
Strong understanding of SDLC and Agile methodologies with hands-on experience in Azure DevOps, GitHub, CI/CD, and artifact management.
Deep expertise in Azure data services.
Skilled in data modeling, database design, and data warehousing solutions on Azure.
Knowledge of data quality, governance, and security best practices within Azure (AD, NSG, encryption, compliance).
Certifications preferred: Azure Fundamentals, Azure Data Engineer Associate, and Azure Solutions Architect Expert (nice to have).

Responsibilities:

Architect, design, and implement scalable and efficient data solutions on Flink.
Design and implement the Flink 2.x streaming pipeline for IoT.
Develop custom KeyedProcessFunctions to handle "Heartbeat Injection" (detecting sensor silence) and complex windowing.
Implement the Gatekeeper Pattern: A Flink job that applies Data Quality tags (Validity, Completeness) to the stream without dropping data.
Optimize State Backends for high-cardinality sensor data (100k+ concurrent sensors).
Work with the "Shared Core" team to integrate libraries into the Flink runtime.
Manage and optimize Azure resources (Flink clusters) for performance, reliability, and cost-efficiency.
Transform, clean, and prepare data using SQL, and Java.
Monitor and fine-tune workloads and pipelines for optimal performance and reliability.
Maintain clear documentation of solutions, configurations, and workflows.
Actively participate in Agile team activities and continuous improvement initiatives.
Promote and enforce data engineering best practices, including data governance, security, and data quality.

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Lead Flink Data Engineer - IoT in United States vacancy

Remote Flink Engineer — Real-Time Data (H-1B Sponsorship)
A U.S.-based technology consulting firm is seeking a remote Apache Flink Engineer specializing in real-time data engineering. This full-time role offers H-1B visa sponsorship and remote flexibility, allowing candidates to work on enterprise-scale streaming platforms. Responsibilities...
Suggested
Remote job
Full time
H1b
Visa sponsorship
NewsNowGh
Cincinnati, OH
4 days ago
Real-Time Analytics Engineer (Flink, Kafka) - Q125
...Corporation (R2) , headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial... ...technology innovation! Real-Time Analytics Engineer (Flink, Kafka) Location: Alpharetta, GA (willing to...
Suggested
Full time
R2 Technologies
Alpharetta, GA
1 day ago
Data Engineer (Ab Initio, OzoneCH, Flink)/ Ab Initio Consultant
...Rate: $70-75/hr on W2 (Mphasis Payroll) Candidate will be on direct pay roll of Mphasis Title: Data Engineer (Ab Initio, OzoneCH, Flink)/ Ab Initio Consultant Role: Streaming Data Engineer - Ab Initio, OzoneCH, Flink Location: Berkeley...
Suggested
Work at office
Local area
Hallmark Global Solutions Ltd
Berkeley Heights, NJ
3 days ago
Distributed Data Streaming Engineer (Flink/Kafka)
Apple Inc. is seeking extraordinary software engineers in Cupertino, California, with expertise... ...dynamic team to drive innovation in our data infrastructure and collaborate with open... ...systems, and proficiency in Apache Flink or Kafka. The role offers competitive compensation...
Suggested
Apple Inc.
Cupertino, CA
3 days ago
Senior Data Warehouse Engineer - Big Data, Flink
...Data Engineer Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered... ...batch pipelines and low-latency streaming pipelines (e.g., Flink, Kafka), with production SLAs for stability,...
Suggested
Remote work
Work from home
Overseas
Flexible hours
binance
United States
4 days ago
Senior Lead Data Engineer
...brands, Toyota is growing and leading the future of mobility... ...We're looking for a Sr Lead Data Enginee r — an individual contributor... ...deep expertise in data engineering, streaming architectures, and... ...event transformation ~ Apache Flink (via Amazon Managed Service...
Contract work
Worldwide
Relocation package
Toyota
Plano, TX
3 days ago
Lead Data Governance Engineer
...Lead Data Governance Engineer Canonical is a leading provider of open-source software and operating systems for global enterprise and technology... ...public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and...
Work at office
Local area
Remote work
Work from home
Worldwide
Canonical
United States
4 days ago
Lead Data Engineer
...Lead Data Engineer We are looking for a Lead Data Engineer to design, build, and scale robust data infrastructure and pipelines. This role... ...dbt, etc.) ~ Familiarity with streaming technologies (Kafka, Flink, etc.) ~ Experience with data warehousing solutions (...
Covetit
Encino, CA
4 days ago
Lead Data Engineer
...Lead Data Engineer The Lead Data Engineer will lead the design, development, and administration of critical data pipelines and platform... ...and related concepts. Experience designing and implementing IoT and real-time streaming data pipelines. Proficiency with...
Work experience placement
Monday to Friday
Brentwood Industries
Reading, PA
14 days ago
Lead Data Engineer
...that shape the industries of tomorrow. Its engineers build critical infrastructure to... .... The Position We are seeking a Lead Data Engineer to play a critical role in advancing... ...Scala, or Java ~ Experience with Spark, Flink, or Beam ~ Experience with Airflow or...
Temporary work
Flexible hours
NorthMark Strategies
Dallas, TX
3 days ago
Lead Data Engineer
...Lead Data Engineer The Lead Data Engineer will design, build, and maintain the organization's enterprise data platform, leading the technical... ...data technologies (e.g., Kafka, Kinesis, Spark Streaming, Flink) supporting reporting and operational visibility. Excellent...
Work at office
WellDyne
Lakeland, FL
22 hours ago
Lead Data Engineer
$125k - $143.71k
...Job Posting Title: Lead Data Engineer ---- Hiring Department: Enterprise Technology - Data to Insights (D2I) ---- Position... ...processing and streaming frameworks, such as Apache Spark, Kafka, Flink, or Airflow, for orchestration and automation. ~ Strong...
Full time
For contractors
Fixed term contract
Work at office
Immediate start
Remote work
Monday to Friday
Flexible hours
Shift work
Night shift
The University of Texas at Austin
Austin, TX
22 hours ago
Lead Data Engineer
$86.62k - $101.9k
...Job Title Lead Data Engineer Job Description Summary Job Description The Lead Data Engineer helps architect and lead the development... ..., tSQLt, nBI, etc.) Exposure to real-time integrations or IoT solutions e.g. Event Hubs, Service Bus, IoT and Event Grid in...
Minimum wage
Flexible hours
Cushman & Wakefield
United States
22 days ago
Lead Data Engineer, Analytics & Insights
$160k - $210k
...Our fleet produces a continuous stream of data, and we're looking for a senior IC to own... ...: for customers, partners, operations, engineering, and leadership. You'll be the bridge between... ...Bonus Points Experience in robotics, IoT, fleet management, automotive, or any...
Full time
Temporary work
Flexible hours
Agtonomy
South San Francisco, CA
4 days ago
Lead Data Engineer
...from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you... ...that enable physical AI at scale: from terabytes of IoT sensor telemetry streaming through our medallion...
Permanent employment
Temporary work
Relocation package
Flexible hours
Honeywell
Atlanta, GA
5 days ago
Sr. Lead Data Engineer - Enterprise Risk Management
$229.9k - $262.4k
...Sr. Lead Data Engineer - Enterprise Risk Management Do you love building and pioneering in the technology space? Do you enjoy solving complex... ...Spark, Gurobi, or MySQL) ~4+ year experience using Apache Flink or working on real-time data and streaming applications ~4+...
Full time
Part time
Internship
Local area
Capital One Financial Corp
McLean, VA
1 day ago
IoT Technical Support Engineer (On-Call & Data-Driven)
Wiliot Ltd in Dallas is looking for a Technical Support Engineer crucial for troubleshooting and resolving technical issues in Wiliot’s Ambient IoT ecosystem. The role involves interaction with both hardware and software components while ensuring system performance meets...
WilioT Ltd
Plano, TX
2 days ago
Lead Data Platform Engineer for IoT Analytics
A technology solutions provider is seeking a Principal Software Engineer - Data Platform Engineering in Raleigh, North Carolina. This role involves designing scalable data pipelines and developing micro-services using Python, Apache Spark, and Databricks. The ideal candidate...
Compunnel, Inc.
Raleigh, NC
22 hours ago
Senior Lead Data Engineer
...Senior Data Engineer Born digital in 2014, Brillio is a powerhouse of digital transformations. Orchestrated around the superpowers of technology – Cloud, AI, Mobile, IoT, we are a partner of choice for leading companies around the world, helping them leverage digital...
Remote work
Work from home
Flexible hours
Brillio
United States
4 days ago
Lead Data Engineer
$125k - $143.71k
Lead Data Engineer Enterprise Technology - Data to Insights (D2I) All Applicants Weekly Scheduled Hours: 40 FLSA Status: Exempt Earliest... ...processing and streaming frameworks, such as Apache Spark, Kafka, Flink, or Airflow, for orchestration and automation. Strong...
Full time
For contractors
Fixed term contract
Work at office
Immediate start
Remote work
Monday to Friday
Flexible hours
Shift work
Night shift
The University of Texas at Austin
Austin, TX
1 day ago
Senior Backend Engineer - IoT & Data
...Job Title: Senior Backend Engineer - IoT & Data Key Responsibilities: Design, develop, and maintain containerized backend systems using Java 17+ and Spring Framework Build scalable APIs and data transformation pipelines for real-time telemetry ingestion...
Redolent
Bentonville, AR
2 days ago
Senior Software Engineer - Data Team (AWS, Flink, OpenSearch)
...Senior Streaming Platform Engineer At NiCE, we don't limit our challenges. We challenge... ...in enterprise-scale streaming and cloud data platforms. The ideal candidate brings hands... ...Preferred: Experience with Flink using Spring Boot Snowflake integration...
NICE Actimize
Seattle, WA
3 days ago
Lead Data Engineer
...and deliver production-grade, scalable data pipelines and AI-ready data platforms... ...cloud-native services and modern data engineering frameworks.* Lead end-to-end implementation of lakehouse... ...frameworks, such as Apache Spark, Kafka, Flink, or Airflow, for orchestration and...
Local area
Flexible hours
University of Texas
Austin, TX
22 hours ago
Lead Data Engineer
$160k - $220k
...across four continents — and we're hiring the engineering team to build what comes next. About the... ...clinical picture alongside the wearable data. Your job is to make sure every one of... ...at least two of: audio/video processing, IoT/wearables, or mobile sensing Have expert...
Permanent employment
Full time
Work experience placement
H1b
Worldwide
Relocation
Flexible hours
Shift work
Night shift
Day shift
Deliberate Solutions, Inc.
Boston, MA
22 hours ago
Real-Time Data Engineer: Iceberg, Flink & Spark Specialist
A technology firm in Tampa, Florida is seeking a skilled Data Engineer to design and maintain scalable data pipelines using cutting-edge technologies such as Apache Flink and Spark. The ideal candidate will possess strong programming skills in Python and Java, with a proven...
LTM
Tampa, FL
3 days ago
Senior Lead Data Engineer Content Engineering
$156.8k - $235.2k
...positive mark on culture. Overview We are hiring a Senior Lead Data Engineer to build and scale the data foundations that power Paramount'... ...: Design and maintain batch/streaming pipelines (Spark, Flink, Databricks, Airflow) producing ML features for ranking models...
Paramount
New York, NY
2 days ago
Lead IT Data Engineer (SQL/Python)
...Job Details: The Lead IT Data Engineer owns and drives the organization's data strategy, setting the technical direction for data engineering... ...(Airflow, Dagster), transformation (dbt), streaming (Kafka, Flink), and storage (Delta Lake, Iceberg, Snowflake, BigQuery)....
Hourly pay
Relocation package
Shift work
Day shift
Tyson Foods Inc.
Springdale, AR
22 hours ago
IoT Engineering Data Analyst
...IoT Engineering Data Analyst Job Category: Tech / Engineering Requisition Number: IOTDA001432 Full-Time On-site TG Kentucky, LLC Lebanon... ...create technical presentations and documents. # Capability to lead and conduct root cause analysis for current problems and...
Full time
Monday to Friday
Weekend work
Toyoda Gosei
Lebanon, KY
4 days ago
Sr. Cloud Data Engineer-(IoT) Greenfield
...Job Description Job Description Senior Cloud Engineer – IoT We are seeking a Senior Cloud Engineer – IoT to help build and scale... ...enabling customers to collect, analyze, and act on telemetry data through both user-facing applications and APIs. As the Senior...
duvari group
Minneapolis, MN
22 days ago
Digital Twin Data Engineer — Cloud, IoT & ML
...requirements, supporting teams to design technical solutions, constructing data pipelines, and leveraging cloud platforms for deployment. Ideal... ...will have strong skills in Python programming, experience with IoT integration, and a focus on security and efficiency in digital...
Vortalsoft Inc
New York, NY
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Flink Data Engineer - IoT. Be the first to apply!