Lead Flink Data Engineer - IoT

Maintec Technologies

United States

Lead Flink Data Engineer - IoT

New York City, NY (Remote)

Job Description:

This is a role responsible for designing, building, and maintaining the real-time streaming infrastructure required for sensor data integration, complex state processing, and alerting in the Industrial IoT / Smart Buildings domain.
We are seeking a Lead Data Engineer with expert-level Apache Flink (Java and SQL) skills, and proven implementation of custom ProcessFunctions, state management, and real-time data quality gates, delivering Data and Analytics products using Agile methodology. The ideal candidate will possess strong technical, analytical, and interpersonal skills.

Qualification / Skill Set Requirement:

5+ years of hands-on data engineering experience with deep expertise in the Azure ecosystem.
5+ years in Java (backend) with 3+ years deep specialization in Apache Flink (DataStream API & SQL).
Experience with Flink State Management, Checkpointing, and Watermark strategies.
Experience upgrading to or using Flink 2.0/2.x.
Experience with Azure Event Hubs or Kafka.
Understanding of "Sensor/IoT" data patterns (out-of-order and missing events).
Proficient in Java, SQL, and writing optimized data integration and processing code.
Strong understanding of SDLC and Agile methodologies with hands-on experience in Azure DevOps, GitHub, CI/CD, and artifact management.
Deep expertise in Azure data services.
Skilled in data modeling, database design, and data warehousing solutions on Azure.
Knowledge of data quality, governance, and security best practices within Azure (AD, NSG, encryption, compliance).
Certifications preferred: Azure Fundamentals, Azure Data Engineer Associate, and Azure Solutions Architect Expert (nice to have).

Responsibilities:

Architect, design, and implement scalable and efficient data solutions on Flink.
Design and implement the Flink 2.x streaming pipeline for IoT.
Develop custom KeyedProcessFunctions to handle "Heartbeat Injection" (detecting sensor silence) and complex windowing.
Implement the Gatekeeper Pattern: A Flink job that applies Data Quality tags (Validity, Completeness) to the stream without dropping data.
Optimize State Backends for high-cardinality sensor data (100k+ concurrent sensors).
Work with the "Shared Core" team to integrate libraries into the Flink runtime.
Manage and optimize Azure resources (Flink clusters) for performance, reliability, and cost-efficiency.
Transform, clean, and prepare data using SQL, and Java.
Monitor and fine-tune workloads and pipelines for optimal performance and reliability.
Maintain clear documentation of solutions, configurations, and workflows.
Actively participate in Agile team activities and continuous improvement initiatives.
Promote and enforce data engineering best practices, including data governance, security, and data quality.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Lead Flink Data Engineer - IoT in United States vacancy

Lead Data Engineer
...deeply interested in how data flows — not just... ...second energy data from our IoT sensors to the cloud. Our... ...cases and personas, and engineer product to support a strong... ..., StarTree, etc). Lead data architecture decisions... ...processing tools (e.g., Kafka, Flink, Spark Streaming)...
Suggested
Remote work
Verdigris Technologies Inc
Mission, KS
1 day ago
Data Engineer with Flink, Druid
...Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp... ...Data Engineer Primary Skills - Scala, Spark, AWS, Kafka, Flink, Druid About the Data Engineer Role Data Engineer responsible...
Suggested
Keylent Inc
Denver, CO
3 days ago
Data Engineer- PySpark/Apache Flink
...Data Engineer- PySpark/Apache Flink Skills: Digital : Python for Data Science~5G Wireless Networks Experience Required: 8-10 Role Descriptions: Data Analysis Insight GenerationAnalyze large-scale wireless (RAN| Core) and IEN network alarm data from OSSNMS systems...
Suggested
Diverse Lynx
Irving, TX
2 days ago
Flink Data Engineer
...Role: Flink Data Engineer Location: MTV/San Diego CA Experience: 8-10 years of experience Must have: Expertise in Apache Flink Strong programming skills in Java or Scala and SQL Knowledge of stream processing and batch processing Experience...
Suggested
United IT Solutions
San Diego, CA
2 days ago
Senior Data Engineer - Spark/Flink/Scala
...Scala Engineer We are looking for Scala Engineers with experience with batch and/or streaming... .... We utilize Spark for batch jobs and Flink for real-time streaming jobs. Experience... ...and interacting with infrastructure and data teams to produce complex analysis across...
Suggested
Omega Solutions Inc
Mountain View, CA
3 days ago
Data Engineer (Ab Initio, OzoneCH, Flink)/ Ab Initio Consultant
$110k
...Rate: upto $110k (FTE) Title: Data Engineer (Ab Initio, OzoneCH, Flink)/ Ab Initio Consultant Role: Streaming Data Engineer - Ab Initio, OzoneCH, Flink Location: Berkeley Heights, NJ (5 Days Onsite) local candidates only required Need...
Work at office
Local area
Hallmark Global Solutions Ltd
Berkeley Heights, NJ
2 days ago
Real-Time Analytics Engineer (Flink, Kafka) - Q125
...Corporation (R2) , headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial... ...technology innovation! Real-Time Analytics Engineer (Flink, Kafka) Location: Alpharetta, GA (willing to...
Full time
R2 Technologies
Alpharetta, GA
8 hours ago
Remote Flink Engineer — Real-Time Data (H-1B Sponsorship)
A U.S.-based technology consulting firm is seeking a remote Apache Flink Engineer specializing in real-time data engineering. This full-time role offers H-1B visa sponsorship and remote flexibility, allowing candidates to work on enterprise-scale streaming platforms. Responsibilities...
Remote job
Full time
H1b
Visa sponsorship
NewsNowGh
Cincinnati, OH
3 days ago
Senior Data Engineer - IoT Data Pipelines & ML (Hybrid)
$95k - $149k
SmartSense by Digi is seeking a Sr Data Engineer to join their innovative team in Boston, MA. This hybrid role involves contributing to strategic... ...$95,000 to $149,000, comprehensive benefits, and the opportunity to shape the future of IoT. #J-18808-Ljbffr SmartSense by Digi
SmartSense by Digi
Boston, MA
4 days ago
Data Engineer (Ab Initio, OzoneCH, Flink) | Berkeley Heights, NJ (5 Days Onsite) | W2 & Fulltime
Job Description Duration: Long term Experience: 8 - 15 Years Primary Skills Docker Kubernetes Kafka GDE CLOUD Ab Initio MQ Flink Linux Unix Shell Big Data OzoneCH EME flow graphs file streams Graphical #J-18808-Ljbffr Indotronix UK
Full time
Indotronix UK
Berkeley Heights, NJ
4 days ago
Senior Real-Time Data Engineer — Flink & Feature Store
Medium is seeking a Data Engineer to leverage Apache Flink for building high-performance, real-time data streams. This role involves ensuring data quality, optimizing pipeline performance, and bridging the gap between data science and backend teams. Candidates should have...
Relocation
Medium
Hamburg, IL
3 days ago
Lead Data Engineer
...Summary The Lead Data Engineer will design, build, and maintain the organization's enterprise data platform, leading the technical implementation... ...data technologies (e.g., Kafka, Kinesis, Spark Streaming, Flink) supporting reporting and operational visibility....
Work at office
WellDyne
Lakeland, FL
4 days ago
Lead Data Engineer
...from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you... ...that enable physical AI at scale: from terabytes of IoT sensor telemetry streaming through our medallion...
Permanent employment
Temporary work
Relocation package
Flexible hours
Honeywell
Atlanta, GA
4 days ago
Lead Data Engineer
$179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-... ...Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java,...
Full time
Part time
Internship
H1b
Local area
Capital One
Plano, TX
1 day ago
Lead Data Engineer
$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation... ...with streaming systems such as Kafka, Kinesis, Pub/Sub, Flink, Spark Streaming, or similar technologies ~ Experience...
Local area
Remote work
Flexible hours
Bayview Asset Management
New York, NY
4 days ago
Lead Data Engineer
$86.62k - $101.9k
...Job Title Lead Data Engineer Job Description Summary Job Description The Lead Data Engineer helps architect and lead the development... ..., tSQLt, nBI, etc.) Exposure to real-time integrations or IoT solutions e.g. Event Hubs, Service Bus, IoT and Event Grid in...
Minimum wage
Flexible hours
Cushman & Wakefield
Saint Louis, MO
1 day ago
Lead Data Engineer
$125k - $143.71k
...Job Posting Title: Lead Data Engineer ---- Hiring Department: Enterprise Technology - Data to Insights (D2I) ---- Position... ...processing and streaming frameworks, such as Apache Spark, Kafka, Flink, or Airflow, for orchestration and automation. ~ Strong...
Full time
For contractors
Fixed term contract
Work at office
Immediate start
Remote work
Monday to Friday
Flexible hours
Shift work
Night shift
The University of Texas at Austin
Austin, TX
3 days ago
Lead Data Engineer
...Lead Data Engineer We are looking for a Lead Data Engineer to design, build, and scale robust data infrastructure and pipelines. This role... ...dbt, etc.) ~ Familiarity with streaming technologies (Kafka, Flink, etc.) ~ Experience with data warehousing solutions (...
Covetit
Encino, CA
3 days ago
Lead Data Engineer
...Lead Data Engineer The Lead Data Engineer will lead the design, development, and administration of critical data pipelines and platform... ...and related concepts. Experience designing and implementing IoT and real-time streaming data pipelines. Proficiency with...
Work experience placement
Monday to Friday
Brentwood Industries
Reading, PA
23 days ago
Lead Data Engineer
...that shape the industries of tomorrow. Its engineers build critical infrastructure to... .... The Position We are seeking a Lead Data Engineer to play a critical role in advancing... ...Scala, or Java ~ Experience with Spark, Flink, or Beam ~ Experience with Airflow or...
Temporary work
Flexible hours
NorthMark Strategies
Dallas, TX
2 days ago
Lead Data Engineer
...Lead Data Engineer This role is responsible for providing technical leadership and execution expertise to design and deliver end-to-end data... ...in transportation, logistics, or network optimization Experience with IoT Data Architecture Leadership experience...
1872 Consulting
Oak Brook, IL
1 day ago
Lead Data Platform Engineer for IoT Analytics
A technology solutions provider is seeking a Principal Software Engineer - Data Platform Engineering in Raleigh, North Carolina. This role involves designing scalable data pipelines and developing micro-services using Python, Apache Spark, and Databricks. The ideal candidate...
Compunnel, Inc.
Raleigh, NC
4 days ago
Senior Software Engineer - Real-Time Data & Flink
...We are looking for motivated Software Engineers to join our dynamic development teams. In this... ..., and contribute to cutting-edge data-intensive solutions. At Ververica, you... ...using innovative approaches to manage Apache Flink. Your Role and Responsibilities...
Worldwide
Ververica | Original creators of Apache Flink®
New Bremen, OH
1 day ago
Senior Software Engineer - Data Team (AWS, Flink, OpenSearch)
...We are seeking a Senior Streaming Platform Engineer (6+ years) with deep expertise in enterprise-scale streaming and cloud data platforms. Based in Atlanta, this role collaborates... ...Preferred: Experience with Flink using Spring Boot Snowflake integration experience...
NICE
Atlanta, GA
3 days ago
Lead Data Engineer
$125k - $143.71k
Job Details Job Title: Lead Data Engineer Department: Enterprise Technology - Data to Insights (D2I) Position Open To: All Applicants Weekly... ...distributed data processing and orchestration (Spark, Kafka, Flink, Airflow). Familiarity with data observability, cost optimization...
Fixed term contract
Work at office
Immediate start
Remote work
Flexible hours
Phase2 Technology
Austin, TX
1 day ago
Lead Data Engineer
Use your data engineering expertise to drive impact at a dynamic investment firm where data fuels... ..., Java, or Scala Experience with Spark, Flink, Trino, Kafka, Iceberg, Airflow Deep knowledge... ...leadership skills If you’re ready to lead data innovation and influence key...
Arcus Search
Wisconsin
5 days ago
Lead Data Engineer
$160k - $220k
...across four continents — and we're hiring the engineering team to build what comes next. About the... ...clinical picture alongside the wearable data. Your job is to make sure every one of... ...at least two of: audio/video processing, IoT/wearables, or mobile sensing Have expert...
Permanent employment
Full time
Work experience placement
H1b
Worldwide
Relocation
Flexible hours
Shift work
Night shift
Day shift
Deliberate Solutions, Inc.
Boston, MA
4 days ago
Lead Data Engineer
$125k - $143.71k
Job Posting Title: Lead Data Engineer Hiring Department: Enterprise Technology - Data to Insights (D2I) Location: Texas Weekly Scheduled Hours... ...and streaming frameworks, such as Apache Spark, Kafka, Flink, or Airflow, for orchestration and automation. Strong familiarity...
Immediate start
Flexible hours
University of Texas at Austin
Austin, TX
1 day ago
Lead Data Engineer
$125k - $143.71k
Lead Data Engineer Enterprise Technology - Data to Insights (D2I) All Applicants Weekly Scheduled Hours: 40 FLSA Status: Exempt Earliest... ...processing and streaming frameworks, such as Apache Spark, Kafka, Flink, or Airflow, for orchestration and automation. Strong...
Full time
For contractors
Fixed term contract
Work at office
Immediate start
Remote work
Monday to Friday
Flexible hours
Shift work
Night shift
The University of Texas at Austin
Austin, TX
5 days ago
Lead Data Engineer
...that shape the industries of tomorrow. Its engineers build critical infrastructure to... ...innovation. The Position We are seeking a Lead Data Engineer to play a critical role in advancing... ...Scala, or Java Experience with Spark, Flink, or Beam Experience with Airflow or...
NMC2
Dallas, TX
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Flink Data Engineer - IoT. Be the first to apply!