Lead Data Engineer - Real-Time Analytics & Data Pipelines
OPSWAT
A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing robust data pipelines, guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over 5 years of experience with tools like Prefect and Airflow, strong technical skills in Python, GO, and SQL, and a passion for leading teams. The role is located in the United States, with a focus on innovative data solutions. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Real-Time Analytics & Data Pipelines in New York, NY vacancy
$230k - $290k
...sellers are building real businesses across... ...on our news and engineering blogs and join us... .... Role The Data team at Whatnot creates... ...direction and leading the development of... ...learning, real-time analytics, stream processing... ...-time processing pipelines at scale. Strong...PipelineWork at officeLocal areaRemote workWork from homeWhatnot
New York, NY3 days ago$140k - $160k
Key Responsibilities Analytics & Reporting Architect multi-source data aggregation pipelines consolidating web, social, broadcast, and third‑party data Lead AI‑powered dashboard development with automated... ...anomaly detection and real‑time trend surfacing Establish reporting...PipelineWork at office$160k - $240k
...Bloomberg is seeking a Senior Software Engineer for its Analytics Event Streaming team in New York. You will develop high-standard software and data streaming pipelines to ensure scalability, reliability, and efficiency. The ideal candidate will have 4+ years of experience...PipelineBloomberg
New York, NY3 days ago- ...fast-growing AI startup in New York seeks a Data Engineer to build and maintain their core data... ...infrastructure. You'll work with advanced data pipelines and modern data warehouses, ensuring data integrity for AI-driven analytics. Ideal candidates will have strong SQL...Pipeline
- A healthcare technology company is seeking a Data Engineer to develop data infrastructure that supports business intelligence and operational analytics. The role requires extensive experience in building data pipelines and working with relational databases. Candidates should...Pipeline
$180k - $260k
Elea Ecuador is seeking a Data Engineer in New York to design data architectures and build scalable... ...'ll work across teams to implement data pipelines and ensure data quality at scale. This... ...including health insurance and generous time off policies. Applicants must be within...PipelineWork from home- A cybersecurity startup in New York seeks a Data Engineer to develop secure data infrastructure for real-time analytics. The role involves designing ETL/ELT pipelines, optimizing cloud storage solutions, and collaborating with engineering teams. Ideal candidates have a...PipelineRemote job
- Bamboo Health, Inc. is seeking a passionate Senior Analytics Engineer who will work with the Analytics and Visualization team to develop reporting solutions. This role focuses on designing data pipelines and creating user-facing data products to improve healthcare delivery...PipelineRemote work
- SCALIS is looking for a Data Analytics Engineer in New York City to enhance our analytics infrastructure. You'll build and maintain the pipelines crucial to understand our products and customers. The ideal candidate will have 5+ years in data engineering or BI analytics...Pipeline
- A dynamic tech company is looking for a Data Analytics Engineer to join their team in New York. The role involves building and maintaining analytics infrastructure, creating pipelines in BigQuery, and managing data ingestion processes. Ideal candidates should have expert...PipelineRemote job
- ...Carlsbad Tech is looking for a Lead Data Engineer to develop and optimize data pipelines in New York, NY. This role requires expertise in building data solutions using technologies like Kafka and Snowflake, ensuring scalable and reliable data processing. Join a team that...Pipeline
Carlsbad Tech
New York, NY4 days ago $160k - $240k
...A leading financial technology company in New York is seeking a Senior Software Engineer - Analytics Event Streaming. The role involves developing software and data streaming pipelines at large scale while collaborating with business stakeholders. Candidates should have...PipelineBloomberg
New York, NY3 days ago- ...A leading healthcare technology firm is seeking a Staff Data Engineer to enhance its Real-Time Care Intelligence solutions. The ideal candidate has over 8 years of software development experience, specializes in ETL solutions, and is proficient with AWS technologies like...Remote work
Bamboo Health Inc.
New York, NY2 days ago $250k - $280k
...A leading AdTech company in the United States is seeking a Principal Engineer with extensive experience in backend systems and adtech. This role involves leading the development of real-time bidding systems and data pipelines, as well as API architecture and collaboration...PipelineMadHive
New York, NY2 days ago$200k - $400k
...Decagon is looking for a Senior Data Infrastructure Engineer to design and operate data systems supporting AI products. You will own critical data pipelines, improve performance, and collaborate with product teams. The ideal candidate has over 5 years of experience in...PipelineDecagon
New York, NY3 days ago- ...Software Services is seeking a highly skilled Streaming Engineer to join a large-scale data engineering project in the United States. The ideal... ...-on experience in designing and managing scalable real-time streaming pipelines and distributed event-driven architectures. This...Pipeline
Neuronimbus Software Services
New York, NY2 days ago - ...Valid8 Financial, Inc. is seeking a Senior Event Streaming Engineer to support a Fortune 100 client in their enterprise data transformation. The role focuses on designing scalable, real-time data pipelines using Apache Kafka and integrating AI elements into the architecture...Pipeline
VALID8 Financial
New York, NY3 days ago - ...Neura Market in New York is seeking a Senior Data Infrastructure Engineer to design and build crucial data systems for our AI products. You will manage data pipelines and storage layers, ensuring performance and reliability. The ideal candidate has over 5 years of experience...PipelineFlexible hours
Neura Market
New York, NY3 days ago - ...Senior KDB Developer to join their engineering team in New York. You will be responsible... ...kdb+/q applications focused on real-time and historical data processing. The ideal candidate will... ...building scalable, low-latency data pipelines, and the ability to support production...Pipeline
- Patrianna Limited is seeking a skilled data engineer in the United States, Georgia to design... ...systems. You'll build and optimize data pipelines and infrastructures to enhance gaming... ...Your role will involve developing APIs, real-time data processing, and upholding data governance...PipelineRemote workFlexible hours
- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely with the engineering team and collaborating with key stakeholders to drive...Pipeline
- ...A global leader in automotive solutions seeks a Data Engineer to design Data Warehouse schemas and build data pipelines. Ideal candidates will have over 5 years of experience, especially with SQL and Python, alongside proficiency in Power BI and AWS CloudWatch. The role...PipelineRemote work
Coherent Solutions
New York, NY3 days ago - A technology consulting firm located in New York is looking for an experienced Senior Data Engineer to design and develop ETL/ELT pipelines for banking applications. Candidates should have over 9 years of experience, including 3 years in the banking sector, with expertise...Pipeline
- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience...Pipeline
- ...company is seeking a dedicated Backend Engineer to enhance a professional web-based financial... ...you will design and implement scalable data pipelines, optimize databases, and manage... ...collaborate with backend teams to ensure real-time data delivery and monitor system performance...Pipeline
DL Company
New York, NY4 days ago - ...Capstone Investment Advisors is looking for a Data Engineer in New York to design and build data platforms for real-time market data. You will develop solutions for efficiently... ...diverse datasets and create tools for data pipelines, enhancing efficiency and quality. The role...Pipeline
Experimentation Jobs
New York, NY4 days ago - A leading technology firm is seeking a Data Engineer to design and develop scalable data architectures for advanced intelligence analysis. The role involves implementing ETL workflows, ensuring data quality, and collaborating with analysts to meet mission needs. Candidates...Pipeline
- A Series D fintech firm is seeking a Senior Data Engineer to design and scale data infrastructure supporting secure financial products. This hands-on role entails building scalable pipelines, ensuring data quality, and collaborating across teams to meet regulatory standards...Pipeline
- ...in digital health, focused on real-time clinical AI integration that supports... ...patient outcomes through data-driven, production-grade AI systems... ...partner with product and engineering to embed AI into telehealth and care‑delivery pipelines establish and track operational...PipelineRemote work
Forsyth Barnes
New York, NY2 days ago - Olik Global is seeking an experienced Data Engineer for projects in New Jersey, Irving, and Tampa. You'll be responsible for designing and optimizing data pipelines with a focus on MEM SQL (SingleStore) for real-time processing. The ideal candidate will require strong...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Real-Time Analytics & Data Pipelines. Be the first to apply!
Related searches
- staff data engineer New York, NY
- data engineering intern summer New York, NY
- senior data integration developer New York, NY
- data engineer graduate New York, NY
- data engineer contract New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- software data engineer New York, NY
- hadoop big data developer New York, NY
- data developer New York, NY