Lead Data Engineer — Real-Time Pipelines & Architecture
Human Power BG
A leading performance marketing company in New York is searching for a Lead Software Engineer specializing in data pipelines. This role involves developing micro batch and real-time streaming systems while leading a team of data engineers. Candidates should have experience with big data tools, Java, Scala, and possess strong leadership skills. This position offers an opportunity to work in an innovative environment focused on scalability and efficiency, with a competitive compensation package. #J-18808-Ljbffr Human Power BG
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer — Real-Time Pipelines & Architecture in New York, NY vacancy
- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely with the engineering... ...stakeholders to drive architecture strategies. The ideal...Pipeline
- Quartermaster AI in New York is seeking a Senior Data Engineer to lead the architecture and implementation of scalable data pipelines, optimizing the processing of maritime... ...7 years of experience with high-volume, real-time streaming data. This role focuses on building...PipelineFlexible hours
- The Walt Disney Company seeks a Lead Product Software Engineer for Data Systems to build the foundation of ESPN... ...enhance user experiences through real-time data. Key responsibilities include... ...have 7+ years of experience in data pipelines, modern frameworks, and software engineering...Pipeline
$180k - $260k
Elea Ecuador is seeking a Data Engineer in New York to design data architectures and build scalable data systems. You'll... ...work across teams to implement data pipelines and ensure data quality at scale.... ...health insurance and generous time off policies. Applicants must be...PipelineWork from home$170k - $230k
...Architect in New York, NY. This role focuses on shaping the real-time data infrastructure that drives critical business operations and innovative... ...candidate will design and implement high-performance data pipelines, requiring expertise in Kafka, Java, and Python. The position...Pipeline- ...Architect in our New York, NY office to shape the real-time data backbone powering critical business... ...emphasis on high-throughput, low-latency pipelines and resilient distributed systems. Collaborate across architects, engineers, and stakeholders to drive transformation...PipelineWork at office
- Inizio Partners Corp is seeking a Senior Data Engineer to design and optimize ETL pipelines on cloud Databricks, with a focus on insurance data and real-time integration via Spark. You will lead data engineering projects, collaborate with global teams, and implement automated...Pipeline
- Lead Data Engineer - Front Office | Global Multi-Strategy Firm | Up to $600k TC My client... ...to own the platform end-to-end. Architecture, roadmap, engineering standards, and... ...The work ranges from low-latency pipelines powering real-time PnL and risk, to the governance...PipelineImmediate start
- Netflix is looking for a Data Engineer to help develop and maintain large-scale data pipelines and services that support decision‑making across the organization. You will design batch and real‑time pipelines, model data for analytics, and collaborate with product, software...PipelineRemote jobRelocation
- A cybersecurity startup in New York seeks a Data Engineer to develop secure data infrastructure for real-time analytics. The role involves designing ETL/ELT pipelines, optimizing cloud storage solutions, and collaborating with engineering teams. Ideal candidates have a...PipelineRemote job
- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing... ...This role involves developing real-time data pipelines and APIs that serve customer... ...familiarity with event-driven architectures, and proficiency in Python. This...Pipeline
$187.94k - $281.91k
Spotify USA, Inc. seeks a Senior Data Engineer located in New York, NY. The role involves building scalable and real-time data processing systems to support machine learning algorithms. The ideal candidate will have a Master's degree and 5 years of experience, or a Bachelor...PipelineRemote job- A leading technology firm is seeking a Data Engineer to design and develop scalable data architectures for advanced intelligence analysis. The role involves implementing ETL workflows, ensuring data quality, and collaborating with analysts to meet mission needs. Candidates...Pipeline
$200k - $250k
Clear-Street is seeking an experienced Software Engineer in New York, NY, to build high-performance real-time data pipelines for processing financial market data across... ...systems, understanding of distributed architectures, and familiarity with financial data. Competitive...PipelineWork at office- Slang AI in New York City is seeking a Data Analytics Engineer to build and scale our analytics... ...ingestion to dashboards. You will own pipelines, transformations, and reporting layers... ...efficient, with opportunities to move toward real-time analytics as the platform evolves....Pipeline
- Clear Street is seeking a seasoned Software Engineer to build high-performance real-time data pipelines for financial market data, including security prices across asset classes. You will design, develop, and optimize pipelines with low latency and high throughput, collaborating...Pipeline
- A leading AI investment firm in San Francisco seeks a skilled integration engineer to join its team. In this hands-on role, you will design and build complex data pipelines, working with systems like Snowflake and AWS... ...and efficiency in real-time. The ideal candidate will...Pipeline
- Olik Global is seeking an experienced Data Engineer for projects in New Jersey, Irving, and Tampa. You'll be responsible for designing and optimizing data pipelines with a focus on MEM SQL (SingleStore) for real-time processing. The ideal candidate will require strong...Pipeline
- ...Series A startup powering right-time data replication and transform —... ...layers. Senior Systems Engineer — Capture & Materializations... ...data in and out of Estuary in real time. Work across APIs, databases... ...visualizations of distributed data pipelines, metrics, and system health...Pipeline
- ...Entertainment Distribution is seeking a Senior Software Engineer to design, develop, and maintain backend services and real-time data systems used across ABC News and Disney platforms. You’ll build APIs, data pipelines, and event-driven services with Java/Spring Boot,...Pipeline
- A leading financial institution in New York is seeking a skilled Lead Data Engineer who is passionate about full-stack development and cloud technologies. The role involves... ...solutions, focusing on big data and real-time applications. Candidates should have a Bachelor...
- Gravity Engineering Services Pvt Ltd. is seeking a skilled Machine Learning Engineer based... ...designing end-to-end machine-learning pipelines and deploying solutions using AWS services... ...teams to optimize ad creatives in real-time. The ideal candidate has strong programming...Pipeline
- ..., and Plumbing. We are hiring a Software Engineer to own our data platform and analytics, designing migrations, schemas, and pipelines for data extracted from dense construction... ...and internal teams. You will craft real-time ingestion, cleanse messy data, and enable...Pipeline
- Block Labs in Georgia is searching for a Data Platform Engineer to design and maintain scalable data pipelines that support advanced intelligence applications. This position entails owning the end-to-end real-time data pipeline while ensuring optimal performance of ClickHouse...Pipeline
- A leading healthcare technology company is seeking a Principal Data Platform Engineer to define and evolve a real‑time and batch data platform built on AWS and Databricks. This role involves... ...and expertise in real-time data architectures. Join a highly collaborative team...
- ...is seeking an experienced Senior Analytics Engineer to drive business growth by building the data foundation for strategic insights. This role... ...ownership of the BigQuery data warehouse and data pipelines, contributing to real-time data products and analytics. The ideal...Pipeline
- David Yurman Enterprises, LLC is seeking a Data Engineer to join their Data Management &... ...solutions and building serverless data pipelines using AWS services. The ideal candidate... ...including healthcare and generous paid time off. #J-18808-Ljbffr David Yurman Enterprises...Pipeline
- ...Entertainment & Sports LLC is looking for a Lead Product Software Engineer in New York, NY, to build scalable... ...user experiences. You will develop data platforms and work closely with engineering... ...educational background. This full-time role is integral to the growth of ESPN...Full time
- A leading AI technology firm in New York is seeking a Senior Software Engineer to scale their voice agent pipeline. This hands-on role requires expertise in backend engineering, with a focus on integrating AI models for real-time performance. The ideal candidate will have...Pipeline
- ...technology is seeking a skilled 3D Graphics Software Engineer to design and develop real-time 3D applications. The role requires expertise in C++, OpenGL... .... Responsibilities include optimizing rendering pipelines and integrating graphics modules. The position offers...Pipeline
Canfieldimaging
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer — Real-Time Pipelines & Architecture. Be the first to apply!
