Lead Data Engineer: Scale Pipelines & Observability
Kargo
Kargo is building toward a unified platform for self-serve campaigns across CTV, web, mobile, and social. You will own data engineering reporting, domain data sharing, and log processing pipelines, while raising observability and leading a team of data engineers. The role blends hands-on engineering with leadership, in a fast-paced adtech environment. Experience with large-scale Spark-based transformations, AWS, and Kubernetes is required, along with strong collaboration with analysts and #J-18808-Ljbffr Kargo
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Scale Pipelines & Observability in New York, NY vacancy
$220k - $230k
...digital assets and data center infrastructure... ..., hands-on data engineer with 8+ years of experience... ...data platforms at scale — and you're ready to lead. You set the... ...and streaming data pipelines, owning them from design... ..., and monitoring/observability tools Experience...PipelineLocal areaFlexible hoursGalaxy USA
New York, NY9 hours ago$140k - $160k
...seeking a Associate Director/Lead Data Engineer based out of our Chicago... ...architecture of end-to-end data pipelines and solutions on modern... ...lead role architecting large‑scale data platforms. You possess... ...Kinesis). Proficiency with observability tools (Datadog) and data...PipelineTemporary workWork at officeImmediate startWorldwideShift work2 days per weekFitch Ratings
New York, NY3 days ago- ...Job Description Tech Lead – Data Platform | Remote... ...partner with Product and Engineering leadership, and lead... ...performance, transparency, observability, and data integrity.... ...robust ETL/ELT pipelines using Python ,... ...Experience working with large-scale financial datasets....PipelineRemote work
The Cypress Group
New York, NYa month ago - ...seeking a Senior AI/ML Engineer to design, build, and optimize data pipelines powering AI-driven accounting... ...agents. You will lead PySpark ETL development... ...ensure data accuracy at scale across cloud... ...define governance and observability practices for reliable...Pipeline
BlackLine
New York, NY14 hours ago $200k - $230k
...Collaborators to build it. Data pros who turn... ...the bar on the pipelines behind it, which... ...across surfaces, and observability that catches... ...before clients do (for engineers and AI agents... ...and a runbook. Lead and grow the domain... ...You've owned large-scale, interdependent data...PipelineHourly payWork experience placementLocal areaKARGO
New York, NY6 days ago- ...CoreWeave seeks a Senior Software Engineer for the Observability team to design and operate scalable observability infrastructure across thousands... .... You’ll build metrics, logging, tracing, and telemetry pipelines and collaborate with internal teams to improve reliability...Pipeline
Coreweave
New York, NY14 hours ago $195k - $215k
...NYTechnology - Software Engineering /Full Time /HybridAbout... ...design and industry-leading technology. Our portfolio... ...entertainment.Powered by vast data and insights, TTG helps... ...Group and own how we scale our data platform — the... ...marts — plus the CI/CD pipeline and Snowflake platform...PipelineFull timeContract workWork at officeFlexible hoursShift work2 days per week$120k - $180k
...the newly consolidated Data and Analytics (D&A) organization... ...data governance, data engineering, data modeling, data... ...science, and AI.The Lead Data Engineer is... ...build a reusable data pipeline utilizing Big Data and... ...cost efficiency in large-scale environments.• Ability...PipelineFull timeTemporary workWork at officeLocal areaRelocation package3 days per week- Perplexity AI Inc. is seeking a Senior/Staff Software Engineer for the Data Platform team. This role involves shaping architecture... ...of the data ecosystem. You'll design and operate large-scale data pipelines and lead the architecture using tools like Airflow or Dagster....Pipeline
$145.2k - $217.88k
...Scientific Computing and Data team at the Icahn School of... ...computer. AIR.MS ingests OHDSI’s Observational Medical Outcomes... ...translational science. The Lead Data Warehouse Engineer is a senior technical specialist... ...databases and pipelines that balance functionality...PipelineTraineeshipLocal area$180k - $250k
...range $180,000.00/yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize the data infrastructure powering... ...researchers and data scientists to design advanced data pipelines that unlock new sources of alpha. This is a...PipelineFull timeEvolve Group, Inc.
New York, NY3 days ago- ...Lead Data EngineerLocations: Richmond - VA / McLean - VA / Plano -... ...deployment of scalable data engineering solutions that deliver operational... ...to design and implement data pipelines and workflows.Ensure the... ...of clients, enabling them to scale with flexibility, create seamless...PipelineWork at office
InterSources
New York, NY4 days ago - ...MetLife Corporate Functions Data Office is part of the Data and... ...New Frontier strategy! The Lead Data Engineer plays a critical role in big... ...Design and execute a large-scale data migration initiative with... ...reliable, and maintainable pipelines in Azure Data Bricks, Azure...PipelineWork at office
MetLife
New York, NY3 days ago $159.1k - $265.1k
...Summary Our Deloitte AI & Engineering team works to transform... ...innovation. Work You’ll Do As a Lead AI and Data Science Engineer II on the... ....Develop and oversee data pipelines, model training workflows, and... ...they can mature and scale effectively with organizational...PipelineLocal area- Pandora is seeking a Senior Staff Data Engineer to join SiriusXM’s AdsWizz... ...and reporting systems at scale, driving data onboarding across... .... You will mentor engineers, lead architecture discussions, and... ...teams to deliver reliable data pipelines and APIs with a focus on...Pipeline
- Capital One in New York, NY is hiring a Lead Data Engineer to join Risk Tech. You’ll design and deploy data-driven... ..., building scalable, real-time data pipelines and ML-enabled tools to empower financial decisions at scale. #J-18808-Ljbffr Capital One National AssociationPipeline
- ...ads. We are looking to add a data engineer to our Targeting and Audiences... ..., and build processes that scale to petabytes of data. This role... ...reports. Building data pipelines to ingest, process, and load... ...proactive attitude Follow Our Lead Big Picture: com The Latest:...Pipeline
- Pandora, part of SiriusXM, seeks a Senior Staff Data Engineer to design and scale backend data products, reporting systems, and data onboarding across SXM Media services. You will own end-to-end data pipelines and collaborate with multiple teams to deliver insights at scale...Pipeline
- Aaru is seeking a Data Integration Specialist to build and maintain the data foundation powering our simulations... ...data can be linked, queried, and trusted at scale. This role sits at the intersection of data engineering and architecture, critical to producing predictive...Pipeline
$156.28k - $223.25k
We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational... ...to grow your skills in engineering at scale, drive a ton of business impact, and... ...large-scale batch and real-time data pipelines with data processing frameworks like...PipelineFlexible hours- ...Clearview is looking for a Senior Platform Engineer in New York, NY to design and operate the data infrastructure for their facial recognition technologies... ...DevOps, along with the ability to manage large-scale data pipelines and container orchestration. The ideal...Pipeline
clearview
New York, NY14 hours ago $170k - $250k
...are looking for a highly driven Data Engineer to help design, build, and scale the data foundations that power Thesis... ..., and maintain scalable, data pipelines and architectures across... ...Implement monitoring, testing, and observability to ensure high data quality and system...PipelineFull timeWork at office3 days per week- A leading fintech and e-commerce platform is seeking a Senior Data Engineer to design, build, and manage the data platform crucial for... ...and experience with ETL/ELT pipelines. This role demands... ...infrastructure as the company scales. Great benefits and a competitive...Pipeline
$134k - $175.88k
...of how work gets done.Observe by Snowflake is a high... ...built on the Snowflake AI Data Cloud, enabling... ...maintaining a strong pipeline of recurring revenueDrive... ...functionally with sales engineering, product, professional... ...fast, and we’re scaling our team to help enable...PipelineRemote work$106k - $151k
Build data pipelines, reports, best practices and frameworks that enable... ...organization.Use feature engineering to support data needs for... ...development and subsequent scaling through ETL pipeline development... ...pipelines, automation, observability and reporting tools.As a Data...Pipeline- ..., Business Analytics, Engineering, Mathematics, or related... ...experience in data engineering, software... ...for production-grade pipelines, with strong skills in... ...automation, with exposure to observability tools such as Datadog,... ...company Optimize large-scale batch and streaming workflows...PipelineApprenticeshipEasy work
$140k - $160k
...Times is looking for a Senior Data Engineer to join the Customer-Facing... ...to develop real-time data pipelines and APIs that process events... ...across patterns.Engineer and scale high availability data... ...mechanisms to ensure data quality, observability and governance best...PipelineFull timeLocal areaFlexible hours- ...evoke is seeking a Senior Software Engineer to design the backend systems that will scale our real-time HealthTech... ...You’ll own distributed systems, pipelines, and infrastructure that remain... ...under heavy load while delivering observable, reliable performance. The role...Pipeline
evoke
New York, NY14 hours ago $123k - $215.25k
...benefitsJob Function: Engineering &... ..., grounded in our data technology model that... ...capabilities, and leads the end-to-end technology... ...of scalable data pipelines and data architecture... ...automation, CI/CD, observability, documentation, and... ...of enterprise-scale data engineering initiatives...PipelineWorldwideVisa sponsorship$141.9k - $190.3k
...Posting Title:Sr Data EngineerReq ID:101... ...global organization of engineers, product... ...years to come. Reach, Scale & Impact: More than... ...large scale data pipelines that ingest vendor... ...and Unity Catalog.Lead the modernization... ...reliability, logging, and observability.Contribute to...PipelineFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Scale Pipelines & Observability. Be the first to apply!
Related searches
- data network cabling New York, NY
- data processor New York, NY
- data capturer New York, NY
- clinical data coordinator remote New York, NY
- data tech New York, NY
- data technician New York, NY
- provider data management New York, NY
- data recovery New York, NY
- data visualization New York, NY
- data governance New York, NY