Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake
Carlsbad Tech
Carlsbad Tech is looking for a Lead Data Engineer to develop and optimize data pipelines in New York, NY. This role requires expertise in building data solutions using technologies like Kafka and Snowflake, ensuring scalable and reliable data processing. Join a team that values proactive support and collaboration, focusing on delivering high-quality data services essential for financial markets. Candidates should have proven skills in Python and SQL, as well as a deep understanding of data modeling and regulatory standards. #J-18808-Ljbffr Carlsbad Tech
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake in New York, NY vacancy
- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely with the engineering... ...like Bigtable and Apache Spark. This position offers...Pipeline
- A leading data solutions company in New York is seeking a... ...Mid-Senior level Data Engineer. The role involves designing... ...high-performance Spark-based data pipelines using Python/PySpark.... ...warehousing tools such as Snowflake or Teradata. This is a full-time position that promises...PipelineFull time
- A leading financial services firm is seeking a Data Engineer to join its regulatory reporting data... ...involves developing data pipelines and processing large... ...using Scala and Spark on Databricks and Snowflake. The ideal candidate... ...experience. This full-time role offers an...PipelineFull time
$80.42k - $106.05k
...seeking a professional in New York for a role involving the design and building of Snowflake data models for Operational Risk and GRC data. Responsibilities include implementing data pipelines, ensuring data quality governance, and supporting risk reporting needs. The...Pipeline- ...A leading digital media company is seeking a Senior Data Engineer to design and implement streaming data pipelines that process billions of user signals daily. The ideal candidate will... ...Java, and hands-on experience with real-time data processing. Responsibilities include...Pipeline
Yahoo Holdings Inc.
New York, NY3 days ago - ...York is seeking an Intermediate Data Engineer to design and manage scalable ETL pipelines for analytics. The role involves... ...within a centralized data lake and Snowflake environment. Candidates should... ...in PySpark and Apache Spark. This position will require onsite...Pipeline
$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays... ...scalable data platforms, pipelines, and trusted datasets... ...ETL/ELT, batch and real-time processing, OLTP and... ...platforms such as Snowflake, BigQuery, Redshift,... ...Kinesis, Pub/Sub, Flink, Spark Streaming, or similar...PipelineLocal areaRemote workFlexible hoursBayview Asset Management
New York, NY2 days ago- ...Senior KDB Developer to join their engineering team in New York. You will be responsible... ...kdb+/q applications focused on real-time and historical data processing. The ideal candidate will... ...building scalable, low-latency data pipelines, and the ability to support production...Pipeline
- Patrianna Limited is seeking a skilled data engineer in the United States, Georgia to design... ...systems. You'll build and optimize data pipelines and infrastructures to enhance gaming... ...Your role will involve developing APIs, real-time data processing, and upholding data governance...PipelineRemote workFlexible hours
- A cybersecurity startup in New York seeks a Data Engineer to develop secure data infrastructure for real-time analytics. The role involves designing ETL/ELT pipelines, optimizing cloud storage solutions, and collaborating with engineering teams. Ideal candidates have a...PipelineRemote job
$204.5k - $267k
...high cost and time of clinical trials... ..., John Doerr, Spark Capital, SV... ...looking for a Senior Data Engineer to join the... ...help transform Real World Data (RWD... ...reliable, scalable pipelines is essential,... ..., and Snowflake as the primary... ...Scientists and clinical leads to design and execute...PipelineWork at officeLocal areaRelocation3 days per weekFormation Bio
New York, NY4 days ago- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience...Pipeline
- A technology consulting firm in New York is seeking a Data Engineer to join their regulatory reporting team. The role involves developing data pipelines using Scala and Spark on Databricks and Snowflake. Candidates should have a Bachelor’s degree in Computer Science and...Pipeline
- Data Engineering | Contract with potential for extension | New York, NY |... ...consulting firm to bring on a Lead Snowflake Data Engineer who can design... ...will sit at the center of pipeline design, modeling, and optimization... ...the platform, has shipped real production pipelines, and...PipelineContract workShift work
- ...is actively recruiting Lead data engineer for full-time roles with direct clients... ...maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink... ...(star schema, snowflake) and query optimization...PipelineFull timeRelocation
$156.8k - $235.2k
...are hiring a Senior Lead Data Engineer to build and scale the... ...will design and operate pipelines processing billions... ...feature stores, and real-time engagement streams that... ...streaming pipelines (Spark, Flink, Databricks,... ...performance engines like Snowflake or Redshift. ~...PipelineParamount
New York, NY4 days ago- ...Staff Data Engineer (B2B Identity Platform) Build... ...on a strong Snowflake foundation—and you... ...build scalable data pipelines and models using Snowflake... ...assets that power real client use cases... ...collaboration to spark ideas and... ...Hub offices at any time. Those who live outside...PipelinePermanent employmentFull timeContract workTemporary workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week
Dan Global
New York, NY4 days ago $110k - $150k
...located in New York, is seeking a Senior Data Integration Engineer to manage the integration of over 400... ...systems into their SaaS platform in real-time. The role requires proficiency in... ...developing and maintaining data integration pipelines. As part of a hybrid model,...Pipeline- ...company is seeking a dedicated Backend Engineer to enhance a professional web-based financial... ...you will design and implement scalable data pipelines, optimize databases, and manage... ...collaborate with backend teams to ensure real-time data delivery and monitor system performance...Pipeline
$140k - $170k
...Studio and AI Engines, the company helps... ...Engineer / Data Scientist to build... ...working with real-world data, and... ...classification, regression, time series... ...robust feature pipelines (aggregation,... ...ML (e.g., Spark, Delta Lake, MLflow... ...modern data stacks (Snowflake/BigQuery/...PipelineH1bLocal areaFusemachines
New York, NY3 days ago- Lead Data Engineer with SQL, Python and Capital banking job at Cortex consultants LLC... ...development and optimization of batch and real-time data pipelines, ensuring scalability,... ...and analytics solutions leveraging Spark, Kafka, and Snowflake. Ability to help voluntarily and...Pipeline
- Smadex is looking for a Data Engineering Team Lead in Austin, TX, to drive the engineering organization and enhance data quality frameworks. You... ...two specialized teams, focusing on optimizing data for real-time machine learning applications. This full-time position requires...PipelineFull time
- A leading technology consulting firm in New York is seeking a Data Engineer to enhance their data platform. The role involves architecting real-time data processing systems and collaborating with diverse teams to deliver actionable business insights. Candidates should...
- Capstone Investment Advisors is looking for a Data Engineer in New York to design and build data platforms for real-time market data. You will develop solutions for efficiently... ...diverse datasets and create tools for data pipelines, enhancing efficiency and quality. The role...Pipeline
- A data technology company in New York is looking for a Data Engineer to design and build batch and real-time data warehouses. The ideal candidate will have over 7 years of experience... ...role involves developing efficient ETL pipelines, maintaining data platforms, and working...Pipeline
- A leading financial institution in New York is seeking a skilled Lead Data Engineer who is passionate about full-stack development and cloud technologies. The role involves... ...solutions, focusing on big data and real-time applications. Candidates should have a Bachelor...
$117.06k - $175.6k
...seeking a Principal SAP Data Integration... ...integrations and data pipelines. The role involves designing... ...SAP S/4HANA, Snowflake, and other systems,... ...ideal candidate will lead the creation of CDS... ...collaborating with engineers to support real-time data movement and optimizations...Pipeline- ...of different types of data systems across the organization... ...Data Warehouse and Snowflake environments... ...tools like Databricks, spark Understand, comply and... ...architects and other software engineers on design Collaborate... ...etc. Building data pipelines via tools like Apache...PipelineWork experience placement
- ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions... ...role requires full lifecycle ownership across Snowflake pipelines, data modeling, and performance optimization, with...Pipeline
TheStaffed
New York, NY1 day ago $175k - $250k
A leading asset management firm is looking for a Machine Learning Engineer to design and build mission-critical infrastructure that powers the ML lifecycle... ..., strong SQL skills, and experience with data pipeline tools like Spark and Terraform. The position offers a competitive...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake. Be the first to apply!
Related searches