Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake
Carlsbad Tech
Carlsbad Tech is looking for a Lead Data Engineer to develop and optimize data pipelines in New York, NY. This role requires expertise in building data solutions using technologies like Kafka and Snowflake, ensuring scalable and reliable data processing. Join a team that values proactive support and collaboration, focusing on delivering high-quality data services essential for financial markets. Candidates should have proven skills in Python and SQL, as well as a deep understanding of data modeling and regulatory standards. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake in New York, NY vacancy
- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely with the engineering... ...like Bigtable and Apache Spark. This position offers...Pipeline
- A leading data solutions company in New York is seeking a... ...Mid-Senior level Data Engineer. The role involves designing... ...high-performance Spark-based data pipelines using Python/PySpark.... ...warehousing tools such as Snowflake or Teradata. This is a full-time position that promises...PipelineFull time
- A leading financial services firm is seeking a Data Engineer to join its regulatory reporting data... ...involves developing data pipelines and processing large... ...using Scala and Spark on Databricks and Snowflake. The ideal candidate... ...experience. This full-time role offers an...PipelineFull time
$230k - $290k
...sellers are building real businesses... ...our news and engineering blogs and join... ...commerce. Role The Data team at Whatnot... ...direction and leading the development... ...learning, real-time analytics,... ...cloud data stores (Snowflake, BigQuery, Redshift... ...processing pipelines at scale. Strong...PipelineWork at officeLocal areaRemote workWork from homeWhatnot
New York, NY1 day ago- ...is seeking a highly skilled Python Data Engineer to work remotely. The ideal candidate... ...include designing and developing data pipelines, implementing real-time streaming solutions, and... ...engineering teams. Proficiency in Python, Spark, Kafka, and cloud platforms is essential...PipelineRemote work
Saxon Global
New York, NY1 day ago $156.28k - $223.25k
We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving... ...'ll Do Build large-scale batch and real-time data pipelines with data processing frameworks like... ...Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on experience...PipelineFlexible hours$80.42k - $106.05k
...seeking a professional in New York for a role involving the design and building of Snowflake data models for Operational Risk and GRC data. Responsibilities include implementing data pipelines, ensuring data quality governance, and supporting risk reporting needs. The...Pipeline$165k - $185k
...com is the world’s leading commerce... ...seeking a Senior Data Scientist to serve... ...science, platform engineering, and marketplace economics... ...architecting the data pipelines that feed your... ...performance, and deploying real-time inference systems... ...scale data tools (Spark, Kafka, or...PipelineTemporary workWork at officeHome officeFlexible hoursShift workSilversmith Capital Partners
New York, NY1 day ago- ...A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing robust data pipelines, guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over...Pipeline
OPSWAT
New York, NY4 days ago - ...Software Services is seeking a highly skilled Streaming Engineer to join a large-scale data engineering project in the United States. The ideal... ...-on experience in designing and managing scalable real-time streaming pipelines and distributed event-driven architectures. This...Pipeline
Neuronimbus Software Services
New York, NY4 days ago - ...A leading healthcare event company is seeking a Senior Data Engineer to design and secure core data pipelines. You will work with modern technologies including Snowflake and AWS to ensure effective data management and... ...privacy. This is a full-time hybrid role located in...PipelineFull timeRemote work
Longwood University
New York, NY1 day ago - ...Title: Lead Snowflake Data Engineer Location: NYC | Fully Onsite | Prioritizing local candidates... ...building scalable, high-performance data pipelines using Snowflake and Cortex AI, with... ...clearly explain and apply the following in real-world scenarios: Snowflake...PipelineContract workLocal area
Suncap Technology
New York, NY3 days ago - ...Valid8 Financial, Inc. is seeking a Senior Event Streaming Engineer to support a Fortune 100 client in their enterprise data transformation. The role focuses on designing scalable, real-time data pipelines using Apache Kafka and integrating AI elements into the architecture...Pipeline
VALID8 Financial
New York, NY1 day ago - ...Lead Data Engineer Locations: Richmond - VA / McLean - VA... ...design and implement data pipelines and workflows.... ...smooth integration and real-time processing of data using... ...solutions using Snowflake. Oversee the implementation... ...such as AWS Glue, Spark, and Databricks....PipelineLong term contractWork at office
InterSources
New York, NY8 days ago $250k - $280k
...A leading AdTech company in the United States is seeking a Principal Engineer with extensive experience in backend systems and adtech. This role involves leading the development of real-time bidding systems and data pipelines, as well as API architecture and collaboration...PipelineMadHive
New York, NY4 days ago- ...York is seeking an Intermediate Data Engineer to design and manage scalable ETL pipelines for analytics. The role involves... ...within a centralized data lake and Snowflake environment. Candidates should... ...in PySpark and Apache Spark. This position will require onsite...Pipeline
- ...Senior KDB Developer to join their engineering team in New York. You will be responsible... ...kdb+/q applications focused on real-time and historical data processing. The ideal candidate will... ...building scalable, low-latency data pipelines, and the ability to support production...Pipeline
- Patrianna Limited is seeking a skilled data engineer in the United States, Georgia to design... ...systems. You'll build and optimize data pipelines and infrastructures to enhance gaming... ...Your role will involve developing APIs, real-time data processing, and upholding data governance...PipelineRemote workFlexible hours
- A cybersecurity startup in New York seeks a Data Engineer to develop secure data infrastructure for real-time analytics. The role involves designing ETL/ELT pipelines, optimizing cloud storage solutions, and collaborating with engineering teams. Ideal candidates have a...PipelineRemote job
- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience...Pipeline
$204.5k - $267k
...Senior Data Engineer Locations: New York... ...high cost and time of clinical trials... ..., John Doerr, Spark Capital, SV Angel... ...help transform Real World Data (RWD... ..., scalable pipelines is essential, you... ...transformation, and Snowflake as the primary... ...and clinical leads to design and...PipelineWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
New York, NY3 days ago- ...Tranzeal is seeking a highly skilled Data Engineer / Data Ingestion Engineer with over... ...in building scalable data pipelines and cloud-based data integration solutions... ...have expertise in AWS Glue, Apache Spark, Python, SQL, and Snowflake. This role is fully remote, allowing...PipelineImmediate startRemote workFlexible hours
Tranzeal
New York, NY4 days ago - A technology consulting firm in New York is seeking a Data Engineer to join their regulatory reporting team. The role involves developing data pipelines using Scala and Spark on Databricks and Snowflake. Candidates should have a Bachelor’s degree in Computer Science and...Pipeline
- ...on developing agent tools, integrating APIs, and implementing data pipelines. The role emphasizes strong expertise in API development and... ...responsive chat interfaces and interactive visualizations, ensuring performance optimization for real-time applications. #J-18808-Ljbffr...PipelineFull time
Bahwan CyberTek
New York, NY1 day ago $110k - $150k
...located in New York, is seeking a Senior Data Integration Engineer to manage the integration of over 400... ...systems into their SaaS platform in real-time. The role requires proficiency in... ...developing and maintaining data integration pipelines. As part of a hybrid model,...PipelineCity Hive
New York, NY1 day ago- ...Algorithmic Trading team, focusing on maintaining and enhancing the data pipeline that supports algorithmic trading models. The ideal candidate will analyze order and market data, enabling real-time decision-making, and work to foster a culture of collaboration and innovation...Pipeline
Nomura Holdings
New York, NY2 days ago $156.8k - $235.2k
...are hiring a Senior Lead Data Engineer to build and scale the... ...will design and operate pipelines processing billions... ...feature stores, and real-time engagement streams that... ...streaming pipelines (Spark, Flink, Databricks,... ...performance engines like Snowflake or Redshift....PipelineParamount Pictures
New York, NY23 hours ago- ...in digital health, focused on real-time clinical AI integration that supports... ...patient outcomes through data-driven, production-grade AI systems... ...partner with product and engineering to embed AI into telehealth and care‐delivery pipelines establish and track operational...PipelineRemote work
Forsyth Barnes
New York, NY4 days ago - ...company is seeking a dedicated Backend Engineer to enhance a professional web-based financial... ...you will design and implement scalable data pipelines, optimize databases, and manage... ...collaborate with backend teams to ensure real-time data delivery and monitor system performance...Pipeline
DL Company
New York, NY1 day ago - ...Staff Engineer page is loaded## Staff... ...innovative data solutions. In... ...and delivering real business... ...You’ll Do*** Lead project initiatives... ...data pipelines and monthly data... ...technologies, including Snowflake Native App... ...to spark ideas and strengthen... ...at any time. Those who live...PipelineFull timeContract workTemporary workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week
Dentsu Aegis Network
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake. Be the first to apply!
Related searches