Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake
Carlsbad Tech
Carlsbad Tech is looking for a Lead Data Engineer to develop and optimize data pipelines in New York, NY. This role requires expertise in building data solutions using technologies like Kafka and Snowflake, ensuring scalable and reliable data processing. Join a team that values proactive support and collaboration, focusing on delivering high-quality data services essential for financial markets. Candidates should have proven skills in Python and SQL, as well as a deep understanding of data modeling and regulatory standards. #J-18808-Ljbffr Carlsbad Tech
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake in New York, NY vacancy
- The Walt Disney Company seeks a Lead Product Software Engineer for Data Systems to build the foundation of ESPN... ...enhance user experiences through real-time data. Key responsibilities include... ...have 7+ years of experience in data pipelines, modern frameworks, and software engineering...Pipeline
$140k - $150k
David Yurman is seeking a Data Engineer to design and implement data solutions in a hybrid setting... ...role involves creating AWS-based data pipelines, ensuring data integrity, and... ...strong experience in AWS technologies and Snowflake, with excellent communication skills. A...Pipeline- A leading data solutions company in New York is seeking a... ...Mid-Senior level Data Engineer. The role involves designing... ...high-performance Spark-based data pipelines using Python/PySpark.... ...warehousing tools such as Snowflake or Teradata. This is a full-time position that promises...PipelineFull time
- Disney Cruise Line - The Walt Disney Company is seeking a Data Engineer to join the Product Performance Team within their Data Organization... ...of 3 years data engineering experience, proficiency in Spark and Scala, and strong AWS knowledge. The position offers a competitive...Pipeline
- Patrianna Limited is seeking a skilled data engineer in the United States, Georgia to design... ...systems. You'll build and optimize data pipelines and infrastructures to enhance gaming... ...Your role will involve developing APIs, real-time data processing, and upholding data governance...PipelineRemote workFlexible hours
- Lead Data Engineer - Front Office | Global Multi-Strategy Firm | Up to $600k TC My client is... ...across the firm. The platform spans Snowflake, dbt, Spark, and Databricks/EMR. The work ranges from low-latency pipelines powering real-time PnL and risk, to the governance and...PipelineImmediate start
- A cybersecurity startup in New York seeks a Data Engineer to develop secure data infrastructure for real-time analytics. The role involves designing ETL/ELT pipelines, optimizing cloud storage solutions, and collaborating with engineering teams. Ideal candidates have a...PipelineRemote job
$130k - $196.5k
...is looking for a seasoned data engineering professional to design and... ...optimize scalable data processing pipelines. You'll lead collaborations with... ...proficiency in tools like Apache Spark and Kubernetes, and a... ...matching plan and flexible paid time off. #J-18808-Ljbffr...PipelineFlexible hours- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience...Pipeline
$187.94k - $281.91k
Spotify USA, Inc. seeks a Senior Data Engineer located in New York, NY. The role involves building scalable and real-time data processing systems to support machine learning algorithms. The ideal candidate will have a Master's degree and 5 years of experience, or a Bachelor...PipelineRemote job- Olik Global is seeking an experienced Data Engineer for projects in New Jersey, Irving, and Tampa. You'll be responsible for designing and optimizing data pipelines with a focus on MEM SQL (SingleStore) for real-time processing. The ideal candidate will require strong...Pipeline
$156.8k - $235.2k
...are hiring a Senior Lead Data Engineer to build and scale the... ...will design and operate pipelines processing billions... ...feature stores, and real-time engagement streams that... ...streaming pipelines (Spark, Flink, Databricks,... ...performance engines like Snowflake or Redshift....Pipeline- NLM It Solutions is seeking a Data Engineer in the United States to build and manage real-time and batch data pipelines. This role demands expertise in SAP BODS, Striim, BigQuery, and GCP Composer to design and implement efficient ETL processes and optimize SQL performance...PipelineFull time
- Lead Data Engineer with SQL, Python and Capital banking job at Cortex consultants LLC... ...development and optimization of batch and real-time data pipelines, ensuring scalability,... ...and analytics solutions leveraging Spark, Kafka, and Snowflake. Ability to help voluntarily and...Pipeline
$204.5k - $267k
...high cost and time of clinical... ...John Doerr, Spark Capital, SV Angel... ...for a Senior Data Scientist to... ...transform Real World Data (RWD... ...healthcare data engineering, real-world... ..., scalable pipelines is essential,... ...transformation, and Snowflake as the... ...and clinical leads to design and...PipelineWork at officeLocal areaRelocation3 days per week- A leading technology consulting firm in New York is seeking a Data Engineer to enhance their data platform. The role involves architecting real-time data processing systems and collaborating with diverse teams to deliver actionable business insights. Candidates should...
- Smadex is looking for a Data Engineering Team Lead in Austin, TX, to drive the engineering organization and enhance data quality frameworks. You... ...two specialized teams, focusing on optimizing data for real-time machine learning applications. This full-time position requires...PipelineFull time
- ...Ditto is redefining how data moves at the edge. Our... ...developers to build resilient, real-time applications,... ...Ditto's peer-to-peer sync engine ensures devices stay... ...Core Aggregation Node: Lead the on-site architecture... ...Adaptability. And a genuine spark for what we’re building...Fixed term contractLocal areaImmediate startRemote workFlexible hours
- Capstone Investment Advisors is looking for a Data Engineer in New York to design and build data platforms for real-time market data. You will develop solutions for efficiently... ...diverse datasets and create tools for data pipelines, enhancing efficiency and quality. The role...Pipeline
$185k - $215k
...Group is seeking a Back Machine Learning Engineer in New York, NY, focused on AI/ML... ...evaluating Generative AI systems, building data pipelines, and implementing advanced language models. Ideal candidates will work on real-time processing and insights generation. Applicants...Pipeline- A leading financial institution in New York is seeking a skilled Lead Data Engineer who is passionate about full-stack development and cloud technologies. The role involves... ...solutions, focusing on big data and real-time applications. Candidates should have a Bachelor...
- ...is seeking an experienced Senior Analytics Engineer to drive business growth by building the data foundation for strategic insights. This role... ...ownership of the BigQuery data warehouse and data pipelines, contributing to real-time data products and analytics. The ideal...Pipeline
- ...Remote Employment Type: Contract / Full-Time Experience: 10+ Years Position Overview We are seeking an experienced Lead Data Engineer - Azure & Snowflake to design, develop, and optimize... ...background in building scalable ETL/ELT pipelines and modern data architectures. This...PipelineFull timeContract workRemote work
- A leading technology firm is seeking a Mid-Senior level Data Engineering Lead to manage a team for complex data integration projects... ...models, developing ETL/ELT pipelines, and ensuring data accuracy. The... ...candidates in the EST or CST time zones. #J-18808-Ljbffr Largeton...PipelineRemote job
- ...Consulting firm, is seeking a Senior Python and Snowflake Developer to design, build, and optimize scalable data pipelines, develop robust backend services, implement... ...data models, and drive end-to-end data engineering solutions. The role involves collaborating with...Pipeline
$180k - $260k
Elea Ecuador is seeking a Data Engineer in New York to design data architectures and build scalable... ...'ll work across teams to implement data pipelines and ensure data quality at scale. This... ...including health insurance and generous time off policies. Applicants must be within...PipelineWork from home- ...seeking a seasoned Machine Learning and Computer Algorithm Engineer. In this hands-on role, you will develop AI-driven... ...Python, C#, or C++ are essential, alongside experience with real-time computer vision pipelines. This is an exciting opportunity to work directly with...Pipeline
- ...Overview We are seeking a Lead Data Engineer to join a rapidly growing Data... ...and reusable data pipelines supporting critical business... ...scalable solutions. Optimize Spark workloads, ETL processes, and... ...platforms supporting both batch and real-time workloads. Strong expertise...Pipeline
$220k - $230k
...senior, hands‑on data engineer with 8+ years of experience... ...you're ready to lead. You set the... ...— AWS, Databricks/Spark, dbt, and Airflow.... ...and streaming data pipelines, owning them from... ...systems, including time spent in a... ...lakehouse, streaming, real‑time analytics) Hands...PipelineFlexible hours- ...the benefits of data and AI . Since... ...behavior grounded in real‑world actions... ...for leading brands and agencies... ...the ground up. Engineers here own major... ...runway. At the same time, we are scaling... ...data pipelines - push‑based, pull... ...Delta Lake, Scala Spark, Python Spark,...PipelineRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Real-Time Pipelines, Spark & Snowflake. Be the first to apply!
Related searches
- data cabling installation New York, NY
- data recovery New York, NY
- clinical data coordinator New York, NY
- data capturer New York, NY
- sap master data New York, NY
- data loss prevention engineer New York, NY
- data technician New York, NY
- data analysis part time New York, NY
- sap data migration New York, NY
- data operator New York, NY