Data Engineer, Large-Scale Spark Pipelines
Apple Inc.
Apple Inc. in New York City, NY, United States, is seeking a Software Engineer for the Apple Ads data engineering team. You will design, build, and operate scalable data pipelines and reporting infrastructure that process large volumes of advertising events. The ideal candidate has hands-on Spark, Kafka, Java/Scala experience and a passion for data quality, privacy, reliability, and performance. You will own systems end-to-end and collaborate across engineering and product teams. #J-18808-Ljbffr Apple Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer, Large-Scale Spark Pipelines in New York, NY vacancy
- Aaru is seeking a Data Integration Specialist to build and maintain the... .... You will work across large internal and third-party datasets... ...linked, queried, and trusted at scale. This role sits at the intersection of data engineering and architecture, critical to producing...Pipeline
- Biohub is seeking a Senior Staff Data Engineer to design data pipelines and infrastructure for AI research, ingesting public and internal data and delivering... ...City offices, you will own data strategy, quality, and scale, ensuring reliability and observability as data volumes...Pipeline
- Tatari Inc. is seeking a Senior Data Engineer to design, build and own large-scale ETL pipelines powering our reporting and measurement products. You will work closely with data science, backend and frontend engineers, translating requirements into production datasets...Pipeline
$100 - $130 per hour
...financial firm is looking for a Data Engineer - Databricks to join their... ...in designing and building large-scale solutions in an enterprise setting... ..., design and develop data pipelines keeping security, scale,... ...is a plus Experience using Spark, Kafka, Hadoop, or similar distributed...PipelineRemote work$170k - $230k
...agentic space. No legacy pipelines, no inherited... ...re energized by shaping data infrastructure from zero... ...service reporting that scales spanning Engineering, Science, PM-T, and Design... ...such as: Hadoop, Hive, Spark, EMR- Experience operating large data warehouses- Do you...PipelineFlexible hours- ..., Business Analytics, Engineering, Mathematics, or related... ...experience in data engineering, software... ...for production-grade pipelines, with strong skills in... ...distributed systems such as (Spark, Dask, Flink) and streaming... ...company Optimize large-scale batch and streaming workflows...PipelineApprenticeshipEasy work
$125k - $145k
...team runs a range of data and AI projects... ...value.•Real-time pipelines that turn raw client... ...that spans data engineering, AI product enablement... ...You'll build and scale the data backbone... ...using Python, Spark, SQL, and modern ETL... ...practices, turning large raw datasets into...PipelineFull timeWork at officeFlexible hoursDay shift$182k - $242k
...innovators to build and scale AI with confidence.... ...at .What You'll Do:The Data Engineering Team builds and operates... ...design resilient data pipelines, scalable lakehouse... ...designing and operating large-scale lakehouse or... ...StarRocks, ClickHouse, Trino, Spark, Flink, or Kafka....PipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$190.8k - $238.8k
...Amsterdam.Making data-driven decisions is... ...that, we need to scale our data systems while... ...to teams across engineering, product, and... ...orchestrate data pipelines and define workflows... ...pipelines on top of large datasets (in the order... ...technologies like Spark, Kafka.You...PipelineFull timeWork experience placementLocal areaFlexible hours$147k - $181k
...forward. About JLL and Data PlatformJLL is a... ...re-building pipelines of their own.What this... ...involvesAs a Senior Data Engineer on the Data... ...delivered at least one large or complex data platform... ...reliability at scale.Cross-Functional Collaboration... ...via Spark UI.Experience designing...PipelineFull timeContract workLocal areaRemote work$116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...platforms, modernize data environments, and... ...that support large-scale transformation. You will... ...integration, and modelling. • Pipeline Ownership: Oversee the... ...architecture, Apache Spark, Delta Lake, cloud-...PipelineLocal areaVisa sponsorship$110k - $190k
Senior Data Management Professional - Data Engineering - Entities Location New York Business... ...scalable, automated pipelines and human-in-the-loop... ...modern data tooling such as Spark, Airflow, Kafka, or... ...experience working with large-scale datasets and complex data...PipelineTemporary workFor contractorsWork experience placement- ...Quinnox is seeking an experienced Data Engineer to design and build scalable data pipelines in New York. You will optimize Spark jobs, develop ETL/ELT processes, and ensure data quality across large-scale datasets. The role emphasizes collaboration with data teams, advanced...Pipeline
Quinnox
New York, NY1 day ago $150k - $350k
...investment firm, where engineers, data scientists, and domain... ...to create scalable pipelines, cloud infrastructure,... ...We deal with data at scale with complexity that requires... ...technologies for large-scale data processing... ...Python Experience with Spark, Scala, or related frameworks...PipelineFull timeAffinity North
New York, NY2 days ago- ...TitleResponsibilitiesBuild reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple... ...fieldExtensive experience in building large scale data pipelines with mainstream... ...with Elasticsearch, Apache Beam, Spark, and GCP Dataflow a big plus....PipelineWork experience placement
1872 Consulting
New York, NY1 day ago - ...Overview We are hiring a Data Engineer to join our Data Technologies team. This... ...-generation data platforms and pipelines that ingest, process, and transform large-scale data into business-ready datasets... ...technologies such as Spark, Databricks, Trino, Iceberg, Snowflake...Pipeline
SIG Susquehanna
New York, NY5 days ago - ...Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design, build, and optimize scalable... ...high-performance data pipelines that enable reliable,... ...expertise in Apache Spark and Python.Experience... ...complex SQL queries for large-scale data analysis.Build and...Pipeline
The Brixton Group, Inc.
New York, NY5 days ago - ...Data Engineer – IntermediateAmpcus Inc. is a certified global provider... ..., and manage scalable ETL pipelines supporting a centralized... ...using PySpark and Apache Spark (Java).Work with large, structured and semi-... ...lake architectures and large-scale data processing.Hands-on experience...Pipeline
Ampcus
New York, NY2 days ago - ...Data EngineerDesign, build, and optimize scalable ELT/ETL pipelines ingesting banking and treasury data... ...efficiency at scale. Enforce data quality... ...while managing large datasets, including... ...and feature engineering built on top of treasury... ..., Apache Spark (PySpark/SQL).Proven...Pipeline
TPI Global
New York, NY4 days ago - ...Data EngineerAs a Data Engineer, you will play a critical role in building and scaling our real-time data infrastructure at the... ...high-throughput data pipelines, analytics systems,... ...technologies such as Spark, Kafka, Airflow, dbt... ..., or similar large-scale data ecosystemsDesigned...PipelineTemporary work
Baton, Inc.
New York, NY1 day ago - ...Analytics is a fast-growing data and analytics... ...specializing in cloud data engineering, AI, business... ...technologies. Our team works on large-scale data engineering... ..., Databricks, Python, Spark, and SQL, along with a... ...to build scalable data pipelines and analytics solutions...Pipeline
Fabric
New York, NY3 days ago - ...Senior Data Engineer (Bristol, CT or New York City, NY – Hybrid) Optomi, in partnership... ...exciting opportunity to build and optimize large-scale data pipelines that power product analytics,... ...data pipelines using Scala, Python, Spark, Kafka, and Airflow! Developing data...Pipeline
Optomi
New York, NY5 days ago - ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our... ...and cloud platforms. Manage large-scale geospatial and temporal datasets... ...with Databricks and Spark for large-scale data processing...PipelineFull timeWork at officeRemote work
Urban SDK
New York, NY5 days ago - ...helped launch Waymo, scaled Segment to a $3.2B... ...for housing, data centers, manufacturing... ...and world‑class engineers to solve physical‑... ...data sources, more pipelines - and the... ...strong track record in large‑scale data lake or... ...query engines (e.g. Spark, BigQuery, Snowflake...PipelineWork at officeFlexible hours
Bedrock Robotics Inc
New York, NY1 day ago - ...hedge fund is seeking a Senior Data Engineer to build and evolve the data... ...support scalable Python ETL pipelines to ingest, process, and... ...AWS and Databricks to manage large-scale structured and unstructured... ...AWS, Snowflake, Databricks, Spark, Kafka or similar is advantageous...Pipeline
Goldman Lloyds
New York, NY5 days ago - ...Senior Data Architect/EngineerTeamBuilder... ...experienced Senior Data Engineer / Data Architect to... ...robust data pipelines, optimizing analytical... ...govern enterprise-scale data architectures.... ...Analyze and improve large-scale datasets and... ...Lake Storage, Apache Spark, Python, CI/CD for...PipelineFull timeRemote work
TeamBuilder
New York, NY5 days ago $170k - $180k
Data Infrastructure Engineer (Hadoop)New York City, NYHybrid Schedule (M/F remote... ...data platforms that support large-scale data processing and... ...IntegrationData Ecosystem & Pipeline Management:Kafka Event Streaming... ...tools including Hive, Spark, and HDFS.We’re looking for...PipelineFull timeWork experience placementWork at officeLocal areaRemote workMonday to Friday$120k - $180k
...newly consolidated Data and Analytics (D&A... ...governance, data engineering, data modeling, data... ...a reusable data pipeline utilizing Big Data... ...process, and analyze large datasets to build... ...frameworks, Spark jobs for performance... ...efficiency in large-scale environments.• Ability...PipelineFull timeTemporary workWork at officeLocal areaRelocation package3 days per week- ...Big Data EngineerWe are seeking a highly skilled Big Data Engineer to design, develop, and maintain... ...of handling large volumes of structured... ...big data pipelines, data lakes, and... ...and maintain large-scale data processing and... ...Technologies: Hadoop, Spark, Hive, HBase,...PipelineRemote work
Ova Technologies
New York, NY1 day ago $153k - $204k
...innovators to build and scale AI with confidence. Trusted... ...the role:As a Senior Data Engineer you will own and evolve the... ..., Apache Airflow, Apache Spark, Apache Superset) and ETL pipelines, while delivering ad-hoc... ..., modeling, and querying large datasets.Proficiency in at...PipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer, Large-Scale Spark Pipelines. Be the first to apply!
Related searches
- bi data engineer New York, NY
- data engineer analytics New York, NY
- principal data engineer New York, NY
- senior cloud data engineer New York, NY
- data center engineer New York, NY
- staff data engineer New York, NY
- director data engineering New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- azure data engineer New York, NY