Senior Data Engineer: Scalable Spark Pipelines & Real-Time
3M Consultancy
A leading consultancy firm in the United States is looking for an experienced Data Engineer to design, build, and maintain scalable data processing pipelines. The ideal candidate will have over 5 years of software development experience with strong proficiency in Python, Java, or Scala, and extensive hands-on experience with Apache Spark. Key responsibilities include optimizing data workflows and supporting data scientists' needs. This is an excellent opportunity for those passionate about large-scale data systems. #J-18808-Ljbffr 3M Consultancy
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Scalable Spark Pipelines & Real-Time in Seattle, WA vacancy
- Nordstrom Data Platform is seeking an engineer to design and develop scalable software applications, data pipelines, and database solutions in a real-time, streaming environment. You will apply scientific principles to deliver data solutions that support Nordstrom business...PipelineSenior
- ...ESPN Product & Technology is hiring a Senior Data Engineer to design, build, and scale data foundations... ...You’ll own data flows from streaming pipelines to vector stores and monitoring... ...with AI Core Engineering for robust, real‑time data delivery. You will mentor engineers...PipelineSenior
- ...seeking a hands-on AI/Data Engineer & Analyst to power aviation... ...will own end-to-end pipelines, train and deploy... ...analytics that inform real decisions in the National... .... You will design scalable infrastructure, operationalize... .../ML models for real-time use, and collaborate...Pipeline
- Nordstrom in Seattle is seeking a capable engineer to design and develop highly scalable software applications, data pipelines, and database solutions for the Product Information... ...teams to publish high-quality product data in near real time. #J-18808-Ljbffr NordstromPipeline
- Coinbase is seeking a Senior Data Engineer, Market Data, on the Institutional Markets team. You will build and operate low-latency market data systems, including feed handlers, normalization pipelines, and distribution layers across Coinbase's trading platform. The role...PipelineSenior
- Nordstrom Inc in Seattle is seeking a passionate data engineer to design and develop scalable data analytical solutions. The successful... ...will build distributed data processing pipelines using modern technologies such as Kafka, Spark, and Kubernetes. This role demands...Pipeline
$124.9k - $228.9k
...Operations group in Engineering at The Trade... ...building reliable, scalable, and well‑governed enterprise data solutions. As a Senior Software... ...for complex data pipelines, models, and integrations... ...batch and near‑real‑time ETL/ELT... ...Snowflake, Databricks, Spark, and cloud...PipelineSeniorFull timeTemporary workWork experience placement$142k - $220.5k
Nordstrom Data Platform is a real-time, event-streaming-centric analytical... ...We are looking for an engineer to help our team design and develop highly scalable software applications, data pipelines, and database... ...solutions using Kafka, Flink, Spark, DynamoDB, and Airflow...PipelineSenior- ...embodied AI meets real robots, real... ...beyond typical data-driven approaches... ...rigorous engineering with learning systems... ...better every time our robots run... ...engineers to build scalable systems for... ...Develop reliable pipelines for... ...Airflow/Dagster, Spark/Ray, Kubernetes...PipelineSeniorLocal area
FieldAI
Seattle, WA1 day ago - Adobe is seeking a senior, hands‑on engineer to own and evolve the cross‑platform GPU rendering platform at the heart of Premiere... ..., Metal, Vulkan, and shader tooling to advance real‑time video processing and rendering pipelines, partnering with internal graphics, product, and...PipelineSenior
- OneEnergy Renewables seeks a GIS Data Engineer to own data systems architecture and pipelines. You will design PostgreSQL/PostGIS databases, implement ETL workflows... ..., systems, and finance teams. You will build scalable data models, integrations, and documentation while...PipelineSenior
$138.9k - $186.2k
...Senior Data Engineer Disney Entertainment and ESPN Product... ...stores, from streaming pipelines and embedding pipelines... ...robust, reliable, real-time data. As a Senior Engineer... ...Develop and optimize scalable storage and retrieval... ...(e.g., Kafka, Flink, Spark, Kinesis). ~...PipelineSeniorThe Walt Disney Studios
Seattle, WA2 days ago- ...We are seeking a Senior Data Engineer with strong expertise in Databricks, Python, ETL, SQL... ...Modeling to design, build, and operate scalable data pipelines and lakehouse data products. The... ..., network supply chain, and real-time control tower initiatives. The ideal...PipelineSenior
BrickRed Systems
Bellevue, WA2 days ago - ...are a team of engineers and technologists... ...Role As a Senior Software Engineer... ..., benchmarking pipelines, and monitoring... ...reliably in real-world environments... ...learning and data engineering teams... ...Build scalable model evaluation... ...relational and time-series databases...PipelineSenior
VTI Aerospace
Seattle, WAa month ago $172.5k - $260.1k
...Senior Data Engineer Salesforce is the #1 AI CRM, where humans... ...scaling data models, pipelines, and metric systems... ...provide consistent and timely access to business... ...translate them into scalable data models and technical... ...such as Snowflake, Spark, Airflow, and Hive...PipelineSeniorSalesforce
Seattle, WA2 days ago$155.4k - $208.4k
...Sr Data Engineer Technology is at the heart of Disney... ...velocity, innovation, and scalability for our businesses.... ...data processing pipelines and backend to ensure... ...reliable delivery of both real-time and batch data.... ...tools/libraries such as Spark, Presto, Hive to query...PipelineSeniorWork experience placementDisney
Seattle, WA1 day ago$182k - $242k
...Senior Data Engineer Livingston, NJ / New York, NY / Sunnyvale, CA / San... .... We design resilient data pipelines, scalable lakehouse systems, and high... ...data processing systems using Spark, Flink, or similar... ...US-based offerings for full-time employees; for roles in other...PipelineSeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Bellevue, WA2 days ago- ...and services Position: Senior Data Engineer Location: Bellevue,... ...identify technical and scalability constraints early,... ...Develop scalable data pipelines using Azure Databricks... ..., and ADF. Optimize Spark workloads including large... ...early and make timely technical decisions....PipelineSeniorTemporary work
- ...embodied AI meets real robots, real... ...beyond typical data-driven approaches... ...rigorous engineering with learning systems... ...better every time our robots run... ...Build and maintain pipelines that transform... .... Develop scalable batch and offline... ...data. Ray/Spark or similar distributed...PipelineSeniorLocal area
FieldAI
Seattle, WA11 days ago - ...energy who want real impact,... ...The Platform Engineering team is architecting... ...beyond standard pipelines to build a high... ...that powers real-time AI enablement and... ...financial data. We aim to push... ...products through scalable vector indexing... ...Kafka, Flink, Spark, Kubernetes, or...PipelineSeniorFull timeWorldwide
Airwallex
Seattle, WA14 days ago - SiriusXM is seeking a Senior Staff Data Engineer to build and maintain backend data products and reporting systems for AdsWizz. You will design scalable data pipelines and APIs powering measurement and revenue analytics across multiple platforms in North America. You will...PipelineSenior
$140k - $150k
Responsibilities Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Apache Airflow, processing... ...maintain data quality dashboards to give engineering and business stakeholders real‑time confidence in platform health. Manage and optimise...PipelineSeniorFull timeLocal area$212k - $265k
...Senior Manager, Data Engineering 1 in 4 people in the US have a treatable... ...(a16z, Accel, Spark Capital, etc.), looking... ...mission. We want your time here to be the most... ...maintain the reliable, scalable data systems that... ...warehouse, ingestion pipelines, transformation...PipelineSeniorWork from homeFlexible hoursHeadway - Design & Development
Seattle, WA4 days ago$138.9k - $186.2k
...organization of engineers, product... ...technologists, data scientists, and... ...innovation, and scalability for our businesses... ...We are hiring a Senior Data Engineer to... ...from streaming pipelines and embedding pipelines... ..., reliable, real‑time data. As a... ...Kafka, Flink, Spark, Kinesis). Experience...PipelineSenior- ...the problem, given real ownership and the tools... ...deliver. We are a data and technology... ...assignment is to build the pipelines that move a federal... ...pipelines on AWS: Spark-based extract,... ...lineage built in. In time, the firm itself:... ...are You are a data engineer who is serious...PipelineTemporary workWork at officeImmediate start
$154.6k - $209.1k
...(SPIA) team is hiring a Senior Data Engineer to architect and evolve... ...Responsibilities Design and operate scalable, cost-effective AWS data pipelines and infrastructure,... ..., NodeJS Hadoop, Hive, Spark, EMR Preferred... ...coverage 401(k) matching Paid time off Parental leave A Day...PipelineSeniorWorldwideFlexible hoursShift work$137.4k - $161.7k
...Monroe is seeking a Senior Data Engineer to join our Data & AI... ...ecosystems, develop scalable data pipelines, and establish... ...data pipelines using Spark, SQL, Python, and modern... ...unlimited flexible time off and ten paid holidays... ...clients, delivering real-world solutions.The...PipelineSeniorLocal areaImmediate startFlexible hours$126.7k - $215k
...ll Make An Impact As a Senior Staff Data Engineer, you will join a highly... ...performance, reliable, and scalable reporting APIs and data pipelines. Lead high-level... ...managing data pipelines using Spark, BigQuery, AWS EMR, and... ...the tasks on time. Strong analytical and...PipelineSeniorTemporary workLocal areaWorldwide$215.2k - $244.7k
...is seeking a Senior Architect to... ...developing Big Data strategy and... ...and processing pipelines for analysis... ...such as Spark on Scala, Storm... ...and implement scalable AI/ML and Generative... ...), prompt engineering, embeddings,... ...flexible time off and ten paid... ..., delivering real-world...PipelineSeniorLocal areaImmediate startFlexible hours- ...paid by ICHS ~ Paid time off accrual up to 200... ...Job Summary The Senior Cloud Data Engineer serves as the technical... ...implementation of scalable, secure, and HIPAAcompliant... ...Azure Data Factory, Spark, or equivalent modern... ...maintaining CI/CD pipelines, source control processes...PipelineSeniorWork at office
International Community Health Services
Seattle, WA22 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Scalable Spark Pipelines & Real-Time. Be the first to apply!
Related searches
- data engineer contract Seattle, WA
- big data cloud engineer Seattle, WA
- staff data engineer Seattle, WA
- big data developer Seattle, WA
- finance data engineer Seattle, WA
- software data engineer Seattle, WA
- data engineer intern Seattle, WA
- data systems engineer Seattle, WA
- hadoop big data developer Seattle, WA
- data engineer machine learning Seattle, WA