Senior Data Engineer Scale Real-Time Pipelines & Personalization
$156.28k - $223.25kSpotify.space
We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations of music content and users’ taste, which are key for Spotify teams to create personalized, engaging experiences. This is a unique opportunity to help develop and improve our next-gen user representations, and shape the way Spotify recommendations work. You’ll be able to grow your skills in engineering at scale, drive a ton of business impact, and join a high-energy, positive team environment! Join us and you’ll keep millions of users listening to great recommendations every day. What You'll Do Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Google Cloud Platform and the Apache Beam Develop, deploy, and operate Java services that impact millions of users Work on machine learning projects powering the experience that suits each user individually Collaborate with other engineers, product managers and stakeholders, taking on learning and leadership opportunities that will arise every single day Deliver scalable, testable, maintainable, and high-quality code Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability. Who You Are You have Data Engineering experience and you know how to work with high- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure You know Scala language well, and are interested in spreading this knowledge in the team You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on experience with high-volume services in Java. Python experience is also a plus You might have worked with Docker as well as Luigi, Airflow, or similar tools You care about quality and you know what it means to ship high quality code You care about agile software processes, data-driven development, reliability, and responsible experimentation You understand the value of collaboration and partnership within teams If you have experience with (of interest in) product management, that would be a plus, but it’s not required Where You'll Be We offer you the flexibility to work where you work best! For this role, you can be within the Eastern time zone as long as we have a work location. The United States base range for this position is $156,275.00- 223,250 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future. Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. #J-18808-Ljbffr Spotify.space
- LineVision, Inc. is seeking a Senior Data Engineer in Boston to own and evolve the data backbone that processes real-time grid data for utilities. You will design pipelines and infrastructure to support scalable, reliable data flows that enable affordable, reliable power...PipelineSenior
- LineVision is seeking a Senior Data Engineer in the Boston area to own and evolve the company's data platform. You will design and lead data pipelines that ingest real-time grid data from diverse sources, enabling utilities to deliver affordable, reliable power. You will...PipelineSenior
- Strategic Employment in Boston, MA is seeking a Senior Data Engineer to modernize data pipelines behind its digital products. You will own end-to-end data... ...on a cross-functional Scrum team, building real-time and batch data flows and mentoring peers. You'll collaborate...PipelineSenior
- ...organizations modernize data ecosystems, build real-time analytics... ...and responsibly scale AI. As part of... ...You AreA hands-on Engineer with... ...clients, supporting senior architects, and... ...design, build data pipelines and models, perform... ...imperative, every person at Accenture has...PipelineSeniorFull timeWork experience placementLive inWork at officeLocal area
- ...are looking for a Senior SIEM Data Engineer reporting... ...security telemetry pipelines, improving log fidelity... ..., or large-scale log onboarding, with... ...to 5:00 PM local time for the employee’... ...technical skills, solve real problems and make... ...identity and personality. Another...PipelineSeniorFull timeTemporary workWork experience placementWork at officeLocal areaFlexible hours
- ...Senior Data EngineerWe are looking for a Senior Data Engineer to help design, build, and scale the data systems that power... ...reliable data pipelines, contribute to... ...enjoys solving real technical problems... ...systems over time. You will... ...processes your personal information during...PipelineSeniorContract workRemote work
$95k - $149k
...of IoT. Position Data Services team members... ...data products, engineering data flows, storage... ...field sensors, PII (Personally Identifiable... ...Transform, Load) pipelines, to data sets used... ...aggregate metrics from real time data streams Establish... ...systems at scale Collaborate with your...PipelineSeniorTemporary work- AMC Health is seeking a Senior Software Engineer to advance real-time voice AI, LLM pipelines, and traditional ML in a regulated healthcare setting. The role emphasizes... ..., telemetry-driven debugging, and end-to-end data workflows across cloud and on-prem environments....PipelineSenior
$100.2k - $150.2k
...our Enterprise Data & Engineering team! We're looking for a Senior Analytics Engineer... ...that drive real impact? In this... ...align upstream pipeline design with downstream... ...enterprise-scale analytics... ...Health & Wellness Time Off to Recharge... ...protect your personal information in...PipelineSenior$166k - $220k
Slope is seeking a C++ Software Engineer to join their Deepview team in Boston. The role focuses on developing real-time 3D rendering engines and optimizing data ingestion pipelines, essential for analyzing autonomous systems. The ideal candidate will have over 3 years...PipelineSenior$150k - $215k
...lives.WHOOP is hiring a Senior Data Engineer to lead the design,... ...of scalable ELT pipelines and data workflows using... ...simplify, automate, and scale our data ecosystem.... ...quality standards as personal contributions.Interested... ...range for this full-time position is $150,000...PipelineSeniorFull time- ...Robotics is seeking a software-driven systems engineer to own the interface between hardware... ...up new hardware, build drivers and data pipelines, and implement the low-level control... ...move and perceive. This role emphasizes real-time behavior, reliable interfaces, and field...PipelineSenior
- As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate... ...APIs for seamless access to data pipelines, enabling real-time insights for applications, machine... ..., develop, and optimize large-scale ETL/ELT pipelines on Databricks to...PipelineSeniorContract work
- Senior Investment Data Engineer, Boston, MA, Hybrid, 2 days in, 150k to... ...excellent professional and personal development... ...operate on a significant scale across a broad array... ...and efficient pipelines to swiftly incorporate... ...document, relational, time-series and file stores...PipelineSeniorPermanent employmentWork experience placementCasual workWork at office
$165k - $185k
Position: Senior Data Engineer Location... ...is seeking a full-time Senior Data Engineer... ...solutionsContinuously enhance data pipelines through automation,... ..., Geode offers the scale of a large asset... ...professionally and personally, offering comprehensive...PipelineSeniorFull timeWork at officeRemote workMonday to Friday- SiriusXM is seeking a Senior Staff Data Engineer to design and operate backend data products and scalable reporting at AdsWizz. You will... ...across AdsWizz and SXM Media services, and build data pipelines that scale for decision-making. You will mentor junior engineers while...PipelineSenior
- ...Senior Machine Learning Engineer, Data & Intelligence Products AcuityMD... ...Data company scaling rapidly. We... ...convert messy, real-world health data... ...research across time-series, geospatial... ...on production pipelines You are fluent... ...: We meet in-person multiple times per...PipelineSeniorRemote jobFull timeFor contractorsWork at officeWork from homeHome officeFlexible hours
$90k - $180k
...About the RoleSenior Data... ...has arisen for a Senior Data Engineer. As a member of the... ...design, build, and scale data-driven solutions... ...maintaining ETL/ELT pipelines and data workflows... ...employees to thrive personally and... ...reimbursement and paid time off (leave of absence...PipelineSeniorFull timeRemote workFlexible hours1 day per week$119.5k - $161.7k
...Monroe is seeking a Senior Data Engineer to join our Data & AI... ...scalable data pipelines, and establish trusted... ...receive unlimited flexible time off and ten paid... ...clients, delivering real-world solutions.... ...we work. We show up personally. We’re right there in...PipelineSeniorFull timeWork at officeLocal areaImmediate startFlexible hours$128k - $249k
...same place.We are seeking a Senior Data Engineer to join the firm. The... ...and Azure AI Foundry data pipelines. Role involves mentoring staff... ...Azure AI Foundry pipelines and real-time, event-driven architecture... ...or affected by virtue of a person’s race (including traits associated...PipelineSeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- Boston, MAHybridFull Time$140k - $165kJob DescriptionA rapidly scaling robotics and automation... ...company is hiring a Senior Data Integration Engineer to help connect,... ...often focus on analytics pipelines, machine learning data... ...services that enable real-time information...PipelineSeniorFull time
$107.87k - $143.78k
...opportunities uncommon in scale and scope,... ...and in their personal lives. Read... ...and maintains data products that make... ...learning engineers, and translational... ...normalization pipelines on Databricks and... ...permitted at this time. · Life... ...R1605529 : Senior Data Engineer —...PipelineSeniorHourly payFull timeTemporary workPart timeFor contractorsWork experience placementSummer workLive inWork at officeLocal areaRemote workFlexible hoursShift work- ...Senior Data EngineerBuild the data backbone enabling utilities... ...seeking a Senior Data Engineer to own and evolve... ...design and lead the data pipelines and infrastructure that process real-time grid data, enabling utilities... ...small to medium-scale projectsOutstanding collaboration...PipelineSeniorFlexible hours
- ...We are looking for a Senior Data Engineer to design and build scalable... ...Python-based ETL/ELT pipelines, orchestrate... ...ETL/ELT processes at scale using Python, incorporating... ...sponsorship at this time; Bachelor’s degree in... ..., TechTalks, and personalized growth roadmaps. Competitive...PipelineSeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
$124k - $280k
..., our people in data and analytics engineering focus on leveraging... ...data pipelines, data integration... ...business needs. As a Senior Manager you lead... ...strategies- Lead large-scale projects and... ...pay, vacation, personal and family sick... ...Pittsburgh; OR-PortlandType: Full timePipelineSeniorFull timeH1b$130k
...Day in the Life The Senior Data Engineer will be responsible for... ...scalable data pipelines and workflows that support... .... As part of a 12-person Data Engineering team... ...supporting enterprise-scale ETL/ELT solutions.... ...building streaming and real-time data processing solutions...PipelineSeniorWorldwide- ...Design and build high-throughput data pipelines for billing and cost... ...standards. Contribute to engineering standards and help develop the... ...production data pipelines at scale using Spark and Airflow.... ...low-latency data serving or real-time aggregation pipelines is preferred...PipelineSeniorFull time
- This is a senior data engineering role within a capital markets-focused investment environment... ...cloud and on‑prem data pipelines Building scalable ingestion, processing... ...Experience with streaming data, real‑time processing, or large‑scale analytics environments is a plus....PipelineSenior
$150k - $215k
...daily lives.We are seeking a Senior Data Platform Engineer to build and evolve the... ...platform, lakehouse, and real-time data systems. In this role... ...and product innovation at scale.This role requires a strong... ...practices for data architecture, pipeline design, governance, and...PipelineSeniorFull timeWork at officeRelocation$117.6k - $161.7k
...caring community The Senior Data Engineer designs, builds, and... ...optimize scalable data pipelines and data-driven... ...Experience optimizing large-scale data pipelines and ETL... ...cultivating a strong, person-first culture, always... ...program ~ Paid Volunteer Time Off If you share...PipelineSeniorBi-weekly payFull timeTemporary workApprenticeshipWork at officeImmediate startRemote workWork from homeHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Scale Real-Time Pipelines & Personalization. Be the first to apply!
- data center engineer Boston, MA
- senior cloud data engineer Boston, MA
- data infrastructure engineer Boston, MA
- sr information security engineer Boston, MA
- data visualization developer Boston, MA
- remote data engineer Boston, MA
- etl data engineer Boston, MA
- data engineer analytics Boston, MA
- sr data engineer Boston, MA
- junior big data engineer Boston, MA



