Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer Scale Real-Time Pipelines & Personalization

$156.28k - $223.25k

Spotify.space

We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations of music content and users’ taste, which are key for Spotify teams to create personalized, engaging experiences. This is a unique opportunity to help develop and improve our next-gen user representations, and shape the way Spotify recommendations work. You’ll be able to grow your skills in engineering at scale, drive a ton of business impact, and join a high-energy, positive team environment! Join us and you’ll keep millions of users listening to great recommendations every day. What You'll Do Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Google Cloud Platform and the Apache Beam Develop, deploy, and operate Java services that impact millions of users Work on machine learning projects powering the experience that suits each user individually Collaborate with other engineers, product managers and stakeholders, taking on learning and leadership opportunities that will arise every single day Deliver scalable, testable, maintainable, and high-quality code Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability. Who You Are You have Data Engineering experience and you know how to work with high- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure You know Scala language well, and are interested in spreading this knowledge in the team You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on experience with high-volume services in Java. Python experience is also a plus You might have worked with Docker as well as Luigi, Airflow, or similar tools You care about quality and you know what it means to ship high quality code You care about agile software processes, data-driven development, reliability, and responsible experimentation You understand the value of collaboration and partnership within teams If you have experience with (of interest in) product management, that would be a plus, but it’s not required Where You'll Be We offer you the flexibility to work where you work best! For this role, you can be within the Eastern time zone as long as we have a work location. The United States base range for this position is $156,275.00- 223,250 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future. Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. #J-18808-Ljbffr Spotify.space

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Scale Real-Time Pipelines & Personalization in Boston, MA vacancy
  • LineVision, Inc. is seeking a Senior Data Engineer in Boston to own and evolve the data backbone that processes real-time grid data for utilities. You will design pipelines and infrastructure to support scalable, reliable data flows that enable affordable, reliable power... 
    Pipeline
    Senior

    LineVision

    Boston, MA
    3 days ago
  • LineVision is seeking a Senior Data Engineer in the Boston area to own and evolve the company's data platform. You will design and lead data pipelines that ingest real-time grid data from diverse sources, enabling utilities to deliver affordable, reliable power. You will... 
    Pipeline
    Senior

    LineVision

    Boston, MA
    3 days ago
  • Strategic Employment in Boston, MA is seeking a Senior Data Engineer to modernize data pipelines behind its digital products. You will own end-to-end data...  ...on a cross-functional Scrum team, building real-time and batch data flows and mentoring peers. You'll collaborate... 
    Pipeline
    Senior

    Strategic Employment

    Boston, MA
    5 days ago
  •  ...organizations modernize data ecosystems, build real-time analytics...  ...and responsibly scale AI. As part of...  ...You AreA hands-on Engineer with...  ...clients, supporting senior architects, and...  ...design, build data pipelines and models, perform...  ...imperative, every person at Accenture has... 
    Pipeline
    Senior
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  •  ...are looking for a Senior SIEM Data Engineer reporting...  ...security telemetry pipelines, improving log fidelity...  ..., or large-scale log onboarding, with...  ...to 5:00 PM local time for the employee’...  ...technical skills, solve real problems and make...  ...identity and personality. Another... 
    Pipeline
    Senior
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Flexible hours

    State Street Bank

    Quincy, MA
    1 day ago
  •  ...Senior Data EngineerWe are looking for a Senior Data Engineer to help design, build, and scale the data systems that power...  ...reliable data pipelines, contribute to...  ...enjoys solving real technical problems...  ...systems over time. You will...  ...processes your personal information during... 
    Pipeline
    Senior
    Contract work
    Remote work

    Foley

    Boston, MA
    4 days ago
  • $95k - $149k

     ...of IoT. Position Data Services team members...  ...data products, engineering data flows, storage...  ...field sensors, PII (Personally Identifiable...  ...Transform, Load) pipelines, to data sets used...  ...aggregate metrics from real time data streams Establish...  ...systems at scale Collaborate with your... 
    Pipeline
    Senior
    Temporary work

    Digi Axess

    Boston, MA
    3 days ago
  • AMC Health is seeking a Senior Software Engineer to advance real-time voice AI, LLM pipelines, and traditional ML in a regulated healthcare setting. The role emphasizes...  ..., telemetry-driven debugging, and end-to-end data workflows across cloud and on-prem environments.... 
    Pipeline
    Senior

    amchealth

    Boston, MA
    2 days ago
  • $100.2k - $150.2k

     ...our Enterprise Data & Engineering team! We're looking for a Senior Analytics Engineer...  ...that drive real impact? In this...  ...align upstream pipeline design with downstream...  ...enterprise-scale analytics...  ...Health & Wellness Time Off to Recharge...  ...protect your personal information in... 
    Pipeline
    Senior

    Hasbro

    Boston, MA
    5 days ago
  • $166k - $220k

    Slope is seeking a C++ Software Engineer to join their Deepview team in Boston. The role focuses on developing real-time 3D rendering engines and optimizing data ingestion pipelines, essential for analyzing autonomous systems. The ideal candidate will have over 3 years... 
    Pipeline
    Senior

    Slope

    Boston, MA
    5 days ago
  • $150k - $215k

     ...lives.WHOOP is hiring a Senior Data Engineer to lead the design,...  ...of scalable ELT pipelines and data workflows using...  ...simplify, automate, and scale our data ecosystem....  ...quality standards as personal contributions.Interested...  ...range for this full-time position is $150,000... 
    Pipeline
    Senior
    Full time

    WHOOP

    Boston, MA
    4 days ago
  •  ...Robotics is seeking a software-driven systems engineer to own the interface between hardware...  ...up new hardware, build drivers and data pipelines, and implement the low-level control...  ...move and perceive. This role emphasizes real-time behavior, reliable interfaces, and field... 
    Pipeline
    Senior

    Walden Robotics

    Cambridge, MA
    5 days ago
  • As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate...  ...APIs for seamless access to data pipelines, enabling real-time insights for applications, machine...  ..., develop, and optimize large-scale ETL/ELT pipelines on Databricks to... 
    Pipeline
    Senior
    Contract work

    Cedent Consulting

    Boston, MA
    3 days ago
  • Senior Investment Data Engineer, Boston, MA, Hybrid, 2 days in, 150k to...  ...excellent professional and personal development...  ...operate on a significant scale across a broad array...  ...and efficient pipelines to swiftly incorporate...  ...document, relational, time-series and file stores... 
    Pipeline
    Senior
    Permanent employment
    Work experience placement
    Casual work
    Work at office

    BlueSkyClarity

    Boston, MA
    3 days ago
  • $165k - $185k

    Position: Senior Data Engineer Location...  ...is seeking a full-time Senior Data Engineer...  ...solutionsContinuously enhance data pipelines through automation,...  ..., Geode offers the scale of a large asset...  ...professionally and personally, offering comprehensive... 
    Pipeline
    Senior
    Full time
    Work at office
    Remote work
    Monday to Friday

    Geode Capital Management

    Boston, MA
    3 days ago
  • SiriusXM is seeking a Senior Staff Data Engineer to design and operate backend data products and scalable reporting at AdsWizz. You will...  ...across AdsWizz and SXM Media services, and build data pipelines that scale for decision-making. You will mentor junior engineers while... 
    Pipeline
    Senior

    Sirius XM Radio Inc

    Boston, MA
    4 days ago
  •  ...Senior Machine Learning Engineer, Data & Intelligence Products AcuityMD...  ...Data company scaling rapidly. We...  ...convert messy, real-world health data...  ...research across time-series, geospatial...  ...on production pipelines You are fluent...  ...: We meet in-person multiple times per... 
    Pipeline
    Senior
    Remote job
    Full time
    For contractors
    Work at office
    Work from home
    Home office
    Flexible hours

    Acuitymd

    Boston, MA
    1 day ago
  • $90k - $180k

     ...About the RoleSenior Data...  ...has arisen for a Senior Data Engineer. As a member of the...  ...design, build, and scale data-driven solutions...  ...maintaining ETL/ELT pipelines and data workflows...  ...employees to thrive personally and...  ...reimbursement and paid time off (leave of absence... 
    Pipeline
    Senior
    Full time
    Remote work
    Flexible hours
    1 day per week

    Wellington Management

    Boston, MA
    3 days ago
  • $119.5k - $161.7k

     ...Monroe is seeking a Senior Data Engineer to join our Data & AI...  ...scalable data pipelines, and establish trusted...  ...receive unlimited flexible time off and ten paid...  ...clients, delivering real-world solutions....  ...we work. We show up personally. We’re right there in... 
    Pipeline
    Senior
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    West Monroe

    Boston, MA
    3 days ago
  • $128k - $249k

     ...same place.We are seeking a Senior Data Engineer to join the firm. The...  ...and Azure AI Foundry data pipelines. Role involves mentoring staff...  ...Azure AI Foundry pipelines and real-time, event-driven architecture...  ...or affected by virtue of a person’s race (including traits associated... 
    Pipeline
    Senior
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours
    Afternoon shift

    K&L Gates

    Boston, MA
    5 days ago
  • Boston, MAHybridFull Time$140k - $165kJob DescriptionA rapidly scaling robotics and automation...  ...company is hiring a Senior Data Integration Engineer to help connect,...  ...often focus on analytics pipelines, machine learning data...  ...services that enable real-time information... 
    Pipeline
    Senior
    Full time

    Motion Recruitment

    Boston, MA
    4 days ago
  • $107.87k - $143.78k

     ...opportunities uncommon in scale and scope,...  ...and in their personal lives. Read...  ...and maintains data products that make...  ...learning engineers, and translational...  ...normalization pipelines on Databricks and...  ...permitted at this time. · Life...  ...R1605529 : Senior Data Engineer —... 
    Pipeline
    Senior
    Hourly pay
    Full time
    Temporary work
    Part time
    For contractors
    Work experience placement
    Summer work
    Live in
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Bristol Myers Squibb

    Cambridge, MA
    2 days ago
  •  ...Senior Data EngineerBuild the data backbone enabling utilities...  ...seeking a Senior Data Engineer to own and evolve...  ...design and lead the data pipelines and infrastructure that process real-time grid data, enabling utilities...  ...small to medium-scale projectsOutstanding collaboration... 
    Pipeline
    Senior
    Flexible hours

    LineVision

    Boston, MA
    1 day ago
  •  ...We are looking for a Senior Data Engineer to design and build scalable...  ...Python-based ETL/ELT pipelines, orchestrate...  ...ETL/ELT processes at scale using Python, incorporating...  ...sponsorship at this time; Bachelor’s degree in...  ..., TechTalks, and personalized growth roadmaps. Competitive... 
    Pipeline
    Senior
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    AgileEngine

    Boston, MA
    2 days ago
  • $124k - $280k

     ..., our people in data and analytics engineering focus on leveraging...  ...data pipelines, data integration...  ...business needs. As a Senior Manager you lead...  ...strategies- Lead large-scale projects and...  ...pay, vacation, personal and family sick...  ...Pittsburgh; OR-PortlandType: Full time
    Pipeline
    Senior
    Full time
    H1b

    PwC

    Boston, MA
    3 days ago
  • $130k

     ...Day in the Life The Senior Data Engineer will be responsible for...  ...scalable data pipelines and workflows that support...  .... As part of a 12-person Data Engineering team...  ...supporting enterprise-scale ETL/ELT solutions....  ...building streaming and real-time data processing solutions... 
    Pipeline
    Senior
    Worldwide

    The Hertz Corporation

    Boston, MA
    2 days ago
  •  ...Design and build high-throughput data pipelines for billing and cost...  ...standards. Contribute to engineering standards and help develop the...  ...production data pipelines at scale using Spark and Airflow....  ...low-latency data serving or real-time aggregation pipelines is preferred... 
    Pipeline
    Senior
    Full time

    Datadog

    Boston, MA
    6 days ago
  • This is a senior data engineering role within a capital markets-focused investment environment...  ...cloud and on‑prem data pipelines Building scalable ingestion, processing...  ...Experience with streaming data, real‑time processing, or large‑scale analytics environments is a plus.... 
    Pipeline
    Senior

    Fynetra

    Boston, MA
    4 days ago
  • $150k - $215k

     ...daily lives.We are seeking a Senior Data Platform Engineer to build and evolve the...  ...platform, lakehouse, and real-time data systems. In this role...  ...and product innovation at scale.This role requires a strong...  ...practices for data architecture, pipeline design, governance, and... 
    Pipeline
    Senior
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    1 day ago
  • $117.6k - $161.7k

     ...caring community The Senior Data Engineer designs, builds, and...  ...optimize scalable data pipelines and data-driven...  ...Experience optimizing large-scale data pipelines and ETL...  ...cultivating a strong, person-first culture, always...  ...program ~ Paid Volunteer Time Off If you share... 
    Pipeline
    Senior
    Bi-weekly pay
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Immediate start
    Remote work
    Work from home
    Home office

    Humana

    Boston, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer Scale Real-Time Pipelines & Personalization. Be the first to apply!