Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer Scale Real-Time Pipelines & Personalization

$156.28k - $223.25k

Spotify.space

We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations of music content and users’ taste, which are key for Spotify teams to create personalized, engaging experiences. This is a unique opportunity to help develop and improve our next-gen user representations, and shape the way Spotify recommendations work. You’ll be able to grow your skills in engineering at scale, drive a ton of business impact, and join a high-energy, positive team environment! Join us and you’ll keep millions of users listening to great recommendations every day. What You'll Do Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Google Cloud Platform and the Apache Beam Develop, deploy, and operate Java services that impact millions of users Work on machine learning projects powering the experience that suits each user individually Collaborate with other engineers, product managers and stakeholders, taking on learning and leadership opportunities that will arise every single day Deliver scalable, testable, maintainable, and high-quality code Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability. Who You Are You have Data Engineering experience and you know how to work with high- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure You know Scala language well, and are interested in spreading this knowledge in the team You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on experience with high-volume services in Java. Python experience is also a plus You might have worked with Docker as well as Luigi, Airflow, or similar tools You care about quality and you know what it means to ship high quality code You care about agile software processes, data-driven development, reliability, and responsible experimentation You understand the value of collaboration and partnership within teams If you have experience with (of interest in) product management, that would be a plus, but it’s not required Where You'll Be We offer you the flexibility to work where you work best! For this role, you can be within the Eastern time zone as long as we have a work location. The United States base range for this position is $156,275.00- 223,250 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future. Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. #J-18808-Ljbffr Spotify.space

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Scale Real-Time Pipelines & Personalization in Boston, MA vacancy
  • $90k - $157.5k

    STATE STREET CORPORATION is looking for a Sr. Databricks Data Engineer in Quincy, Massachusetts, to develop and optimize high throughput data pipelines. The role requires extensive experience with Databricks, SQL, and Scala/PySpark, along with cloud-based development expertise... 
    Pipeline
    Senior

    STATE STREET CORPORATION

    Quincy, MA
    1 day ago
  • $99k - $164.8k

     ...opportunities for personal development and...  ...services are making a real difference to our...  ...a highly skilled Senior Data Engineer to guide the...  ...of scalable data pipelines, ingestion frameworks...  ...-batch, and real-time ingestion...  ...delivering large‑scale AWS‑based data platforms... 
    Pipeline
    Senior
    Casual work
    Work at office
    Local area
    Remote work

    Kemper

    Boston, MA
    1 day ago
  • $100.2k - $150.2k

     ...our Enterprise Data & Engineering team! We're looking for a Senior Analytics Engineer...  ...that drive real impact? In this...  ...align upstream pipeline design with downstream...  ...enterprise-scale analytics...  ...Health & Wellness Time Off to Recharge...  ...and protect your personal information in... 
    Pipeline
    Senior

    Hasbro

    Boston, MA
    5 days ago
  • $175.5k - $180k

     ...implementation of scalable data architectures...  ...of robust data pipelines, manage secure...  ...feature engineering workstreams,...  ...problems at speed and scale. You will be...  ...the kind of person who thrives in...  ...development. The real magic happens...  .... Exceptional time management and... 
    Pipeline
    Senior
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    Boston, MA
    3 days ago
  • $180.37k - $212.2k

     ...not remote‑only. In‑person participation is...  ...are held multiple times annually to foster...  ...bridges the gap between data engineering, data science, and...  ...– ensuring our pipelines, data models, and...  ...and reporting at scale. What You'll Be...  ...Kinesis) and/or near‑real‑time data... 
    Pipeline
    Senior
    Work at office
    Local area

    Coinbase

    Boston, MA
    4 days ago
  • $100k - $160k

    Job Description Senior Consultant Data Engineer , you will be a key contributor...  ...scalable data pipelines and infrastructure...  ...implement streaming and real‑time data processing...  ...financial records, and personal conduct. Must be...  ...enterprise transformation at scale. Comprehensive... 
    Pipeline
    Senior
    For contractors
    Immediate start
    Remote work
    Home office
    Flexible hours
    Shift work

    Kearney

    Boston, MA
    5 days ago
  • $166k - $220k

    Slope is seeking a C++ Software Engineer to join their Deepview team in Boston. The role focuses on developing real-time 3D rendering engines and optimizing data ingestion pipelines, essential for analyzing autonomous systems. The ideal candidate will have over 3 years... 
    Pipeline
    Senior

    Slope

    Boston, MA
    1 day ago
  • Tech Mirrors is seeking a highly experienced Senior Data Engineer / Data Architect with deep expertise in Databricks, Snowflake...  ...The ideal candidate will implement scalable data pipelines, Lakehouse architectures, and real-time data processing solutions, especially in Life... 
    Pipeline
    Senior

    Tech Mirrors

    Boston, MA
    2 days ago
  •  ...Senior Data Engineer Department: Development - Software Development...  ...: Permanent - Full Time Location: Boston, US Reporting...  ..., high‑quality data pipelines. Collaborate with...  ...challenges that have real business impact Collaborate...  ...ETL pipelines at scale Exposure to cloud platforms... 
    Pipeline
    Senior
    Permanent employment
    Full time
    Flexible hours

    Confluence Technologies

    Boston, MA
    1 day ago
  •  ...As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate...  ...APIs for seamless access to data pipelines, enabling real‑time insights for applications, machine...  ..., develop, and optimize large‑scale ETL/ELT pipelines on Databricks to... 
    Pipeline
    Senior
    Contract work

    Cedent

    Boston, MA
    5 days ago
  • $120k - $160k

     ...Overview Senior Data Engineer at VIA. VIA is making an impact by enabling...  ...transparency Engineer data pipelines: Develop, deploy, and maintain...  ...ETL/ELT pipelines for both real-time streaming and batch...  ...sessions Transit benefits and in-person events to foster team bonding... 
    Pipeline
    Senior
    Summer work
    Work at office
    Remote work
    Flexible hours

    Solve With Via

    Somerville, MA
    5 days ago
  • $90k - $180k

     ...our clients. The Role Senior Data Engineer Tracing our roots to 1...  ...help design, build, and scale data-driven solutions...  ...maintaining ETL/ELT pipelines and data workflows using...  ..., and paid time off (leave of absence,...  ...time). We believe in-person interactions energize... 
    Pipeline
    Senior
    Remote work
    Flexible hours
    1 day per week

    CFA Institute

    Boston, MA
    5 days ago
  •  ...Staff Data Platform Engineer (AI / Data Fabric / Iceberg Lakehouse...  ...to enable scale and business transformation...  ...client is hiring a Senior Engineer to take a hands...  ...that process massive pipelines, leverage AI-powered...  ...driven patterns for real-time ingestion and data movement... 
    Pipeline
    Senior
    Work at office

    NxT Level

    Boston, MA
    1 day ago
  • $106.9k - $176.5k

     ...world. Technology – Data and Decision Science – Data Engineering – Senior The opportunity In...  ...actionable insights. Your time will be spent on...  ...end-to-end data pipeline development,...  .... Development of a real-time data processing...  ...to work together in person 40-60% of the time... 
    Pipeline
    Senior
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Boston, MA
    3 days ago
  • This is a senior data engineering role within a capital markets-focused investment environment...  ...cloud and on-prem data pipelines Building scalable ingestion, processing...  ...Experience with streaming data, real-time processing, or large-scale analytics environments is a plus.... 
    Pipeline
    Senior

    Fynetra

    Boston, MA
    a month ago
  •  ...Senior Data Engineer At Magnite, we cultivate an environment of continuous growth and...  ...to build and optimize large-scale batch and streaming data pipelines. The Core Data Engineering team sits...  ...including Spark jobs, Java-based real-time event processing, and large-scale... 
    Pipeline
    Senior
    Hourly pay
    Work experience placement
    Summer work
    Seasonal work
    Shift work

    Magnite

    Boston, MA
    3 days ago
  • $120k - $160k

     ...exciting opportunity for a Senior Data Engineer to join its Platform Engineering...  ...design, automation, and scaling of our cloud-native data...  ...cloud technologies, CI/CD pipelines, and Power BI to deliver scalable...  ...for batch and near real-time data. Ingest, transform, and... 
    Pipeline
    Senior
    Temporary work
    Flexible hours

    BERKSHIRE HATHAWAY SPEC INS

    Boston, MA
    1 day ago
  • $100.2k - $150.2k

     ...our Enterprise Data & Engineering team! We’re looking for a Senior Analytics Engineer...  ...that drive real impact? In this...  ...align upstream pipeline design with downstream...  ...enterprise‑scale analytics...  ...Vision Insurance Time Off to Recharge...  ...and protect your personal information in... 
    Pipeline
    Senior

    Hasbro

    Boston, MA
    2 days ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI...  ...Applicable Time Type: Full...  ...and analytics engineering focus on...  ...implementing data pipelines, data integration...  ...business needs. As a Senior Manager you...  ...- Lead large-scale projects and innovate...  ...pay, vacation, personal and family sick... 
    Pipeline
    Senior
    Full time
    H1b

    PwC

    Boston, MA
    2 days ago
  • $99.75k - $159.6k

     ...ownership and drive real change. Constantly grow...  ...a well-versed Data Analytics Engineer with expertise in SQL...  ...Develop and maintain data pipelines, models, and dashboards...  ...Discretionary paid time off Paid parental...  ...environment. We collect personal information from... 
    Pipeline
    Senior
    Work experience placement
    Work at office

    Axon

    Boston, MA
    3 days ago
  • $95k - $149k

     ...of IoT. Position Data Services team members...  ...data products, engineering data flows, storage...  ...sensors, PII (Personally Identifiable Information...  ...Transform, Load) pipelines, to data sets used...  ...metrics from real time data streams Establish...  ...systems at scale Collaborate with... 
    Pipeline
    Senior
    Temporary work

    Digi Axess

    Boston, MA
    2 days ago
  • $155k - $235k

     ...employees can be real and be bold;...  ...intentional in‑person moments that strengthen...  ...the Team The Data Platform team...  ...for everyone — engineers, analysts, and...  ...looking for a Senior AI Data...  ...they need to ship pipelines faster without...  ...Generous paid time off, including... 
    Pipeline
    Senior
    Local area
    Home office
    Flexible hours

    Scribd

    Boston, MA
    5 days ago
  • $150k - $215k

     ...Senior Data Platform Engineer At WHOOP, we are on a mission to unlock human performance...  ...platform, lakehouse, and real-time data systems. In this role...  ...and product innovation at scale. This role requires a...  ...for data architecture, pipeline design, governance, and platform... 
    Pipeline
    Senior
    Full time
    Work at office
    Relocation

    WHOOP

    Boston, MA
    2 days ago
  • $135k

     ...insights that drive real impact. Our...  ...together the rigor of data‑driven analysis with...  ...We are seeking a Senior Data Engineer with deep expertise...  ...of large‑scale structured and unstructured...  ...building the pipelines, platforms, and apps...  ...applicable), paid time off, and other firm... 
    Pipeline
    Senior
    Permanent employment
    H1b
    Local area
    Worldwide
    Home office

    LEK

    Boston, MA
    3 days ago
  • $120k - $160k

     ...Senior Data Platform Engineer Boston, Massachusetts Hybrid Full Time $120k - $160k This company located in...  ...industries by investing in real estate, private...  ...for how we structure, scale, and weaponize data....  ...building world class data pipelines that are capable of... 
    Pipeline
    Senior
    Full time
    Worldwide

    Motion Recruitment

    Boston, MA
    2 days ago
  • $186.07k - $218.9k

     ...remote-only. In-person participation...  ...held multiple times annually to foster...  .... The Data Platform team builds...  ...experiences. As an engineer on the team you...  ...scalable pipelines, to developing...  ...graph db, and real-time event aggregation...  ...such as scale-out, caching, key... 
    Pipeline
    Senior
    Local area

    Coinbase

    Boston, MA
    4 days ago
  • $150k - $210k

     ...daily lives. Our data science...  ...Currently, we have two Senior MLE roles open...  ...Learning Engineer on our Core Algos...  ...deliver meaningful, personalized health metrics...  ...ML data pipelines, tooling, and validation...  ...optimized for scale, latency and...  ...systems at scale (real-time streaming and/... 
    Pipeline
    Senior
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    3 days ago
  • $139.1k - $231.9k

     ...building an AI-first R&D engine where artificial...  ...are seeking AI & Data Engineers to focus...  ...enjoy translating real-world problems...  ...teams to develop data pipelines, analytics, and...  ..., with production scaling supported by...  ...vacation, holiday and personal days, paid caregiver... 
    Pipeline
    Senior
    Permanent employment
    Work experience placement
    H1b
    Local area
    Visa sponsorship
    Work visa
    Relocation package

    Pfizer Belgium

    Cambridge, MA
    1 day ago
  • $132.5k - $338.3k

     ...and oversight of data system...  ...collaboration with senior leadership. Oversee...  ...across engineering teams. Develop...  ...managing large-scale Data warehouse,...  ...Jenkins for CI/CD pipeline automation, and...  ...holidays, and paid time off. See more...  ...opportunities for persons with... 
    Pipeline
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  •  ...experienced candidate to fill the Senior Cloud Data Engineer position within the...  ...Data Catalog, Data processing Pipeline optimization, and...  ...facilitate decisions. Ensure timely delivery of solutions meeting...  ...minorities, veterans, and persons with disabilities are strongly... 
    Pipeline
    Senior
    Work at office

    Commonwealth of Massachusetts

    Quincy, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer Scale Real-Time Pipelines & Personalization. Be the first to apply!