Senior Data Engineer Scale Real-Time Pipelines & Personalization
$156.28k - $223.25kSpotify.space
We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations of music content and users’ taste, which are key for Spotify teams to create personalized, engaging experiences. This is a unique opportunity to help develop and improve our next-gen user representations, and shape the way Spotify recommendations work. You’ll be able to grow your skills in engineering at scale, drive a ton of business impact, and join a high-energy, positive team environment! Join us and you’ll keep millions of users listening to great recommendations every day. What You'll Do Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Google Cloud Platform and the Apache Beam Develop, deploy, and operate Java services that impact millions of users Work on machine learning projects powering the experience that suits each user individually Collaborate with other engineers, product managers and stakeholders, taking on learning and leadership opportunities that will arise every single day Deliver scalable, testable, maintainable, and high-quality code Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability. Who You Are You have Data Engineering experience and you know how to work with high- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure You know Scala language well, and are interested in spreading this knowledge in the team You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on experience with high-volume services in Java. Python experience is also a plus You might have worked with Docker as well as Luigi, Airflow, or similar tools You care about quality and you know what it means to ship high quality code You care about agile software processes, data-driven development, reliability, and responsible experimentation You understand the value of collaboration and partnership within teams If you have experience with (of interest in) product management, that would be a plus, but it’s not required Where You'll Be We offer you the flexibility to work where you work best! For this role, you can be within the Eastern time zone as long as we have a work location. The United States base range for this position is $156,275.00- 223,250 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future. Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. #J-18808-Ljbffr Spotify.space
$90k - $157.5k
STATE STREET CORPORATION is looking for a Sr. Databricks Data Engineer in Quincy, Massachusetts, to develop and optimize high throughput data pipelines. The role requires extensive experience with Databricks, SQL, and Scala/PySpark, along with cloud-based development expertise...PipelineSenior$99k - $164.8k
...opportunities for personal development and... ...services are making a real difference to our... ...a highly skilled Senior Data Engineer to guide the... ...of scalable data pipelines, ingestion frameworks... ...-batch, and real-time ingestion... ...delivering large‑scale AWS‑based data platforms...PipelineSeniorCasual workWork at officeLocal areaRemote work$100.2k - $150.2k
...our Enterprise Data & Engineering team! We're looking for a Senior Analytics Engineer... ...that drive real impact? In this... ...align upstream pipeline design with downstream... ...enterprise-scale analytics... ...Health & Wellness Time Off to Recharge... ...and protect your personal information in...PipelineSenior$175.5k - $180k
...implementation of scalable data architectures... ...of robust data pipelines, manage secure... ...feature engineering workstreams,... ...problems at speed and scale. You will be... ...the kind of person who thrives in... ...development. The real magic happens... .... Exceptional time management and...PipelineSeniorApprenticeshipWork at officeLocal areaEasy work$180.37k - $212.2k
...not remote‑only. In‑person participation is... ...are held multiple times annually to foster... ...bridges the gap between data engineering, data science, and... ...– ensuring our pipelines, data models, and... ...and reporting at scale. What You'll Be... ...Kinesis) and/or near‑real‑time data...PipelineSeniorWork at officeLocal area$100k - $160k
Job Description Senior Consultant Data Engineer , you will be a key contributor... ...scalable data pipelines and infrastructure... ...implement streaming and real‑time data processing... ...financial records, and personal conduct. Must be... ...enterprise transformation at scale. Comprehensive...PipelineSeniorFor contractorsImmediate startRemote workHome officeFlexible hoursShift work$166k - $220k
Slope is seeking a C++ Software Engineer to join their Deepview team in Boston. The role focuses on developing real-time 3D rendering engines and optimizing data ingestion pipelines, essential for analyzing autonomous systems. The ideal candidate will have over 3 years...PipelineSenior- Tech Mirrors is seeking a highly experienced Senior Data Engineer / Data Architect with deep expertise in Databricks, Snowflake... ...The ideal candidate will implement scalable data pipelines, Lakehouse architectures, and real-time data processing solutions, especially in Life...PipelineSenior
- ...Senior Data Engineer Department: Development - Software Development... ...: Permanent - Full Time Location: Boston, US Reporting... ..., high‑quality data pipelines. Collaborate with... ...challenges that have real business impact Collaborate... ...ETL pipelines at scale Exposure to cloud platforms...PipelineSeniorPermanent employmentFull timeFlexible hours
- ...As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate... ...APIs for seamless access to data pipelines, enabling real‑time insights for applications, machine... ..., develop, and optimize large‑scale ETL/ELT pipelines on Databricks to...PipelineSeniorContract work
$120k - $160k
...Overview Senior Data Engineer at VIA. VIA is making an impact by enabling... ...transparency Engineer data pipelines: Develop, deploy, and maintain... ...ETL/ELT pipelines for both real-time streaming and batch... ...sessions Transit benefits and in-person events to foster team bonding...PipelineSeniorSummer workWork at officeRemote workFlexible hours$90k - $180k
...our clients. The Role Senior Data Engineer Tracing our roots to 1... ...help design, build, and scale data-driven solutions... ...maintaining ETL/ELT pipelines and data workflows using... ..., and paid time off (leave of absence,... ...time). We believe in-person interactions energize...PipelineSeniorRemote workFlexible hours1 day per week- ...Staff Data Platform Engineer (AI / Data Fabric / Iceberg Lakehouse... ...to enable scale and business transformation... ...client is hiring a Senior Engineer to take a hands... ...that process massive pipelines, leverage AI-powered... ...driven patterns for real-time ingestion and data movement...PipelineSeniorWork at office
$106.9k - $176.5k
...world. Technology – Data and Decision Science – Data Engineering – Senior The opportunity In... ...actionable insights. Your time will be spent on... ...end-to-end data pipeline development,... .... Development of a real-time data processing... ...to work together in person 40-60% of the time...PipelineSeniorSummer holidayFlexible hours- This is a senior data engineering role within a capital markets-focused investment environment... ...cloud and on-prem data pipelines Building scalable ingestion, processing... ...Experience with streaming data, real-time processing, or large-scale analytics environments is a plus....PipelineSenior
- ...Senior Data Engineer At Magnite, we cultivate an environment of continuous growth and... ...to build and optimize large-scale batch and streaming data pipelines. The Core Data Engineering team sits... ...including Spark jobs, Java-based real-time event processing, and large-scale...PipelineSeniorHourly payWork experience placementSummer workSeasonal workShift work
$120k - $160k
...exciting opportunity for a Senior Data Engineer to join its Platform Engineering... ...design, automation, and scaling of our cloud-native data... ...cloud technologies, CI/CD pipelines, and Power BI to deliver scalable... ...for batch and near real-time data. Ingest, transform, and...PipelineSeniorTemporary workFlexible hours$100.2k - $150.2k
...our Enterprise Data & Engineering team! We’re looking for a Senior Analytics Engineer... ...that drive real impact? In this... ...align upstream pipeline design with downstream... ...enterprise‑scale analytics... ...Vision Insurance Time Off to Recharge... ...and protect your personal information in...PipelineSenior$124k - $280k
...Specialty/Competency: Data, Analytics & AI... ...Applicable Time Type: Full... ...and analytics engineering focus on... ...implementing data pipelines, data integration... ...business needs. As a Senior Manager you... ...- Lead large-scale projects and innovate... ...pay, vacation, personal and family sick...PipelineSeniorFull timeH1b$99.75k - $159.6k
...ownership and drive real change. Constantly grow... ...a well-versed Data Analytics Engineer with expertise in SQL... ...Develop and maintain data pipelines, models, and dashboards... ...Discretionary paid time off Paid parental... ...environment. We collect personal information from...PipelineSeniorWork experience placementWork at office$95k - $149k
...of IoT. Position Data Services team members... ...data products, engineering data flows, storage... ...sensors, PII (Personally Identifiable Information... ...Transform, Load) pipelines, to data sets used... ...metrics from real time data streams Establish... ...systems at scale Collaborate with...PipelineSeniorTemporary work$155k - $235k
...employees can be real and be bold;... ...intentional in‑person moments that strengthen... ...the Team The Data Platform team... ...for everyone — engineers, analysts, and... ...looking for a Senior AI Data... ...they need to ship pipelines faster without... ...Generous paid time off, including...PipelineSeniorLocal areaHome officeFlexible hours$150k - $215k
...Senior Data Platform Engineer At WHOOP, we are on a mission to unlock human performance... ...platform, lakehouse, and real-time data systems. In this role... ...and product innovation at scale. This role requires a... ...for data architecture, pipeline design, governance, and platform...PipelineSeniorFull timeWork at officeRelocation$135k
...insights that drive real impact. Our... ...together the rigor of data‑driven analysis with... ...We are seeking a Senior Data Engineer with deep expertise... ...of large‑scale structured and unstructured... ...building the pipelines, platforms, and apps... ...applicable), paid time off, and other firm...PipelineSeniorPermanent employmentH1bLocal areaWorldwideHome office$120k - $160k
...Senior Data Platform Engineer Boston, Massachusetts Hybrid Full Time $120k - $160k This company located in... ...industries by investing in real estate, private... ...for how we structure, scale, and weaponize data.... ...building world class data pipelines that are capable of...PipelineSeniorFull timeWorldwide$186.07k - $218.9k
...remote-only. In-person participation... ...held multiple times annually to foster... .... The Data Platform team builds... ...experiences. As an engineer on the team you... ...scalable pipelines, to developing... ...graph db, and real-time event aggregation... ...such as scale-out, caching, key...PipelineSeniorLocal area$150k - $210k
...daily lives. Our data science... ...Currently, we have two Senior MLE roles open... ...Learning Engineer on our Core Algos... ...deliver meaningful, personalized health metrics... ...ML data pipelines, tooling, and validation... ...optimized for scale, latency and... ...systems at scale (real-time streaming and/...PipelineSeniorFull timeWork at officeRelocation$139.1k - $231.9k
...building an AI-first R&D engine where artificial... ...are seeking AI & Data Engineers to focus... ...enjoy translating real-world problems... ...teams to develop data pipelines, analytics, and... ..., with production scaling supported by... ...vacation, holiday and personal days, paid caregiver...PipelineSeniorPermanent employmentWork experience placementH1bLocal areaVisa sponsorshipWork visaRelocation package$132.5k - $338.3k
...and oversight of data system... ...collaboration with senior leadership. Oversee... ...across engineering teams. Develop... ...managing large-scale Data warehouse,... ...Jenkins for CI/CD pipeline automation, and... ...holidays, and paid time off. See more... ...opportunities for persons with...PipelineSeniorWork experience placementLive inWork at officeLocal area- ...experienced candidate to fill the Senior Cloud Data Engineer position within the... ...Data Catalog, Data processing Pipeline optimization, and... ...facilitate decisions. Ensure timely delivery of solutions meeting... ...minorities, veterans, and persons with disabilities are strongly...PipelineSeniorWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Scale Real-Time Pipelines & Personalization. Be the first to apply!
- remote data engineer Boston, MA
- data engineer intern Boston, MA
- entry level big data engineer Boston, MA
- big data devops engineer Boston, MA
- entry level data engineer Boston, MA
- data engineer Boston, MA
- data engineer contract Boston, MA
- software data engineer Boston, MA
- data engineer graduate Boston, MA
- big data cloud engineer Boston, MA

