Senior Data Engineer Scale Real-Time Pipelines & Personalization
$156.28k - $223.25kSpotify.space
We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations of music content and users’ taste, which are key for Spotify teams to create personalized, engaging experiences. This is a unique opportunity to help develop and improve our next-gen user representations, and shape the way Spotify recommendations work. You’ll be able to grow your skills in engineering at scale, drive a ton of business impact, and join a high-energy, positive team environment! Join us and you’ll keep millions of users listening to great recommendations every day. What You'll Do Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Google Cloud Platform and the Apache Beam Develop, deploy, and operate Java services that impact millions of users Work on machine learning projects powering the experience that suits each user individually Collaborate with other engineers, product managers and stakeholders, taking on learning and leadership opportunities that will arise every single day Deliver scalable, testable, maintainable, and high-quality code Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability. Who You Are You have Data Engineering experience and you know how to work with high- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure You know Scala language well, and are interested in spreading this knowledge in the team You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on experience with high-volume services in Java. Python experience is also a plus You might have worked with Docker as well as Luigi, Airflow, or similar tools You care about quality and you know what it means to ship high quality code You care about agile software processes, data-driven development, reliability, and responsible experimentation You understand the value of collaboration and partnership within teams If you have experience with (of interest in) product management, that would be a plus, but it’s not required Where You'll Be We offer you the flexibility to work where you work best! For this role, you can be within the Eastern time zone as long as we have a work location. The United States base range for this position is $156,275.00- 223,250 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future. Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. #J-18808-Ljbffr Spotify.space
- Consigli Construction is seeking a Senior Data Engineer to enhance its Data & Analytics capabilities in Boston, Massachusetts. This role involves... ...and optimizing our analytical data environment, including pipelines and data quality controls, all while working closely with...PipelineSenior
- CeDent is seeking a Senior Data Engineer to enhance their CASM Platform in Boston, MA. The successful candidate will be responsible for integrating... ...diverse cybersecurity data, designing scalable ETL pipelines, and ensuring data quality and governance. An ideal applicant...PipelineSeniorContract work
$100.2k - $150.2k
...our Enterprise Data & Engineering team! We're looking for a Senior Analytics Engineer... ...that drive real impact? In this... ...align upstream pipeline design with downstream... ...enterprise-scale analytics... ...Health & Wellness Time Off to Recharge... ...and protect your personal information in...PipelineSenior$175.5k - $180k
...implementation of scalable data architectures... ...of robust data pipelines, manage secure... ...feature engineering workstreams,... ...problems at speed and scale. You will be... ...the kind of person who thrives in... ...development. The real magic happens... ...) Exceptional time management and...PipelineSeniorApprenticeshipWork at officeLocal areaEasy work$100k - $160k
Job Description Senior Consultant Data Engineer , you will be a key contributor... ...scalable data pipelines and infrastructure... ...implement streaming and real‑time data processing... ...financial records, and personal conduct. Must be... ...enterprise transformation at scale. Comprehensive...PipelineSeniorFor contractorsImmediate startRemote workHome officeFlexible hoursShift work$148k - $222k
...Mar 2 Apply Full-time Unknown Senior Software Engineer, AI & Analytics Data Enablement... ...design resilient pipelines and analytics models... ...AI/ML products at scale. You’ll also help... ...with AI in work or personal projects, and you... ...building near real-time or streaming...PipelineSeniorFull time$166k - $220k
Slope is seeking a C++ Software Engineer to join their Deepview team in Boston. The role focuses on developing real-time 3D rendering engines and optimizing data ingestion pipelines, essential for analyzing autonomous systems. The ideal candidate will have over 3 years...PipelineSenior$350k
...Senior Data Infrastructure Engineer | Boston, MA | $350k cash comp | Python | Apache... ...talent and technology that scales across the firm and its portfolio... ...Drive event‑driven and real‑time data patterns with a... ...datasets, feature‑ready pipelines, and training/inference data...PipelineSenior- ...As a Senior Data Engineer, CASM Platform, you will: ~Data Integration, API Development:... ...data APIs for seamless access to data pipelines, enabling real-time insights for applications, machine... ...Design, develop, and optimize large-scale ETL/ELT pipelines on Databricks to...PipelineSeniorContract work
$101.97k - $222.48k
...health care one person, one family and... ...community at a time. Position... ...eager to make a real impact in the health... ...innovators and data visionaries:... ...ambitious Data Engineers. In this role,... ...terabyte to petabyte scale healthcare data... ...ETL/ELT pipelines using Cloud Dataflow...PipelineSeniorFull timeWork experience placementLocal area- This is a senior data engineering role within a capital markets-focused investment environment... ...cloud and on-prem data pipelines Building scalable ingestion, processing... ...Experience with streaming data, real-time processing, or large-scale analytics environments is a plus....PipelineSenior
- Senior Data Engineer Department: Development - Software Development... ...: Permanent - Full Time Location: Boston, US... ...reliable, high‑quality data pipelines. Collaborate with... ...challenges that have real business impact Collaborate... ...ETL pipelines at scale Exposure to cloud platforms...PipelineSeniorPermanent employmentFull timeFlexible hours
$100k - $120k
Employment Type: Full-Time FSLA: Salary/... ...Systems & Data Reports to: Senior Manager, Enterprise... ...provide reliable,real‑time, and predictive... ...The Senior Data Engineer supports the design... ..., including pipelines, semantic models,... .... Contribute to scaling master data domains...PipelineSeniorFull time$128k - $249k
...Job Summary We are seeking a Senior Data Engineer to join the firm. The... ...and Azure AI Foundry data pipelines. The role involves mentoring... ...Azure AI Foundry pipelines and real‑time, event‑driven architecture... ...or affected by virtue of a person’s race (including traits associated...PipelineSeniorTemporary workLocal areaRemote workRelocationFlexible hoursAfternoon shift- ...We are looking for a Senior Data Engineer to design and build scalable... ...Python-based ETL/ELT pipelines, orchestrate... ...ETL/ELT processes at scale using Python, incorporating... ...sponsorship at this time; Bachelor’s degree... ..., TechTalks, and personalized growth roadmaps. Competitive...PipelineSeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
$90k - $180k
...our clients. The Role Senior Data Engineer Tracing our roots to... ...help design, build, and scale data-driven solutions... ...maintaining ETL/ELT pipelines and data workflows using... ..., and paid time off (leave of absence,... ...time). We believe in-person interactions energize...PipelineSeniorRemote workFlexible hours1 day per week$120k - $160k
...exciting opportunity for a Senior Data Engineer to join its Platform Engineering... ...design, automation, and scaling of our cloud-native data... ...cloud technologies, CI/CD pipelines, and Power BI to deliver scalable... ...for batch and near real-time data. Ingest, transform, and...PipelineSeniorTemporary workFlexible hours$90k - $157.5k
...Looking For We are seeking a Senior Data Engineer with 7+ years of experience... ...in data modeling, pipeline development, and performance... ...supporting both batch and near real‑time data processing needs. This... ..., resource management, and scaling strategies What We Value...PipelineSeniorTemporary workWork at officeRemote work$95k - $149k
...of IoT. Position Data Services team members... ...data products, engineering data flows, storage... ...sensors, PII (Personally Identifiable Information... ...Transform, Load) pipelines, to data sets used... ...metrics from real time data streams Establish... ...systems at scale Collaborate with...PipelineSeniorTemporary work$99.75k - $159.6k
...ownership and drive real change. Constantly grow... ...a well-versed Data Analytics Engineer with expertise in SQL... ...Develop and maintain data pipelines, models, and dashboards... ...Discretionary paid time off Paid parental leave... ...asked for sensitive personal information (bank...PipelineSeniorWork experience placementWork at office$155k - $235k
...employees can be real and be bold;... ...intentional in‑person moments that strengthen... ...the Team The Data Platform team... ...for everyone — engineers, analysts, and... ...looking for a Senior AI Data... ...they need to ship pipelines faster without... ...Generous paid time off, including...PipelineSeniorLocal areaHome officeFlexible hours$227.2k - $340.8k
...Business Partner Senior Director, Data Technology & EngineeringSkip... ...Technology & Engineering page is loaded##... ...:** Lead large-scale change... ...this job at the time of posting. This... ...without regard to a person's race, color, sex... ...robust clinical pipeline of investigational...PipelineSeniorSummer workRemote workFlexible hours2 days per week$120k - $160k
Overview hatch I.T. is partnering with VIA to find a Senior Data Engineer . See details below: About the Role An impressive mission... ...transparency Develop, deploy, and maintain resilient ETL/ELT pipelines for both real-time streaming and batch processing, ensuring seamless data...PipelineSenior$130k - $160k
Senior Data Engineer Stack: JavaScript (Node/Lambdas), Python, SQL... ...aren’t just building pipelines; you are designing the... ...optimize retrieval at scale. You’ll work across cross... .... You are the person who finds the right questions... ...you to divide your time between working in the...PipelineSeniorWork at officeRemote workFlexible hours- Modeling Data Solutions is hiring experienced data analytics engineers for its personal lines auto teams. The role supports the US Data Science... ...maintenance of scalable data pipelines and ETL processes to support... ...ability to deliver on time and communicate progress to varied...PipelineSeniorWork at office
$220k - $292k
...turns thousands of data streams into a... ...ABOUT THE JOB As an engineer on the Robotics Data... ...our ingestion pipelines, storage systems,... ...that supports large-scale batch ingestion of... ...driven engineering in real-time: We own the... .../ ArgoCD). U.S. Person status is required...PipelineSeniorFull timeWork experience placementImmediate start$116.8k - $146k
...new possibilities. What you’ll do as a Senior Data Engineer Build scalable, high-performance data... ...and optimize modern cloud‑based data pipelines and streaming solutions using technologies... ...hands‑on experience developing both real‑time and batch data processing solutions....PipelineSeniorFull timeImmediate start$94.43k
...design and implement real-world solutions for a... ...currently seeking a Senior Associate, Data Engineer for our Consulting practice... ...of large-scale data solutions in Databricks... ...and a robust suite of personal well-being benefits... ...KPMG provides Personal Time Off per fiscal year....SeniorLocal areaVisa sponsorship- ...electric future. As AI data centers drive a... ...with prices in real-time—delivering the same... ...Data / Analytics Engineer to own the data infrastructure... ...maintain our data pipeline infrastructure,... ...trustworthy as we scale. You'll also play... ...value regular in-person collaboration with...PipelineFlexible hours
- ...doers and disruptors, who solve real problems and meet real customer needs. We are seeking Senior Data Engineers who are passionate about... ...ll Do Build and optimize data pipelines for efficient data ingestion,... ...year experience working on real-time data and streaming...PipelineSeniorFull timePart timeInternshipLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Scale Real-Time Pipelines & Personalization. Be the first to apply!
- data engineer analytics Boston, MA
- data engineer manager Boston, MA
- remote data engineer Boston, MA
- junior data engineer remote Boston, MA
- senior cloud data engineer Boston, MA
- data platform engineer Boston, MA
- data infrastructure engineer Boston, MA
- aws data engineer Boston, MA
- director data engineering Boston, MA
- big data developer Boston, MA

