Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Infrastructure Engineer: Scale, Reliability & Tooling

Roberts Recruiting, LLC

TheData Infrastructure team is responsible for the various datastores we use, including MySQL, HBase, ElasticSearch, and Kafka. We aim to provide four nines (or better) of reliability for all of these, as well as to help our developers use them easily and safely. We spend a lot of time building automation, tooling, and monitoring to equip developers to understand and optimize their datastore usage and minimize the impact of any operational issues on customers and developers alike. We’re also operationally responsible for a huge volume of traffic to and from these datastores. Our HBase clusters serve over 3 million requests/second across 220+ tables, while our ElasticSearch clusters serve over 20k searches/second and 50k indexes/second to 90+ billion documents. Streaming that data to and from applications amounts to more than 3 GB/sec of data through our Kafka clusters, with hundreds of producers and consumers. Experienced with some or most of our datastores (MySQL, HBase, ElasticSearch, Kafka) as a user and/or operationally Excited to build great tools for developers so they can work faster and more reliably Interested in working with and supporting infrastructure at scale Eager to learn and grow Get in touch! We’d love to talk to you about our data infrastructure team. #J-18808-Ljbffr Roberts Recruiting, LLC

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Infrastructure Engineer: Scale, Reliability & Tooling in Cambridge, MA vacancy
  • $108k - $209k

     ...highly skilled, hands-on Senior / Principal Data Infrastructure Engineer to design, build, and own...  ...develops machine learning tools trained on proteomics...  ...analysis of that data at scale.This is a senior individual...  ...output into ML-ready datasets reliably and reproducibly.Cloud... 
    Senior

    Seres Therapeutics

    Somerville, MA
    3 days ago
  • $125k - $205k

     ...of proprietary data—including billions...  ...positionAs a Senior Data Platform Engineer at Later, you'll...  ...and evolve the infrastructure, backend services...  ...original design.Build reliable batch and real-...  ...(GCP-native tools plus our custom...  ...data systems at scale and improving their... 
    Senior
    Permanent employment
    Live in
    Local area
    Remote work

    Later

    Boston, MA
    4 days ago
  • $110k - $130k

     ...motivated and experienced Senior Data Engineer to join our IT Data Engineering...  ...the data systems and infrastructure that deliver diagnostic results...  ...data deliveryHelp improve reliability, automation, and observability...  ...testing frameworks using tools such as JenkinsKnowledge of... 
    Senior
    Work at office
    Local area
    Worldwide

    IDEXX Laboratories

    Boston, MA
    2 days ago
  • $216k - $324k

     ...own their own destiny.Senior Lead Software Engineer - Data PlatformTeam...  ...that keeps the platform reliable, observable, and usable at scale. The role requires strong...  ...developer-facing data infrastructure, while maintaining strong...  ...-based data platform tooling, modeled data systems... 
    Senior
    Shift work

    Klaviyo

    Boston, MA
    2 days ago
  •  ...Senior Data Engineer - GenAI & Cloud Data Platforms: Senior Data Engineer...  .../ELT pipelines for large-scale data movement and...  ...Experience with data orchestration tools such as Apache Airflow, AWS...  ...Strong understanding of Infrastructure as Code (IaC) using Terraform... 
    Senior
    Full time

    Purple Drive

    Boston, MA
    7 days ago
  • $191k - $253k

     ...turns thousands of data streams into a realtime...  ...3rd-party analysis tools. Our vehicle...  ....ABOUT THE JOBAs an engineer on the Robotics Data...  ...analysis tools, and build infrastructure that supports large-scale batch ingestion of recorded...  ...streaming.Build reliable and performant cloud... 
    Senior
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Boston, MA
    14 hours ago
  • $100k - $140k

     ...MissionBoston Dynamics is scaling the Atlas...  ..., the Controls Reliability Team serves as a...  ...failure analysis data pipelines.What You...  ...Analysis.Software & Tooling Development:...  ...procedures for diverse engineering and operational...  ..., Google Test infrastructure, Google Cloud Platform... 
    Senior
    Full time
    Work at office

    Boston Dynamics

    Waltham, MA
    4 days ago
  • $146.25k - $225k

     ...recruiting for a skilled Senior/Staff Site Reliability Engineer focused on...  ...build and operate our data center to support our...  ...existing cloud infrastructure to create a seamless...  ...proficient with automation tools; you eliminate toil...  ..., infrastructure scaling, and navigating... 
    Senior
    Local area
    Remote work
    Relocation package

    PathAI

    Boston, MA
    4 days ago
  • $195.3k - $199.2k

     ...and maintain scalable data pipelines and systems...  ...cost-efficiency, and reliability. You will utilize advanced...  ...and executing data engineering projects from inception...  ...analytics, and cloud-based tools to provide more than 2...  ...and cost in large-scale data... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Boston, MA
    3 days ago
  • $152.5k - $205k

     ...programmable blockchain infrastructure. Circle’s platform...  ...trusted, internet-scale financial...  ...reputation rests on data that is right. As a Senior Data Engineer at Circle, you'll...  ...think about data reliability, so that the most...  ...and transformation tooling, and AI.Review code... 
    Senior
    Local area
    Immediate start
    Flexible hours

    Circle

    Boston, MA
    2 days ago
  • $135k - $141.75k

     ...Role:We are seeking a Senior Data Engineer with deep expertise in...  ...intersection of large-scale structured and unstructured data, infrastructure and AI while building...  ...scalability, performance, and reliability Design and deliver...  ...and client-facing tools Build and maintain cloud... 
    Senior
    Permanent employment
    H1b
    Local area
    Worldwide
    Home office

    L.E.K. Consulting

    Boston, MA
    14 hours ago
  • $188k - $282k

     ...individual with a passion for data and AI technology who can...  ...drive forward enterprise-scale AI adoption of our data & AI...  ...AI adoption at scale. As a Senior Principal AI Engineer in the Data Platforms team,...  ...solutions as templated, internal tooling, and opinionated defaults... 
    Senior
    Full time
    Summer work

    Vertex Pharmaceuticals

    Boston, MA
    2 days ago
  • $149k - $198.5k

    Mission Summary:The Data Platform team is the vital...  ...data and the engineering teams that rely on it....  ...the core services and infrastructure necessary to transform...  ...demands of our rapidly scaling fleet and sophisticated...  ...autonomous vehicles a safe, reliable, and accessible... 
    Senior
    Work at office
    Remote work

    Motional

    Boston, MA
    3 days ago
  • $250k

    Senior AI Data Engineer A high-growth organization is seeking a Senior AI...  ...Engineer to help build and scale the AI infrastructure that powers next-...  ...quality, and application reliability.Collaborate closely with...  ...agentic AI architectures, tool-calling frameworks, and multi... 
    Senior

    Huxley Associates

    Boston, MA
    3 days ago
  • $171.2k - $228.2k

     ...quarter Enterprise Data Platform program to...  ...We’re looking for a Senior Manager, Data Platform Engineering to lead the team...  ...deprecation of legacy infrastructure. You’ll stay close...  ...capability against reliability, cost, and technical...  ...Built ingestion at scale (batch, replication... 
    Senior
    Work at office

    SimpliSafe

    Boston, MA
    4 days ago
  • $149k - $198.5k

     ...Motional's Platform Infrastructure organization...  ...maintenance, high-speed data logging and...  ...Onboard Vehicle Network Engineer to lead the design...  ...software and tooling for network routing...  ...systems and large-scale software codebases...  ...vehicles a safe, reliable, and accessible reality... 
    Senior
    Work at office

    Motional

    Boston, MA
    27 days ago
  • $90k - $157.5k

    Job DescriptionAbout the jobState Street Investment Management Data, Analytics & AI Services (DAAIS) is seeking an experienced AVP, to...  ...to document and manage stakeholder and regulatory demand.Use tools like JIRA to manage intake, prioritization, and delivery of enhancement... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours

    State Street Bank

    Boston, MA
    3 days ago
  • $150.4k

     ...a world-class AI Engineering team to transform...  ...intelligence. Join us as a Senior AI Engineer. As a...  ...on a global scale. Together, we'll...  ...solutions with data, infrastructure, systems, and...  ...ensure accuracy, reliability, and functional performance...  ...frameworks, and tools to improve... 
    Senior
    For contractors
    Work experience placement
    Work at office
    Worldwide

    Boston University

    Boston, MA
    5 hours ago
  • $120k

     ...community. Join us as a Senior Data Engineer, where you will design and scale modern data pipelines...  ...decision-making through reliable, high-quality data solutions...  ...and analytics.Manage infrastructure deployments,...  ...application integration tools such as SnapLogic, Informatica... 
    Senior
    For contractors
    Work at office

    Boston University

    Boston, MA
    2 days ago
  • $126k - $204.5k

     ...Job SummaryJob SummaryWe're looking for an Infrastructure Engineer to build developer tooling that enables developer velocity and reliability for the entire engineering organization....  ...& Build: Design and maintain high-scale developer tooling and backend services that... 
    Senior
    Full time
    Local area
    Remote work

    Palo Alto Networks

    Boston, MA
    3 days ago
  • $149k - $198.5k

     ...We are seeking a Senior Engineer to join our ML Data Services team and help...  ...and improve data infrastructure for Autonomy ML teams...  ..., APIs, and tooling to support Autonomy...  ...processing in a large-scale environment Expertise...  ...vehicles a safe, reliable, and accessible reality... 
    Senior

    Motional

    Boston, MA
    13 days ago
  •  ...Job Description Senior Platform/Infrastructure Engineer Location: Fully...  ...responsible for designing, scaling, and maintaining...  ...ship quickly and reliably. Key...  ...Build internal tooling and abstractions for...  ...Workflows + ArgoCD Data: Cloud SQL, ClickHouse... 
    Senior
    Remote work

    ICONSTAFF

    Cambridge, MA
    3 days ago
  • $130k - $160k

    Requisition ID: 3Senior Data Engineer Stack: JavaScript...  ...re looking for a Senior Data Engineer to...  ...of our AI infrastructure. In this role, you...  ...optimize retrieval at scale. You’ll work...  ...with precision and reliability.AI-Driven...  ...You leverage these tools to refactor data... 
    Senior
    Work at office
    Remote work
    Flexible hours

    C-4 Analytics

    Wakefield, MA
    2 days ago
  • $148k - $222k

     ...in productivity tools for human users...  ...’ve built the infrastructure and application...  ...-on conversion data. We are building...  ....As a Senior Machine Learning Platform Engineer, you will help...  ...feature data, and scaling systems that must operate reliably at Klaviyo’s data... 
    Senior

    Klaviyo

    Boston, MA
    14 hours ago
  • $140k - $200k

     ...A rapidly growing scientific data and AI technology company is seeking a Senior Scientific Data Engineer to join its fully remote team...  ...Jupyter Notebooks, or similar tools Experience working with...  ...business users Ensure data quality, reliability, and production readiness... 
    Senior
    Full time
    Temporary work
    Immediate start
    Remote work

    Motion Recruitment

    Boston, MA
    14 hours ago
  • Senior Data Engineer - Boston, United StatesWe are partnering with our client, a leading institutional...  ...and data warehouses that provide reliable, well-structured datasets for analytics...  ...scalability and resilience.Scheduling Tools (Airflow, Control-M) - Orchestrating and... 
    Senior
    Permanent employment
    Work at office
    Remote work
    Monday to Friday

    Huxley Associates

    Boston, MA
    14 hours ago
  • $175.5k - $180k

     ...implementation of scalable data architectures for...  ...design of complex feature engineering workstreams, ensuring...  ...problems at speed and scale. You will be...  ...behavior, evaluation, reliability, guardrails, and the trade...  ...Opik, Langfuse), and infrastructure as code (Terraform) across... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Boston, MA
    14 hours ago
  • $176k - $179.5k

     ...manage scalable data pipelines and secure...  ...machine learning engineers, and industry...  ...flexibility to hire at the Senior Data Engineer I/...  ...orchestration tools such as Temporal,...  ...workflows, and infrastructure-as-code (...  ...data storage, and reliability with commonly used... 
    Senior
    Apprenticeship
    Easy work
    Shift work

    McKinsey & Company

    Boston, MA
    3 days ago
  • $130k - $160k

     ...leading travel search engine. With billions of queries...  ....We are looking for a Senior Data Engineer to join our...  ...will:Architect for scale: Develop and monitor robust...  ...volumes with high reliability.Optimize performance:...  ...and build self-service tools to make data easier to... 
    Senior
    Work at office
    Flexible hours
    3 days per week

    Kayak Europe

    Concord, MA
    2 days ago
  • $170k - $200k

     ...is expanding, the data challenges we're...  ...the platform is scaling to match. As we look...  ...of CloudZero's infrastructure, we're looking for a Senior Platform Engineer who can help shape...  ...improvements in reliability, performance, and...  ...Infrastructure as Code tools to manage... 
    Senior

    CloudZero

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Infrastructure Engineer: Scale, Reliability & Tooling. Be the first to apply!