Staff Machine Learning Engineer

Responsibilities

• Drive transformative initiatives for production ML infrastructure, including queueing, orchestration, deployment, cloud identity, and infrastructure retirement.
• Build and operate multi-region model-serving fleets, customer-specific model pipelines, and CI and deployment tooling.
• Set the technical vision for model training, deployment, serving, observability, reliability, and cost efficiency.
• Lead incident response for ML systems and maintain the platform’s production-quality bar.
• Drive cross-team initiatives involving shared infrastructure, deployment tooling, and data systems.
• Improve engineering quality through design reviews, code reviews, production readiness work, and mentoring.
• Connect technical decisions to customer and business outcomes and represent the team’s technical perspective to leadership.

Requirements

• 8+ years building and operating distributed systems in production, including deployment, operations, scale, reliability, CI/CD, and infrastructure as code.
• Hands-on experience operating ML workloads in production, such as training pipelines, model serving, feature systems, or ML platform tooling.
• Experience owning technical direction, leading multi-quarter cross-team initiatives, and developing senior engineers while maintaining high personal output.
• Deep working knowledge of Kubernetes and cloud infrastructure, including identity and access management, networking, and cost management.
• Strong written and verbal communication skills with the ability to build consensus and drive decisions.
• Preferred experience with Celery, RabbitMQ, Kafka, Ray, MLflow, model registries, feature stores, or ML observability.
• Preferred experience with Python, Ruby on Rails, MongoDB, Redis, SOX or HIPAA compliance, and customer engagement, personalization, or marketing technology.

Benefits

• Hybrid work model with a curated in-office employee experience.
• Competitive compensation that may include equity, retirement and employee stock purchase plans, flexible paid time off, and comprehensive medical, dental, vision, life, and disability benefits.
• Family services including fertility benefits and equal paid parental leave.
• Professional development through career pathing, learning platforms, and a yearly learning stipend.
• Community engagement opportunities including Volunteer Week and donation matching, plus Employee Resource Groups.
• The role is based within Braze’s global office network, with benefits varying by location.