Staff Software Engineer, Ray Data

Responsibilities

• Design, build, and improve Ray Data systems with a focus on performance, scalability, and reliability.
• Design and optimize distributed execution across data-pipeline stages and heterogeneous environments.
• Build data loading and processing solutions for production training and inference workloads.
• Solve problems involving scheduling, resource management, data partitioning, fault tolerance, distributed execution, and performance optimization.
• Make system-level architectural decisions involving resource allocation, execution models, batch versus streaming workloads, and consistency versus availability.
• Work with customers and AI-native companies to address challenges in scaling AI workloads.

Requirements

• At least 6 years of experience building production-grade software, infrastructure, or developer-facing systems, with strong Python engineering experience.
• At least 6 years of personally owning core architectural decisions within a distributed data or compute engine.
• Deep experience with distributed-systems internals, including scheduling, fault tolerance, data partitioning, distributed execution, performance optimization, or database and query-engine internals.
• Demonstrated ability to reason through and defend system-level tradeoffs such as batch versus streaming and static versus dynamic resource allocation.
• Passion for solving large-scale AI infrastructure problems and building systems for next-generation AI applications.

Benefits

• Competitive salary and equity.
• Health, dental, and vision coverage, with many plans up to 99% employer-covered.
• Flexible time off, paid parental leave, and mental health support.