Senior Software Engineer, Infrastructure

The Role

Raydar is recruiting for this role on behalf of our client. Own the platform that runs many concurrent, stateful workloads for AI systems. The work covers job dispatch and reliability, designing realistic test scenarios, and extending the platform with new integrations as the field evolves.

What You'll Do

Run and scale the dispatch layer for many parallel, stateful workloads, including queueing, concurrency control and failure handling.

Design realistic environments and test scenarios that probe system limits and measure what matters, not only what is easy to measure.

Build new evaluation approaches and extend the platform to support additional environment types.

Ship integrations with external orchestration frameworks.

Keep pace with a fast-moving area and bring new ideas into the platform.

What We're Looking For

A track record of designing, launching and growing production backend systems that handle heavy traffic and large volumes of data.

Background at a startup that grew quickly or at a fast-paced large technology company.

Comfort with cluster management tooling and event-driven system design.

Experience maintaining distributed services and infrastructure for large language model workloads.

Bonus Points

Experience running AI or machine learning workloads at scale.

Experience at both an early-stage startup and a large technology company.

Extensive hands-on experience with Kubernetes.

Location And Work Model

New York, NY, United States

Hybrid, 2-3 days per week in the office

Remote option may be available for strong candidates

Full-time

Compensation, As The Posting Describes It

Equity