Systems Software Engineer

The RoleRaydar is recruiting for this role on behalf of our client. Work on low-level performance and infrastructure engineering for a production machine learning serving platform. You will tune software for speed and efficiency, run large compute clusters, and speak directly with customers as part of a small, high-ownership team.What You'll DoDeliver fast support for newly released open-source models, tuned for low latency and high throughput.Improve the model serving stack with techniques such as request batching, caching, decoding strategies and quantization.Write and tune low-level GPU kernels across several hardware vendors.Design, deploy and operate compute clusters built from mixed hardware.Run production inference across a varied fleet, with attention to reliability, observability and cost efficiency at scale.Talk with customers and help set the direction of your own work with a high degree of autonomy.What We're Looking ForDeep understanding of how computers work, including architecture, memory hierarchy and operating system internals, beyond application-level coding.Backend, infrastructure or systems experience at a well-regarded technology company or an early-stage startup.Real enthusiasm for using AI agents and coding tools to improve your own workflow.A computer science degree from a strong undergraduate program.Clear communication and emotional intelligence, as roughly 10 to 20 percent of the role is customer-facing.Comfort working on-site five days a week.Bonus PointsExperience deploying or operating infrastructure at scale, such as clusters or large GPU fleets.Experience with machine learning inference optimization.Familiarity with GPU programming.Academic background in low-level systems topics.New graduates with strong internships are welcome.BenefitsHealth, dental and vision coverageUnlimited paid time offParental leaveLocation And Work ModelSan Francisco, CA, United StatesOn-site, 5 days per week in officeFull-timeCompensation, As The Posting Describes ItEquityMeals provided Raydar Inc