Machine Learning Systems Engineer Software company San Jose, California $180k to $350k USD base a year Posted yesterday

# Machine Learning Systems EngineerSoftware company* LocationSan Jose, California* TypeFull-time* Posted23 October 2026Apply for this roleTalk to us firstYou apply on Workable, where Raydar manages applications.The role, as published## About the companyOur client is a software company.## The roleRaydar is recruiting for this role on behalf of our client. Own low-level performance work for machine learning model serving in production, tuning compute clusters and building the tooling that measures results. Partner with researchers to bring new model designs into live systems, and speak directly with customers when technical needs have to be pinned down.## What you'll do* **Design**, deploy and tune model serving systems across multi-node clusters to raise throughput and cut response times for production workloads.* **Implement targeted performance improvements** and benchmark their impact.* Diagnose performance bottlenecks across the stack, from GPU execution to memory limits.* **Build test and benchmarking tooling that compares quality**, speed and resource usage across different parallelism approaches.* **Partner with research scientists** to move new model architectures and optimizations into production infrastructure.* Keep up with academic and open-source work and apply promising ideas to improve performance.* Talk with customers to understand and clarify their technical needs.## What we're looking for* Software engineering background at companies that build hardware or chip design tools.* Track record of tuning performance for high-performance computing and machine learning workloads.* Experience shipping native compiled software that runs in customer environments, in a language such as C, Rust or Go.* Strong skills in Python and C++/CUDA, plus hands-on use of a common model serving framework such as PyTorch.* A degree in electrical engineering, computer science or a closely related discipline.* Comfortable engaging customers directly and representing the company in a professional manner.## Bonus points* Background building performance-critical engines or algorithms at chip design software vendors.* Familiarity with C++ performance modeling and simulation libraries.* Experience with machine learning or heavy numerical workloads running on consumer devices.* Experience in scientific or numerical computing.* Health, dental and vision coverage* Relocation support## Location and work model* San Jose, California, United States* On-site, 5 days per week in office* Full-time## Compensation, as the posting describes it* Equity* Retirement plan* Flexible time offPay$180k to $350kUSD base a year #J-18808-Ljbffr