Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Performance Engineer, Inference

Cerebras Systems

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.About The RoleWe are hiring a Senior Performance Engineer to join our Product team. You are an expert on state-of-the-art inference performance and will serve as our resident expert on how Cerebras stacks up against alternative inference providers on both price and performance. This role sits at the intersection of performance benchmarking from first principles and competitive intelligence. The role has two core pillars:Performance BenchmarkingYou will build, run, and maintain reproducible benchmarks that measure Cerebras inference performance for real customer workloads. This includes metrics like tokens per second, time to first token, latency under concurrency, and total cost of ownership (TCO). Competitive Pricing IntelligenceYou will build and maintain a living model of competitor pricing across the AI inference landscape, including cloud providers, custom silicon vendors, and inference API platforms. You will work directly with our Sales and Product teams to translate this intelligence into pricing recommendations for enterprise contracts, ensuring Cerebras offers a compelling value proposition for every customer.This role requires deep, hands-on fluency with open-source inference stacks (vLLM, SGLang, TensorRT-LLM), GPU kernel-level optimization toolchains (CUDA, Triton), and an intuitive understanding of how transformer architecture decisions—attention mechanisms, model sizing, quantization, KV-cache strategies—interact with the realities of GPU memory hierarchies and compute budgets. ResponsibilitiesDesign standardized benchmark suites for inference workloads (code generation, summarization, multi-turn conversation, agentic tool use) that enable fair, reproducible comparisons. Stay current with GPU optimization communities (CUDA, Triton, TensorRT) and evaluate how new kernel fusions, flash-attention variants, and quantization techniques shift performance ceilings. Build and continuously update a competitive pricing model covering token-based pricing, throughput-based pricing, and enterprise contract structures across major inference providers. Monitor industry announcements, pricing changes, and new product launches. Synthesize findings into actionable briefs for the Sales and Product teams. Partner with Sales to build deal-specific competitive analyses showing total cost of ownership and performance advantages for enterprise prospects. Collaborate with Product and Engineering to identify where competitors are closing gaps or where Cerebras has underappreciated advantages. Track third-party benchmarking sources (Artificial Analysis, InferenceX) and ensure Cerebras is well-represented and accurately measured. Skills & QualificationsRequiredDeep practical experience with state-of-the-art open-source inference frameworks like vLLM, SGLang, or TensorRT-LLM. 5+ years of experience in ML systems, ML research engineering, or high-performance computing. Strong understanding of LLM inference economics: tokens, throughput, latency, batch sizes, precision trade-offs, and how these translate to customer cost. Strong understanding of transformer model architecture internals such as attention mechanisms (MHA, MQA,GQA, MLA, DSA, MHA) and KV-cache management, and how each affects memory and compute profiles. Self-directed and resourceful. PreferredBackground in ML research (publications or significant open-source contributions) with a systems or efficiency focus. Contributions to open-source inference or kernel optimization projects. Excellent communication skills. You will collaborate with executives, write for engineers, and create materials for sales leaders. Why Join CerebrasPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:Build a breakthrough AI platform beyond the constraints of the GPU.Publish and open source their cutting-edge AI research.Work on one of the fastest AI supercomputers in the world.Enjoy job stability with startup vitality.Our simple, non-corporate work culture that respects individual beliefs.Find out more about what it's like to work at Cerebras here! Apply today and become part of the forefront of groundbreaking advancements in AI!Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.LocationHeadquarters/Sunnyvale OfficeEmployment TypeFull timeLocation TypeOn-siteDepartmentSoftware

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Performance Engineer, Inference in Sunnyvale, CA vacancy
  • $184k - $287.5k

    We are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help us squeeze every last...  ...Implement language and multimodal model inference as part of NVIDIA Inference Microservices... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    18 hours ago
  •  ...Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated AI inference workloads. You will profile, diagnose, and... 
    Senior
    Performance

    AMD

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

    We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...edge AI technology for safety-critical applications? Join NVIDIA's TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and other specialized platforms. Your expertise... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    18 hours ago
  • $195.2k - $361.2k

     ...models fast on the hardware people actually own. You optimize inference engines (llama.cpp, vLLM) for constrained local and edge...  .../ health)Benchmark across hardware tiers and publish honest performance comparisonsUpstream fixes and patches to open-source engines... 
    Senior
    Performance
    Full time
    Internship
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...known as “the AI computing company”.We're looking for a Senior Performance Compiler Engineer to join our team and work on the open-source Triton...  ...impact AI applications, accelerating both training and inference. You will be immersed in a diverse, supportive environment... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    NVIDIA is seeking an NCX Senior Engineer to join our DSX team, collaborating closely with strategic...  ...ensure customers realize efficient performance from NVIDIA's AI platform across...  ...platforms, including distributed training, inference optimization, and MLOps pipelines... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...are looking for a Deep Learning Compiler Engineer. NVIDIA is hiring software engineers...  ...Our DLC has been the backbone of NVIDIA inference engine, spanning across data centers, personal...  ...must deliver leading inference performance, fast build time, reduced memory footprints... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...world.We are seeking an exceptional Senior Perception Engineer to help design and productize NVIDIA...  ...KPI frameworks to quantify perception performance; analyze large-scale real and...  ...development and optimizing training or inference pipelines through custom CUDA kernels... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...headquarters 3 days per week.The role: Senior toStaff Runtime Systems...  ...on in-memory compute for AI inference in datacenters.This position is for runtime software engineering, working on the architecture,...  ...for all aspects of runtime performance of the silicon product. You... 
    Senior
    Performance
    3 days per week

    d-Matrix

    Santa Clara, CA
    3 days ago
  • $224k - $356.5k

     ...world.We are seeking an exceptional Senior Radar Perception Engineer to help design and productize...  ...frameworks to quantify radar perception performance; analyze large-scale real and synthetic...  ...and optimizing training or inference pipelines through custom CUDA kernels... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...secure for millions globally. We seek a Senior Engineer to lead technical efforts in deploying...  ...PCs. By combining powerful local inference (Nemotron models) with strong privacy...  ...multiple languages, particularly C++ (for performance-critical systems/OS integration) and Python... 
    Senior
    Performance
    Full time
    Local area
    Shift work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU,...  ...looking for a motivated Deep Learning engineer to bring advanced communication...  ...training on scales up to 100K GPUs to inference down at microsecond latency. Communication... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...on the world.As a Developer Technology Engineer, you will be at the forefront of innovation...  ...resulting in suboptimal runtime performance.Conduct hands-on trainings, develop sample...  ...crowd:Experience with GPU-accelerated AI inference driven by NVIDIA APIs and SDKs,... 
    Senior
    Performance
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    3 days ago
  • $224k - $356.5k

     ...NVIDIA, a company at the forefront of AI and high-performance computing. As a Senior / Principal Deep Learning Engineer — Model Evaluation & AI Systems, you will play...  ...best practices.Work alongside model training, inference, and product divisions to provide trusted... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $175k - $275k

     ...deliver industry-leading training and inference speeds; over 10 times faster than GPU...  ...Role: We are looking for a hands-on Senior Quality Engineer to drive manufacturing quality for printed...  ...AOI/inspection data, and parametric performance to proactively identify and correct... 
    Senior
    Performance
    Contract work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $168k - $270.25k

     ...including NeMo microservices and NVIDIA Inference Microservices (NIM), enabling...  .... We are looking for a senior, technically strong test development engineer to drive quality, automation, and...  ...functional, integration, system, performance, and reliability testingDesign,... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $160k - $253k

     ...accelerated computing is the engine of artificial intelligence. Our...  ...platforms integrate high performance compute, networking, and a full...  ...scale. We are looking for a Senior Technical Marketing Engineer...  ...performance and efficiency for AI inference & training.What you’ll be... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...headquarters 3-5 days per week.The role: Senior Staff Analog Design EngineerWhat...  ...of the art In-Memory-Compute engine for Artificial Intelligence Inference Accelerator and High-Speed Die-2-Die...  ...circuit design, system level performance analysis, design test benches for... 
    Senior
    Performance
    3 days per week

    d-Matrix

    Santa Clara, CA
    4 days ago
  • $240k

     ...industry-leading training and inference speeds; over 10 times faster...  .... has multiple openings for Senior Quality Assurance...  ...integration, regression, and performance test strategies for AI/ML systems...  ...logs, monitoring tools, and engineering best practices.Document test... 
    Senior
    Performance

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

     ...oriented team to help unlock maximum hardware performance for emerging AI workloads. You will be...  ...bottlenecks in both training and inference pipelines.Collaborate closely with AI researchers...  ...degree in Computer Science, Computer Engineering, Electrical Engineering, or related... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...make this transition flawless, high-performing, and secure for millions of users worldwide...  ...in their PCs.We are looking for a Senior Software Engineer to build and optimize the local...  ...By combining high-performance local inference (Nemotron models) with robust privacy... 
    Senior
    Performance
    Full time
    Local area
    Worldwide

    Nvidia

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

    As a Senior Engineering Manager for Agentic Systems & Platform Architecture, you will lead the...  ...decisionsArchitect and integrate high-performance data pipelines, RAG systems, vector databases...  ..., and GPU-optimized training and inference workflows.Lead integration of the AI... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...NVIDIA is seeking top-tier AI Compiler Engineers to drive innovation within our world-class...  ...boundaries of what is possible in AI performance and help build the technology that...  ...compilation problems for AI workloads (both inference and training) and successfully... 
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    18 hours ago
  • $144.7k - $261.3k

    Job DescriptionThe Senior ML Validation Research Engineer will lead applied machine learning research focused...  ...ResponsibilitiesPrototype research concepts into performant tools integrated into CI/CD and...  ....Knowledge of Bayesian ML, causal inference, and sequential testing.Experience... 
    Senior
    Performance
    Full time
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    18 hours ago
  • $170.6k - $261.3k

     ...transportation on a global scale.As a Senior Machine Learning Engineer on the State Estimation and Mapping...  ...experimentation to improve model performance against those metrics. Analyze...  .... Implement efficient training and inference pipelines, including model optimization... 
    Senior
    Performance
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $200k - $245k

     ...Department of Defense.We are looking for a Senior Autonomy Software Systems Engineer who can derive requirements from...  ...decisions affecting safety and performance.Support development of simulation...  ...or more of the following:Bayesian inference (e.g., beta and gamma... 
    Senior
    Performance
    Temporary work
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    4 days ago
  • $272k - $431.25k

     ...NVIDIA is the engine of modern AI, and robotics is where AI meets the physical world....  ...team. Recruit, grow, and mentor a high-performing team of robotics software engineers; set...  ...across simulation, training, and on-robot inference on Jetson and edge platforms.Deliver. Drive... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $173.9k - $235.2k

     ...tasked with developing the next generation of EC2 Supercomputers, optimized for high-performance training and inference workloads.We are looking for an experienced System development engineer to drive development for new EC2 machine learning platforms. In this role, the... 
    Senior
    Performance
    Internship
    Local area
    Work from home
    Worldwide
    Flexible hours

    Amazon

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Performance Engineer, Inference. Be the first to apply!