Staff Engineer, High-Performance Model Inference (C++)
x.ai
x.ai is seeking a Software Engineer to build and optimize high-performance inference platforms. This role involves designing scalable infrastructure and enhancing model serving capabilities for millions of users. You will engage in deep low-level optimizations and ensure reliability and speed in model serving. Ideal candidates have strong systems programming skills (C/C++ or Rust) and experience with GPU inference engines. You'll work in a motivated team focused on engineering excellence, and enjoy a comprehensive benefits package including competitive salary and equity. #J-18808-Ljbffr x.ai
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Engineer, High-Performance Model Inference (C++) in Palo Alto, CA vacancy
$184k - $287.5k
...accelerating it. The TensorRT inference platform is the... ...edge deep learning models on every NVIDIA GPU... .... We're seeking a highly skilled and driven Engineering Manager to take the... ...standard for AI performance. What You'll Be... ...Strong background in C++ or Python, with...PerformanceC++$180k
...Our team is small, highly motivated, and focused on engineering excellence. This organization... ...on the Imagine Model Team, you will... ..., training, inference serving, and product... ...state‑of‑the‑art model performance, including real‑time... ...XLA, PyTorch, Rust/C++, Spark, Ray, and related...PerformanceC++Temporary work$197.8k - $296.6k
...as robotics foundation models, vision-language-action... ...generalizing robots to perform tasks in the real world... ...optimizing models for real-time inference on edge devices and... ...environments targeting high impact business areas... ..., TensorFlow, C, C++, Java, ROS, and CUDA Strong...PerformanceC++Full timeWork at officeLocal area$130k - $260k
...information, please .Senior Staff Engineer page is loaded## Senior Staff... ...with a passion for building high-performance, low maintenance, zero-... ...transition from a traditional IT model to a tech organization with... ...modern languages such as Java, C++, Python or C# including...PerformanceC++Hourly payWork experience placementFlexible hoursGEICO
Palo Alto, CA3 days ago- ...Member of Technical Staff — Inference to push the limits... ...that serve frontier models at scale, optimizing performance, latency,... ...intersection of systems engineering, ML infrastructure,... ...deeply technical, high-impact role for engineers... ...Proficiency in C++, Rust, Go, or Python...PerformanceC++WorldwideFlexible hours
$180k
Software Engineer - Training/Inference (C++) ABOUT xAI xAI’s mission is to... ...Our team is small, highly motivated, and focused... ...are building the high-performance inference platform... ...Member of Technical Staff - Inference, you will... ...large‑scale model serving systems end‑...PerformanceC++Temporary work$198.9k - $304.8k
..., ensuring deliverables meet performance targets and safety constraints... ...reviews and drive software engineering best practices across the team... ...demonstrated track record of building high quality autonomous software... ...design. Experience with C++/Python in a large,...PerformanceC++Work experience placementLocal areaRelocation packageFlexible hoursGeneral Motors
Mountain View, CA2 days ago$197k - $285k
...Senior Staff Electrical Engineer Aurora’s mission is to deliver the... ...defining HW architecture, modeling, and delivering electronics that achieve performance and product metrics.... ...teams to mature high quality electrical designs... ...and Scripting (C++, Python or equivalent...PerformanceC++Local areaDormont Manufacturing Company
Mountain View, CA5 days ago$126k - $248k
...looking for a Senior Engineer to help build the next‑generation inference platform that supports embedding models used for semantic... ..., low‑latency, and high‑scale inference — fully... ...for reliability, performance, and ease of use.... ..., Rust, Python, or C++, with an emphasis on...PerformanceC++Local area$110k - $260k
Senior Staff Engineer - Agentic AI & Enterprise ProductivitySkip to main... ...GEICO is standing up a focused, high-impact engineering team to... ...the quality, usability, and performance of the solutions* Influence and... ...languages such as Java, Go, Python, C++, etc.* Experience partnering...PerformanceC++Hourly payWork experience placementLocal area- ...mathematical reasoning engine that operates with... ...Gold Medal-level performance on the 2025... ...primarily through high-level wrappers, we... ...training loops and inference engines. We are seeking... ...for foundation model workloads. Optimized... ...Proficiency in C++ Experience writing...PerformanceC++
$140k - $300k
...software, and manufacturing engineering disciplines, working... ...Your focus will be on model informed design and... ...set new standards for performance. You'll be empowered to... ...programming skills in C++ or Python (both preferred... ...Contribution when enrolled in the High-Deductible medical plan...PerformanceC++Hourly payTemporary workFlexible hours- ...further! We are seeking a highly skilled and experienced Systems Engineer to design, develop, and validate sophisticated models for our complex electro‑... ...cycles, improving system performance, and ensuring robust and... ...SciPy, NumPy, Pandas), or C/C++. Strong communication...PerformanceC++Contract work
$132k - $330k
Software Engineer, AI Inference Codesign The AI inference co-design... ...is to take research models and make them run... ...compiler and solve the performance bottlenecks needed to... ...throughput Implement/improve highly performant micro... ...with Python and C++, including modern C++...PerformanceC++Hourly payFull timeTemporary workFlexible hours$230k - $284k
...across 15+ U.S. states. Hardware Engineering is an innovative and... ...from safety goals and product performance objectives. Lead the sign‑off... ...culture of clear communication and high standard. You have: 7+... ...analyze data, and understanding C++ production code. Project...PerformanceC++Full timeRemote work$176.4k - $319.72k
...About the Role As a Senior/Staff Systems Engineer working on Autonomy... ...ability to code in Python or C++. Highly collaborative in nature, with... ...experience building computational models for driving behavior or ML... ...eligible for an annual performance bonus, equity, and a...PerformanceC++Odd jobWork experience placement$180k - $240k
...for hardware designers and engineers, integrating rich text, image... ...with machine learning, physics modeling, and geometry processing... ...those with a background in high-performance geometry or graphics, in HPC... ...software engineering skills in C++ (modern C++ standards) and/...PerformanceC++$179k - $223.8k
...are seeking Senior Data Engineers to play a pivotal role... ...development of our Large Driving Model (LDM). In this role,... ...miners that surface high-value examples,... ...modeling teams to accelerate performance. If you are a strong... ...Qualifications Proficiency in C++. Hands‑on experience...PerformanceC++Full timeTemporary workPart timeLocal areaShift work- ...Delivery Foundation Model job at Amazon.com... ...next science and engineering revolution at Amazon... ..., you'll combine highly technical work... ...of Amazon data and infer at Amazon scale, taking... ..., ensuring robust performance in production... ...environments using Python, C++ or other languages...PerformanceC++Worldwide
$220k - $292k
...technology, and business model of the 21st century’s... ...the job We are seeking a highly skilled and experienced System Modeling Engineer to design, develop, and... ...cycles, improving system performance, and ensuring robust and... ...SciPy, NumPy, Pandas), or C/C++. Experience with model...PerformanceC++Full timeContract work- Staff Network EngineerSkip to main contentGEICO uses... ...policy.#Staff Network Engineer page is loaded## Staff... ...passion for building high-performance, low maintenance, zero... ...from a traditional IT model to a tech organization... ...such as Go, Java, C++, Python, or C#, including...PerformanceC++Hourly payWork experience placementLocal areaFlexible hours
- ...Corporation is seeking a Senior Software Engineer for Deep Learning Inference in Santa Clara. In this role, you... ...contribute to TensorRT, NVIDIA’s high-performance deep learning inference SDK. The... ...position requires a strong background in C++, machine learning, and...PerformanceC++
- ...company in California is seeking a Software Engineer to develop and enhance runtime stacks for... ...various teams to support next-generation high-performance compute systems. Candidates should have strong programming skills in C/C++ and Python, along with experience in distributed...PerformanceC++
- ...transforming our world. It can perform cognitive functions... ...of industry-leading high-performance, low-power... ...multimodal Generative AI inference acceleration at scale... ...working closely with design engineers to stay abreast of the... .... Experience in C/C++ or System‑C Deep understanding...PerformanceC++Work at officeRemote workFlexible hours
$100k - $150k
Bright Vision Technologies is looking for a Model Serving Engineer to join its team remotely. This position will focus on designing, building, and operating high-performance inference platforms for machine learning models. Responsibilities include optimizing performance...PerformanceRemote job$190k - $250k
...Hybrid Department AI We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will... ...large-scale deployment of machine learning models for real-time inference. Responsibilities...C++Full time$170k - $240k
...the role We are building a high-scale, web-based... ...R&D team producing AI/ML models and a Senior Full-Stack Engineer building the platform interface... ...correctly captures the model's performance. This role is onsite 5 days... ...ROS2 middleware layers (C++/Python) that allow AI models...PerformanceC++Odd jobWork at office- ...company specializing in AI seeks a Runtime Engineer in Palo Alto, California. The role... ...designing and implementing features for high-performance machine learning applications and supporting... ...Engineering along with experience in C/C++, distributed systems, and good communication...PerformanceC++
$180k - $260k
...a Tech Lead to architect and develop a high-performance network monitoring platform. This role... ...programming skills in languages such as C++, Go, or Python and significant experience... ...TCP/IP. The ideal candidate will lead engineering standards and mentor teams while...PerformanceC++- ...California is seeking a Senior Software Engineer specializing in Deep Learning Inference. In this role, you will craft and develop high-performance software tailored for scalable... ...candidate will have a strong background in C++, Python, and machine learning concepts,...PerformanceC++
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, High-Performance Model Inference (C++). Be the first to apply!
Related searches
- staff engineer Palo Alto, CA
- senior staff systems engineer Palo Alto, CA
- assistant engineer Palo Alto, CA
- senior staff engineer Palo Alto, CA
- software engineer staff Palo Alto, CA
- technology administrator Palo Alto, CA
- engineering aide Palo Alto, CA
- performance nutrition Palo Alto, CA
- lead performance test engineer Palo Alto, CA
- acting performance Palo Alto, CA