Staff AI Inference and Acceleration Engineer
$180k - $275kFull-time
Figure
Figure is an AI robotics company developing autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial markets. Figure is headquartered in San Jose, CA. We are looking for a Staff AI Inference & Acceleration Engineer to join the Platform Software team and own the on-board inference architecture for Figure’s humanoid robots. You will be the technical authority on how AI workloads are mapped, optimized, and executed across the robot’s compute hardware — driving down power consumption and cost while meeting the strict latency and reliability demands of a real-time autonomous system. Responsibilities
- Own the on-board inference architecture — mapping models to available accelerators (NPU, GPU, DSP, CPU) based on latency, power, and memory budgets.
- Partition inference workloads across heterogeneous compute resources, balancing real-time performance with power and thermal constraints.
- Define and maintain a system-level compute budget across all inference tasks running on the robot.
- Evaluate next-generation acceleration hardware and contribute to the definition of future compute platform requirements.
- Optimize inference toolchains end-to-end — from model export through runtime execution — for target hardware.
- Apply quantization (INT8, INT4, mixed-precision), pruning, operator fusion, and other compression techniques to reduce compute, memory, and power footprint.
- Profile inference pipelines to identify and eliminate bottlenecks in latency, memory bandwidth, and power consumption.
- Optimize kernel scheduling, memory layout, and data movement across the compute hierarchy.
- Partner closely with the AI/ML team to define model architecture constraints that are hardware-friendly from the outset.
- Work with the Platform Software team on runtime integration, scheduling, and power management.
- Engage with silicon vendors and research teams to track the accelerator landscape and influence hardware roadmaps.
- M.S. or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a related field — or equivalent industry experience.
- At least 8 years of industry experience in hardware acceleration, ML systems, or compute architecture.
- Deep understanding of AI/ML inference — model formats (ONNX, TFLite, etc.), inference runtimes, and deployment pipelines.
- Hands-on experience optimizing models for edge or embedded hardware using quantization, pruning, and operator-level tuning.
- Strong understanding of computer architecture — memory hierarchies, data movement, and heterogeneous compute.
- Experience profiling and benchmarking inference workloads across CPU, GPU, NPU, DSP.
- Familiarity with low-level toolchains and compilation frameworks (e.g. TVM, MLIR, TensorRT, Torch, SNPE/QNN, JAX, CUDA, ROCm).
- Solid software engineering skills in C++ and Python.
- Strong cross-functional communication skills — able to work effectively across hardware, software, and AI/ML teams.
- Knowledge of real-time operating constraints and their impact on inference scheduling.
- Track record of co-designing model architectures with ML teams to meet hardware constraints.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff AI Inference and Acceleration Engineer in California vacancy
$180k - $275k
Figure is an AI robotics company developing autonomous general-purpose humanoid... ...level intelligence. Its robots are engineered to perform a variety of tasks in the... ...San Jose, CA. We are looking for a Staff AI Inference & Acceleration Engineer to join the Platform Software...SuggestedFull time- Staff Technologist-AI ArchitectInfrastructure Solutions Group (ISG) builds the... ...connect infrastructure, accelerate computational workloads, integrate... ...how work gets done. Engineers define intent, author precise... ...Kubernetes, low-latency inference runtimes, enterprise data platforms...Suggested
$250k - $350k
...mission is to develop reliable AI systems for the world’s... ...like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across... ...— training/fine-tuning, inference, memory and retrieval,... ...are expanding our team to accelerate the development of AI applications...SuggestedFull time$175k - $275k
...builds the world's largest AI chip, 56 times larger than GPUs... ...-leading training and inference speeds; over 10 times faster... ...high-speed inference.Senior Staff AI Accelerator Performance ArchitectWafer-scale... ...clearly.MS or PhD in Electrical Engineering, Computer Engineering,...Suggested- ...builds the world's largest AI chip, 56 times larger... ...-leading training and inference speeds; over 10 times... ....About the RoleAs a Staff GPU Inference SDET,... ...Working closely with engineering leads and cross-functional... ...stack and rack-scale accelerated compute fleets. In this...Suggested
$183k - $247.6k
...to shape the future of AI? Join the team... ...cloud for AI training and inference — where multi-billion-... ...hardware, and network engineers, supply chain specialists... ...performance server and/or accelerator server and rack system... ..., supervisors, and staff; adhere to standards...Local areaFlexible hours$183k - $247.6k
...the world's largest fleet of GPU-accelerated servers powering AI/ML training and inference at cloud scale. Our team defines... ...a Cloud Hardware Development Engineer to define server architectures based... ...employees, supervisors, and staff; adhere to standards of excellence...Local areaWorldwideFlexible hoursDay shift$192k - $278k
...qualifications:Bachelor's degree in Electrical Engineering, Computer Engineering, Computer... ...optimizations for ML training and inference.Experience with deep learning... ...you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive...Worldwide$148.7k - $201.2k
...available to Generative AI customers? Do you want... ...scale?AWS Hardware Engineering is looking for a Systems... ...- the servers, accelerators, and storage platforms... ...systems for AI training, inference, and compute workloads... ...employees, supervisors, and staff; adhere to standards...InternshipLocal areaWorldwideFlexible hours- ...community where each individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI lifecycle by bridging the... ...enterprise-grade reliability by leveraging hardware acceleration, designing scalable infrastructure, and monitoring system...Full timeLocal areaImmediate start
$164k - $246k
...event into a continuous process of discovery that accelerates knowledge, broadens participation, and inspires the... ...partnership model for space science. We're hiring one Staff Assembly, Integration & Test (AI&T) Engineer to own the integration and test campaigns for the...Full time$214k - $220k
...Overview Hyve Solutions transforms complex engineering challenges into production reality for technology innovators building AI, cloud, and connected infrastructure. As a... ...eliminate vendor complexity while accelerating time-to-market with single-partner accountability...Flexible hours$200k - $350k
...talented Design Verification Engineers to help verify and deliver Velaura... ...'s next generation Physical AI SoC. You will work closely... ...This role focuses on our AI acceleration units. We are designing custom... ...to deliver industry leading inference performance at best in class...Full timeFlexible hours$150.98k - $218.62k
...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions... .... Learn more at and on LinkedIn and X.Staff System Architecture and Design... ...DCE)San Jose, CAAbout the RoleAs a System Engineer, you will own the system development of high...Permanent employmentFull timeWork at officeShift workDay shift- ...Systems builds the world's largest AI chip, 56 times larger than... ...-leading training and inference speeds; over 10 times faster... ...roleAs demand for AI continues to accelerate, intelligent capacity management... ...role working directly with Engineering, Product, Infrastructure, SRE...Remote work
$204k - $216k
...Description About Sapience AI Sapience AI is the collective... ...scale. You build and run the inference infrastructure that turns the... ...applied AI, research, and platform engineering, and you make the difference... ...AI at scale. 7. Hardware, accelerators, and platform choices Make...$170k - $245k
...Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.With Anyscale, we’... ...raised to date.About the roleAs a Distributed LLM Inference Engineer, you will help systems and optimizations that push the...Work at office$165.2k - $223.6k
We are looking for an Inference Engineer to help serve inference for real-time... ...multimodal conversational AI. This is a full-stack... ...KV-cache management, and the accelerator programming model- Demonstrated... ...employees, supervisors, and staff; adhere to standards of excellence...InternshipLocal areaFlexible hours- ...our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded... ...career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU...
$266.05k - $396k
...potential of their data, from AI to multicloud. Ready to... ...Job Summary Distinguished Engineer - AI Infrastructure We are... ...experience with high-performance inference engines (TensorRT, vLLM, ONNX... ...for inter-service and accelerator-to-accelerator communication....Part timeWork at officeLocal area$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to... ...three interconnected systems, all aimed at accelerating NVIDIA's LLM inference stack. The first... ...agentic kernel optimization: applying AI-driven analysis to diagnose performance...Full time- ...is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming... ...AMD is looking for a Principal Engineer to serve as a hands-on technical... ...architecture to model architecture, inference paradigms, and system-level...
- ...Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and... .... Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build...Full time
$160k - $200k
...across the whole robot autonomy stack to accelerate algorithms and thereby unlock new robot capabilities... ...preferred (e.g., including game engine development, computer graphics, etc.)Base... ....We may use artificial intelligence (AI) tools to support parts of the hiring process...Worldwide$181k - $308k
...innovating memory and storage solutions that accelerate the transformation of information into intelligence... .... Our team works across global, multicultural engineering groups to build next-generation HBM solutions that power AI and machine learning. We believe the best...Full timeLocal areaImmediate start$184k - $287.5k
...globally. We seek a Senior Engineer to lead technical... ...in deploying advanced AI agent frameworks and local... ...combining powerful local inference (Nemotron models) with... ...at least 3+ years in Staff, or Lead Architect role... ...Llama.cpp, vLLM), GPU-accelerated computing (CUDA, TensorRT...Full timeLocal areaShift work$152k - $241.5k
...into the unlimited potential of AI to define the next era of... ...world.As a Developer Technology Engineer, you will be at the forefront... ...for analyzing most demanding accelerated end-to-end agentic AI... ...Experience with GPU-accelerated AI inference driven by NVIDIA APIs and SDKs...Full timeLocal area$145k - $246k
...innovating memory and storage solutions that accelerate the transformation of information into... ...and advance faster than ever.As a Design Engineer at Micron Technology, Inc., you will be... ...proficiency with general-purpose agentic AI applied to engineering work — AI-powered...Full timeLocal areaImmediate start$207k - $300k
...projects.Collaborate closely with hardware, software, and system engineering teams to drive pre-silicon Firmware (FW)/Software (SW) co-... ...currently need-to-know products shaping our future solutions.The AI and Infrastructure team is redefining what’s possible. We empower...Worldwide$300 per month
Crusoe is on a mission to accelerate the abundance of energy and intelligence... ...only vertically integrated AI infrastructure company built... ...:At Crusoe, our Production Engineering team ensures the reliability... ...distributed AI pipelines and inference servicesDefine, measure, and...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff AI Inference and Acceleration Engineer. Be the first to apply!





