Inference
genesis
What You’ll Do
Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics
Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization
Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks
Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)
Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks
What You’ll Bring
Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)
Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go)
Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling
Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments
System-level mindset with a history of tuning hardware–software interactions for maximum efficiency, throughput, and responsiveness
$196.72k - $236.48k
...field, or equivalent practical experience. Preferred Qualifications • Rail-optimized network design for distributed training or inference. • Embedded, remote, power-constrained, or radiation-exposed networking experience. • Switch or adapter firmware, FPGA, kernel-driver...SuggestedPermanent employmentWork at officeLocal areaRemote workRelocation package$170.6k - $213.3k
...) and containerization (Docker), enough to read, debug, and extend existing workflows. AWS or GCP for large‑scale ML training and inference. Patents, peer‑reviewed publications, or conference presentations. A desire to work in a fast‑paced environment where a small team...SuggestedFor contractorsImmediate startWorldwide- ...Build machine learning models for robotics control end-to-end: data curation, careful evaluation, model architecture, training/inference stacks, rigorous experiments Collaborate with simulation and real-world robotics teams to curate high-quality, diverse, and large...SuggestedFull time
$250k - $350k
...scale up World Model training. Simply: more tokens in = more tokens out! ML Infrastructure Own the distributed training and inference systems that keep GPUs fully utilized. Increase the throughput during training, and speed of inference, to supercharge the model’s...SuggestedFull timeLocal area- ...across the team. What You’ll Do Own the production embedded vision stack, including camera capture, media pipelines, model inference, tracking, pre- and post-processing, device services, and cloud interfaces. Design software for real-world operation: constrained...SuggestedRemote jobFull timeLocal area
- Senior/Staff Level Inference Engineer We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism...Work at office3 days per week
$160.36k - $240.54k
Software Engineer, ML Inference Platform Mountain View, California (HQ) Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier...Immediate startFlexible hours$177k - $270k
...Foundation models, VLMs, and VLAs to make autonomous driving as seamless as possible. The Opportunity Are you excited to drive our ML Inference Optimization initiatives and make our ML models that enable autonomous driving as fast and efficient as possible? You will get to...Temporary workRelocation package$250k - $300k
About the job Senior Machine Learning Engineer, Inference Senior Machine Learning Engineer, Inference Job Summary For our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise...Permanent employmentFull timeContract workH1bLocal areaRemote workRelocationRelocation package$180k
Software Engineer, RL Inference SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate...Temporary work- ...Runtime Stand up and operate model endpoints using AWS Bedrock and/or SageMaker; evaluate when to use ECS/EKS, Lambda, or Batch for inference jobs. Build and maintain application services that call LLMs through clean APIs, with streaming, batching, and backoff...Permanent employmentFull timeLocal areaRemote work3 days per week
- ...and asynchronous workflows with attention to concurrency, fault tolerance, observability, and maintainability. Integrate model inference, retrieval systems, and external data services into production applications. Build and operate containerized workloads and cloud...Permanent employmentFull timeLocal areaRemote work3 days per week
- About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Hundreds of...Full timeWork at officeRelocation package
- ...and the Middle East. We are creative, low-ego and team-spirited. About the role As a Partner Manager, you will work with inference providers to support the adoption and growth of Mistral AI models on their platforms. Key responsibilities include : Own end...Full timeRelocation package
$230k - $350k
...Job Description Job Description About the Role Join a small AI systems team building a high-performance inference platform from the ground up. You will shape the runtime architecture and improve how large language models are served across GPUs and nodes. What You...Visa sponsorship$230k - $350k
...Job Description Job Description Member of Technical Staff, Inference Systems Company: Confidential — founded by Stanford alumni with deep AI infrastructure experience Location: Palo Alto, CA (on-site 5 days per week) Compensation: $230,000 - $350,000 + competitive...Full timeH1bVisa sponsorship$160.36k - $240.54k
...components. Develop observability to track ML model lifecycles from data generation to on-road validation. Maintain an in-house ML inference platform to serve large language models efficiently. Maintain an in-house ML compiler platform to compile, deploy, and validate...Immediate startFlexible hours$160k - $250k
...more useful products, and what we learn from people using those products shapes what we build next. SOFTWARE ENGINEER, TRAINING/INFERENCE (C++) At SpaceXSI we are building the high-performance inference platform that serves Grok to millions of users every day. As a Software...Temporary work- ...and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads. The Senior/Staff Inference Reliability Engineer will own the end-to-end reliability and production performance of customer inference workloads. This role sits...Full time
- ...models have to run fast enough to control robots in the real world, and efficiently enough to support large-scale research. As an Inference Infrastructure Engineer Intern, you'll work with our infra and research engineers to make model inference faster and more efficient...Internship
- ...This ownership spans from low-level environment simulators and custom communication primitives to our distributed training loops and inference engines. We are seeking engineers who view existing libraries as a baseline and the hardware speed itself as the true target....Full time
- ...with edge/cloud hybrid deployment patterns and the latency constraints that come with them Familiarity with on-robot or embedded inference environments Experience with large-scale cluster topology and scheduling systems (e.g., SLURM, Ray, Volcano) Why This Role...Full time
- ...ABOUT THE ROLE We’re seeking an inference systems engineer to build the distributed serving and high-performance networking layer behind our large language models. You will own the path from model server to GPU fabric: prefill/decode disaggregation, KV-cache transfer...Full timeWork at office
$200k - $400k
...an infrastructure engineer to design, optimize, and scale the systems that serve our large multimodal models. Your work will make inference faster, more cost-effective, and more reliable, so our teams can focus on advancing model capabilities rather than managing bottlenecks...Remote jobFull timeVisa sponsorshipWork visaRelocation package- ...models, VLMs, and VLAs to make autonomous driving as seamless as possible. The Opportunity Are you excited to drive our ML Inference Optimization initiatives and make our ML models that enable autonomous driving as fast and efficient as possible? You will get to...Full time
- ...growing fleet of robots is expensive. We can't rely on one hardware vendor or the most expensive accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast, correctly, and cheaply on a wide range of hardware: AMD Instinct GPUs,...Full time
$200k - $400k
...About the Role RadixArk is looking for a Member of Technical Staff — TPU Systems to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU hardware, working on SGLang-JAX and other critical...Full time$213k - $263k
.... In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer. You will: Develop Waymo's inference platform to make it scalable, high throughput, and low latency Work closely with other teams across Waymo in hosting both internal...Full timeRemote work$147.2k - $224k
...complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and...$200k - $400k
...About the Role RadixArk is seeking a Member of Technical Staff - Inference-Multi-Hardware to push the limits of performance for frontier AI systems. Most performance engineering assumes a single vendor's stack. This role assumes none. You'll bring up, optimize, and...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference. Be the first to apply!
