Get new jobs by email
$236k - $330k
...Snowflake AI Research team and advance the state of the art in LLM inference systems and optimization.Our mission is to build the next... ...configurations with minimal manual tuning. We embrace AI-native engineering, using AI not only as the workload we optimize, but also as a...SuggestedSnowflake
Bellevue, WA5 days ago$155k - $235k
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into... ...execution and energized by hard problems.Staff Test & Release Engineer, Inference CloudLocation: Santa Clara, Ca / Remote, USRole...SuggestedRemote workShift workd-Matrix
Santa Clara, CA5 days ago$192k - $278k
...production.Minimum qualifications:Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field,... ...solutions or performance optimizations for ML training and inference.Experience with deep learning frameworks such as TensorFlow or...SuggestedWorldwideGoogle
Sunnyvale, TX2 days ago- ...Netpreme is seeking a skilled engineer to own the inference-serving stack for frontier LLM workloads. You will optimize and operate distributed inference pipelines, working with vLLM, SGLang, and TensorRT-LLM, while coordinating with hardware and systems teams. You’...Suggested
Netpreme
Boston, MA12 hours ago $110 - $140 per hour
Software Engineer - ADAS Platform, Sensor Pipeline & AI Inference Optimization Lead the development and optimization of next-generation ADAS platform software across CPUs, GPUs, DSPs, AI accelerators, and safety-critical automotive hardware. Drive sensor processing pipelines...SuggestedYoh
Newark, DE5 days ago- ...Liquid AI in Boston is seeking a Member Of Technical Staff, Infrastructure to join our Research & Engineering team. You will design benchmark suites and verify inference performance across hardware targets. Port models like LFM2, extend the inference engine on llama...Suggested
Liquid AI
Boston, MA3 days ago - ...energy into intelligence that people can actually afford to use. Inference is where that happens: every product built on a model is... ...the role can be filled as a Research Scientist or a Research Engineer; both are expected to do research and to write the code that ships...Suggested
Bitdeer Technologies Group
Austin, TX3 days ago - ...The AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs... ...training infrastructure at scale and high-performance inference serving. THE PERSON: This role demands someone who has shipped...Suggested
AMD
Markham, IL4 days ago - ...Nebius is building a standalone AI cloud platform with a focus on scalable GPU-based inference. The role targets engineers who can develop low-level kernels and runtime components, improve inference performance, and profile across CPUs and GPUs to optimize end-to-end execution...Suggested
Nebius Group
Austin, TX12 hours ago - ...Normal Computing is building AI inference hardware based on its Thermo In-Memory Computing architecture. As the founding mechanical engineer on our hardware team, you will shape the physical design from accelerator to rack, determining form factor, cooling, serviceability...Suggested
Normal Computing Corporation
Palo Alto, CA3 days ago $148k - $270k
...way developers build and deploy AI models. State-of-the-art inference is a fast moving target - every few months brings new model... ...You bring war stories from learning the hard way why defensive engineering is worth the extra investment. ~ Genuine interest in the research...SuggestedWork experience placementWork at officeLocal areaRemote workVisa sponsorshipFlexible hoursModular Services
Los Altos, CA5 days ago$250k - $320k
...Software Engineer, Production ReliabilityWe're looking for a software engineer, reliability-minded but still a builder, to own what... ...Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds the manifest-driven API and...SuggestedPermanent employmentFull timeTogether AI
San Francisco, CA2 days ago- ...customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI lifecycle by bridging the gap between high-performance model development and optimized deployment...SuggestedFull timeLocal areaImmediate start
F5 Networks
Seattle, WA4 days ago - ...FriendliAI Inc. is seeking a Forward Deployed Engineer to help enterprises deploy, scale, and operate generative AI workloads on our... ...services. You will collaborate with customer engineering teams on AI inference challenges, including scaling, orchestration, and monitoring,...Suggested
FriendliAI Inc.
San Francisco, CA2 days ago - Snowflake is building the next generation of AI-native inference systems. We seek experienced researchers and systems developers to advance LLM inference, optimization, and platform-wide performance across GPUs, CPUs, and distributed runtimes. You will collaborate with...Suggested
- Senior Inference SW EngineerThis role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from... ...'s Private Cloud AI organization is seeking a Senior Software Engineer to build and evolve the model runtime within HPE AI Essentials...Full timeWork experience placementWork at officeLocal areaImmediate startRemote work2 days per week
Hewlett Packard Enterprise
Durham, NC2 days ago $184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop...Full timeNvidia
Austin, TX5 days ago$193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational AI. This is a full-stack inference role: you will work across the entire path a modeltakes from research to production — shaping model architecture so it is servable,...InternshipLocal areaFlexible hoursAmazon
Sunnyvale, CA4 days ago$159k - $198.8k
...the Deloitte Fast 500, Uniphore delivers on the promise of AI as a transformative force for business. Job Description:Staff Inference Engineer -Uniphore is building an enterprise AI platform where agents operate across voice, video, text, and structured data in real time...Full timeUniphore
Palo Alto, CA5 days ago- ...Cloudflare is building a world-class AI inference platform that powers real-time voice, LLMs, and user-deployed models across its global... ...challenges in distributed systems. As a senior systems engineer, you will drive sub-second model cold starts, multi-accelerator...
Cloudflare Inc
New York, NY3 days ago - ...TikTok is offering a PhD internship focused on building and optimizing the inference infrastructure for ultra-large-scale AI systems. You will work on distributed serving, global scheduling, and low-latency inference across heterogeneous compute resources. Ideal candidates...Internship
Tik Tok
San Jose, CA3 days ago - ...Senior/Staff Inference Reliability EngineerParasail is redefining AI infrastructure by enabling seamless deployment across a distributed... ...of AI workloads.The Senior/Staff Inference Reliability Engineer will own the end-to-end reliability and production performance...
Parasail
San Mateo, CA3 days ago - ...world forward. Join us and, together, we'll advance your career.The role:We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation infrastructure behind AI-for-engineering systems. This role focuses on the systems that...
Advanced Micro Devices , Inc.
Santa Clara, CA2 days ago - ...OpenAI, Inc. is seeking an experienced Electrical Engineer to develop AI inference compute systems powering humanoid robots. You will own hardware architecture, from component selection to deployment, and design high-speed interfaces while balancing bandwidth, power,...
OpenAI, Inc.
San Francisco, CA2 days ago - ...NVIDIA seeks best-in-class ASIC Verification Engineers to verify the design and implementation of the world's leading inference accelerator. This role offers impact across NVIDIA's product lines, from consumer graphics to self-driving systems and AI. You will work...
NVIDIA
Austin, TX3 days ago - ...advanced NLP applications? We are looking for a Site Reliability Engineer to join the Model Serving team at Cohere. The team is... ...accelerators), especially how they influence latency and throughput of inference. ~ Strong understanding or working experience with...Full timeWork experience placementWork at officeLocal areaRemote workHome office
Cohere
New York, NY2 days ago - ...Amazon.com Services LLC in Seattle seeks a Software Development Engineer for Special Projects to design and deliver scalable ML inference systems that empower scientists to create new products. You will work with researchers, engineers, and product managers in a startup...
Amazon
Seattle, WA4 days ago - ...infrastructure and software that supports the entire digital ecosystem. We are looking for a talented DevOps/SRE Engineer to join our AI Inference Operations Team. Job Description The employee will be dedicated full-time to ensuring the security and license...Full timeRemote workFlexible hours
- ...OpenAI, Inc. in Seattle is looking for a Developer Productivity Engineer to accelerate the inferencing stack through improved tooling,... ...model launches reliable and scalable. You’ll collaborate with inference teams and researchers to reduce friction, diagnose complex...
OpenAI, Inc.
Seattle, WA11 hours ago - ...us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated AI inference workloads. You will profile, diagnose, and explain...
AMD
Santa Clara, CA2 days ago
