Software Engineer, AI Inference Platform
jobs.frontdoordefense.com - Jobboard
SambaNova Systems in Palo Alto, California is seeking a Software Engineer to build and scale the AI inference platform. This role involves working with a cloud-agnostic platform, ensuring system stability, and collaborating with cross-functional teams. Candidates should have 4+ years of Software Engineering experience, strong skills in Python, Go, and Rust, and a solid understanding of Kubernetes. A competitive benefits package including health insurance, wellness programs, and more is offered. #J-18808-Ljbffr jobs.frontdoordefense.com - Jobboard
$119.8k - $234.7k
...Fortune 500 enterprises. Ourconverged AI fabricdelivers inference capabilities for all LLMs... ...Cohere, Llama, and more. As a Senior Software Engineer , you will shape the future of one... ...Build large-scale AI services and platform capabilities that power new products...PlatformOngoing contractLocal area- We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for... ...semantic search, retrieval, and AI-native experiences in MongoDB... ...infrastructure systems at scale Strong software engineering skills in languages...PlatformLocal areaWorldwide
$187.5k - $395k
...About Luma AI Luma's mission is to build multimodal AI to expand human imagination... ...by integrating them into our inference engine Collaborate closely across research,... ...processing/optimizing model checkpoints, platform components, and SDKs for internal teams...Platform- ...computing experiences-from AI and data centers, to... ...LLM and Multimodal inference at scale across multi-... ...collaborate across internal GPU software teams and engage with... ...: Skilled engineer with strong technical... ...across AMD GPU platforms for LLM, multimodal serving...Platform
$152k - $204k
...Senior Software Engineer, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted...PlatformPermanent employmentTemporary workCasual workWork at officeFlexible hoursShift work- ...computing experiences-from AI and data centers, to... ...member of the LLM inference framework team, you will... ...deployments and benchmarking platforms (e.g., InferenceMax,... ...intersection of inference engines, distributed systems,... ...development Software Engineering ~ Expertise...Platform
$139k - $204k
...Senior Software Engineer I, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence....PlatformPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$152k - $241.5k
NVIDIA is the platform upon which every new AI‑powered application is built. We are seeking a Senior Software Engineer - AI Inference to advance open‑source LLM serving by contributing directly to upstream inference engines like vLLM and SGLang-ensuring they run best‑in...Platform$92k - $135k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and... ...What You'll Do: Join the Inference team to ship production features... ...with mentorship from experienced engineers. About the role:...PlatformPermanent employmentTemporary workCasual workInternshipWork at officeFlexible hours- A leading data platform company in Palo Alto seeks a Senior Engineer to develop a cutting-edge inference platform supporting semantic search and AI-native experiences. The ideal candidate will have over five years of experience in backend systems and proficiency in languages...Platform
$184k - $287.5k
...Overview We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme... ...as containerd/CRI‑O/CRIU. Experience with cloud platforms (AWS/GCP/Azure), infrastructure as code, CI/CD, and...Platform$236k - $339.25k
...Machine Learning Platform Team Member At Snowflake, we are powering the era of the agentic... .... To usher in this new era, we seek AI-native thinkers across every function who... .... Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang,...PlatformFlexible hours- ...for a Senior ML Infrastructure Engineer in Mountain View, California. This... ...aims to build and scale robust platforms for ML inference workflows supporting GM’s AI efforts. You will collaborate with... ...strategies and handle backend software components. The position demands...PlatformRemote job
- ...Mountain View is seeking a Machine Learning Engineer to build and optimize the infrastructure for its Intelligence Composition Platform. The role involves designing and deploying... ...multimodal data understanding, optimizing inference pipelines, and collaborating with teams to...Platform
- ...Tech Lead, Data & Inference Engineer Palo Alto, California, United States About the Job... ...precision targetable audiences across platforms such as Meta, Google and YouTube, they... ...with a specialized vertical in Applied AI, Machine Learning, and Data Science. We...PlatformFull time
$160k - $240k
...profound opportunity for AI to drive positive... ...a universal autonomy platform: self-driving for all... ...looking for self-motivated engineers to build the next-... ...Collaborate with other software teams to build foundational... ...experience, ML inference optimization experience...PlatformImmediate startFlexible hours$160k - $230k
...this new era, we seek AI-native thinkers across... ...Performance Group (APG) Engineering team provides a highly... ...the best Cloud Data Platform in the industry. A... ...Apache Flink, etc.) Software development experience... ...for training and inference). University degree...PlatformFlexible hours- ...Software Engineer, Product Palo Alto, CA About the Role RadixArk... ...developer-facing surfaces of our inference and training infrastructure.... ...to turn cutting-edge AI infrastructure into delightful... ...RadixArk's inference and training platforms. Build and maintain...PlatformFull time
$102.1k - $202.2k
...competitive, and hardcore AI/ML frameworks team with... ...at Microsoft develops software that pushes the cutting... ...As a Software Engineer on our team, you would... ...Runtime : ONNX based cross-platform, high performance ML inferencing... ...: an on-device AI inference solution offering...PlatformOngoing contractWork at officeLocal areaRemote work3 days per week$135.8k - $237.05k
...Mountain View, CA, USA Senior Backend Engineer, ML Inference Systems Location Mountain View, CA, USA Department AI & Machine Learning Requisition ID JOBREQ... ...Drive technical direction of our inference platform, with a focus on low-latency, high-...PlatformWork at officeWorldwideRelocation package- ...Software Engineer, AI Compute Infrastructure Los Angeles, Palo Alto, San Francisco, Toronto, Singapore... ...the robust, efficient, and scalable platform that enables our research and... ...utilization across thousands of devices for inference, training, data processing and large-...PlatformFull time
$188k - $275k
...Staff Software Engineer, Inference CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups...PlatformPermanent employmentTemporary workCasual workWork at officeFlexible hours- ...world's first real-time speech AI platform capable of accent... ...model innovation and systems engineering with a design‑minded product... ...infrastructure that serves model inference and training for our cutting... ...Qualifications 5+ years of Software Engineering experience, preferably...Platform
$152k - $241.5k
Senior Software Engineer - Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning...Platform$167.2k - $250.8k
...hardware with our generalized AI‑first self‑driving software. Built to learn and... ...looking for strong software engineers to research, develop, and... ...technologies on real vehicle platforms in a safe, performant,... ...distributed training, or inference optimization. Equal‑Opportunity...PlatformImmediate start- Software Engineer Build and scale the SambaStack AI inference platform for enterprise deployments Location: Palo Alto, California, United States About the Role The era of pervasive AI has arrived. Generative AI unlocks hidden value in data, accelerates processes, reduces...PlatformTemporary workLocal areaFlexible hours
$145k - $165k
...for a Machine Learning Engineer II to help build and ship... ...machine learning and software engineering who is excited... ...engineering, data, and platform partners to translate... ...building ML or AI-related systems, or strong... ...recommendation systems or casual inference Familiarity with big...PlatformWork experience placementCasual workWork at officeFlexible hours$160.36k - $240.54k
...Software Engineer, ML Infrastructure, Optimization Mountain View, California... ...profound opportunity for AI to drive positive change in... ...a universal autonomy platform: self-driving for all roads... ...quantization, low precision inference, and model pruning. Work...PlatformWork experience placementImmediate startFlexible hours$272k - $431.25k
NVIDIA is the platform for every new AI-powered application. We seek a Principal Software Engineer - AI Inference to advance open-source LLM serving. This role involves contributing to upstream inference engines like vLLM and SGLang. You will ensure they run outstandingly...Platform$272k - $431.25k
NVIDIA Gruppe is looking for a Principal Software Engineer to advance open-source AI inference. This hands-on role emphasizes running high-performance inference on NVIDIA platforms and involves collaboration across various teams. Key responsibilities include optimizing...Platform
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, AI Inference Platform. Be the first to apply!
- software developer internship no experience Palo Alto, CA
- federal - software developer Palo Alto, CA
- research software engineer Palo Alto, CA
- software engineer contract Palo Alto, CA
- part time software developer Palo Alto, CA
- software engineer healthcare Palo Alto, CA
- network software engineer Palo Alto, CA
- ngo software engineer Palo Alto, CA
- software development engineer aws Palo Alto, CA
- software developer internship Palo Alto, CA


