Software Engineer, ML infrastructure, Core Inference, Level 4
$157k - $235kSnap Inc.
Snap Inc is a technology company. We believe the camera presents the greatest opportunity to improve the way people live and communicate. Snap contributes to human progress by empowering people to express themselves, live in the moment, learn about the world, and have fun together.The Company operates Snapchat, a visual messaging app that enhances your relationships with friends, family, and the world, and Specs Inc., a wholly-owned subsidiary dedicated to making computing more human, in addition to Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically sophisticated products that reach hundreds of millions of Snapchatters around the world, every day. We’re deeply committed to the well-being of everyone in our global community, which is why our values are at the root of everything we do. We move fast, with precision, and always execute with privacy at the forefront.We’re looking for a Software Engineer to join the Core Inference team, part of the core ML Platform organization. Our team builds and owns the machine learning infrastructure that powers personalized experiences across Snap. As a centralized ML platform team, we enable teams across the company to deploy, optimize, and serve sophisticated machine learning models reliably and efficiently at scale.We own the end-to-end inference stack for recommendation models, embedding-generation models, and self-hosted large language models. Our platform supports nearly every major organization at Snap, including Ads, Content, Growth, Lenses, Security, and My AI.What you’ll do:Support the models powering personalized experiences across Discover, Stories, Spotlight, and other Snap products with ranking needs.Optimize, export, and prepare models for efficient production use while working across training and inference.Own the infrastructure used to host and serve recommendation models, embedding-generation models, and self-hosted LLMs.Work on LLM fine-tuning, reinforcement learning infrastructure, serving, and inference optimization.Provide model-hosting and serving capabilities to teams across Ads, Content, Growth, Lenses, Security, My AI, and other product areas.Own the inference components that power advertising models, while Ads teams generally own the ad products, formats, modeling objectives, and ranking strategies.Provide ranking and ML infrastructure for products such as Camera, Creative Tools, Maps, Chat, Memories, Games, and Minis when those products require model hosting or serving.Knowledge, Skills & Abilities:Strong programming skills in Python, JavaStrong problem-solving skills with a focus on system performance, scalability, and efficiencyGood understanding of distributed systems and the infrastructure components of large-scale ML Experience with big data processing frameworks such as Spark, Flink, or RayAbility to collaborate and work well with othersProven track record of operating highly-available systems at significant scaleAbility to proactively learn new concepts and apply them at workAdaptability in learning and applying evolving AI systems and tools to remain at the forefront of engineering trends and modern development practicesMinimum Qualifications:Bachelor’s degree in a technical field such as computer science or equivalent experience2+ years of post-Bachelor’s software development experience; or Master’s degree in a technical field + 1+ year of post-grad software development experience; or PhD in a relevant technical fieldExperience building large scale production machine learning systems, distributed systems or big data processingPreferred Qualifications:Masters/PhD in a technical field such as computer science or equivalent industry experienceExperience working with ML Training platforms or optimizing AI model inferenceFamiliarity with ML frameworks such as TensorFlow, PyTorch, Caffe2, Spark ML, scikit-learn, or related frameworks"Default Together" Policy at Snap: At Snap Inc. we believe that being together in person helps us build our culture faster, reinforce our values, and serve our community, customers and partners better through dynamic collaboration. To reflect this, we practice a “default together” approach and expect our team members to work in an office 4+ days per week. At Snap, we believe that having a team of diverse backgrounds and voices working together will enable us to create innovative products that improve the way people live and communicate. Snap is proud to be an equal opportunity employer, and committed to providing employment opportunities regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, pregnancy, childbirth and breastfeeding, age, sexual orientation, military or veteran status, or any other protected classification, in accordance with applicable federal, state, and local laws. EOE, including disability/vets.We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, where applicable).Our Benefits: Snap Inc. is its own community, so we’ve got your back! We do our best to make sure you and your loved ones have everything you need to be happy and healthy, on your own terms. Our benefits are built around your needs and include paid parental leave, comprehensive medical coverage, emotional and mental health support programs, and compensation packages that let you share in Snap’s long-term success!CompensationIn the United States, work locations are assigned a pay zone which determines the salary range for the position. The successful candidate’s starting pay will be determined based on job-related skills, experience, qualifications, work location, and market conditions. The starting pay may be negotiable within the salary range for the position.These pay zones may be modified in the future.Zone A (CA, WA, NYC):The base salary range for this position is $157,000-$235,000 annually.Zone B: The base salary range for this position is $149,000-$223,000 annually.Zone C:The base salary range for this position is $133,000-$200,000 annually.This position is eligible for equity in the form of RSUs.If you believe this job description is missing required pay transparency information, please submit a report through this form:Job Description Pay Range Disclosure.SummaryLocation: Bellevue, Washington; Palo Alto, California; Los Angeles, CaliforniaType: Full time
$160.36k - $240.54k
...physical AI company developing Level 4 autonomous driving technology... ...investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams... ....Maintain an in-house ML inference platform to serve large language...SuggestedImmediate startFlexible hours$209k - $313k
...digital services.Snap Engineering teams build fun... ...looking for a Software Engineer to join the ML Platform... ...team, part of the core ML Platform organization... ...and optimize infrastructure systems for... ...high-performance inference systems to ensure... ...work in an office 4+ days per week....SuggestedFull timeLive inWork at officeLocal area$160.36k - $240.54k
...physical AI company developing Level 4 autonomous driving... ...RoleNuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration,... ...processing to join our ML Infrastructure team. In... ...building and evolving the core platform that provides researchers...SuggestedImmediate startFlexible hours$193.93k - $352.29k
...company developing Level 4 autonomous... ...fungible is the infrastructure that decides whether... ...inside Nuro's own engineering organization, under... ...You3+ years of software engineering experience... ...the hood at inference. Attention and KV... ....Experience with ML training or research...SuggestedImmediate startFlexible hours$152k - $228k
...company developing Level 4 autonomous... ...different aspects of the software and hardware... ...code change, from ML model updates to radius... ...You will own the infrastructure that makes this possible... ...much much more.Engineers across the company... ...You treat AI as a core part of your...SuggestedTemporary workImmediate startFlexible hours$193.3k - $261.5k
...looking for an engineer to work at the frontier... ...disaggregated inference: splitting LLM... ...the low-level data-movement software across accelerators... ...a plus.Prior AI/ML experience is welcome... ...edge of AI/ML infrastructure.About the team:... ...respect WLB as a core org tenet. The team...InternshipLocal areaFlexible hours$165.2k - $223.6k
...looking for an engineer to work at the frontier... ...disaggregated inference: splitting LLM... ...the low-level data-movement software that transfers KV... ...welcome.Prior AI/ML experience is not... ...leading edge of AI/ML infrastructure.About the team:... ...WLB as a core org tenet. The team...InternshipLocal areaFlexible hours$193.93k - $291.15k
...company developing Level 4 autonomous driving... ...output generalists where ML and systems engineering converge to push... ...Perception ML Data Infrastructure Engineer, you will own... ...take ownership of our core native perception... ...in Computer Science, Software Engineering, Robotics...Immediate startFlexible hours$160.36k - $240.54k
...AI company developing Level 4 autonomous driving technology... ....About the RoleOur software team is growing, and... ...looking for talented engineers to join us and be... ...Simulation, and Technical Infrastructure.Data Platform: The... ...setting. We work on the core simulator and simulation...Immediate startFlexible hours$102.1k - $202.2k
...than 25%Profession: Software EngineeringDiscipline... ...MicrosoftOverviewSoftware engineer role in Cloud + AI... ...services to the inference infrastructure serving cutting-edge... ...equivalent experience.Core technical competencies... ...design, understanding of ML/AI fundamentals and...Ongoing contractLocal area3 days per week$157k - $235k
...digital services.Some core features we build... ..., and Minis. Our Infrastructure teams deliver an... ...Reality. As a Snap Engineering team member, you’... ...alerting, service-level objectives, capacity... ...experience.4+ years of full-stack... ...stack application or software engineering...Full timeLive inWork at officeLocal area$119.8k - $234.7k
...%Profession: Software EngineeringDiscipline... ...stack and is core to Azure AI... ..., Azure ML, Cognitive... ...global Azure AI infrastructure for running... ...of all skill levels to easily create... ...Software Engineer - Responsible... ...technical field AND 4+ years... ...models and agents Inference, routing,...Ongoing contractWork at officeLocal area3 days per week$208k - $333.5k
...The Contract Manufacturing infrastructure team is seeking... ...NVIDIA manufacturing sites core services, enable new sites... ...down. This is a hands-on engineer position focused on the development... ...workloads and GPU‑dense AI/ML training and inference environments.Partner with...Full timeContract work$188.5k - $282.7k
...possible with enterprise AI infrastructure.Nature of the... ...disparate environments.Engineering secure "Landing Zones"... ...optimizing for low-latency AI inference and data throughput.... ...junior and mid-level engineers on complex systems... ...issues.Redesigning core infrastructure components...$184k - $287.5k
...models for maximal inference efficiency using techniques... ...an innovative software platform (TRT Model... ...by research and engineering teams alike developing... ...working in high-level frameworks like PyTorch... ..., and related ML tools (e.g. HuggingFace... ...,500 USD for Level 4, and 224,000 USD -...Full time- ...company developing Level 4 autonomous driving... ...About the Role As a software engineering intern, you will... ...Platform, Onboard Systems, ML Infrastructure, Simulation, or... ...training and onboard inference. Our solutions include... .... We work on the core simulator and simulation...InternshipImmediate startFlexible hours
$160.36k - $240.54k
...AI company developing Level 4 autonomous driving technology... ...technology. In an ML-first system, the... ...scalable and reliable data infrastructure. This infrastructure... ...closely with system engineers to thoroughly validate... ...practices across broader software organizationA bachelor...Immediate startFlexible hours$198k - $326k
...team. The Streams Infrastructure team at LinkedIn builds... ..., while over 4+ trillion messages... .... As a Sr. Staff Software Engineer, you will be a key... ...building best-in-class core systems... ...actively improve the level of craftsmanship at... ...infrastructure, IaaS, ML/AI infrastructure,...For contractorsWork at officeFlexible hours- ...leading training and inference speeds; over 10... ...hiring a Staff Engineer to own major... ...technical areas.Core Cloud Systems. Design... .... Drive system-level improvements in... .... Partner with ML, Product, Infrastructure, and Platform... ...of experience in software engineering, with...
- ...industry-leading training and inference speeds; over 10 times... ...About the RoleWe're hiring a Software Engineer to help contribute to... ...clear SLOs. Drive system-level improvements in latency, throughput... ...Influence. Partner with ML, Product, Infrastructure, and Cloud teams to...
- ...industry-leading training and inference speeds; over 10 times faster than... ...inference.About the TeamThe Core Infrastructure team builds the software systems that power engineering workflows across Cerebras.Our... ...platform, CI, release, quality, ML systems, and product...Remote work
$175k - $287k
...the team. LinkedIn’s Core AI is building the... ...for tracing infrastructure for all LinkedIn AI Agents.As a Staff Engineer, you will own the end... ...AI product teams, ML engineers, and infrastructure... ...learning systems.4+ years of... ...for employees of all levels. LinkedIn is committed...For contractorsWork experience placementWork at officeFlexible hours$182k - $242k
...combines superior infrastructure performance with deep... ...for a Senior Engineer to be a driving force... ...training and inference workloads. You will... ...network fabric and GPU-level behavior... ...infrastructure or ML systems rather than... ...represented through our core values: Be Curious...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$276k - $414k
...other digital services.Snap Engineering teams build fun and technically... ...with leadership to up-level the ML tech stack and improve the performance... ...programming and software design skillsAbility to proactively... ...members to work in an office 4+ days per week. At Snap, we...Full timeLive inWork at officeLocal area$168k - $264.5k
...world.Join NVIDIA’s CAD Infrastructure team and be part of... ...building a next-generation software platform for... ...endeavor, and we need engineers who thrive in a hands-... ...based systems.Exposure to ML or agentic tooling, particularly... ...USD - 264,500 USD for Level 4, and 196,000 USD - 31...Full time$245.4k - $429.45k
...recruiting process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions of... ...AI.Pinterest’s Product ML Infrastructure (PMLI) team enables fast,... ...solutions across Ads and Core critical products. We... ...data, training, feature, and inference infrastructure; this role...Work at officeLocal areaRemote workRelocationRelocation package$258k - $387k
...physical AI company developing Level 4 autonomous driving... ...About the RoleAs a Principal Software Engineer, you will help define and build... ...direction of Nuro’s onboard infrastructure. We are looking for a technical... ...Onboard Systems.Architect core onboard systems for embedded...Immediate startFlexible hours$175k - $287k
...privately managed compute infrastructures in the world outside... ...providers. As a Staff Software Engineer on the Compute... ...petabytes daily, and the AI/ML infrastructure driving... ...experience, or PhD and 4+ years of relevant... ...for employees of all levels. LinkedIn is committed...For contractorsWork experience placementWork at officeFlexible hours$145k - $200k
...builds the world’s leading software for data-driven... ...Role We are a software engineering team with expertise in enabling ML models in production. We... ...across the full stack, from inference engines, GPU scheduling... ...at the intersection of infrastructure and machine learning...Full timeWork experience placementWork at officeRemote workWork from homeRelocation package$184k - $287.5k
...built. We are seeking a Senior Software Engineer - AI Inference Performance to advance... ...model quality, and service-level objectives.Build and optimize... ...architecture, including Tensor Cores, memory hierarchy, caches, occupancy... ...USD - 287,500 USD for Level 4, and 224,000 USD - 356,500...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML infrastructure, Core Inference, Level 4. Be the first to apply!
- scientific software engineer Palo Alto, CA
- intel software engineer Palo Alto, CA
- director software engineering Palo Alto, CA
- software engineer Palo Alto, CA
- senior robotics software engineer Palo Alto, CA
- financial software developer Palo Alto, CA
- graduate software developer Palo Alto, CA
- part time software developer remote Palo Alto, CA
- software engineer remote Palo Alto, CA
- part time software developer Palo Alto, CA



