Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, ML infrastructure, Core Inference, Level 4

$157k - $235k

Snap Inc.

Snap Inc is a technology company. We believe the camera presents the greatest opportunity to improve the way people live and communicate. Snap contributes to human progress by empowering people to express themselves, live in the moment, learn about the world, and have fun together.The Company operates Snapchat, a visual messaging app that enhances your relationships with friends, family, and the world, and Specs Inc., a wholly-owned subsidiary dedicated to making computing more human, in addition to Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically sophisticated products that reach hundreds of millions of Snapchatters around the world, every day. We’re deeply committed to the well-being of everyone in our global community, which is why our values are at the root of everything we do. We move fast, with precision, and always execute with privacy at the forefront.We’re looking for a Software Engineer to join the Core Inference team, part of the core ML Platform organization. Our team builds and owns the machine learning infrastructure that powers personalized experiences across Snap. As a centralized ML platform team, we enable teams across the company to deploy, optimize, and serve sophisticated machine learning models reliably and efficiently at scale.We own the end-to-end inference stack for recommendation models, embedding-generation models, and self-hosted large language models. Our platform supports nearly every major organization at Snap, including Ads, Content, Growth, Lenses, Security, and My AI.What you’ll do:Support the models powering personalized experiences across Discover, Stories, Spotlight, and other Snap products with ranking needs.Optimize, export, and prepare models for efficient production use while working across training and inference.Own the infrastructure used to host and serve recommendation models, embedding-generation models, and self-hosted LLMs.Work on LLM fine-tuning, reinforcement learning infrastructure, serving, and inference optimization.Provide model-hosting and serving capabilities to teams across Ads, Content, Growth, Lenses, Security, My AI, and other product areas.Own the inference components that power advertising models, while Ads teams generally own the ad products, formats, modeling objectives, and ranking strategies.Provide ranking and ML infrastructure for products such as Camera, Creative Tools, Maps, Chat, Memories, Games, and Minis when those products require model hosting or serving.Knowledge, Skills & Abilities:Strong programming skills in Python, JavaStrong problem-solving skills with a focus on system performance, scalability, and efficiencyGood understanding of distributed systems and the infrastructure components of large-scale ML Experience with big data processing frameworks such as Spark, Flink, or RayAbility to collaborate and work well with othersProven track record of operating highly-available systems at significant scaleAbility to proactively learn new concepts and apply them at workAdaptability in learning and applying evolving AI systems and tools to remain at the forefront of engineering trends and modern development practicesMinimum Qualifications:Bachelor’s degree in a technical field such as computer science or equivalent experience2+ years of post-Bachelor’s software development experience; or Master’s degree in a technical field + 1+ year of post-grad software development experience; or PhD in a relevant technical fieldExperience building large scale production machine learning systems, distributed systems or big data processingPreferred Qualifications:Masters/PhD in a technical field such as computer science or equivalent industry experienceExperience working with ML Training platforms or optimizing AI model inferenceFamiliarity with ML frameworks such as TensorFlow, PyTorch, Caffe2, Spark ML, scikit-learn, or related frameworks"Default Together" Policy at Snap: At Snap Inc. we believe that being together in person helps us build our culture faster, reinforce our values, and serve our community, customers and partners better through dynamic collaboration. To reflect this, we practice a “default together” approach and expect our team members to work in an office 4+ days per week. At Snap, we believe that having a team of diverse backgrounds and voices working together will enable us to create innovative products that improve the way people live and communicate. Snap is proud to be an equal opportunity employer, and committed to providing employment opportunities regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, pregnancy, childbirth and breastfeeding, age, sexual orientation, military or veteran status, or any other protected classification, in accordance with applicable federal, state, and local laws. EOE, including disability/vets.We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, where applicable).Our Benefits: Snap Inc. is its own community, so we’ve got your back! We do our best to make sure you and your loved ones have everything you need to be happy and healthy, on your own terms. Our benefits are built around your needs and include paid parental leave, comprehensive medical coverage, emotional and mental health support programs, and compensation packages that let you share in Snap’s long-term success!CompensationIn the United States, work locations are assigned a pay zone which determines the salary range for the position. The successful candidate’s starting pay will be determined based on job-related skills, experience, qualifications, work location, and market conditions. The starting pay may be negotiable within the salary range for the position.These pay zones may be modified in the future.Zone A (CA, WA, NYC):The base salary range for this position is $157,000-$235,000 annually.Zone B: The base salary range for this position is $149,000-$223,000 annually.Zone C:The base salary range for this position is $133,000-$200,000 annually.This position is eligible for equity in the form of RSUs.If you believe this job description is missing required pay transparency information, please submit a report through this form:Job Description Pay Range Disclosure.SummaryLocation: Bellevue, Washington; Palo Alto, California; Los Angeles, CaliforniaType: Full time

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, ML infrastructure, Core Inference, Level 4 in Palo Alto, CA vacancy
  • $160.36k - $240.54k

     ...physical AI company developing Level 4 autonomous driving technology...  ...investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams...  ....Maintain an in-house ML inference platform to serve large language... 
    Suggested
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $209k - $313k

     ...digital services.Snap Engineering teams build fun...  ...looking for a Software Engineer to join the ML Platform...  ...team, part of the core ML Platform organization...  ...and optimize infrastructure systems for...  ...high-performance inference systems to ensure...  ...work in an office 4+ days per week.... 
    Suggested
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    1 day ago
  • $160.36k - $240.54k

     ...physical AI company developing Level 4 autonomous driving...  ...RoleNuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration,...  ...processing to join our ML Infrastructure team. In...  ...building and evolving the core platform that provides researchers... 
    Suggested
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $193.93k - $352.29k

     ...company developing Level 4 autonomous...  ...fungible is the infrastructure that decides whether...  ...inside Nuro's own engineering organization, under...  ...You3+ years of software engineering experience...  ...the hood at inference. Attention and KV...  ....Experience with ML training or research... 
    Suggested
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $152k - $228k

     ...company developing Level 4 autonomous...  ...different aspects of the software and hardware...  ...code change, from ML model updates to radius...  ...You will own the infrastructure that makes this possible...  ...much much more.Engineers across the company...  ...You treat AI as a core part of your... 
    Suggested
    Temporary work
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $193.3k - $261.5k

     ...looking for an engineer to work at the frontier...  ...disaggregated inference: splitting LLM...  ...the low-level data-movement software across accelerators...  ...a plus.Prior AI/ML experience is welcome...  ...edge of AI/ML infrastructure.About the team:...  ...respect WLB as a core org tenet. The team... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $165.2k - $223.6k

     ...looking for an engineer to work at the frontier...  ...disaggregated inference: splitting LLM...  ...the low-level data-movement software that transfers KV...  ...welcome.Prior AI/ML experience is not...  ...leading edge of AI/ML infrastructure.About the team:...  ...WLB as a core org tenet. The team... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $193.93k - $291.15k

     ...company developing Level 4 autonomous driving...  ...output generalists where ML and systems engineering converge to push...  ...Perception ML Data Infrastructure Engineer, you will own...  ...take ownership of our core native perception...  ...in Computer Science, Software Engineering, Robotics... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $160.36k - $240.54k

     ...AI company developing Level 4 autonomous driving technology...  ....About the RoleOur software team is growing, and...  ...looking for talented engineers to join us and be...  ...Simulation, and Technical Infrastructure.Data Platform: The...  ...setting. We work on the core simulator and simulation... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    20 hours ago
  • $102.1k - $202.2k

     ...than 25%Profession: Software EngineeringDiscipline...  ...MicrosoftOverviewSoftware engineer role in Cloud + AI...  ...services to the inference infrastructure serving cutting-edge...  ...equivalent experience.Core technical competencies...  ...design, understanding of ML/AI fundamentals and... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    3 days ago
  • $157k - $235k

     ...digital services.Some core features we build...  ..., and Minis. Our Infrastructure teams deliver an...  ...Reality. As a Snap Engineering team member, you’...  ...alerting, service-level objectives, capacity...  ...experience.4+ years of full-stack...  ...stack application or software engineering... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    1 day ago
  • $119.8k - $234.7k

     ...%Profession: Software EngineeringDiscipline...  ...stack and is core to Azure AI...  ..., Azure ML, Cognitive...  ...global Azure AI infrastructure for running...  ...of all skill levels to easily create...  ...Software Engineer - Responsible...  ...technical field AND 4+ years...  ...models and agents Inference, routing,... 
    Ongoing contract
    Work at office
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    1 day ago
  • $208k - $333.5k

     ...The Contract Manufacturing infrastructure team is seeking...  ...NVIDIA manufacturing sites core services, enable new sites...  ...down. This is a hands-on engineer position focused on the development...  ...workloads and GPU‑dense AI/ML training and inference environments.Partner with... 
    Full time
    Contract work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $188.5k - $282.7k

     ...possible with enterprise AI infrastructure.Nature of the...  ...disparate environments.Engineering secure "Landing Zones"...  ...optimizing for low-latency AI inference and data throughput....  ...junior and mid-level engineers on complex systems...  ...issues.Redesigning core infrastructure components... 

    Rubrik

    Palo Alto, CA
    1 day ago
  • $184k - $287.5k

     ...models for maximal inference efficiency using techniques...  ...an innovative software platform (TRT Model...  ...by research and engineering teams alike developing...  ...working in high-level frameworks like PyTorch...  ..., and related ML tools (e.g. HuggingFace...  ...,500 USD for Level 4, and 224,000 USD -... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...company developing Level 4 autonomous driving...  ...About the Role As a software engineering intern, you will...  ...Platform, Onboard Systems, ML Infrastructure, Simulation, or...  ...training and onboard inference. Our solutions include...  .... We work on the core simulator and simulation... 
    Internship
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $160.36k - $240.54k

     ...AI company developing Level 4 autonomous driving technology...  ...technology. In an ML-first system, the...  ...scalable and reliable data infrastructure. This infrastructure...  ...closely with system engineers to thoroughly validate...  ...practices across broader software organizationA bachelor... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    20 hours ago
  • $198k - $326k

     ...team. The Streams Infrastructure team at LinkedIn builds...  ..., while over 4+ trillion messages...  .... As a Sr. Staff Software Engineer, you will be a key...  ...building best-in-class core systems...  ...actively improve the level of craftsmanship at...  ...infrastructure, IaaS, ML/AI infrastructure,... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  •  ...leading training and inference speeds; over 10...  ...hiring a Staff Engineer to own major...  ...technical areas.Core Cloud Systems. Design...  .... Drive system-level improvements in...  .... Partner with ML, Product, Infrastructure, and Platform...  ...of experience in software engineering, with... 

    Cerebras Systems

    Sunnyvale, CA
    20 hours ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...About the RoleWe're hiring a Software Engineer to help contribute to...  ...clear SLOs. Drive system-level improvements in latency, throughput...  ...Influence. Partner with ML, Product, Infrastructure, and Cloud teams to... 

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ...inference.About the TeamThe Core Infrastructure team builds the software systems that power engineering workflows across Cerebras.Our...  ...platform, CI, release, quality, ML systems, and product... 
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $175k - $287k

     ...the team. LinkedIn’s Core AI is building the...  ...for tracing infrastructure for all LinkedIn AI Agents.As a Staff Engineer, you will own the end...  ...AI product teams, ML engineers, and infrastructure...  ...learning systems.4+ years of...  ...for employees of all levels. LinkedIn is committed... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    20 hours ago
  • $182k - $242k

     ...combines superior infrastructure performance with deep...  ...for a Senior Engineer to be a driving force...  ...training and inference workloads. You will...  ...network fabric and GPU-level behavior...  ...infrastructure or ML systems rather than...  ...represented through our core values: Be Curious... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • $276k - $414k

     ...other digital services.Snap Engineering teams build fun and technically...  ...with leadership to up-level the ML tech stack and improve the performance...  ...programming and software design skillsAbility to proactively...  ...members to work in an office 4+ days per week. At Snap, we... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    1 day ago
  • $168k - $264.5k

     ...world.Join NVIDIA’s CAD Infrastructure team and be part of...  ...building a next-generation software platform for...  ...endeavor, and we need engineers who thrive in a hands-...  ...based systems.Exposure to ML or agentic tooling, particularly...  ...USD - 264,500 USD for Level 4, and 196,000 USD - 31... 
    Full time

    Nvidia

    Santa Clara, CA
    20 hours ago
  • $245.4k - $429.45k

     ...recruiting process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions of...  ...AI.Pinterest’s Product ML Infrastructure (PMLI) team enables fast,...  ...solutions across Ads and Core critical products. We...  ...data, training, feature, and inference infrastructure; this role... 
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    1 day ago
  • $258k - $387k

     ...physical AI company developing Level 4 autonomous driving...  ...About the RoleAs a Principal Software Engineer, you will help define and build...  ...direction of Nuro’s onboard infrastructure. We are looking for a technical...  ...Onboard Systems.Architect core onboard systems for embedded... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    3 days ago
  • $175k - $287k

     ...privately managed compute infrastructures in the world outside...  ...providers. As a Staff Software Engineer on the Compute...  ...petabytes daily, and the AI/ML infrastructure driving...  ...experience, or PhD and 4+ years of relevant...  ...for employees of all levels. LinkedIn is committed... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  • $145k - $200k

     ...builds the world’s leading software for data-driven...  ...Role We are a software engineering team with expertise in enabling ML models in production. We...  ...across the full stack, from inference engines, GPU scheduling...  ...at the intersection of infrastructure and machine learning... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package

    Palantir Technologies

    Palo Alto, CA
    1 day ago
  • $184k - $287.5k

     ...built. We are seeking a Senior Software Engineer - AI Inference Performance to advance...  ...model quality, and service-level objectives.Build and optimize...  ...architecture, including Tensor Cores, memory hierarchy, caches, occupancy...  ...USD - 287,500 USD for Level 4, and 224,000 USD - 356,500... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, ML infrastructure, Core Inference, Level 4. Be the first to apply!