Software Engineer, ML Infrastructure, Core Inference, Level 4
$133k - $200kSnap Inc.
The Company operates Snapchat a visual messaging app that enhances your relationships with friends family and the world and Specs Inc. a wholly-owned subsidiary dedicated to making computing more human in addition to Bitmoji Saturn and other digital services.
Were looking for a Software Engineer to join the Core Inference team part of the core ML Platform organization. Our team builds and owns the machine learning infrastructure that powers personalized experiences across Snap. As a centralized ML platform team we enable teams across the company to deploy optimize and serve sophisticated machine learning models reliably and efficiently at scale.
We own the end-to-end inference stack for recommendation models embedding-generation models and self-hosted large language models. Our platform supports nearly every major organization at Snap including Ads Content Growth Lenses Security and My AI.What youll do:
- Support the models powering personalized experiences across Discover Stories Spotlight and other Snap products with ranking needs.
- Optimize export and prepare models for efficient production use while working across training and inference.
- Own the infrastructure used to host and serve recommendation models embedding-generation models and self-hosted LLMs.
- Work on LLM fine-tuning reinforcement learning infrastructure serving and inference optimization.
- Provide model-hosting and serving capabilities to teams across Ads Content Growth Lenses Security My AI and other product areas.
- Own the inference components that power advertising models while Ads teams generally own the ad products formats modeling objectives and ranking strategies.
- Provide ranking and ML infrastructure for products such as Camera Creative Tools Maps Chat Memories Games and Minis when those products require model hosting or serving.
Knowledge Skills & Abilities:
- Strong programming skills in Python Java
- Strong problem-solving skills with a focus on system performance scalability and efficiency
- Good understanding of distributed systems and the infrastructure components of large-scale ML
- Experience with big data processing frameworks such as Spark Flink or Ray
- Ability to collaborate and work well with others
- Proven track record of operating highly-available systems at significant scale
- Ability to proactively learn new concepts and apply them at work
- Adaptability in learning and applying evolving AI systems and tools to remain at the forefront of engineering trends and modern development practices
Minimum Qualifications:
- Bachelors degree in a technical field such as computer science or equivalent experience
- 2 years of post-Bachelors software development experience; or Masters degree in a technical field 1 year of post-grad software development experience; or PhD in a relevant technical field
- Experience building large scale production machine learning systems distributed systems or big data processing
Preferred Qualifications:
- Masters/PhD in a technical field such as computer science or equivalent industry experience
- Experience working with ML Training platforms or optimizing AI model inference
- Familiarity with ML frameworks such as TensorFlow PyTorch Caffe2 Spark ML scikit-learn or related frameworks
Default Together Policy at Snap: At Snap Inc. we believe that being together in person helps us build our culture faster reinforce our values and serve our community customers and partners better through dynamic collaboration. To reflect this we practice a default together approach and expect our team members to work in an office 4 days per week.
At Snap we believe that having a team of diverse backgrounds and voices working together will enable us to create innovative products that improve the way people live and communicate. Snap is proud to be an equal opportunity employer and committed to providing employment opportunities regardless of race religious creed color national origin ancestry physical disability mental disability medical condition genetic information marital status sex gender gender identity gender expression pregnancy childbirth and breastfeeding age sexual orientation military or veteran status or any other protected classification in accordance with applicable federal state and local laws. EOE including disability/vets.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example the requirements of the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring where applicable).
Compensation
In the United States work locations are assigned a pay zone which determines the salary range for the position. The successful candidates starting pay will be determined based on job-related skills experience qualifications work location and market conditions. The starting pay may be negotiable within the salary range for the position. These pay zones may be modified in the future.
The base salary range for this position is $157000-$235000 annually. The base salary range for this position is $149000-$223000 annually.:
The base salary range for this position is $133000-$200000 annually. This position is eligible for equity in the form of RSUs.If you believe this job description is missing required pay transparency information please submit a report through this form : Job Description Pay Range Disclosure .
Required Experience:
IC
$157k - $235k
...digital services.Snap Engineering teams build fun and... ....We’re looking for a Software Engineer to join the Core Inference team, part of the core ML Platform organization... ...the machine learning infrastructure that powers personalized... ...to work in an office 4+ days per week. At...SuggestedFull timeLive inWork at officeLocal area$157k - $235k
...services. Were looking for a Software Engineer to join the Core Inference team part of the core ML Platform organization. Our... ...and owns the machine learning infrastructure that powers personalized... ...members to work in an office 4 days per week. At Snap we...SuggestedFull timeWork at officeLocal area$209k - $313k
...digital services.Snap Engineering teams build fun... ...looking for a Software Engineer to join the ML Platform... ...team, part of the core ML Platform organization... ...and optimize infrastructure systems for... ...high-performance inference systems to ensure... ...work in an office 4+ days per week....SuggestedFull timeLive inWork at officeLocal area$160.36k - $240.54k
...physical AI company developing Level 4 autonomous driving technology... ...investors.About the RoleThe ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams... ....Maintain an in-house ML inference platform to serve large language...SuggestedImmediate startFlexible hours$193.93k - $291.15k
...physical AI company developing Level 4 autonomous driving... ...RoleNuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration,... ...processing to join our ML Infrastructure team. In... ...building and evolving the core platform that provides researchers...SuggestedImmediate startFlexible hours$183k - $275k
...company developing Level 4 autonomous... ...different aspects of the software and hardware... ...code change, from ML model updates to radius... ...You will own the infrastructure that makes this possible... ...much much more.Engineers across the company... ...You treat AI as a core part of your...Temporary workImmediate startFlexible hours$193.93k - $352.29k
...company developing Level 4 autonomous... ...fungible is the infrastructure that decides whether... ...inside Nuro's own engineering organization, under... ...You3+ years of software engineering experience... ...the hood at inference. Attention and KV... ....Experience with ML training or research...Immediate startFlexible hours$193.3k - $261.5k
...looking for an engineer to work at the frontier... ...disaggregated inference: splitting LLM... ...the low-level data-movement software across accelerators... ...a plus.Prior AI/ML experience is welcome... ...edge of AI/ML infrastructure.About the team:... ...respect WLB as a core org tenet. The team...InternshipLocal areaFlexible hours$165.2k - $223.6k
...looking for an engineer to work at the frontier... ...disaggregated inference: splitting LLM... ...the low-level data-movement software that transfers KV... ...welcome.Prior AI/ML experience is not... ...leading edge of AI/ML infrastructure.About the team:... ...WLB as a core org tenet. The team...InternshipLocal areaFlexible hours$193.93k - $291.15k
...company developing Level 4 autonomous driving... ...output generalists where ML and systems engineering converge to push... ...Perception ML Data Infrastructure Engineer, you will own... ...take ownership of our core native perception... ...in Computer Science, Software Engineering, Robotics...Immediate startFlexible hours$160.36k - $240.54k
...AI company developing Level 4 autonomous driving technology... ....About the RoleOur software team is growing, and... ...looking for talented engineers to join us and be... ...Simulation, and Technical Infrastructure.Data Platform: The... ...setting. We work on the core simulator and simulation...Immediate startFlexible hours$102.1k - $202.2k
...than 25%Profession: Software EngineeringDiscipline... ...MicrosoftOverviewSoftware engineer role in Cloud + AI... ...services to the inference infrastructure serving cutting-edge... ...equivalent experience.Core technical competencies... ...design, understanding of ML/AI fundamentals and...Ongoing contractLocal area3 days per week$162k - $260k
...forWe’re searching for a Senior Software Engineer, ML Evaluation & Introspection Infrastructure to join our Behavior Analysis team... ...as engineers do. You’ll own core pieces of that loop and help lead... ...ranges are determined by role, level, and location. Within the range,...Work at officeLocal area3 days per week$157k - $235k
...digital services.Some core features we build... ..., and Minis. Our Infrastructure teams deliver an... ...Reality. As a Snap Engineering team member, you’... ...alerting, service-level objectives, capacity... ...experience.4+ years of full-stack... ...stack application or software engineering...Full timeLive inWork at officeLocal area$119.8k - $234.7k
...%Profession: Software EngineeringDiscipline... ...stack and is core to Azure AI... ..., Azure ML, Cognitive... ...global Azure AI infrastructure for running... ...of all skill levels to easily create... ...Software Engineer - Responsible... ...technical field AND 4+ years... ...models and agents Inference, routing,...Ongoing contractWork at officeLocal area3 days per week$208k - $333.5k
...The Contract Manufacturing infrastructure team is seeking... ...NVIDIA manufacturing sites core services, enable new sites... ...down. This is a hands-on engineer position focused on the development... ...workloads and GPU‑dense AI/ML training and inference environments.Partner with...Full timeContract work$188.5k - $282.7k
...possible with enterprise AI infrastructure.Nature of the... ...disparate environments.Engineering secure "Landing Zones"... ...optimizing for low-latency AI inference and data throughput.... ...junior and mid-level engineers on complex systems... ...issues.Redesigning core infrastructure components...- ...company developing Level 4 autonomous driving... ...About the Role As a software engineering intern, you will... ...Platform, Onboard Systems, ML Infrastructure, Simulation, or... ...training and onboard inference. Our solutions include... .... We work on the core simulator and simulation...InternshipImmediate startFlexible hours
$184k - $287.5k
...models for maximal inference efficiency using techniques... ...an innovative software platform (TRT Model... ...by research and engineering teams alike developing... ...working in high-level frameworks like PyTorch... ..., and related ML tools (e.g. HuggingFace... ...,500 USD for Level 4, and 224,000 USD -...Full time- ...industry-leading training and inference speeds; over 10 times... ...About the RoleWe're hiring a Software Engineer to help contribute to... ...clear SLOs. Drive system-level improvements in latency, throughput... ...Influence. Partner with ML, Product, Infrastructure, and Cloud teams to...
$160.36k - $240.54k
...AI company developing Level 4 autonomous driving technology... ...technology. In an ML-first system, the... ...scalable and reliable data infrastructure. This infrastructure... ...closely with system engineers to thoroughly validate... ...practices across broader software organizationA bachelor...Immediate startFlexible hours- ...leading training and inference speeds; over 10... ...hiring a Staff Engineer to own major... ...technical areas.Core Cloud Systems. Design... .... Drive system-level improvements in... .... Partner with ML, Product, Infrastructure, and Platform... ...of experience in software engineering, with...
$198k - $326k
...team. The Streams Infrastructure team at LinkedIn builds... ..., while over 4+ trillion messages... .... As a Sr. Staff Software Engineer, you will be a key... ...building best-in-class core systems... ...actively improve the level of craftsmanship at... ...infrastructure, IaaS, ML/AI infrastructure,...For contractorsWork at officeFlexible hours- ...industry-leading training and inference speeds; over 10 times faster than... ...inference.About the TeamThe Core Infrastructure team builds the software systems that power engineering workflows across Cerebras.Our... ...platform, CI, release, quality, ML systems, and product...Remote work
- ...Senior Software Engineer, Cloud Infrastructure We're a fast-moving team of aviators... ...focus areas in LLM/ML Infra and IoT infra... ...Lambda, or Batch for inference jobs. Build and... ...Depth: Strong with core AWS services such as... ...Bonus Points ~4+ years working with...Permanent employmentFull timeRemote work3 days per week
$160.36k - $240.54k
...Software Engineer, ML Data Infrastructure Mountain View, California (HQ) Who We Are Nuro believes self-driving vehicles are the most immediate... ...in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles...Work experience placementImmediate startFlexible hours- ...orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our... ...to build and operate these core platforms that underpin... .... We're not just scaling infrastructure - we're redefining how... ...this role if you: Have 4+ years in data...Work at officeRelocation package
$276k - $414k
...other digital services.Snap Engineering teams build fun and technically... ...with leadership to up-level the ML tech stack and improve the performance... ...programming and software design skillsAbility to proactively... ...members to work in an office 4+ days per week. At Snap, we...Full timeLive inWork at officeLocal area$152k - $287.5k
...seeking talented engineers to join the... ...performance AI inference on NVIDIA GPUs.... ...team develops software that accelerates... ...experience. ~4+ years of relevant... ...MLIR compiler infrastructure, familiarity... ...NVIDIA Tensor Core architecture, mixed... ..., or low-level GPU performance...Full timeLocal area$168k - $264.5k
...world.Join NVIDIA’s CAD Infrastructure team and be part of... ...building a next-generation software platform for... ...endeavor, and we need engineers who thrive in a hands-... ...based systems.Exposure to ML or agentic tooling, particularly... ...USD - 264,500 USD for Level 4, and 196,000 USD - 31...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Infrastructure, Core Inference, Level 4. Be the first to apply!
- software engineer amazon Palo Alto, CA
- information technology software engineer Palo Alto, CA
- federal - software developer Palo Alto, CA
- graduate software developer Palo Alto, CA
- rust software engineer Palo Alto, CA
- software engineer remote Palo Alto, CA
- junior software developer internship Palo Alto, CA
- remote entry level software developer Palo Alto, CA
- software engineer contract Palo Alto, CA
- network software engineer Palo Alto, CA




