Staff Software Engineer, Inference Systems at Scale
$300kAnthropic
A forward-thinking AI company in San Francisco is seeking an experienced software engineer to join their Inference team. The role focuses on building and optimizing systems for AI model deployment, with a strong emphasis on technical excellence and societal impact. Candidates should possess solid software engineering experience, particularly in distributed systems, and be eager to work in a collaborative environment. Competitive salary range of $300,000 to $485,000 USD and hybrid work policy are offered. #J-18808-Ljbffr Anthropic
- Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and related frameworks to push the bleeding edge of AI performance. This...Suggested
$300k
# Staff + Sr. Software Engineer, InferenceJob Type / Location: San FranciscoExperience... ..., and steerable AI systems. We want AI to be safe and... ...systems.About the roleOur Inference team is responsible for building... ...with:High-performance, large-scale distributed systemsImplementing...SuggestedWork at officeWorldwideVisa sponsorshipFlexible hours$300k
...and steerable AI systems. We want AI to be... ...committed researchers, engineers, policy experts,... ...the role Our Inference team is responsible... ...Have significant software engineering experience... ...performance, large-scale distributed... ...Currently, we expect all staff to be in one of...SuggestedFull timeWork at officeWorldwideVisa sponsorshipFlexible hours$320k
...and steerable AI systems. We want AI to be... ...committed researchers, engineers, policy experts,... ...is to make inference deployment boring... ...unattended. As a Software Engineer on Launch... ...strategies for large-scale deployments across... ...Currently, we expect all staff to be in one of...SuggestedWork at officeVisa sponsorshipFlexible hoursShift work$405k
...and steerable AI systems. We want AI to be... ...committed researchers, engineers, policy experts,... ...Role Anthropic's Inference organization serves... ...are looking for a Staff Engineer to be a... ...spanning serving, scaling, and accelerator teams... ...Have significant software engineering...SuggestedWork at officeVisa sponsorshipFlexible hours$228k - $290k
...time, integrating deeply with EMR systems. Role Overview Abridge’s services and engineering team are in hyperscale mode. We are looking for experienced software engineers to help improve the... ...engineering enablement and software scaling. Back‑end engineering experience...Hourly payFull timeFlexible hours- ...deployment of AI across health systems. We are a growing team of... ...creatives, technologists, and engineers working together to empower people... ...are looking for experienced software engineers to join our team... ...security, will be under tremendous scale, and presents many...
$225k
Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems... ...engineering fundamentals and experience with large-scale systems. Compensation includes a competitive salary...$300k
...interpretable, and steerable AI systems. We want AI to be... ...researchers, engineers, policy experts, and... ...About The Role The Cloud Inference team scales and optimizes Claude... ...You Have significant software engineering... ...Currently, we expect all staff to be in one of our offices...Visa sponsorship- Gravity Engineering Services Pvt Ltd. is looking for an experienced Engineering Manager to lead the Cloud Inference team for AWS. In this role, you will manage the end-to-end product... ...over 10 years of experience in high-scale software development and at least 5 years in...
- Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance for ML... ...like PyTorch and knowledge of distributed systems is crucial. #J-18808-Ljbffr Gravity Engineering...
- Gravity Engineering Services Pvt Ltd. is seeking a Staff + Sr. Software Engineer for its San Francisco office. You will be integral... ...to building and maintaining the systems that support our AI models, focusing on high-performance inference and distributed systems. The...Work at office
$208.45k - $364.8k
Pinterest is seeking an experienced Backend Engineer to join the Cache Infra team in San Francisco. The role involves leading a high-performing team to build and maintain large-scale caching systems critical to the company's operations. Candidates should have a bachelor...Work at office- ...company in San Francisco is seeking a Staff Software Engineer to enhance its messaging infrastructure... ...reliability and performance of systems, promoting event-driven architectures.... ...engineering, particularly in internet-scale applications. The position offers comprehensive...Flexible hours
$235k - $275k
...rapidly growing tech company in San Francisco is seeking a Staff Software Engineer to enhance the connection between students and... ...include leading the development of consumer features, scaling distributed systems, and mentoring team members. The ideal candidate has over...$253.9k - $298.7k
...Payments strategy, focusing on technical and operational excellence in large-scale distributed systems. The role involves enhancing the Payments platform's efficiency while mentoring engineers and ensuring high levels of service reliability. With an expected background...- Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today, but simply adding more hardware isn't the answer. We're partnering... ...inference that's faster, more efficient and built to scale. You’ll be: Building and optimising high-performance...
- ...deliver, and govern AI at scale. DataRobot empowers... ...’s Fleet team is the engine behind how our platform... ...you come in. As a Staff Software Engineer, you’ll be responsible... ...our control plane systems, influence cross‑team... ...for training and inference. Why Join the Fleet Management...WorldwideFlexible hours
$235k - $275k
...025, we tripled our ARR at scale. Why Join Handshake Now Shape... ...About The Role As a Staff Software Engineer on the Consumer Experience... ...Architect and scale distributed systems to support millions of users... ...entity resolution and real‑time inference Experience building AI‑...Full timeFreelanceInternshipWork at officeRemote workFlexible hours$265k
...make better decisions, and scale with precision. With $300B+... ...of the time. Senior Staff Software Engineer Location: Americas (preferably... ...and evolution of the core systems that power Juniper Square —... ...AI workloads, from inference pipelines to agent fleets...Full timeWork at officeLocal areaRemote workWork from homeFlexible hours- ...AI is seeking a Lead Research Engineer in San Francisco to optimize... ...infrastructure for training and inference workloads. This role involves... ...improvements across ML systems and collaborating with cross-... ...substantial experience with large-scale workloads. The position...Flexible hours
- Who are we? Our mission is to scale intelligence to serve... ...enterprises who are building AI systems to power magical experiences... ...looking for a Site Reliability Engineer to join the Model Serving team... ...influence latency and throughput of inference. Strong understanding or...Full timeWork experience placementWork at officeRemote workFlexible hours
- ...information from complex documents at scale. We have a breakthrough... ...small, fast-growing team of engineers in San Francisco powering... ...low-latency, high-throughput inference for OCR and multimodal models... ...performance engineering or ML systems Strong Python, plus C++ or CUDA...Work at officeVisa sponsorshipRelocation package
$310k
About the Team OpenAI's Inference team powers the... ..., fast-moving team of engineers focused on delivering... ...Role We're looking for a software engineer to help us serve... ...multimodal models at scale. You'll be part of a small... ...and optimize the systems that let users generate...$180k - $360k
...powers mission‑critical inference for the world’s most... ...help build the platform engineers turn to to ship AI... ...runtime that powers large‑scale LLM inference across... ...intersection of distributed systems, model performance,... ...ease of use. As a Software Engineer on the Inference...Flexible hours- Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background to push the bleeding edge of AI, working with CUDA/C++ and a modern tech stack. Ideal candidates...Full time
- Senior Staff Engineers — Multiple Tracks Series A ($120M)... ...next generation of AI systems. Having recently closed... ...Series A, we’re scaling our team rapidly across... ...supporting AI training and inference workloads. Implement... ...of professional software engineering experience...Remote job
$405k
...and steerable AI systems. We want AI to be... ...committed researchers, engineers, policy experts,... ...team and help scale our privacy infrastructure... ...AI training and inference systems handling... ...experience in a Software Engineer role, building... ..., we expect all staff to be in one of...InternshipWork at officeVisa sponsorshipFlexible hours$248.4k - $310.5k
Staff Software Engineer, Enterprise GenAI Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative... ...provides APIs for knowledge retrieval, inference, evaluation, and more. We are... ...experience with large-scale distributed systems. You will be responsible for...Full time$405k
...broadly. We're looking for a Staff+ Engineer to anchor our Enterprise... ...Claude enterprise-ready at scale. When a Fortune 500 company... ...Claude to 100,000 employees, the systems and products that you design... ...Partner other teams such as Inference and Platform for...Visa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Inference Systems at Scale. Be the first to apply!
- ground systems engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- active directory systems engineer San Francisco, CA
- distributed systems engineer San Francisco, CA
- computer systems engineer San Francisco, CA
- adas systems engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- computer system validation engineer San Francisco, CA
- mission system engineer San Francisco, CA
- electronic systems engineer San Francisco, CA

