Staff Software Engineer, Scaling Inference Systems
AI Chopping Block
Anthropic is seeking an experienced software engineer to design, build, and maintain scalable inference systems powering Claude for millions of users. You will implement resilient routing, load balancing, and deployment pipelines across cloud providers and accelerators. You will optimize compute efficiency and support researchers by delivering high-performance infrastructure for next-generation models, collaborating across teams to ensure reliable, scalable operations from SF offices. #J-18808-Ljbffr AI Chopping Block
- OpenAI is seeking an AI Systems Engineer to scale infrastructure behind training and evaluation workflows. You will own projects from bottleneck... ...and collaboration with researchers. You will build shared inference and grading platforms, improve scheduling, and develop...Suggested
$162.5k - $219k
Staff Systems Software Engineer Remote US & Canada About this role Most engineering roles at Thatgamecompany ship features to players. This one ships... ...the systems that prove the gameplay feature works — at scale, on every device, on every commit — and the infrastructure...SuggestedPermanent employmentRemote workWork from homeWork visa$272k - $431.25k
Principal Software Engineer We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to ensure they can deploy, monitor, and operate these systems reliably...SuggestedShift work- Twilio is hiring a Software Engineer (L2) for Twilio Sendgrid to design, deploy and operate large-scale distributed systems. You will contribute to backend redesigns for scalability, security, and customer insights, helping power trillions of emails globally. The role...SuggestedRemote job
- SpaceX in Palo Alto seeks a Software Engineer, Inference (AI Data Engineering) to design and optimize high-throughput AI model serving systems. You will own distributed infrastructure from routing to batching and work with SpaceX AI teams to deliver reliable, scalable...Suggested
- ...real-time data. Instead of moving data out to a separate system to run inference or build an agent, our customers do it in place, on... ...platform they already use to move and process events at scale. As an engineer, you'll own delivery of significant pieces of this...Live in
- # Senior / Staff Software EngineerTrack to Lead Engineer← All open positionsAustinOnsite preferred... ...they run on.* Build and scale our AI employees platform... ....### Who you areYou own systems end to end, you have deep... ...ML pipelines, real-time inference) who wants to do it full...Full time
- ...Staff Software Development EngineerWe use cookies to make... ...Software Development Engineer** to be the hands-on technical... ..., distributed systems, and the unique challenges... ...ML and AI model inference on AWS, including latency... ...and supporting large-scale, customer-facing software...Full timeWork at office
- Crusoe is seeking Sr. Staff Software Engineers to lead the MAPS organization, focusing on infrastructure scale-out, performance, and cross-functional initiatives. You will rotate engagements and drive architecture across on-prem, cloud, and internal platforms. You will...
$255k - $310k
# Senior Staff Software Engineer, ServingUnited States9 hours agoID 1185189Price on request##... ...them in a compelling way. Our systems operate at a scale unseen outside of the largest Internet... ...Develop and optimize GPU-powered inference services that execute neural network...Full timeWork experience placementRemote work- Cerebras Systems in Sunnyvale is seeking a Senior Frontend Engineer to own and scale critical parts of the Cerebras Developer Console—the interface used by developers and enterprises to run and manage inference workloads. You will build high-quality frontend systems with...
- ...Machines Lab Inc. in San Francisco, California is seeking an infrastructure research engineer to design, optimize, and scale the systems that power large AI models. Your work will make inference faster, more cost-effective, more reliable, and more reproducible to enable our...
- Collectors Holdings, Inc. is seeking an experienced Software Engineer to join the Grading Operations team in Santa Ana, CA. You will own end... ...features with Vue.js and JavaScript. You will mentor peers, shape system designs, and operate in a high-volume, cloud-based...
$106.61k - $284.28k
...world. Currently, we are seeking a Staff Software Development Engineer, who will serve as a senior technical... ...lead the development of distributed systems and microservices leveraging Java, Spring... ...SQL, IAM) Experience with large‑scale application modernization, cloud...Hourly payFull timeTemporary workLocal area- ...It all started when engineer Fred Luddy wrote code that automated... ...Role summary The Senior Staff Software Engineer (IC5) on HR Service... ...full-stack engineering, where systems follow deterministic logic rather... ...by measuring behavior at scale rather than by asserting fixed...Contract workWork at officeImmediate startRemote workFlexible hours
$325k
...frictionless experiences. We're looking for a Staff Software Engineer to help build the next generation of... ...by understanding failure modes, system dependencies, degradation strategies,... ...points where systems may break under scale. Build quality and operability into...Casual workWork at officeFlexible hours$155.8k - $262.55k
...resources at the right time—matching the scale, velocity, and changing needs of today... .... About the role As a Senior Staff Software Engineer at SailPoint, you will dive into a highly... ...deploy your first major scalable system to production, meeting all observability...Temporary workLocal areaImmediate startRemote workWorldwideFlexible hours$116k - $174k
## Staff Software EngineerApply: Hartford, CT: Charlotte NC-South Tryon St... ...: R2627188Staff Software Engineer - IE07IEWe’re determined to make... ...Accountable for a small or medium scale software product.- End to End... ...complexity or certain sub-systems of large, complex...Full timeTemporary workWork at office3 days per week$231k - $314.35k
...and world-class investor support. We’re scaling fast and defining a new category in... ...getting started. Role Overview As a Software Engineer on the Product Engineering team at Harvey... ..., Legal, and GTM teams to build secure systems that deliver value to our customers. We...Relocation package$220k - $275k
...Staff Software Engineer Remote - United States, Full-time (regular) Datavant is the data collaboration platform trusted for healthcare... ...vertical. You’ll drive innovation across verticals, solve large-scale system challenges, and mentor senior engineers to maximize impact...Full timeRemote work- ...building the AI-native operating system for regulated finance,... ...the complexity needed to build software that actually works in regulated... ...industries and beyond. Engineering at Valon We are building a... ...handle billions of dollars at scale. In addition, our team of engineers...Local areaRemote workFlexible hours
$160k - $288k
...change how the industry works. As a Staff Software Engineer on our new Takeoff team, you will be... ...one of the first engineers building the systems that measure a building and forecast... ...computer vision, geometry, LLMs, and high-scale estimation. You will build the way...Immediate start$141.13k - $211.69k
...Vibe Coding and AI-assisted engineering practices, using agentic workflows... .... About the Role Staff Software Engineer based at John Deere... ...data products. Define system specifications, integration... ...assisted engineering practices and scale Vibe Coding — design prompt...Flexible hours- ...You’re an experienced engineer with exceptional skill,... ...caring. At EngagedMD, Staff Engineers play a key... ...role not only in building software, but also in shaping... ....js frameworks Lead system design efforts for new... ...designing and evolving large-scale or business-critical...Temporary workH1bRemote workVisa sponsorship
$106.61k - $284.28k
...world. Currently, we are seeking a Staff Software Development Engineer who as both a Technical Lead and Individual... ...and provide RCA, identify gaps in systems in current digital eco system and... ...solution delivery in a large-scale distributed software design environment...Hourly payFull timeTemporary workLocal area- ...Pearson's PSG-CP (Pearson Software Group - Content Platform) team... ...looking for a forward deployed engineer who shows up where the work is... ..., you'll design and build systems end to end for them. These are... ...retrieval, and deployment at scale. You've shipped at least one...Full timeRemote workShift work
$180k - $190k
## Staff Software EngineerApplyremote type: On-sitelocations: San Francisco... ...Role**As a Staff Software Engineer on the MarTech Engineering Team... ...workflows, learning their systems, and turning their expertise... ...agents that operate reliably at scale. When something is missing —...Work experience placementLocal areaRemote work$145k - $180k
...deploy intelligent locker systems that move packages,... ...Forward Deployed Agentic AI Engineers directly inside... ...building internal versions at scale. We are doing it from... ...demos Strong software engineering fundamentals... ...autonomy and ambiguity — staff-level judgment about what...$225k - $265k
...Opportunity at Altana The Engineering team is responsible for building... ...driven by AI, which scales to a massive trove of data, and... ...customer base; it is a complex system that will stretch engineering... ...writing back end or data-driven software in demanding environments....Full timeTemporary workWork experience placementRemote workFlexible hours- ...Siemens +more. Job Summary As a staff software engineer at Aerovy, you’ll lead, architect, and... ...You’ll work on a modular extensible system that powers everything from EV fleets... ...production systems, solving hard problems at scale, and shipping real value in a fast-...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Scaling Inference Systems. Be the first to apply!
- senior linux systems engineer Eastern, KY
- system engineer contract Eastern, KY
- senior staff systems engineer Eastern, KY
- microsoft systems engineer Eastern, KY
- operations support system engineer Eastern, KY
- advanced systems engineer Eastern, KY
- software system engineer Eastern, KY
- space systems engineer Eastern, KY
- system engineer remote Eastern, KY
- distributed systems engineer Eastern, KY

