Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Node Infra

$320k - $405k

anthropic

Staff Infrastructure Engineer, Node Infra

Anthropic's Infrastructure organization is foundational to our mission of developing AI systems that are reliable, interpretable, and steerable. The systems we build determine how quickly we can train new models, how reliably we can run safety experiments, and how effectively we can scale Claude to millions of users — demonstrating that safe, reliable infrastructure and frontier capabilities can go hand in hand.

Node Infra owns the full lifecycle of accelerator capacity at Anthropic. We ingest and provision compute from all major CSPs and our own datacenters, stand up and scale clusters from thousands to hundreds of thousands of hosts, and build the health, diagnostics and repair automation that keep every GPU, TPU and Trainium node in the fleet usable and ready to power Anthropic's frontier AI research.

Key Responsibilities
  • Own the technical strategy and roadmap for node lifecycle management - ingestion, bring-up, health checking, and automated repair
  • Drive cross-team initiatives to build and scale AI clusters across multiple clouds and accelerator families
  • Design and operate the systems that detect, isolate, and remediate unhealthy hardware automatically, driving up fleet MTBI and minimizing stranded capacity
  • Define infrastructure architecture, ensuring the hardest problems get solved - whether by you directly or by working through others
  • Work closely with cloud providers and internal research/inference/product teams to shape long-term compute, data, and infrastructure strategy
  • Establish and evolve operational excellence practices (incident response, postmortem culture, on-call)
  • Support the growth of engineers around you through technical mentorship and coaching
Minimum Qualifications
  • Deep expertise in distributed systems, reliability, and cloud platforms (e.g., Kubernetes, IaC, AWS/GCP/Azure)
  • Strong proficiency in at least one systems language (e.g., Rust, Go, or Python), IaC proficiency with Terraform.
  • Hands-on experience with machine learning accelerators (GPUs, TPUs, or Trainium)
  • Track record of leading complex, multi-quarter technical initiatives that span multiple teams or systems
  • Ability to build alignment across senior stakeholders and communicate effectively at all levels
Preferred Qualifications
  • 8+ years of software engineering experience, including time as a technical lead setting direction for a team
  • Experience managing large scale compute infrastructure at hyperscale (10K+ nodes), including capacity management and efficiency
  • Depth in one or more of: Kubernetes internals (scheduler, autoscaler, kubelet, Karpenter), cluster orchestration systems (Mesos, Borg-like), or node provisioning pipelines
  • Low-level systems experience: kernel, virtualization, device drivers, firmware, or hardware health/diagnostics daemons
  • Familiarity with high-performance networking (EFA, RDMA, InfiniBand) for distributed ML workloads.
  • Demonstrated ownership of production reliability for high-throughput, latency-sensitive systems
  • Contributions to relevant open-source projects (Kubernetes, Linux kernel, container runtimes, etc.)
  • Skill in quickly understanding systems design tradeoffs and keeping track of rapidly evolving software systems

The annual compensation range for this role is listed below. For sales roles, the range provided is the role's On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$320,000 - $405,000 USD

Logistics

Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience

Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings.

How We're Different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come Work With Us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Node Infra in New York, NY vacancy
  • $210k - $280k

     ...Staff Software Engineer (Frontend), Infra New York About Us Harmonic is the startup discovery engine. It pains us to see great startup opportunities consistently go unfunded not because of lack of talent, but lack of signal. We're fixing that by mapping... 
    Suggested
    Work at office
    3 days per week

    Harmonic

    New York, NY
    15 hours ago
  • $175k - $250k

     ...Overview ~ Role: Lead Software Engineer - DevOps and Infra ~5 days a week in NYC HQ ~ Base salary: $175k-250k ~ Equity: Competitive Initial Equity Package + refreshers ~3+ Years of Experience About Pillar Pillar is building the next-generation... 
    Suggested
    Flexible hours

    Pillar

    New York, NY
    2 days ago
  • $200k - $300k

     ...Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing... 
    Suggested
    Visa sponsorship

    Haize Labs

    New York, NY
    1 day ago
  • A leading AI development company located in New York is seeking a Software Engineer to develop groundbreaking infrastructure for AI model training. The role involves designing large-scale data pipelines and optimizing distributed systems. Candidates should have strong skills... 
    Suggested

    Reflection

    New York, NY
    15 hours ago
  •  ...Framework Ventures is seeking a Tech Support Engineer to provide technical assistance to partners within the TON ecosystem. You will troubleshoot API issues, support integration, and ensure effective communication with developers. The ideal candidate has experience in... 
    Suggested

    Framework Ventures

    New York, NY
    3 days ago
  • $320k - $405k

    Menlo Ventures is seeking a candidate for a technical role focused on node lifecycle management of AI systems. The position demands deep expertise in distributed systems and cloud platforms like Kubernetes and AWS. The ideal candidate should have significant experience... 
    Work at office

    Menlo Ventures

    New York, NY
    4 days ago
  •  ...the mission (and each other), we'd love to meet you. About the role We're looking for our first engineer focused on infrastructure to start and lead Infra at Amperos. You'll get to own dev ops, dev experience, compliance, observability, monitoring for our AWS... 
    Work at office
    Flexible hours

    Amperos Health, Inc

    New York, NY
    15 hours ago
  •  ...A dynamic technology firm is seeking a Software Engineer skilled in TypeScript, React, and Node.js. This fully remote position involves leading complex projects in a fast-paced environment, focusing on building scalable solutions for financial workflows. The ideal candidate... 
    Remote work

    DBA Web Technologies

    New York, NY
    3 days ago
  • $118.45k - $260.59k

     ...Fortune 6 company! The API Platform will be leveraged by hundreds of engineers across CVS Health building sites used by millions of customers. We are looking for a Staff Software Development Engineer Backend Node.js to lead the technical direction of an API platform that... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Work experience placement
    Local area

    Hispanic Alliance for Career Enhancement

    New York, NY
    3 days ago
  •  ...knowledge work. With a strong engineering culture and a cross-...  ...of ML researchers, infra specialists, and product...  ...We’re looking for a Staff Fullstack Engineer who’...  ...building production-grade software Expertise in frontend...  ...backend fluency in Python or Node; comfortable going full... 

    People In AI

    New York, NY
    3 days ago
  •  ...and AI-powered workflow software designed specifically for military staffs. By transforming this work...  ...hiring Staff Software Engineers to take on some of the most...  ...real-time collaboration infra, interactive planning...  ...using TypeScript/React/Node with PostgreSQL, Redis,... 
    Remote work

    Onebrief

    New York, NY
    3 days ago
  •  ...We are looking for a Staff or Senior Fullstack Engineer to work on developing and scaling the the company'...  ..., tools, and processes. Champion software quality, implement automation, drive...  ...something meaningful from scratch - Infra experience - Not as a DevOps person,... 

    Spartan Technologies

    New York, NY
    2 days ago
  • $193k - $309k

     ...role* We’re looking for a startup-minded engineer to join our New Ventures team as one of...  ...of experience levels, although listed as Staff to start. We aren't looking for a...  ...part of the stack—frontend, backend, or infra—to get a feature live, and willing to take... 
    Casual work
    Local area
    Immediate start
    Remote work
    Flexible hours

    Toast Inc

    New York, NY
    2 days ago
  •  ...Hiring Manager: Andrew Rosen, Head of Engineering About Arc Arc is building the first...  ...AI-native financial platform. As a Staff Software Engineer , you will own major...  ...systems, audibility, or compliance-heavy infra. Attributes That Make You Successful... 
    Full time
    Work at office
    Work from home

    Arc

    New York, NY
    2 days ago
  •  ...spans: Benefits Platform – the core engine powering eligibility, recommendations,...  ...real engagement. Be the connector: Align infra, security, compliance, and product...  ...Deep experience: 10+ years of professional software engineering, with a track record of building... 
    Work at office
    Worldwide
    3 days per week

    Rippling

    New York, NY
    2 days ago
  •  ...we’re searching for a Senior Full Stack Engineer who is going to lead the projects and work...  ...engineers The Role We are looking for a Staff Engineer with deep expertise in Python/...  ...Bonus Skills (Nice-to-Haves) Cloud + infra experience: GCP, Kubernetes, Docker,... 
    Immediate start
    Remote work
    Flexible hours

    NewtonX

    New York, NY
    15 hours ago
  •  ...Staff Engineer On Ai Platform At Rippling, we're not just building AI features, we're building...  ...pods of engineers drawn from product, infra, and platform orgs. You'll work alongside...  ...What You Will Need ~8+ years of software engineering experience with a proven track... 
    Work at office
    3 days per week

    MyHealthTeam

    New York, NY
    3 days ago
  • $210k - $280k

     ...Staff Software Engineer New York About Us Harmonic is the startup discovery engine. It pains us to see great startup opportunities consistently...  ...clarity in cross team architecture with Flow, Data, and Infra ensuring Sourcing evolves as a cohesive, maintainable system... 
    Work at office
    Shift work

    Harmonic

    New York, NY
    2 days ago
  • $170k - $210k

    Senior Software Engineer, Infra We’re hiring a senior infrastructure engineer to help us shape the future of restaurant tech. You’ll own our infrastructure and platform layers as we build and scale our product, and you’ll shape our engineering and company culture as we... 

    Namely

    New York, NY
    1 day ago
  • $190k - $270k

     ...Staff Software Engineer - AI Research Infrastructure P-1215 At Databricks, we are obsessed with enabling data teams to solve the world'...  ...will have As a Staff Software Engineer on the AI Research Infra Team at Databricks, you will: Design and implement... 
    Local area
    Worldwide

    Databricks

    New York, NY
    1 day ago
  • $500 per month

     ...team is a diverse group of experienced engineers, traders, and brokerage professionals who...  ...order routing, fault‑tolerant market data infra). Proactively identify scalability...  ...Engineering, or equivalent. 10+ years of software engineering experience, with significant... 
    Home office

    Framework Ventures

    New York, NY
    3 days ago
  • $200k - $400k

     ...is highly experimental, frontier-style engineering. The team continuously analyzes real-world...  .... About the Role As a Staff Software Engineer on the Agent Orchestration team...  ...'ll collaborate closely with Research, Infra, and Product teams to ship improvements... 
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    4 days ago
  • $132k - $150k

     ...industrial environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical role in evolving CVector...  ...ergonomics Port backend services from bun to Node.js where appropriate Track and improve DORA metrics (... 
    Work experience placement
    Live in
    Work at office
    Visa sponsorship
    Flexible hours

    CVector - Industrial AI

    New York, NY
    5 days ago
  • $190k - $261.25k

     ...can use deep data insights to improve their business. Founded by engineers - and customer obsessed - we leap at every opportunity to solve...  ...of distributed AI workloads Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences Shape... 
    Local area
    Worldwide

    Databricks

    New York, NY
    3 days ago
  • $204k - $255k

     ...responsible for designing, building and operating the software and solutions that connect all Airbnb users and...  ...Difference You Will Make As a member of the network infra team, you will be working with talented engineers on cutting edge technologies of cloud native network... 
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Traveltechessentialist

    New York, NY
    3 days ago
  •  ...transparency, good communication, and knows that the best outcomes come from working well with others. You’re an experienced Infra/DevOps engineer - 5+ years building and operating reliable cloud infrastructure using AWS CDK (databases, queues, caches etc), CI/CD... 
    Summer work
    Work at office

    Tetrix Inc.

    New York, NY
    4 days ago
  • $300k - $430k

     ...actions across millions of interactions. About the Role As a Staff Software Engineer on the Agent Orchestration team, you will own the long term...  ...systems that last. You will work closely with Research, Infra, Product Engineering, and Agent SWE to define the standards... 
    Work at office

    Decagon

    New York, NY
    15 hours ago
  • $231k - $340k

     ...customers — from leadership to engineers — and work together to solve...  ...started. Role Overview As a Software Engineer, Agents, you'll build...  .... Work with our model infra team to design and implement...  ...role across Mid, Senior, and Staff levels. Proficiency in Python... 

    AI Chopping Block, Inc.

    New York, NY
    1 day ago
  • $170k - $240k

     ...has raised ~$92M. Kao (CTO): Previously led the Stripe engineering team that launched Banking-as-a-Service. We’ve raised $...  ...Expectations We’re looking for our Founding Platform / Infra Engineer – a strong software engineer first. You can design, build, and evolve the systems... 
    Contract work
    Work at office
    Remote work

    GrabJobs

    New York, NY
    15 hours ago
  • $121.4k - $168k

     ...Engine is seeking a Senior Software Engineer specializing in DevOps/Infrastructure. This remote role focuses on leading the technical evolution of the control plane and partnering with embedded infra engineers. The ideal candidate has 8+ years in cloud infrastructure with... 
    Remote work

    Engine Co.

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Node Infra. Be the first to apply!