Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff+ Software Engineer, Backend and Infra

$200k - $300k

Haize Labs

Staff+ Software Engineer, Backend and Infra

Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them – i.e. rigorously, proactively, and continuously fuzz-testing them.

We are looking for a talented and experienced backend + infrastructure engineer to help build out our AI reliability platform. You will play a foundational role in designing and driving forward the core technology that puts our cutting-edge AI research in the hands of customers, empowering them to build AI applications that are trustworthy, robust, and ready for production.

This is an opportunity to directly influence how AI applications are tested, verified, and deployed by everyone from frontier AI labs to massive enterprises across a wide range of industries.

In this role, you will:
  • Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more
  • Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling
  • Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Haize has pioneered
  • Act as a technical leader across the organization, mentoring top talent and helping set technical direction and vision for the company
  • Develop and uphold processes and best practices that reinforce the operational excellence of our team
You may be a good fit if you:
  • Have 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager
  • Have a proven track record of designing, building, and scaling complex distributed systems that solve critical business problems
  • Have strong proficiency in one or more backend programming languages (e.g. Python, Go, Rust)
  • Are deeply knowledgeable about modern cloud infrastructure, including technologies like Kubernetes and Terraform, and platforms like AWS, GCP, and Azure
  • Have a strong understanding of relational and NoSQL databases (we use Postgres, MongoDB, and Redis, among others)
  • Take a pragmatic, outcomes-focused approach to solving ambiguous technical and business problems
  • Are passionate about building products and platforms that feel magical to use
Strong candidates may also:
  • Have experience doing applied AI/ML
  • Have strong familiarity with security and privacy best practices
  • Have built and/or operated large scale, GPU-based model training and serving infrastructure
  • Have experience working on multi-datacenter, cloud-agnostic systems
Logistics
  • Education requirement: Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • Location policy: 6 days a week, in person, in NYC.
  • US visa sponsorship: If you are exceptional, we will sponsor.
Compensation

$200,000 – $300,000 annual salary + equity + benefits

About us

At Haize, we're not here to write GPT wrappers or get rich quick off the AI bubble. We're here to solve the hardest problem in AI: making it safe, reliable, and production-ready.

Since our company's inception in 2024, we've amassed amazing customers including OpenAI, Anthropic, AI21, and more. We've developed best-in-class tooling for evaluation, dynamic testing, red-teaming, observability, and continuous "robustification" of AI applications. And we're backed + advised by the founders of Cognition, Hugging Face, Weights and Biases, Nous, Etched, Okta, and Replit, as well as C-suite execs from Google, Stripe, Databricks, Robinhood, and more.

Our core team is exceptionally well-suited to accomplish our mission. We've turned down opportunities like Stanford PhD programs and Y Combinator in order to pursue this goal, and we have experience doing AI research and engineering at places like Harvard, MIT, Citadel, Datadog, and McKinsey QuantumBlack (to name a few).

We can only serve our mission with an incredibly talented and hard-working team, and we hope that includes you. Come to Haize to push yourself, learn fast, experience excellence, grow with each other, and pursue your life's work.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff+ Software Engineer, Backend and Infra in New York, NY vacancy
  • $227.2k - $324.5k

    About the Role:As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely...  ...latency, cost, and efficiency of our infra. Lead large scale cross functional...  ...scalable, distributed systems in any modern backend language (e.g., Scala, Java, Python,... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    New York, NY
    3 days ago
  • $260k - $300k

     ...Catalyst, and Optum Ventures. We’re about 35 people, working in person in New York and San Francisco. About this role As a Staff Backend/Infra Engineer at Concurrence, you'll build the core services behind our agent platform. The systems you own handle millions of... 
    Suggested
    Full time
    Flexible hours

    Concurrence

    New York, NY
    6 days ago
  • $220k - $240k

     ...narrowing down high-level problems into engineering solutions. You're able to coordinate...  ...engineering knowledge. 10+ years of relevant backend development experience in a high growth...  .... Technical understanding of the software development process. Excellent... 
    Suggested
    Full time
    3 days per week

    Finch Services

    New York, NY
    1 day ago
  • $190k - $261.25k

     ...insights to improve their business. Founded by engineers, and customer obsessed, we leap at every...  ...with research, platform, infra, and AI/ML teams to deliver seamless end-...  ...DatabricksWhat we look for:8+ years of experience in backend or infrastructure engineeringStrong... 
    Suggested
    Local area
    Worldwide

    DataBricks

    New York, NY
    1 day ago
  • $229k - $343k

     ...Saturn, and other digital services.Snap Engineering teams build fun and technically...  ...at the forefront.​We’re looking for a Staff Backend Engineer to join Snap Inc!What you’ll do...  ...experience9+ years of post-Bachelor’s software development experience; or a Master’s degree... 
    Suggested
    Full time
    Live in
    Work at office
    Local area

    Snap

    New York, NY
    2 days ago
  • $192k - $252k

    Hi, we're Oscar. We're hiring a Staff Software Engineer to join our Engineering team.Oscar is the first health insurance company built around a full stack technology platform and a focus on serving our members. We started Oscar in 2012 to create the kind of health insurance... 
    Full time
    Contract work
    Work at office
    2 days per week

    Oscar Health Insurance

    New York, NY
    3 days ago
  • $193.8k - $285k

     ...logistics platform. As we continue to expand our Engineering organization globally, we’re looking for Staff Backend Engineers to build and evolve the large-scale,...  ...(e.g., Claude Code, Codex, Cursor) in the full software development lifecycle, including designing, generating... 
    Hourly pay
    Work at office
    Local area
    Flexible hours

    Doordash

    New York, NY
    4 days ago
  • $180k - $230k

     ...stop to ask what’s next, because they’re already building it.  The Opportunity Kargo is hiring a Staff Software Engineer to own technical direction across backend services and shared platform capabilities—translating ambiguous business needs into durable architecture... 
    Work experience placement
    Local area

    Kargo

    New York, NY
    4 days ago
  •  ...customer-facing HR products.In this role, you will fill a crucial engineering leadership gap, instilling a rigorous, product-focused mindset...  ...products.A highly product-minded approach rather than pure backend distributed systems architecture, coupled with deep customer... 
    Work at office
    3 days per week

    Rippling

    New York, NY
    9 hours ago
  •  ...@Rippling.com addresses.About the roleWe’re looking for a Staff Software Engineer to join our Scheduling team. You’ll build innovative solutions...  ...Code: Build scalable, maintainable, and high-performance backend systems that power critical workforce management products.Move... 
    Hourly pay
    Work at office
    3 days per week

    Rippling

    New York, NY
    9 hours ago
  • $405k

     ...committed researchers, engineers, policy experts, and business...  ...Anthropic - product, infra, research and security....  ...and mobile services to backend training infrastructure...  ...of rapidly evolving software systems \*This is a...  ...Currently, we expect all staff to be in one of our... 
    Full time
    Currently hiring
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    15 days ago
  • $207k - $300k

     ...develop, test, deploy, maintain, and enhance large-scale software solutions and resilient distributed backend infrastructure.Provide technical leadership on...  ...influencing and coaching a distributed team of engineers.Lead the design and implementation of solutions in... 
    Worldwide

    Google

    New York, NY
    3 days ago
  • $199k - $270k

    Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed with enabling...  ...Software Engineer on the AI Research Infra Team at Databricks, you will: Design...  ...systems, data pipelines, or large‑scale backend services, ideally involving GPUs,... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    4 days ago
  • $200k - $350k

     ...excellence through intuitive, enterprise-grade software and expertise. We simplify complex...  ...input on technical decisions with the engineering lead. If you enjoy building systems, not...  ...Drive architecture across frontend, backend, infrastructure, AI services, and shared... 
    Work at office

    Asseta

    New York, NY
    11 days ago
  • $158.1k - $213.8k

     ...the needle for our customers.Ads AI Core Infra (ACI) organization owns services...  ...partner business launches and improve our engineering systems for feature velocity, availability...  ...plan, build, test, deploy, and operate software. You will work on systems that reduce delivery... 
    Internship
    Flexible hours

    Amazon

    New York, NY
    1 hour ago
  • $132k - $150k

     ...United States and operates real-world systems in demanding industrial environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical role in evolving CVector’s core backend platform. You will work on time-series data... 
    Full time
    Work experience placement
    Live in
    Work at office
    Remote work
    Visa sponsorship
    Flexible hours

    CVector - Industrial AI

    New York, NY
    2 days ago
  •  ...Overview: Spur is every company’s AI QA Engineer. New York City Spur builds fundamental technology for the future of QA: autonomous...  ...Read our Manifesto : The Role As our founding infra/backend engineer, you’ll architect the backbone of Spur’s core... 
    Full time
    Live in
    Work at office
    Local area
    Flexible hours

    Pear-VC

    New York, NY
    7 days ago
  • $150k - $234k

     ...Staff Backend Software Engineer - Platform Integration New York, NY Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data... 
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    1 day ago
  • $170k - $230k

    Our FinTech client is looking for a Staff Backend Software Engineer to help build and scale the core data platform that powers their products and internal operations. This is a high-impact opportunity for an engineer who thrives on solving complex distributed systems challenges... 
    2 days per week
    3 days per week

    Solomon Page

    New York, NY
    1 day ago
  • $180k - $211k

     ...Expectations are high, and so are the rewards.The Backend Platform team’s mission is to enable...  ..., and tooling that support hundreds of engineers working across backend services. By...  ...engineers rely on every day!As a Staff Software Developer, you will set technical direction... 
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood Financial

    New York, NY
    1 day ago
  • $257.5k - $386k

     ...invest heavily in building the best creator platform with the best team in the creator economy and are looking for a Staff Software Engineer, Backend Platform to support our mission.This role can be based in San Francisco or New York and open to those who are able to... 
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    3 days per week

    Patreon

    New York, NY
    3 days ago
  •  ...world. The decisions made in our software directly determine what stays...  .... As Cinder has grown, Core Infra has become responsible for...  ...group of strong, self-directed engineers and make sure they're working...  ..., and earn the respect of staff-level engineers. We use AI tooling... 
    Full time
    Work at office
    Relocation

    cinder

    New York, NY
    7 days ago
  • $192k - $240k

     ...spend management, bill pay, and travel software, Brex enables founders and finance teams...  ...and support you need to grow your career.Engineering at BrexEngineering at Brex is about building...  ...designing, building, and operating backend or infrastructure systems in productionStrong... 
    Work at office
    Remote work
    Work from home

    Brex

    New York, NY
    1 day ago
  • $158k - $293k

     ...accountants on real client work every day. As a Lead Software Engineer (Staff Engineer), you will own core backend and AI orchestration systems that turn frontier...  ...quarter initiatives that cut across AI, product, and infra (e.g., a new orchestration layer, a low-latency... 
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    2 days ago
  •  ...Senior Backend EngineerBevel is an AI Health Companion that helps people make smarter decisions...  ...re looking for incredible Senior Backend Engineers to help us build an ambitious roadmap....  ...the entire backend stack, from data infra to product endpointsBuild extensible and... 
    Work at office

    Bevel

    New York, NY
    4 days ago
  •  ...Staff level SW Engineer ( Backend Heavy or Backend) with 8+ years experience The ideal candidate will bring deep TypeScript experience. Node.js/NestJS and React are a +. AWS production experience, and a track record of designing systems around asynchronous workflows... 
    Full time
    Work at office
    3 days per week

    The Cypress Group

    New York, NY
    3 days ago
  •  ...years of building and operating production software, with a record of leading complex...  ...Strong hands-on Python, with experience in backend services, APIs, and large-scale data pipelines...  ...and cost, and explain the tradeoffs to engineering and product leaders. Nice to Have • Long... 

    Robert Half

    New York, NY
    8 days ago
  •  ...working at the intersection of Full-Stack Engineering, AI Agents, and Infrastructure ,...  ...What We're Looking For Exceptional software engineering fundamentals with strong experience...  ...across full-stack development, backend systems, or infrastructure engineering.... 

    Qualis

    New York, NY
    16 days ago
  •  ...Competitive About the Role We’re looking for a hands-on Staff Software Engineer to build and scale the infrastructure behind enterprise AI...  ...with TypeScript, Java, Go, Kotlin or Rust. Extensive backend, distributed systems and platform engineering experience.... 
    Full time
    Work at office

    Albert Bow

    New York, NY
    2 days ago
  • $280k

     ...S taff Backend Engineer | NYC | Up to $280k + Equity We're working with a well-funded Series...  ...than 100 employees. They're hiring a Staff Backend Engineer to take a leading role...  ...What they're looking for ~10+ years of software engineering experience, with a proven... 
    Full time
    3 days per week

    Zest for Tech

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff+ Software Engineer, Backend and Infra. Be the first to apply!