Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Infrastructure

Exa Labs

Exa Infrastructure Engineer

Exa is an applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train state-of-the-art embedding models to process it, and design super high performant vector databases to retrieve over it. We now power search for Cursor, Cognition, HubSpot, and over 400,000 developers and have raised $350m from Lightspeed, Benchmark, and a16z.

Our ultimate goal is to build perfect search over all the world's information, far beyond Google. If you want to build massive-scale ML systems that will define the way the new AI world consumes information, this is the place for you.

Our Infrastructure Team builds the underlying tooling and infrastructure that powers all Exa's systems. Basically, we need more infra engineers to build the machine that builds the machine so that we can move as fast as possible as an engineering org. That could mean building GPU cluster orchestration in Kubernetes, map-reduce batchjobs on Ray, or the best observability tooling in the world.

Who You Are
  • You have experience designing and operating large-scale infrastructure - GPU clusters or large Kubernetes clusters or cloud batchjob systems

  • You bring an obsessive mindset — always thinking about reliability, observability, and optimization across the entire stack.

What You'll Do
  • Build the Kubernetes orchestration on a $20m GPU cluster

  • Scale our AWS batchjob system to handle map reduce jobs over 10s of thousands of machines

  • Design GPU scheduling software so we max out our cluster utilization

  • Build observability into our production systems

Logistics
  • Location: This is an in-person opportunity in San Francisco.

  • Visas: We're happy to sponsor international candidates (e.g., STEM OPT, OPT, H1B, O1, E3). While we cannot guarantee your visa, we have historically been successful in sponsoring candidates from all over the world. If you receive an offer, our team will work hard to get you a visa.

  • Benefits: We offer premium healthcare benefits (medical, dental, vision), fertility benefits, 16 weeks of fully paid parental leave for all new parents, and a monthly wellness stipend to all of our employees.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Infrastructure in San Francisco, CA vacancy
  •  ...is a new cross-functional group working across engineering, product, research, and design to build the foundational...  ...the Role We’re looking for an experienced Software Engineer to help build the machine learning infrastructure that powers OpenAI’s monetization and ads... 
    Suggested

    AI Chopping Block, Inc.

    San Francisco, CA
    8 hours ago
  • $230k - $405k

     ...About the Team Compute Infrastructure builds the platform that turns enormous amounts of compute into a reliable engine for frontier AI. We design, provision, schedule, operate,...  ...networks, storage, data centers, orchestration software, agent infrastructure, developer tools,... 
    Suggested

    Centaur Labs

    San Francisco, CA
    8 hours ago
  • $194k - $239k

     ...Senior Software Engineer, Infrastructure Hover helps people design, improve, and protect the properties they love. With proprietary AI built on over a decade of real property data, Hover answers age-old questions like “What will it look like?” and “What will it cost?”... 
    Suggested
    Full time
    For contractors
    Work at office
    Local area
    Flexible hours

    HOVER Inc.

    San Francisco, CA
    8 hours ago
  • $168k - $213k

     ...and our team comes from world-class organizations like SpaceX, Google, Netflix, Stripe, Plaid and more. The Role As a Senior Infrastructure Engineer , you will own the foundation that enables us to deploy secure, compliant AI systems at major financial institutions... 
    Suggested
    Flexible hours

    Bretton AI

    San Francisco, CA
    1 day ago
  •  ...About Flow Flow Engineering is building a requirements platform for modern engineering teams, helping them design, build...  ...reliability and speed. About the role Flow is hiring a Software Engineer with an infrastructure focus to build and scale the core platform behind Flow... 
    Suggested
    Flexible hours

    Flow Engineering

    San Francisco, CA
    1 day ago
  •  ...economy has grown 6x over the last decade, software businesses have gone from not worrying...  ...In this role, you will play a Software Engineer who designs, builds, and operates the...  .... Drive technical decisions about our infrastructure. Identify and fix bugs and technical debt... 
    Work at office
    Remote work
    Home office
    Flexible hours
    3 days per week

    Anrok

    San Francisco, CA
    9 hours ago
  •  ...About the Team We’re hiring Software Engineers to join our Applied Infrastructure organization, and more specifically for our Database Systems and Online Storage teams. These teams operate with a high degree of autonomy and are deeply collaborative, with a shared mandate... 

    Slope

    San Francisco, CA
    8 hours ago
  • $100k - $300k

     ...waters and contribute to our innovative projects. Position Overview We are looking for a Software Engineer to work at the forefront of developing and optimizing the software infrastructure and tools necessary for training cutting-edge AI models. You will focus on building... 

    Menlo Ventures

    San Francisco, CA
    1 day ago
  • $128.5k - $161k

     ...semgrep.dev. About the role Semgrep’s Infrastructure team is responsible for the cloud infrastructure...  ...environments, and tools for operating software in production. You’ll learn about the...  ...security space, collaborate with other engineers on the Infrastructure team to create a... 
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep

    San Francisco, CA
    8 hours ago
  • $180k - $260k

     ...Vercel gives developers the tools and cloud infrastructure to build, scale, and secure a faster,...  ...every day. As a Senior Infrastructure Engineer on the CI/CD team, you’ll take...  ...that directly impacts how developers ship software on the web. We’re looking for engineers... 
    Work from home
    Flexible hours

    Vercel Corp

    San Francisco, CA
    4 days ago
  •  ...growing business with billions in revenue The Role Handshake is building the infrastructure layer that powers the next generation of AI agents across our platform. As a Senior Software Engineer on our Agentic Infrastructure team, you'll be at forefront of AI at... 
    Full time
    Freelance
    Internship
    Work at office
    Remote work
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    8 hours ago
  •  ...democratize access to cutting‑edge AI infrastructure previously reserved for hyperscalers. What...  ...Role As an Infrastructure Product Engineer, you will play a pivotal role in building...  ...bare‑metal environments. ~ Advanced software engineering skills; capable of building... 
    Full time
    Remote work

    Andromeda

    San Francisco, CA
    11 days ago
  • $170k - $220k

     ...tested, and operated. Our platform gives engineers real-time observability over high-...  ...ensuring mission reliability demanded new infrastructure. Founded by a team from SpaceX, Google,...  ...platform and customer base. Collaborate with software engineers to optimize application... 
    Local area
    Remote work
    Relocation

    Sift Stack, Inc.

    San Francisco, CA
    4 days ago
  •  ...Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable...  .... Join us and help build the platform engineers turn to to ship AI products. THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build and maintain... 
    Flexible hours

    BaseTen

    San Francisco, CA
    8 hours ago
  • $110k - $270k

     ...regulations, and safely manufacture life-saving medicines. The Infrastructure team is responsible for architecting and operating the...  ...distributed, and high-performance system. We are seeking Senior Software Engineers who enjoy hands‑on work, fast paced release cycles, fine... 
    Work at office
    Local area
    Work from home
    Flexible hours

    Veeva Systems

    San Francisco, CA
    9 hours ago
  •  ...other government agencies address real-world challenges. The Infrastructure Engineering team is crucial to the overall success of Hayden products:...  ...Uphold Engineering Standards: Establish and enforce elite software engineering and DevOps standards, including rigorous... 
    Shift work

    Hayden AI

    San Francisco, CA
    8 hours ago
  •  ...About Orb Orb is redefining what billing software can be, turning one of the most complex...  ...the role As a senior member of the infrastructure team, you’ll play a key role in maintaining...  ...customer growth Partner with other engineering teams to ensure we build reliable product... 
    Work at office
    Remote work
    3 days per week

    Orb

    San Francisco, CA
    8 hours ago
  •  ...About the Role This role broadly owns infrastructure across the stack. If it’s running in the cloud, you probably care about it. The life...  ...ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation... 

    Generalist AI, Inc

    San Francisco, CA
    5 days ago
  • $260k - $330k

     ...About the Web Infrastructure Team Notion is building one place where your knowledge, projects, meetings, and AI tools live side by side,...  ...modern teams think and execute. About the Role You’ll be a core engineer on the Web Infrastructure team, focusing on improving Notion’... 
    Local area

    Notion, LLC

    San Francisco, CA
    9 hours ago
  • $190k - $280k

     ...About Sentry Software runs the world and the pace is faster than ever. Sentry helps developers...  ...pipeline. As a member of the Developer Infrastructure team, you’ll be responsible for...  ...experience at Sentry. You’ll support a growing engineering organization by balancing factors like... 
    Hourly pay
    Local area

    Sentry

    San Francisco, CA
    3 days ago
  •  ...including stablecoins. You’ll help design, deploy and operate the infrastructure that makes this possible. This is a hands-on devops role...  ...role sits at the intersection of infrastructure, platform engineering and security. You’ll define how Modern Treasury scales and operates... 
    Work at office
    Local area
    Immediate start

    Modern Treasury

    San Francisco, CA
    1 day ago
  •  ...Software Engineer Intern (AI Infrastructure / Training / Inference) About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern... 
    Internship
    Immediate start

    SpreeAI

    San Francisco, CA
    8 hours ago
  • $161k - $230k

     ...Software Engineer: Infrastructure at Thatch Location: Remote (US); San Francisco, California, United States. Compensation: $161,000 – $230,000 USD. About the role Thatch is rewiring how health benefits work. We build software that gives employees real control over how... 
    Remote work

    Thatch Health

    San Francisco, CA
    11 days ago
  • $185k - $225k

     ...derivatives trading team and work on the key infrastructure that powers our product offering as...  ...and code reviews, maintaining high engineering standards. Leverage AI‑assisted development...  ...6+ years of professional software engineering experience. Strong proficiency... 
    Contract work
    Work at office
    Remote work
    Work from home

    Gauntlet

    San Francisco, CA
    8 hours ago
  • $150k - $215k

     ...Overview As a Space Infrastructure Software Engineer, you are responsible for scaling our ability to operate a heterogeneous fleet of satellites—spanning dedicated, rideshare, and constellation missions. You will work at the intersection of automated satellite operations... 
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Loft Orbital

    San Francisco, CA
    8 hours ago
  • $200k - $280k

     ...SENIOR SOFTWARE ENGINEER, INFRASTRUCTURE Build the core infrastructure that powers petabyte-scale data collection and delivery for the world's leading robotics companies. COMPENSATION $200K - $280K + 0.15% - 0.40% EQUITY ABOUT THE ROLE We are building the data infrastructure... 
    Home office

    Gerra Group

    San Francisco, CA
    8 hours ago
  •  ...responsible AI deployment over unchecked growth. About the role As a software engineer on the Fleet High Performance Computing (HPC) team, you...  ...maintain the health and efficiency of our supercomputing infrastructure. Our team empowers strong engineers with a high degree of... 

    OpenAI

    San Francisco, CA
    9 hours ago
  •  ...About the Role We are seeking a Cloud Infrastructure Engineer to help design and evolve the platforms that power OpenAI’s products. In this role, you will be a hands-on technical leader, driving the architecture, scalability, reliability, and security of critical infrastructure... 

    OpenAI

    San Francisco, CA
    8 hours ago
  • $166k - $225k

     ...and running the world's best data and AI infrastructure platform so our customers can use deep...  ...to improve their business. Founded by engineers — and customer obsessed — we leap at every...  ...'re only getting started. As a Senior Software Engineer on the Infrastructure teams,... 
    For contractors
    Local area
    Worldwide
    Flexible hours

    Databricks

    San Francisco, CA
    5 days ago
  •  ...Background Specter is creating a software-defined "control plane" for the physical...  ...will ultimately become the perception engine for a company's physical footprint, enabling...  ...Specter is hiring an ML infrastructure engineer to build and scale the machine... 

    S.e. Specter

    San Francisco, CA
    8 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Infrastructure. Be the first to apply!