Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior/Staff AI Infrastructure Engineer

Full-time

Echelon Corporation

About Echelon

Echelon is building the AI platform for Business Operations. Our goal is to automate the knowledge work of BizOps so one exceptional operator can deliver the leverage of an entire team, as Ramp and Rippling have done for Finance and HR.

Our platform combines passive process mining with a living ontology that maps how work happens across people, systems, documents, decisions, and outcomes. It connects structured and unstructured data trapped in fragmented, duplicative, and legacy enterprise systems, then turns that context into automated workflows and AI agents.

We are an early-stage company tackling a difficult technical problem at high speed. Engineers work directly with founders and customers, make decisions with incomplete information, ship production systems, and own the results. The pace, rate of change, and standards are high.


The mandate

Build the secure execution substrate for Echelon's agents. You will scale ephemeral sandboxes, optimize filesystem and startup performance, and make long-running agent work durable under load without weakening tenant isolation or operational control.

What you'll own

  • Design and operate sandbox lifecycle systems for agent code execution, browser work, document processing, and tool use.

  • Improve sandbox startup time, density, scheduling, warm pools, caching, and resource utilization.

  • Build fast, reliable filesystem primitives for ephemeral and persistent agent state, large artifacts, and concurrent workloads.

  • Enforce tenant isolation, network policy, secrets boundaries, quotas, and least-privilege access.

  • Make long-running agent jobs durable through checkpointing, retries, idempotency, cancellation, and recovery.

  • Scale orchestration and control-plane services through rapid workload growth and unpredictable bursts.

  • Build observability for resource pressure, execution failures, queue health, noisy neighbors, cost, and end-to-end latency.

  • Run load tests, capacity plans, failure drills, and incident reviews; fix root causes rather than adding fragile workarounds.


What you bring

  • 5+ years building production infrastructure, distributed systems, developer platforms, or execution runtimes.

  • Hands-on ownership of containerized or virtualized workloads in a multi-tenant production environment.

  • Strong Linux systems knowledge across processes, filesystems, networking, resource isolation, and performance debugging.

  • Experience with Kubernetes or a comparable scheduler, infrastructure as code, and cloud primitives on AWS or Azure.

  • Strong programming ability in Go, Rust, TypeScript, Python, or another systems-oriented language.

  • Experience designing for retries, idempotency, backpressure, load shedding, observability, and safe rollouts.

  • Security instincts appropriate for executing untrusted or model-generated work.


Useful experience

  • Firecracker, gVisor, Kata Containers, namespaces/cgroups, seccomp, or eBPF.

  • Sandbox products such as E2B, Modal, Fly Machines, or custom ephemeral compute platforms.

  • FUSE, overlay filesystems, content-addressed storage, snapshotting, distributed caches, or object storage.

  • Agent runtimes, code interpreters, browser automation, remote development environments, or CI execution systems.

  • BYOC, private networking, customer-managed deployments, or enterprise security reviews.

  • Inngest, Temporal, Kafka, NATS, or other durable workflow and event systems.


Benefits

  • Fully covered health, dental, and vision insurance.

  • 401(k) plan.

  • Team lunches and dinners in the office.

  • Unlimited PTO.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior/Staff AI Infrastructure Engineer in San Francisco, CA vacancy
  • $192k - $259.8k

     ...stories, and career news. Job Summary: Drata's AI Platform team builds the production infrastructure that powers AI features across our compliance...  ...ll work closely with our agent developers, product engineers, and an embedded SRE partner, sitting at the intersection... 
    Senior
    Full time
    Work at office
    Immediate start
    Worldwide
    Monday to Friday
    Flexible hours

    Drata

    San Francisco, CA
    1 day ago
  • $156.06k - $211.14k

    Afresh, the AI platform for grocery, began by tackling the most complex problem...  ...knowledge you feed them is not.As a Senior AI Platform Engineer, you build the AI and data platform...  ...of it, and the evaluation and serving infrastructure underneath. Your "customers" are Afresh... 
    Senior
    Full time
    Live in
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours
    3 days per week

    Afresh

    San Francisco, CA
    1 day ago
  • A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training. The ideal candidate has over 3 years of experience in infrastructure engineering and strong... 
    Senior

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $151.8k - $265.35k

     ...exceptional content effortlessly. The AI for Engineering team builds a scalable, production-grade...  ..., and personalization.We are seeking a Staff Engineer - AI for Engineering to design...  ...streams into adaptive AI systems.Mentor senior engineers in modern AI system design,... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    1 day ago
  • Cloudflare seeks a Senior Systems Engineer to help build and operate the AI Gateway at the network edge. You’ll move from half‑formed ideas to production‑ready systems across distributed services, high‑throughput APIs, and developer workflows, collaborating with Workers... 
    Senior

    Cloudflare Inc

    San Francisco, CA
    3 days ago
  • A tech company specializing in AI infrastructure is seeking a Software Engineer to build a scalable compute platform for its generative video models. The ideal candidate will have over 5 years of experience in MLOps or AI infrastructure management, along with strong Python... 
    Senior

    HeyGen

    San Francisco, CA
    6 days ago
  • Grow Therapy in San Francisco is seeking a Senior AI Enablement Engineer to define how AI transforms operations across the organization. You will design and build foundational AI infrastructure that enhances efficiency. Responsibilities include implementing AI systems,... 
    Senior
    Flexible hours
    3 days per week

    Grow Therapy

    San Francisco, CA
    3 days ago
  •  ...deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, Infrastructure Platforms team, you are an integral part of...  ...secure, scalable cloud platforms optimized for AI/ML workloads.Partner with AI teams to... 
    Senior
    For contractors

    JP Morgan Chase

    San Francisco, CA
    2 days ago
  • $112.8k - $153.7k

     ...willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and...  ..., Databricks) and own BI delivery infrastructure (e.g., Power BI, Tableau). You set the...  ...Databricks, etc.) are a plus.Hands-on AI/ML/GenAI enablement experience (model... 
    Senior
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    San Francisco, CA
    3 days ago
  • CoreWeave, The Essential Cloud for AI, is seeking a Software and AI Engineer, IT Systems, to design and build AI agents and internal apps across web, mobile, and backend services. You will work with LangChain, LangGraph, ChatGPT API, Glean API, and modern front-end/back... 
    Senior

    CoreWeave

    San Francisco, CA
    3 days ago
  • $250k - $385k

     ...investment firm in San Francisco is looking for engineers to join their Acceleration team. This role focuses on using AI tools to enhance product delivery and...  ...Ideal candidates will have 4 to 20+ years in infrastructure/platform engineering or developer acceleration... 
    Senior

    Pantera Capital

    San Francisco, CA
    5 days ago
  • CoreWeave is hiring software engineers to build and scale Weave, the observability and evaluation platform for AI agents. In a small, growing team, you will design core functionality, ship features, and engage directly with users to improve the product experience. You... 
    Senior

    Weights & Biases

    San Francisco, CA
    3 days ago
  • Marble is looking for a Senior Software Engineer in San Francisco, California. This role involves building the core product experience of an AI-powered tax platform. As an early hire, you will contribute to shaping the architecture and features of the platform. Ideal candidates... 
    Senior

    Marble

    San Francisco, CA
    2 days ago
  • Adobe is seeking a Senior Staff Applied Scientist to convert cutting-edge research into product...  ...generation, editing, and multimodal AI. You will scout, adapt, and implement the...  ...collaborating with world-class researchers and ML engineers to deploy research in Adobe #J-18808-... 
    Senior

    Adobe

    San Francisco, CA
    3 days ago
  • Plaid is transforming how teams work with AI by building internal tooling that empowers non-engineering groups. As a Senior Software Engineer on Intelligent Tooling, you...  .... You will partner with Security, Infrastructure, and internal stakeholders to ship reliable... 
    Senior

    Segment (Twilio)

    San Francisco, CA
    5 days ago
  • About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS...  ...data, applications, processes, and AI into a single, governed platform. A leader...  ...We're looking for an exceptional Staff Software Engineer to help define and build the distributed... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    Workato

    San Francisco, CA
    3 days ago
  • Procore Technologies in San Francisco seeks a Senior Product Manager, Domain Team Enablement,...  ...platform strategy for Procore’s internal AI enablement. You will shape APIs, SDKs,...  ...architectural drift. Partner with engineering, data science, and product teams to create... 
    Senior

    Procore Technologies

    San Francisco, CA
    4 days ago
  • Build the best products in house to help scale our work   Contract length: 1-3 months
    Senior
    Full time
    Contract work

    A16z New Media

    San Francisco, CA
    1 day ago
  •  ...We’re looking for a Senior AI engineer to build the core intelligence behind AI teammates for finance. You’ll develop systems that go beyond copilots and actually execute work, combining reasoning, context, and action inside real enterprise workflows. What you’ll do... 
    Senior
    Full time

    Numos Ai

    San Francisco, CA
    1 day ago
  •  ...Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance...  ...About the Role We’re looking for a hungry, creative engineer who thrives in a high-trust, high-velocity environment. You’... 
    Senior
    Full time

    Parasail

    San Francisco, CA
    1 day ago
  •  ...Python. The company seeks language agnostic engineers who are able and interested to learn new...  ...simulation and evaluation platform for AI agents, and 50% working on the framework...  ...core frameworks, abstractions, and infrastructure used to develop, orchestrate, and deploy... 
    Senior

    Skyrocket Ventures

    San Francisco, CA
    5 days ago
  • $200k - $350k

     ...behalf of a fast-growing technology company building critical infrastructure that powers high-volume, real-time business operations across multiple systems and platforms. We are seeking a Senior AI Engineer to develop, deploy, and optimize production AI systems.... 
    Senior
    Remote job
    Full time
    Immediate start

    Pragmatike

    San Francisco, CA
    1 day ago
  • $154.39k - $247.02k

     ...ownership and drive real change. Constantly grow as you work hard for a mission that matters at a company where you matter.AI Infrastructure Engineer, Corporate AI TeamTeam & Role OverviewAxon’s Corporate AI Team sits within Business Technology and builds internal-facing... 
    Work experience placement

    Axon

    San Francisco, CA
    4 days ago
  • $250k - $300k

     ...About Us At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge...  ...reliable, transparent, and useful. Our team includes engineers, researchers, product builders, and operators who care about... 
    Senior
    Full time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    You.com

    San Francisco, CA
    1 day ago
  • $160k - $207k

     ...control, and confidence. Semgrep gets smarter as you build, with AI that learns your context to cut false positives and prioritize...  .... Learn more at semgrep.dev . About the role As an AI engineer, you’ll apply LLM technologies throughout our stack to enhance Semgrep... 
    Senior
    Full time
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep

    San Francisco, CA
    1 day ago
  • $286.2k - $326.7k

     ...Overview Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One...  ...experiences. Our investments in technology infrastructure and world-class talent — along with...  ...office hours, mentoring Staff, Principal and Senior engineers, authoring... 
    Senior
    Full time
    Part time
    Work at office
    Local area
    Remote work

    Capital One

    San Francisco, CA
    a month ago
  • $286.2k - $326.7k

     ...Overview Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) At Capital One, we are creating responsible and reliable...  ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience... 
    Senior
    Full time
    Part time
    Local area
    Remote work

    Capital One

    San Francisco, CA
    28 days ago
  • $314.8k - $359.3k

    {"description": "Senior Distinguished AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    San Francisco, CA
    1 day ago
  •  .... About the Role Fieldguide is building AI agents for the most complex audit and advisory workflows...  ...Gil, and other top-tier investors. As a Senior AI Engineer, Quality , you will own the evaluation infrastructure that ensures our AI agents perform reliably at... 
    Senior
    Remote job
    Full time
    Work at office
    Work from home
    Flexible hours

    Field Guide Inc

    San Francisco, CA
    1 day ago
  • THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...
    Senior
    Work at office

    Harnham

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior/Staff AI Infrastructure Engineer. Be the first to apply!