Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Infra Engineer, Self-Hosted AI Platform

Serval

Who We Are Serval is an AI-native automation platform transforming how enterprises operate. We build intelligent agents that understand real-world workflows and execute them end-to-end — replacing manual processes and rigid legacy systems with adaptive, learning software. Founded in early 2024, Serval is already trusted by companies like Fox, Notion, Perplexity, Vercel, and Brex to automate high-volume, high-friction operational work across their organizations. At the core of Serval is an agentic AI platform that turns natural language into production-grade workflows. Our agents don’t just respond to requests — they reason, take action across systems, and continuously improve with usage. What began with operational use cases has quickly evolved into a horizontal AI automation layer used across IT, HR, Finance, Security, Legal, and Engineering. Our mission is to eliminate repetitive, manual work across the enterprise and give teams leverage through intelligent automation. Long term, we’re building the universal AI operations layer — a system of agents that sits across business functions and runs the workflows that keep modern companies moving. We’re backed by leading investors including Sequoia Capital, Redpoint Ventures, Meritech, First Round, General Catalyst, Elad Gil, and others, and founded by product and engineering leaders from Verkada. Role Overview Serval is building an AI platform to automate complex IT workflows for modern enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational systems that power Serval's AI agents and workflow automation platform. A critical part of this role is enabling and supporting self-hosted deployments for enterprise customers who require on‑premises or private cloud installations. This role is for engineers with deep expertise in distributed systems, infrastructure-as-code, production operations, and customer-facing infrastructure support who want to shape the technical architecture of a fast-growing platform. What You’ll Do Design, implement, and operate large-scale distributed systems that power Serval's AI agents, workflow orchestration, and data pipelines. Write and maintain Terraform modules to provision and manage cloud infrastructure across AWS, GCP, or Azure environments. Build and maintain deployment packages, installation scripts, and infrastructure templates that enable customers to self-host Serval in their own environments. Provide technical guidance and troubleshooting support to enterprise customers deploying and operating self-hosted instances of Serval. Ensure high availability, performance, and reliability of production systems through monitoring, alerting, incident response, and capacity planning. Build internal tools and platforms that enable product engineers to deploy, test, and operate services efficiently. Collaborate with engineering teams to design resilient, scalable architectures that support both cloud-hosted and self-hosted deployment models. Profile and optimize system performance, including compute, storage, networking, and database layers. Implement security best practices and ensure infrastructure meets enterprise compliance requirements for both managed and self-hosted deployments. What You’ll Need 3+ years building and operating large-scale distributed systems in production environments. Strong experience writing and maintaining Terraform for infrastructure provisioning and management. Deep knowledge of at least one major cloud provider (AWS, GCP, or Azure), including compute, networking, storage, and managed services. Experience building, packaging, and supporting self-hosted or on-premises software deployments for enterprise customers. Proficiency in Python, Go, or similar languages for building automation, tooling, and infrastructure services. Strong understanding of networking, databases, containerization (Docker, Kubernetes), and orchestration systems. Experience with monitoring, logging, alerting, and incident management tools (e.g., Datadog, Prometheus, Grafana, PagerDuty). Ability to communicate technical concepts clearly to customers and provide infrastructure support and guidance. Ability to debug complex system issues, analyze performance bottlenecks, and implement effective solutions. Nice to Have Experience with Kubernetes in production, including cluster management and workload orchestration. Background in CI/CD systems, build pipelines, and deployment automation. Experience with workflow orchestration systems such as Temporal , including long-running workflows, retries, and failure handling. Experience with data infrastructure (streaming systems like Kafka, data warehouses, ETL pipelines). Knowledge of security and compliance frameworks (SOC 2, ISO 27001, GDPR). Experience supporting enterprise customers with complex deployment requirements. Previous work at a high-growth startup or experience scaling infrastructure rapidly. What We Offer Impact : Be a key player in shaping the success of our product and company. Growth : Build a fundamentally new AI product offering with the support of our experienced team and investors. Grow rapidly with the company. Culture : Join a culture that values innovation, ownership, accountability, and fun. #J-18808-Ljbffr Serval

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Infra Engineer, Self-Hosted AI Platform in San Francisco, CA vacancy
  •  ...Clovyr AI Cloud Sales Representative Location: Remote Compensation: Commission...  ...Technology Clovyr AI Cloud is a self-hosted AI platform built for businesses that demand data...  ...results. Participate in product/engineering development process by communicating customer... 
    Platform
    Price work
    Remote work

    Clovyr

    San Francisco, CA
    4 days ago
  • Pump.co is seeking a DevOps Engineer to oversee AWS infrastructure and drive technical direction...  ...in building our cloud optimization platform, collaborating with multi-disciplinary teams...  .... The ideal candidate has 5+ years in infra or DevOps, preferably suited for a pre-Series... 
    Platform

    Pump

    San Francisco, CA
    3 days ago
  •  ...Every Identity, from AI to Human Identity...  ...The Infrastructure Platform and Shared Services...  ...day. The service is hosted on Amazon Web...  ...be doing Lead the Infra platform and shared...  ...architects and product engineering Build a world-class...  ...capabilities enabled with self-service Accelerate... 
    Platform

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    2 days ago
  • Dedalus Labs, Inc. is seeking a Systems Engineer to build distributed infrastructure for AI applications. This role requires strong skills in Rust, Go, or C...  ...projects that improve latency, build internal developer platforms, and enhance performance. Competitive salary,... 
    Platform
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs, Inc.

    San Francisco, CA
    9 hours ago
  •  ...in San Francisco is looking for a Growth Engineer to own the technical lifecycle of their digital...  ..., ensuring a seamless transition to self-hosted solutions on Vercel and Payload CMS. The...  ...an opportunity to join a rapidly growing AI startup with strong backing and a focus on... 
    Suggested

    HappyRobot

    San Francisco, CA
    3 days ago
  • Blaxel (YC X25) is seeking a Site Reliability Engineer in San Francisco, California, to ensure the reliability of our AI infrastructure platform. Your mission is to operate the core systems that power ultra-low-latency serverless computing as we serve billions of requests... 
    Platform

    Blaxel (YC X25)

    San Francisco, CA
    3 days ago
  • Amplitude, a leading AI analytics platform, seeks a Staff Platform Engineer to set technical direction for the cloud platform and drive AI‑first infrastructure initiatives. You will lead cross‑team efforts, shape Kubernetes and cloud tooling, and define standards that... 
    Platform

    Amplitude Software Co

    San Francisco, CA
    3 days ago
  • Ciridae is looking for systems engineers to tackle infrastructure problems related to AI production across multiple customer environments. You'll maintain the platform and work on distributed systems, APIs, and databases while utilizing your expertise in Python, Terraform... 
    Platform

    Ciridae

    San Francisco, CA
    1 day ago
  •  ...world-class Site Reliability Engineer to ensure the reliability,...  ..., and scalability of our AI infrastructure platform. You'll be building and...  ...closely with the founders, the infra team, and the dev team-and...  .... Design and implement self-healing, automated... 
    Platform

    Blaxel, Inc

    San Francisco, CA
    5 days ago
  • DoorDash USA is looking for a Software Engineer to join the Reliability Platforms team, contributing to infrastructure that improves service health and incident management. Your role will involve designing and building critical back-end services and collaborating with... 
    Platform

    DoorDash USA

    San Francisco, CA
    3 days ago
  • $57 - $61 per hour

    Join to apply for the Software Engineer, AI Safety, Mid-Level role at...  ...Jobright is an AI-powered career platform that helps job seekers...  ...project management skills. You are self-directed and can remove...  ...excited to learn about modern ML infra. Preferred: • Our infrastructure... 
    Platform
    Full time
    Summer work
    Internship
    H1b

    Jobright.ai

    San Francisco, CA
    3 days ago
  • $180k - $275k

     ...technical investments with rapid shipping velocity. As Software Engineer on the Platform team, you’ll collaborate across frontend, product, and data...  ...with real‑time collaboration systems, event pipelines, or AI‑powered applications (Nice to have) Compensation range: The... 
    Platform
    Full time
    Work at office
    Work from home

    Gamma

    San Francisco, CA
    3 days ago
  •  ...Overview Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time...  ...accessed through cloud APIs or as self-hosted/on-premises software, with high...  ...seeking a Pre-Sales Solutions Engineer to join our Applied Engineering... 
    Platform
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours

    Deepgram

    San Francisco, CA
    3 days ago
  • $204k - $281k

     ...Secure Every Identity, from AI to Human Identity is...  ..., Site Reliability Engineering San Francisco, California...  ...a day. The service is hosted on Amazon Web Services...  ...Manager of Infrastructure Platform and Shared Services,...  ...powerful tooling, intuitive self‑service capabilities,... 
    Platform
    Permanent employment
    Worldwide
    Flexible hours

    Okta, Inc.

    San Francisco, CA
    1 day ago
  • $210.8k - $248k

     ...understanding in healthcare. Our AI‑powered platform is purpose‑built for medical...  ..., technologists, and engineers working together throughout...  ...such as service templates and self‑serve infrastructure. Help...  ...up to 10% Abridge typically hosts a three‑day builder team retreat... 
    Platform
    Hourly pay
    Full time
    Flexible hours

    Abridge

    San Francisco, CA
    3 days ago
  •  ...understanding in healthcare. Our AI-powered platform was purpose-built for...  ...creatives, technologists, and engineers working together to empower...  ...such as service templates and self-serve infrastructure. Work...  ...up to 10% Abridge typically hosts a three-day builder team retreat... 
    Platform

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    3 days ago
  • $181k - $263k

     ...the data collaboration platform of choice for the world...  ...Staff Site Reliability Engineer who will set the technical...  ...with LLMs and AI-assisted development workflows...  ...they do. Fun: We host in-person and virtual events...  ...help you be your best self in your personal and... 
    Platform
    Work from home
    Flexible hours
    Night shift

    LiveRamp

    San Francisco, CA
    4 days ago
  • $170k - $190k

     ...Medrio Senior Site Reliability Engineer Responsibilities Build,...  ...support all environments which host the Medrio Platform Monitor environments for...  ...configuring and building alerting/self‑healing of issues Update...  ...-solving Experience with AI/ML tools for automation,... 
    Platform
    Temporary work
    Flexible hours

    Medrio

    San Francisco, CA
    1 day ago
  • $170k - $350k

    Job Title Founding Engineer Salary $170k-$350k + Equity Company Description well-funded AI infrastructure startup Job Description You...  ...layer of LLM-based agent self‑improvement. Location San Francisco...  ...systems, ML pipelines, or platform infrastructure at high‑growth,... 
    Platform

    Jack & Jill

    San Francisco, CA
    3 days ago
  • Lead Automation Engineer - Application Hosting At Gap Inc. IT, we value innovation and thrive on the opportunity...  ..., develop, or modify application platforms via automation. Leverages technical,...  ...with others for delivery, self directed for your deliverables with strong... 
    Platform
    Work experience placement

    Gap Inc

    San Francisco, CA
    3 days ago
  • Baseten is seeking a Senior Enterprise Platform Engineer to architect and lead infrastructure features for our enterprise customers and cloud partners. The role covers self-hosted and single-tenant environments, region-aware routing, and robust security integrations. You... 
    Platform

    Baseten

    San Francisco, CA
    3 days ago
  • $197.3k - $313.7k

     ...Job Category Software Engineering Job Details About Salesforce...  ...Salesforce is the #1 AI CRM, where humans with...  ...Job Details Salesforce hosts web services and...  ...nodes, and services that self-heal and self-optimize....  ...load balancing and proxy platform. The Microservices Platform... 
    Platform

    salesforce.com, inc.

    San Francisco, CA
    3 days ago
  •  ...That means infrastructure where AI systems find demand, acquire...  ...people: researchers who can ship, engineers who can think from first...  ...you’ll own: The product and platform layer for EICO’s company-building...  ...systems, distributed systems, infra, security, or internal tooling... 
    Platform

    Stealth AI Startup

    San Francisco, CA
    3 days ago
  • $120k - $140k

     ...looking for OpenFunnel’s Founding Full Stack Engineer (with AI) You’ll work directly with extremely...  ...frameworks etc. You have good cloud infra knowledge and have worked with Docker,...  ...0.00 2 weeks ago Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.0... 
    Platform
    Full time
    Work at office

    OpenFunnel (YC F24)

    San Francisco, CA
    3 days ago
  •  ...Agent SDK and Agent Studio, our no-code platform. Lead the creation and execution...  ...SDK adoption. Develop and deploy AI Agents as an Agent Software Engineer, building the knowledge to become a...  ...we produce. We continuously self-reflect to continuously self-improve... 
    Platform
    Full time
    Flexible hours

    Colorwave Inc

    San Francisco, CA
    3 days ago
  • $150k - $190k

     ...and our team is building its AI-native future. About the role...  ...partnering with Product and Engineering to test and ship the latest features...  ...will Manage the docs platform, with freedom to shape it how...  ...look like" Attend and even host events and meetups in the... 
    Platform
    Hourly pay

    Sentry

    San Francisco, CA
    4 days ago
  • Baseten in San Francisco is seeking a Senior Enterprise Platform Engineer to architect and develop infrastructure features for enterprise customers. You will lead technical initiatives and design solutions addressing complex regulatory requirements. The ideal candidate... 
    Platform

    Dormont Manufacturing Co

    San Francisco, CA
    9 hours ago
  • $127k - $296k

     ...at Figma Identify and define high‑impact AI use cases across marketing, taking them from...  ...to full workflow transformation and self‑sufficiency. Build custom tools, agents, automations...  ...) or equivalent agent orchestration platforms such as n8n, Workato, or Zapier, including... 
    Platform
    Work from home

    Figma

    San Francisco, CA
    3 days ago
  • $167.2k - $209k

     ...DigitalOcean is expanding its AI Infrastructure layer to support...  .... We are seeking a Senior Engineer 2 to join our AI Inference Data...  ...critical data plane components hosting large generative AI models. System...  ...SLOs to ensure superior platform health. What You’ll Bring To... 
    Platform
    Local area
    Remote work
    Worldwide
    Flexible hours

    DigitalOcean

    San Francisco, CA
    4 days ago
  • $240k - $300k

    About Retell AI Retell AI is using the first principles...  ...vision to build a CX platform of the AI era where the...  ...for a Principal/Staff Engineer to help own the...  ...systems, APIs at scale, infra/platform work, or developer...  ...Interviews (2-3 hrs): Hosted in our office if located... 
    Platform
    H1b
    Work at office

    Retell AI

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Infra Engineer, Self-Hosted AI Platform. Be the first to apply!