Infra Engineer, Self-Hosted AI Platform
Serval
Who We Are Serval is an AI-native automation platform transforming how enterprises operate. We build intelligent agents that understand real-world workflows and execute them end-to-end — replacing manual processes and rigid legacy systems with adaptive, learning software. Founded in early 2024, Serval is already trusted by companies like Fox, Notion, Perplexity, Vercel, and Brex to automate high-volume, high-friction operational work across their organizations. At the core of Serval is an agentic AI platform that turns natural language into production-grade workflows. Our agents don’t just respond to requests — they reason, take action across systems, and continuously improve with usage. What began with operational use cases has quickly evolved into a horizontal AI automation layer used across IT, HR, Finance, Security, Legal, and Engineering. Our mission is to eliminate repetitive, manual work across the enterprise and give teams leverage through intelligent automation. Long term, we’re building the universal AI operations layer — a system of agents that sits across business functions and runs the workflows that keep modern companies moving. We’re backed by leading investors including Sequoia Capital, Redpoint Ventures, Meritech, First Round, General Catalyst, Elad Gil, and others, and founded by product and engineering leaders from Verkada. Role Overview Serval is building an AI platform to automate complex IT workflows for modern enterprises. As a Software Engineer, Infrastructure, you'll build and scale the foundational systems that power Serval's AI agents and workflow automation platform. A critical part of this role is enabling and supporting self-hosted deployments for enterprise customers who require on‑premises or private cloud installations. This role is for engineers with deep expertise in distributed systems, infrastructure-as-code, production operations, and customer-facing infrastructure support who want to shape the technical architecture of a fast-growing platform. What You’ll Do Design, implement, and operate large-scale distributed systems that power Serval's AI agents, workflow orchestration, and data pipelines. Write and maintain Terraform modules to provision and manage cloud infrastructure across AWS, GCP, or Azure environments. Build and maintain deployment packages, installation scripts, and infrastructure templates that enable customers to self-host Serval in their own environments. Provide technical guidance and troubleshooting support to enterprise customers deploying and operating self-hosted instances of Serval. Ensure high availability, performance, and reliability of production systems through monitoring, alerting, incident response, and capacity planning. Build internal tools and platforms that enable product engineers to deploy, test, and operate services efficiently. Collaborate with engineering teams to design resilient, scalable architectures that support both cloud-hosted and self-hosted deployment models. Profile and optimize system performance, including compute, storage, networking, and database layers. Implement security best practices and ensure infrastructure meets enterprise compliance requirements for both managed and self-hosted deployments. What You’ll Need 3+ years building and operating large-scale distributed systems in production environments. Strong experience writing and maintaining Terraform for infrastructure provisioning and management. Deep knowledge of at least one major cloud provider (AWS, GCP, or Azure), including compute, networking, storage, and managed services. Experience building, packaging, and supporting self-hosted or on-premises software deployments for enterprise customers. Proficiency in Python, Go, or similar languages for building automation, tooling, and infrastructure services. Strong understanding of networking, databases, containerization (Docker, Kubernetes), and orchestration systems. Experience with monitoring, logging, alerting, and incident management tools (e.g., Datadog, Prometheus, Grafana, PagerDuty). Ability to communicate technical concepts clearly to customers and provide infrastructure support and guidance. Ability to debug complex system issues, analyze performance bottlenecks, and implement effective solutions. Nice to Have Experience with Kubernetes in production, including cluster management and workload orchestration. Background in CI/CD systems, build pipelines, and deployment automation. Experience with workflow orchestration systems such as Temporal , including long-running workflows, retries, and failure handling. Experience with data infrastructure (streaming systems like Kafka, data warehouses, ETL pipelines). Knowledge of security and compliance frameworks (SOC 2, ISO 27001, GDPR). Experience supporting enterprise customers with complex deployment requirements. Previous work at a high-growth startup or experience scaling infrastructure rapidly. What We Offer Impact : Be a key player in shaping the success of our product and company. Growth : Build a fundamentally new AI product offering with the support of our experienced team and investors. Grow rapidly with the company. Culture : Join a culture that values innovation, ownership, accountability, and fun. #J-18808-Ljbffr Serval
- ...Clovyr AI Cloud Sales Representative Location: Remote Compensation: Commission... ...Technology Clovyr AI Cloud is a self-hosted AI platform built for businesses that demand data... ...results. Participate in product/engineering development process by communicating customer...PlatformPrice workRemote work
- Pump.co is seeking a DevOps Engineer to oversee AWS infrastructure and drive technical direction... ...in building our cloud optimization platform, collaborating with multi-disciplinary teams... .... The ideal candidate has 5+ years in infra or DevOps, preferably suited for a pre-Series...Platform
- ...Every Identity, from AI to Human Identity... ...The Infrastructure Platform and Shared Services... ...day. The service is hosted on Amazon Web... ...be doing Lead the Infra platform and shared... ...architects and product engineering Build a world-class... ...capabilities enabled with self-service Accelerate...Platform
- Dedalus Labs, Inc. is seeking a Systems Engineer to build distributed infrastructure for AI applications. This role requires strong skills in Rust, Go, or C... ...projects that improve latency, build internal developer platforms, and enhance performance. Competitive salary,...PlatformWork at officeVisa sponsorshipRelocation package
- ...in San Francisco is looking for a Growth Engineer to own the technical lifecycle of their digital... ..., ensuring a seamless transition to self-hosted solutions on Vercel and Payload CMS. The... ...an opportunity to join a rapidly growing AI startup with strong backing and a focus on...Suggested
- Blaxel (YC X25) is seeking a Site Reliability Engineer in San Francisco, California, to ensure the reliability of our AI infrastructure platform. Your mission is to operate the core systems that power ultra-low-latency serverless computing as we serve billions of requests...Platform
- Amplitude, a leading AI analytics platform, seeks a Staff Platform Engineer to set technical direction for the cloud platform and drive AI‑first infrastructure initiatives. You will lead cross‑team efforts, shape Kubernetes and cloud tooling, and define standards that...Platform
- Ciridae is looking for systems engineers to tackle infrastructure problems related to AI production across multiple customer environments. You'll maintain the platform and work on distributed systems, APIs, and databases while utilizing your expertise in Python, Terraform...Platform
- ...world-class Site Reliability Engineer to ensure the reliability,... ..., and scalability of our AI infrastructure platform. You'll be building and... ...closely with the founders, the infra team, and the dev team-and... .... Design and implement self-healing, automated...Platform
- DoorDash USA is looking for a Software Engineer to join the Reliability Platforms team, contributing to infrastructure that improves service health and incident management. Your role will involve designing and building critical back-end services and collaborating with...Platform
$57 - $61 per hour
Join to apply for the Software Engineer, AI Safety, Mid-Level role at... ...Jobright is an AI-powered career platform that helps job seekers... ...project management skills. You are self-directed and can remove... ...excited to learn about modern ML infra. Preferred: • Our infrastructure...PlatformFull timeSummer workInternshipH1b$180k - $275k
...technical investments with rapid shipping velocity. As Software Engineer on the Platform team, you’ll collaborate across frontend, product, and data... ...with real‑time collaboration systems, event pipelines, or AI‑powered applications (Nice to have) Compensation range: The...PlatformFull timeWork at officeWork from home- ...Overview Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time... ...accessed through cloud APIs or as self-hosted/on-premises software, with high... ...seeking a Pre-Sales Solutions Engineer to join our Applied Engineering...PlatformWork at officeLocal areaRemote workHome officeFlexible hours
$204k - $281k
...Secure Every Identity, from AI to Human Identity is... ..., Site Reliability Engineering San Francisco, California... ...a day. The service is hosted on Amazon Web Services... ...Manager of Infrastructure Platform and Shared Services,... ...powerful tooling, intuitive self‑service capabilities,...PlatformPermanent employmentWorldwideFlexible hours$210.8k - $248k
...understanding in healthcare. Our AI‑powered platform is purpose‑built for medical... ..., technologists, and engineers working together throughout... ...such as service templates and self‑serve infrastructure. Help... ...up to 10% Abridge typically hosts a three‑day builder team retreat...PlatformHourly payFull timeFlexible hours- ...understanding in healthcare. Our AI-powered platform was purpose-built for... ...creatives, technologists, and engineers working together to empower... ...such as service templates and self-serve infrastructure. Work... ...up to 10% Abridge typically hosts a three-day builder team retreat...Platform
$181k - $263k
...the data collaboration platform of choice for the world... ...Staff Site Reliability Engineer who will set the technical... ...with LLMs and AI-assisted development workflows... ...they do. Fun: We host in-person and virtual events... ...help you be your best self in your personal and...PlatformWork from homeFlexible hoursNight shift$170k - $190k
...Medrio Senior Site Reliability Engineer Responsibilities Build,... ...support all environments which host the Medrio Platform Monitor environments for... ...configuring and building alerting/self‑healing of issues Update... ...-solving Experience with AI/ML tools for automation,...PlatformTemporary workFlexible hours$170k - $350k
Job Title Founding Engineer Salary $170k-$350k + Equity Company Description well-funded AI infrastructure startup Job Description You... ...layer of LLM-based agent self‑improvement. Location San Francisco... ...systems, ML pipelines, or platform infrastructure at high‑growth,...Platform- Lead Automation Engineer - Application Hosting At Gap Inc. IT, we value innovation and thrive on the opportunity... ..., develop, or modify application platforms via automation. Leverages technical,... ...with others for delivery, self directed for your deliverables with strong...PlatformWork experience placement
- Baseten is seeking a Senior Enterprise Platform Engineer to architect and lead infrastructure features for our enterprise customers and cloud partners. The role covers self-hosted and single-tenant environments, region-aware routing, and robust security integrations. You...Platform
$197.3k - $313.7k
...Job Category Software Engineering Job Details About Salesforce... ...Salesforce is the #1 AI CRM, where humans with... ...Job Details Salesforce hosts web services and... ...nodes, and services that self-heal and self-optimize.... ...load balancing and proxy platform. The Microservices Platform...Platform- ...That means infrastructure where AI systems find demand, acquire... ...people: researchers who can ship, engineers who can think from first... ...you’ll own: The product and platform layer for EICO’s company-building... ...systems, distributed systems, infra, security, or internal tooling...Platform
$120k - $140k
...looking for OpenFunnel’s Founding Full Stack Engineer (with AI) You’ll work directly with extremely... ...frameworks etc. You have good cloud infra knowledge and have worked with Docker,... ...0.00 2 weeks ago Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.0...PlatformFull timeWork at office- ...Agent SDK and Agent Studio, our no-code platform. Lead the creation and execution... ...SDK adoption. Develop and deploy AI Agents as an Agent Software Engineer, building the knowledge to become a... ...we produce. We continuously self-reflect to continuously self-improve...PlatformFull timeFlexible hours
$150k - $190k
...and our team is building its AI-native future. About the role... ...partnering with Product and Engineering to test and ship the latest features... ...will Manage the docs platform, with freedom to shape it how... ...look like" Attend and even host events and meetups in the...PlatformHourly pay- Baseten in San Francisco is seeking a Senior Enterprise Platform Engineer to architect and develop infrastructure features for enterprise customers. You will lead technical initiatives and design solutions addressing complex regulatory requirements. The ideal candidate...Platform
$127k - $296k
...at Figma Identify and define high‑impact AI use cases across marketing, taking them from... ...to full workflow transformation and self‑sufficiency. Build custom tools, agents, automations... ...) or equivalent agent orchestration platforms such as n8n, Workato, or Zapier, including...PlatformWork from home$167.2k - $209k
...DigitalOcean is expanding its AI Infrastructure layer to support... .... We are seeking a Senior Engineer 2 to join our AI Inference Data... ...critical data plane components hosting large generative AI models. System... ...SLOs to ensure superior platform health. What You’ll Bring To...PlatformLocal areaRemote workWorldwideFlexible hours$240k - $300k
About Retell AI Retell AI is using the first principles... ...vision to build a CX platform of the AI era where the... ...for a Principal/Staff Engineer to help own the... ...systems, APIs at scale, infra/platform work, or developer... ...Interviews (2-3 hrs): Hosted in our office if located...PlatformH1bWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Infra Engineer, Self-Hosted AI Platform. Be the first to apply!
- data platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- platform engineer San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- director of digital platform San Francisco, CA
- digital platform specialist San Francisco, CA
- power platform San Francisco, CA
- platform manager San Francisco, CA

