Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer (AI Infra)

Pylon Labs

At Pylon, we're building the future of B2B Post Sales.

We're building the all-in-one B2B post-sales support platform powered by conversational data and layered with intelligence to help our customers run their operations in real-time.

We're backed by a16z, BCV, General Catalyst, Y Combinator.

Currently more than 1300 companies including Linear, Cognition (makers of Devin), Modal Labs, and Incident.io run their support and customer success workflows with Pylon. You'll also find us on the Enterprise Tech 30 List.

Our product has a very large problem space so there's a ton of stuff to build and take ownership of - we'd be excited to get your help as we're hiring several extremely talented software engineers across the stack.

In this role, you will...
  • Build the platforms that power Pylon's AI features - prompt executions, search infra, and more!
  • Improve LLM observability - AI evals (online and offline), scorers, and set up Pylon's AI for the next wave of scaling
  • Improve the quality and performance of AI features
You might be a fit if the below describes you...
  • You dislike meetings and would much rather focus your time on building, being productive, and shipping code
  • You have strong engineering fundamentals, code efficiently, and you know what you're great at and what you're less great at
  • You thrive when you have autonomy, own as many of the details as possible, and project manage your own work
  • You're in SF or you're willing to relocate, you love working in-person, and you're serious about joining us to build a culture we'll all love
  • We work with React, Golang, GraphQL, and AWS
  • You'll join a strong technical team of senior engineers from places like Samsara, Affinity, and Airbnb.

Our perks

Fully covered medical, dental, and vision insurance for employees

401(k) retirement plan

Commuter benefits

Parental leave

14 company holidays + unlimited PTO

Annual offsite

Lunch, dinner, and snacks at the office

Fitness stipend

More about Pylon

Funding: Series B led by a16z and BCV ($51M total raised)

Founders: Advith Chelikani, Robert Eng, and Marty Kausas

Team: Currently 100 and growing!
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer (AI Infra) in San Francisco, CA vacancy
  •  ...get your help as we're hiring several extremely talented software engineers across the stack. In this role, you will... Build the platforms that power Pylon's AI features - prompt executions, search infra, and more! Improve LLM observability - AI evals (... 
    Suggested
    Work at office
    Relocation

    Pylon Labs

    San Francisco, CA
    1 day ago
  • $170k - $250k

     ...Senior Infra Software Engineer Title of Role: Senior Infra Software Engineer Location: San Francisco, onsite Company Stage of Funding: Seed - Software Development, Devtools, AI Office Type: Onsite Salary: $170K-$250K Company Description We're... 
    Suggested
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    13 hours ago
  •  ...Amperos Health Amperos Health is healthcare's first AI-native denial management and revenue recovery...  ...you. About the Role We're looking for our first engineer focused on infrastructure to start and lead Infra at Amperos. You'll get to own dev ops, dev experience... 
    Suggested
    Work at office
    Flexible hours

    Amperos Health, Inc

    San Francisco, CA
    13 hours ago
  • $292.5k - $405k

    A leading AI research company is seeking a Security Software Engineer to join their Infrastructure Security team. This role involves architecting and implementing security services to protect critical systems. Ideal candidates should have strong engineering skills in languages... 
    Suggested
    Remote work

    OpenAI

    San Francisco, CA
    3 days ago
  • $202.5k - $247.5k

     ...sharing localhost or running AI workloads in production. We're...  ...vital to our success! We like software that’s serious and culture...  ...below worth your time. About the Infra Platform Team The Infra...  ...team builds the systems ngrok engineers rely on to build, deploy, and... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours

    ngrok Inc.

    San Francisco, CA
    4 days ago
  •  ...MCP-Use Cloud Infrastructure Engineer MCP-Use is building open-source...  ...build and deploy custom AI agents with MCP servers. Think...  ...Role We are looking for an infra god. You are the person who knows...  ...out. You know how to make software easy to install and run on different... 

    Manufact, Inc.

    San Francisco, CA
    13 hours ago
  • Lambda is looking for an engineer in San Francisco to develop and maintain production systems critical to their AI cloud infrastructure. The ideal candidate will have over 2 years of experience with Go or Python, working within Linux environments. Key responsibilities include... 
    Flexible hours

    Lambda

    San Francisco, CA
    4 days ago
  •  ...across the industry. Our growing suite of AI solutions spans ambient AI clinical...  ...journey. We're looking for a talented backend engineer to help take Ambient AI to the next level...  ...extensive experience ~3+ years of professional software development industry experience ~... 
    Work at office

    Commure

    San Francisco, CA
    1 day ago
  •  ...their core mission. We’re the largest and fastest growing AI-native tax solution. Started in 2023, Numeral has raised over...  ...cases About the role: We’re looking for a foundational Software Engineer (Infrastructure) who thrives on solving complex distributed systems... 
    Work at office
    Remote work

    Numeral

    San Francisco, CA
    13 hours ago
  • AI Chopping Block, Inc. is seeking an Associate Software Engineer in San Francisco, CA. This hands-on role involves building Reinforcement Learning Environments and contributing to core systems. The ideal candidate would have 0-2 years of experience in software engineering... 
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    3 days ago
  • An innovative AI company in San Francisco seeks a software engineer to architect reinforcement learning environments and develop scalable training infrastructures for AI models. Ideal candidates should have at least 4 years of software engineering experience, skills in... 

    Preference Model, Inc.

    San Francisco, CA
    2 days ago
  • $150k - $250k

    Foundry Robotics Inc. is looking for a Senior Software Engineer to join their team in San Francisco. This vital role focuses on building cloud-based backend systems, infrastructure, and ensuring data integrity in advanced robotics manufacturing. The successful candidate... 

    Foundry Robotics Inc.

    San Francisco, CA
    2 days ago
  •  ...people interact with the web by building AI agents that can reliably do everyday digital...  ..., etc. Responsibilities: Scale infra for post-training of multimodal LLMs (CPT...  ...web-agent Work closely with product engineers to translate cutting-edge AI capabilities... 
    Work at office
    Relocation
    Visa sponsorship

    Yutori

    San Francisco, CA
    15 days ago
  • $180k - $310k

     ...term technical investments with rapid shipping velocity. As Software Engineer on the Platform team, you'll collaborate across frontend,...  ...Experience with real-time collaboration systems, event pipelines, or AI-powered applications (Nice to have) Compensation range... 
    Full time
    Work at office
    Work from home

    Gamma

    San Francisco, CA
    1 day ago
  • $200k - $275k

     ...work alongside our data scientists and ML engineers to build and operate the infrastructure...  ...this possible. Why You You've built AI infrastructure at a startup where you owned...  ...an early-stage startup where you owned infra end-to-end This Role Is Not For You... 
    Home office
    Day shift

    Healthleap AI

    San Francisco, CA
    13 hours ago
  •  ...About Us Conversion is the AI-native marketing automation platform for modern software companies. Our platform lets growth...  ...in San Francisco and includes engineers, designers, and operators from...  ...reliably for our customers. The best infra work here is measured in how... 

    Conversion Services

    San Francisco, CA
    3 days ago
  • $250k - $400k

     ...Founding Engineer Opportunity Location: San Francisco, CA Type...  ...API designed to give inboxes to AI agents and be the sole...  ...engineer with strong backend and infra instincts to help build the primitives...  ...shipping production software by real users as a software engineer... 
    Full time
    Work experience placement

    AgentMail (YC S25)

    San Francisco, CA
    2 days ago
  •  ...cloud infrastructure provider in San Francisco is looking for a Software Engineer to join their team. This role involves creating autonomous...  ...responsibilities include designing workflows and collaborating on AI tooling and automation frameworks. Competitive compensation is... 
    Flexible hours

    vercel.com

    San Francisco, CA
    4 days ago
  • $320k - $405k

     ...interpretable, and steerable AI systems. We want AI to be safe...  ...group of committed researchers, engineers, policy experts, and business...  ...Infrastructure Engineer, Node Infra About the role Anthropic...  ...~8+ years of software engineering experience, including... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    11 days ago
  •  ...building In 2026, we're on the verge of an "infinite software crisis." How will we support, maintain, and...  ...application development? Our answer is Sazabi: the AI-native observability platform for fast-moving engineering teams. Sazabi gives teams a single place to ask... 
    Full time
    Work at office

    Sazabi

    San Francisco, CA
    13 hours ago
  • A leading AI technology firm in San Francisco is seeking an AI Infra Engineer to enhance their infrastructure. The successful candidate will design and maintain Kubernetes clusters and manage Slurm for distributed training. Important skills include extensive experience... 

    Perplexity

    San Francisco, CA
    4 days ago
  • $141.9k - $190.3k

     ...Sr Product Software Engineer Technology is at the heart of Disney's past, present, and future....  ...streaming video through the power of data and AI. We design and build innovative...  ...able to partner across AI engineering, infra, and product teams. ~ Familiarity with... 

    Disney France

    San Francisco, CA
    2 days ago
  • $150k - $200k

    Truebill is seeking a Cloud Security Engineer in Washington, D.C. to manage and enhance AWS security strategies while collaborating with the InfoSec team. You will be responsible for evolving our cloud infrastructure, ensuring secure deployments, and treating detection... 
    Work at office

    Truebill

    San Francisco, CA
    4 days ago
  • A leading cloud security firm is seeking a Cloud Security Architect to design and implement robust security solutions for enterprise clients. Responsibilities include architecting AWS tenant isolation, managing Kubernetes security, and maintaining cloud security posture...

    Mercor

    San Francisco, CA
    4 days ago
  •  ...create the next generation of Gen AI-driven code reviewers: a...  ...significantly outperforms individual engineers. We combine language models...  ...to push the boundaries of software development efficiency and quality...  ...alongside AI researchers, infra specialists, frontend engineers... 
    Remote work

    CodeRabbit

    San Francisco, CA
    13 hours ago
  •  ...We want a Platform/Infrastructure engineer to help shape how Promise delivers and runs software, and to automate as much of that...  ...faster Automate platform work with AI Respond to incidents and make...  ..., with time spent in a platform, infra, or SRE role Kubernetes... 
    Permanent employment
    Local area
    Flexible hours

    Promise Co.

    San Francisco, CA
    13 hours ago
  • $209k - $253k

    A leading AI infrastructure company in San Francisco seeks a Staff Software Engineer to design and develop control systems for GPU node management. The candidate will be critical in building foundational cloud infrastructure and achieving business goals. This role requires... 

    Crusoe Energy Systems LLC

    San Francisco, CA
    4 days ago
  • FriendliAI is looking for a Forward Deployed Engineer (FDE) to assist enterprises in deploying and operating generative AI workloads. The role involves collaborating with customers to address AI inference challenges, manage Kubernetes workloads, and contribute to deployment... 
    Flexible hours

    FriendliAI

    San Francisco, CA
    2 days ago
  • Lambda Inc. is seeking an expert in high-performance storage systems in San Francisco. You will design validation plans, draft standard operating procedures, and manage access-control processes. The ideal candidate will have over 8 years of experience in large-scale storage...
    Flexible hours

    Lambda Inc.

    San Francisco, CA
    2 days ago
  • A leading AI career network company in San Francisco is seeking a Senior Cloud Engineer to manage and architect scalable cloud infrastructure. The ideal candidate will define best practices for cloud deployments, build CI/CD pipelines, and drive improvements using automation... 

    Handshake

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer (AI Infra). Be the first to apply!