Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Platform Engineer — Scalable, Secure LLM Infra

BrainCo

About Brain Co. Brain Co. is an applied AI startup co-founded by Jared Kushner and Elad Gil, and backed by leading Silicon Valley builders including Patrick Collison and Andrej Karpathy. We are building AI applications for the world’s most important institutions, delivering impact on real-world problems across governments, healthcare systems, and critical industries. Our progress so far: Automated construction permitting for a sovereign government 80% faster, unlocking $375M+ in value Optimized supply chains for a leading global energy company 30% lower cost, 99% reliability, preventing $100M+ in losses Streamlined hospital patient care across national health systems 40% better outcomes, 80% less admin work Company momentum: Raised a $55M Series A from leading investors Built a team of 70+ AI experts from Tesla, Google DeepMind, NVIDIA, and Databricks At Brain Co., we focus on applying frontier AI to real institutional challenges, working alongside governments, healthcare systems, and critical industries to modernize how essential services operate. We are looking for leaders who want to help bring new technology into institutions that impact millions of people. About the role: You'll join the team that builds and enables agentic workflows across Brain Co. For every engineer, operator, and business team internally, and for the production AI systems we deploy to governments, healthcare systems, and critical industries. This is a platform role at the center of the company's agent-first strategy: you'll build foundational systems used by every engineering team, and the bar is product-grade because the entire company depends on them. What you’ll work on: Own the foundations of how LLMs are used across the company: cost visibility and controls, data privacy, identity and access, routing, and the security posture around all provider traffic. Design the sandboxing, orchestration, audit, and guardrail layers that product teams build their agents on, so verticals don't need to invent their own abstraction. Solve the hard problems: prompt-injection defenses, scoped credentials, kill switches, multi-tenant isolation (including VM-level pod isolation), and runaway-cost controls. Design the orchestration, isolation, and resource models that make this viable: cold-start vs. always-on tradeoffs, credential and token lifecycle, fan-out and fan-in patterns, fairness and quota enforcement across tenants, and the observability needed to debug at that volume. Make AI-assisted development a first-class platform layer: coding agents that review and ship code, automate CI, refactor at scale, and run as background workers across the codebase, together with the canonical scaffolding and guardrails that govern them. Build the systems that let every team; engineering, operations, and the business, run their own agents reliably and safely against the tools they already use, with the right credentials, scheduling, memory, and audit underneath. End-to-end ownership: architecture, implementation, rollout, observability, on-call, and iteration based on internal user feedback. Partner closely with security, infrastructure, and product teams to make agent deployments safe by default. You Might Be a Great Fit If You… Have 5+ years building backend systems in production, with deep proficiency in at least one of Python, TypeScript, Go, or Rust. Bring strong fundamentals in distributed systems: consistency, idempotency, retries, failure modes, queueing, scheduling. Have designed and operated APIs and services that other engineers depend on. Have a proven track record building shared infrastructure, internal platforms, or developer-facing services that real users adopted. Have strong intuition for developer experience, long-term maintainability, and where to draw abstraction boundaries. Are comfortable owning the full lifecycle: writing the design doc, shipping the MVP, hardening it, and driving adoption across the company. Have owned services with real uptime and operational responsibility, and are comfortable with observability stacks, incident response, and SLOs. Bring cloud-native experience: Kubernetes, infrastructure-as-code, OAuth/OIDC, secrets management. Ways you might stand out: Experience building or operating LLM infrastructure: gateways, inference systems, prompt routing, cost attribution, evaluation harnesses. Experience with agent frameworks, tool-use systems, or sandboxed code execution. Security instincts around prompt injection, supply-chain risk in agent ecosystems, and credential scoping for autonomous systems. Background in multi-tenant, regulated, or government deployments (HIPAA, SOC2). Open-source contributions to AI infrastructure, agent tooling, or developer platforms. Why Join Us Collaborate with industry veterans from Tesla, DeepMind, Databricks, and more Accelerate your career with ownership based on impact, not tenure Earn competitive compensation + meaningful equity in a high-growth company Thrive in a culture built on speed, curiosity, and impact Benefits Competitive salary plus equity Daily lunches Commuter benefits 401(k) Medical, Dental and Vision Unlimited PTO #J-18808-Ljbffr BrainCo

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Platform Engineer — Scalable, Secure LLM Infra in San Francisco, CA vacancy
  • $216.2k - $270.25k

     ...technology company is seeking a Software Engineer to join their ML Infrastructure team in San Francisco. You will design platforms for scalable serving of LLM workloads, work closely with...  ...270,250 USD, plus equity and comprehensive benefits. #J-18808-Ljbffr Scale AI
    Suggested

    Scale AI

    San Francisco, CA
    1 day ago
  • Pi Security is seeking a Platform Engineer to build and operate the infrastructure behind our agentic security platform. You’ll own production‑grade cloud infrastructure, Kubernetes clusters, and CI/CD pipelines to keep services reliable, secure, and ship‑ready. You’ll... 
    Suggested

    Pi Security

    San Francisco, CA
    1 day ago
  •  ...Francisco, CA seeks a Staff Software Engineer to advance its data platform. You will architect scalable data services, surface...  ...product experience, and support ML/LLM data infrastructure. The role...  ...leadership, shaping data quality, security, and reliability across... 
    Suggested

    Pantheon

    San Francisco, CA
    1 day ago
  • $171k - $242k

    Artos AI in San Francisco is seeking an engineer to join their fast-paced team focused on AI/ML applications. The...  ...involves developing and scaling a platform that supports biopharma companies in...  ...requires hands-on experience with LLM-based applications and a solid understanding... 
    Suggested
    Work at office

    Artos AI

    San Francisco, CA
    1 day ago
  •  ...Brain Co. Brain Co. is an applied AI startup co-founded by Jared...  ...people. About the Role: As our Security Engineer, Infrastructure, you'll secure the platform layer end-to-end including cloud...  ...work shoulder-to-shoulder with our infra team as a true engineering partner... 
    Suggested
    Worldwide

    BrainCo

    San Francisco, CA
    1 day ago
  • $100k - $210k

    A fast-moving startup is seeking a Founding DevOps Engineer to build and scale secure, reliable infrastructure. This role requires a technical thinker ready to tackle complex problems across cloud environments and CI/CD. Key responsibilities include automating processes... 

    Corgea

    San Francisco, CA
    1 day ago
  • Mixpanel is seeking an experienced Senior Software Engineer for the AI Platform team. You will build scalable, secure infrastructure to accelerate AI agent development and lead a small, fast-paced group driving AI product development across the company. You will architect... 

    Mixpanel-1

    San Francisco, CA
    1 day ago
  •  ...experience in offensive security, including manual...  ...Strong expertise across the AI/ML stack, including MLOps...  ..., and securing LLM pipelines and AI workflows...  ...environments , Strong software engineering foundations with...  ...infrastructure, or cloud-native platform security , (Desirable)... 

    Crusoe Energy Systems

    San Francisco, CA
    1 day ago
  • Crusoe Energy Systems is looking for a Senior Software Engineer in San Francisco, CA, to lead the design of core AI services and scale infrastructure for millions of API requests. The role requires strong engineering fundamentals, teamwork, and expertise in AI and software... 

    Crusoe Energy Systems

    San Francisco, CA
    1 day ago
  • $233.5k - $321.2k

    GoFundMe is seeking a Senior Staff Software Engineer for Identity Platform to lead the architecture and scalability of its identity services. In this hybrid role, you...  ...engineering with a focus on identity protocols and security, and it offers a competitive salary in the... 

    HiViz

    San Francisco, CA
    1 day ago
  • Join to apply for the AI Platform Security Engineer role at Brain Co. About Brain Co. Brain Co. is an Applied AI startup founded by Elad Gil and...  ...spec and build from zero. From designing robust and scalable architectures to optimizing performance and reliability,... 
    Worldwide

    Brain Co.

    San Francisco, CA
    1 day ago
  • Crusoe Energy Systems in San Francisco seeks a Staff Software Engineer to lead the design and implementation of core AI services, optimize scheduling mechanisms, and ensure scalability for high performance. The role requires deep knowledge of distributed systems and Kubernetes... 

    Crusoe Energy Systems

    San Francisco, CA
    1 day ago
  • Supermetrics is looking for an AI Platform Engineer to design and maintain critical infrastructure for our AI agent ecosystem. This role involves building shared systems and ensuring reliable data connections across platforms. The ideal candidate will have experience with... 

    Supermetrics

    San Francisco, CA
    1 day ago
  • GoFundMe is searching for a Senior Staff Software Engineer for Identity Platform to drive the architecture, scalability, and reliability of our identity platform,...  ...a strong background in identity protocols and security, with over 8 years in software engineering. We... 
    Work at office

    GoFundMe

    San Francisco, CA
    1 day ago
  • Prime Intellect is building a platform that unifies AI workloads, compute,...  ...role spans platform software engineering and infrastructure, focusing...  ..., real-time tooling, and scalable training infrastructure....  ...to ensure reliability and security as we open-source and #J-... 

    Prime Intellect

    San Francisco, CA
    3 days ago
  •  ...Private Limited in San Francisco, CA is seeking a data engineer to design scalable data platforms and AI-enabled data systems. You will work across backend...  ...balance practical implementation with governance, security, and quality, contributing to data mesh concepts and... 

    SWITS DIGITAL Private Limited

    San Francisco, CA
    1 day ago
  •  ...people interact with the web by building AI agents that can reliably do everyday digital...  ..., etc. Responsibilities: Scale infra for post-training of multimodal LLMs (CPT...  ...generalist web‑agent Work closely with product engineers to translate cutting‑edge AI capabilities... 
    Work at office
    Relocation
    Visa sponsorship

    Yutori

    San Francisco, CA
    1 day ago
  • $225k - $250k

     ...leading open‑source AI coding agent....  ...the world's largest engineering organizations and individual...  ...enterprise‑grade security, using existing...  ...the future of our platform. Responsibilities: Design and operate scalable, low‑latency infrastructure for LLM inference, caching,... 

    Cline

    San Francisco, CA
    1 day ago
  • A leading AI technology firm in San Francisco is looking for a candidate to own security across its platform. The role involves designing secure systems, ensuring smooth operations...  ..., and collaborating closely with engineering teams. Ideal candidates will have experience... 

    Resolve AI

    San Francisco, CA
    1 day ago
  • $180k - $220k

    A tech company specialized in AI is looking for a Senior Application Security Engineer to secure AI, machine learning, and inference platforms. The role requires deep security reviews and implementing security within modern AI infrastructure. Candidates should have strong... 

    Lightning AI

    San Francisco, CA
    1 day ago
  • Baseten, a leader in AI platform infrastructure, is seeking a Cloud Platform Engineer in San Francisco to design and implement scalable systems for ML model deployment. You will automate deployments, monitor performance, and drive reliability across the platform while... 

    Baseten

    San Francisco, CA
    1 day ago
  • A leading AI research company based in San Francisco is seeking talented infrastructure/platform engineers to build and operate foundational systems. Candidates should have a strong...  ...like GCP and AWS, and expertise in security architecture. Reflection AI offers competitive... 

    Reflection AI

    San Francisco, CA
    4 days ago
  •  ...power the next generation of AI-native products. Our mission is...  ...deeply about craft. Our Stack Infra : Terraform, AWS, LGTM (Loki,...  ...We are looking for strong engineers with experience and interest in...  ...infrastructure that make up our adtech platform. You might be a fit if You... 

    Koah Labs

    San Francisco, CA
    1 day ago
  • Sei Labs, located in San Francisco, is seeking a talented Platform Engineer who will be integral in building and maintaining infrastructure...  ...of experience in production systems, solid knowledge of security practices, and the ability to analyze performance bottlenecks... 

    Sei Labs

    San Francisco, CA
    1 day ago
  • Greenlite AI in San Francisco is hiring Platform Engineers to build and operate the infrastructure that powers compliance at scale. You’ll own reliability, performance, and scalability across core systems, designing Postgres schemas, optimizing queries, and delivering... 

    Greenlite AI

    San Francisco, CA
    1 day ago
  • Whatnot is seeking an AI/ML Engineer to design and scale core infrastructure powering LLM applications across the company. You will work with ML scientists to productionize models, build retrieval systems, and ground model outputs in Whatnot’s context. This role offers... 
    Remote job

    Whatnot

    San Francisco, CA
    1 day ago
  • $200k - $250k

    Senior AI Product Engineer (Full Stack) | Series C GRC Startup...  ...product delivery—turning LLM capabilities into...  ...user feedba ckBuild scalable APIs and services that...  ...enterprise environments (GRC, security, complia nce)...  ...to analytics/data platforms (Snowflake, dbt)Experience... 
    Work at office
    3 days per week

    Harnham

    San Francisco, CA
    1 day ago
  • Capital One is seeking an experienced AI Engineer to develop and optimize AI-powered products. This role involves collaborating with engineers...  ...must hold a relevant degree and have a proven track record in deploying scalable AI solutions. #J-18808-Ljbffr Capital One

    Capital One

    San Francisco, CA
    1 day ago
  • $239.2k - $270k

     ...globally. With our innovative platform, we’ve been able to generate...  ...actively seeking a Staff AI Security Engineer to join our team. Reporting...  ...privilege escalation Build scalable AI security guardrails and tooling...  ...AI features with automated LLM vulnerability testing Grow... 
    Work at office
    Relocation
    Sleeping nights
    2 days per week
    3 days per week

    Spring Health

    San Francisco, CA
    1 day ago
  • Founding AI Engineer | LLM Systems | $500k+ & Equity | SF / Seattle / LA Due to regulatory constraints...  ...& hallucination control Build scalable architecture for inference, caching, evaluation...  ...demos Startup, defence, aerospace, infra, fintech or hard‑tech background... 
    Relocation

    Open Talent

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Platform Engineer — Scalable, Secure LLM Infra. Be the first to apply!