Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Gateway Engineer — Edge Inference

CloudFlare

Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms. You should have 5+ years of experience in AI infrastructure, distributed systems, and developer tools, with strong APIs and observability skills. This role includes equity and a comprehensive US benefits package. #J-18808-Ljbffr CloudFlare

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI Gateway Engineer — Edge Inference in San Francisco, CA vacancy
  • Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference across a...  ...Hybrid roles in Austin, TX or London, UK with exposure to edge compute and real-time workloads. The ideal candidate... 
    Senior

    CloudFlare

    San Francisco, CA
    3 days ago
  • Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and operate...  ...data scientists and developers building AI applications on Databricks. This role offers exposure to cutting-edge AI infrastructure and scalable systems... 
    Senior

    Databricks Inc.

    San Francisco, CA
    1 day ago
  • $250k - $300k

     ...intelligence. As the only vertically integrated AI infrastructure company built from the...  ...in production. That means owning the inference stack end to end: profiling where time...  ...you will also work directly with customer engineering teams to tailor deployments to their... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    5 days ago
  • DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine and GPU kernel levels, and guide the technical roadmap for high-performance inference fleets. Bring 5+ years of HPC or AI... 
    Senior
    Remote job

    DigitalOcean

    San Francisco, CA
    1 day ago
  • $250k - $320k

    (Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our... 
    Senior
    Permanent employment
    Full time

    Together Computer Inc

    San Francisco, CA
    8 hours ago
  • $149k - $240k

     ...We AreHP IQ is HP’s new AI innovation lab....  ...diverse, world-class team—engineers, designers, researchers...  ...team is building cutting-edge solutions that bring the...  .... We are looking for a Senior Software Engineer to design...  ...for real-time AI inference and processing.Implement... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    5 days ago
  •  ...Senior AI/Data Engineer - Autonomous Agentic Systems MaxIQ is building the industry's first revenue...  ...-critical operations Scalable Inference : Optimize LLM performance for high-throughput...  ...Agentic AI Focus : Work on cutting-edge autonomous systems that process... 
    Senior

    MaxIQ

    San Francisco, CA
    4 days ago
  • Jack is hiring a Founding AI Engineer for an early-stage SF startup building AI smart glasses for field teams. You’ll own the AI core...  ...will build a production VLM pipeline, data eval flywheel, edge inference, and on-prem fine-tuning of open models to enable real-time... 

    Jack

    San Francisco, CA
    2 days ago
  •  ...is building a reasoning engine that must navigate non-...  ...multi-step inference over messy, high-stakes...  ...building alongside leading AI companies. We're looking...  ...When an agent hits an edge case, missing data, or...  ...how you think, but as a Senior, we expect you to demonstrate... 
    Senior
    Full time
    Work at office
    Immediate start
    Night shift
    Weekend work

    Hilbert's AI

    San Francisco, CA
    1 day ago
  •  ...We're building an agentic AI caregiver advocate that lives...  ...and needs over time. The AI engineering challenge: build an autonomous...  ...the landscape evolves. Optimize inference costs - our unit economics depend...  ..., cost optimization, and edge cases that only show up at scale... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    Citizen Health

    San Francisco, CA
    18 hours ago
  • $203.4k - $235k

     ...Senior Software Engineer, EDGE Discovery About Crunchyroll Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate...  ...best selves. Curiosity. We are curious, which is the gateway to empathy, inclusion, and understanding. ~ Kaizen. We... 
    Senior
    Worldwide
    Flexible hours

    Ellation, Inc.

    San Francisco, CA
    1 day ago
  • Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence...  ...yearOperate reliable online and batch inference capabilities that meet clear contracts...  ...model, Hinge Health leverages cutting-edge technology to improve outcomes,... 
    Senior
    Full time
    Internship
    Work at office
    Local area
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    2 days ago
  • Zuplo, Inc. is hiring a Senior Software Engineer to design and operate the gateway runtime and control plane across Kubernetes, multiple clouds, and edge. You will own production features and build guardrails for thousands of model and MCP tool calls, with a focus on security... 
    Senior
    Remote job

    Zuplo, Inc.

    San Francisco, CA
    2 days ago
  •  ...more important — than ever, with AI enabling fraudsters to launch...  ...has created a dedicated Edge (and Networking) team to own the...  ...traffic layer that every Persona engineer, or their agents, can...  ...where our Istio and multicluster gateway boundary should sit Find an opportunity... 
    Senior
    Full time
    For contractors
    Internship

    Persona

    San Francisco, CA
    18 hours ago
  •  ...the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate...  ...GPU infrastructure, high-performance inference, and enterprise AI platforms to...  ...of serving workloads ranging from edge AI deployments to trillion-parameter... 
    Senior
    Permanent employment
    Work experience placement
    Flexible hours

    Seekr

    San Francisco, CA
    1 day ago
  • $205k - $275k

     ...startup focused on leveraging AI to transform drug discovery and...  ...an experienced research engineer to join our team. As a critical...  ...opportunity to apply cutting-edge AI techniques in production settings...  ...campaigns involve heavy inference workloads and the inference harness... 
    Senior
    Flexible hours

    Xaira Therapeutics, Inc.

    San Francisco, CA
    1 day ago
  •  ...security-first enterprise AI company. We build cutting-edge foundation AI models and end...  ...is a team of researchers, engineers, designers, and more, who...  .... Model Vault is Cohere’s inference platform for deploying and...  ...workloads. As a Senior/Staff Software Engineer, you... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...Us At You.com, we are building the AI Search Infrastructure that powers modern...  ...transparent, and useful. Our team includes engineers, researchers, product builders, and...  ...passes through one layer: our inference gateway. It allows users to select a model and... 
    Senior
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Mixpeek

    San Francisco, CA
    1 day ago
  • You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway... 
    Senior

    Mixpeek

    San Francisco, CA
    18 hours ago
  • $188k - $275k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...'ll Do Description Of The Team The Inference team is responsible for delivering high-performance...  ...Role We are looking for an Applied AI Engineer to help us understand, measure, and... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    1 day ago
  • $242.25k - $285k

     ...JoinCarta is the connected platform and AI-native ecosystem for private capital. Built...  ...You'll Work WithYou’ll join Carta’s ML Engineering team, embedded in Carta Law, our legal...  ...understand the training, evaluation, and inference systems around them. You are equally... 
    Senior
    Full time
    Contract work

    Carta

    San Francisco, CA
    1 day ago
  • $122k - $240.5k

    Position Summary Agentic AI is moving from experimentation...  .... We're growing a team of engineers who want to work at the center...  ...Engineering leverages cutting-edge engineering capabilities to build...  ...From entry-level employees to senior leaders, we believe there’s... 
    Senior
    Work at office
    Local area
    Visa sponsorship
    Shift work

    Deloitte

    San Francisco, CA
    1 day ago
  • $270k - $325k

     ...organization specializing in advanced AI solutions that help...  ...deployments, it is investing in the engineering foundations required to...  ...organization is looking for a Senior AI Engineer to drive the...  ...different foundation models, inference platforms, AI service providers... 
    Senior

    Goliath Partners Inc.

    San Francisco, CA
    8 hours ago
  • $211k - $235k

     ...combining Spiking Neural Networks, Graph Neural Networks, and causal inference to deliver real-time analytics that were previously impossible.The RoleWe're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend systems that power our... 
    Senior
    Work at office

    Alembic

    San Francisco, CA
    2 days ago
  • $220k - $350k

     ...profit research organization using AI to accelerate frontier biology...  ...questions at the cutting edge of biological discovery. Our flagship...  ...compute, dedicated software engineering support, and mentorship from...  .... Role We are seeking a Senior AI Engineer to serve as a... 
    Senior
    Full time
    Work at office

    Edison Scientific Inc.

    San Francisco, CA
    1 day ago
  •  ...information, please see our Privacy Policy We're looking for Senior AI Engineers to design, build and run LLM-powered agents and AI features...  ...OpenAI, Google, AWS Bedrock and others) behind a shared LLM gateway, with MCP for tool access. We work AI-native: agentic coding... 
    Senior
    Contract work
    Summer work
    Remote work

    Logoslabs

    San Francisco, CA
    1 day ago
  •  ...You Are Strong Python backend engineer who has designed and shipped production...  ...operations across distributed/edge environments, remote hosts,...  ...experience (AWS Lambda, API Gateway) and time-series/relational...  ...exec team — and grow into a senior operator. Interested candidates... 
    Senior
    Contract work
    Live in
    Remote work

    Conduit

    San Francisco, CA
    1 day ago
  • $168.1k - $312.3k

     ...people we love. As an imaging-focused machine learning engineer within the AI Enablement team, you will be working closely with folks that...  ...Zarr, HDF5). Optimize GPU memory footprint, batching, and inference throughput for large image pipelines and deep neural... 
    Senior
    Local area
    Relocation package
    3 days per week

    Genentech

    San Francisco, CA
    1 day ago
  • $150.7k - $251.2k

     ...world. The opportunity We are seeking an AI Security Engineer to own the security posture of EY’s...  ...secrets, secure execution and sandboxing, gateway and egress, data and state, delivery...  ...tenant platforms across cloud, on-prem, edge, client-managed, and air-gapped deployment... 
    Senior
    Contract work
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    1 day ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers...  ...About The Role As a Software and AI Engineer, IT Systems, you’ll design and develop AI...  ...to talk. You love to leverage cutting-edge GenAI tools (like Cursor, Claude, or Copilot... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Gateway Engineer — Edge Inference. Be the first to apply!