Senior AI Gateway Engineer — Edge Inference
CloudFlare
Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows, and collaborate across teams to ship production-ready platforms. You should have 5+ years of experience in AI infrastructure, distributed systems, and developer tools, with strong APIs and observability skills. This role includes equity and a comprehensive US benefits package. #J-18808-Ljbffr CloudFlare
- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference across a... ...Hybrid roles in Austin, TX or London, UK with exposure to edge compute and real-time workloads. The ideal candidate...Senior
- Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and operate... ...data scientists and developers building AI applications on Databricks. This role offers exposure to cutting-edge AI infrastructure and scalable systems...Senior
$250k - $300k
...intelligence. As the only vertically integrated AI infrastructure company built from the... ...in production. That means owning the inference stack end to end: profiling where time... ...you will also work directly with customer engineering teams to tailor deployments to their...SeniorTemporary work- DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine and GPU kernel levels, and guide the technical roadmap for high-performance inference fleets. Bring 5+ years of HPC or AI...SeniorRemote job
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our...SeniorPermanent employmentFull time$149k - $240k
...We AreHP IQ is HP’s new AI innovation lab.... ...diverse, world-class team—engineers, designers, researchers... ...team is building cutting-edge solutions that bring the... .... We are looking for a Senior Software Engineer to design... ...for real-time AI inference and processing.Implement...SeniorFull timeTemporary workLocal areaFlexible hours- ...Senior AI/Data Engineer - Autonomous Agentic Systems MaxIQ is building the industry's first revenue... ...-critical operations Scalable Inference : Optimize LLM performance for high-throughput... ...Agentic AI Focus : Work on cutting-edge autonomous systems that process...Senior
- Jack is hiring a Founding AI Engineer for an early-stage SF startup building AI smart glasses for field teams. You’ll own the AI core... ...will build a production VLM pipeline, data eval flywheel, edge inference, and on-prem fine-tuning of open models to enable real-time...
- ...is building a reasoning engine that must navigate non-... ...multi-step inference over messy, high-stakes... ...building alongside leading AI companies. We're looking... ...When an agent hits an edge case, missing data, or... ...how you think, but as a Senior, we expect you to demonstrate...SeniorFull timeWork at officeImmediate startNight shiftWeekend work
- ...We're building an agentic AI caregiver advocate that lives... ...and needs over time. The AI engineering challenge: build an autonomous... ...the landscape evolves. Optimize inference costs - our unit economics depend... ..., cost optimization, and edge cases that only show up at scale...SeniorImmediate startRemote workFlexible hours
$203.4k - $235k
...Senior Software Engineer, EDGE Discovery About Crunchyroll Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate... ...best selves. Curiosity. We are curious, which is the gateway to empathy, inclusion, and understanding. ~ Kaizen. We...SeniorWorldwideFlexible hours- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence... ...yearOperate reliable online and batch inference capabilities that meet clear contracts... ...model, Hinge Health leverages cutting-edge technology to improve outcomes,...SeniorFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
- Zuplo, Inc. is hiring a Senior Software Engineer to design and operate the gateway runtime and control plane across Kubernetes, multiple clouds, and edge. You will own production features and build guardrails for thousands of model and MCP tool calls, with a focus on security...SeniorRemote job
- ...more important — than ever, with AI enabling fraudsters to launch... ...has created a dedicated Edge (and Networking) team to own the... ...traffic layer that every Persona engineer, or their agents, can... ...where our Istio and multicluster gateway boundary should sit Find an opportunity...SeniorFull timeFor contractorsInternship
- ...the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate... ...GPU infrastructure, high-performance inference, and enterprise AI platforms to... ...of serving workloads ranging from edge AI deployments to trillion-parameter...SeniorPermanent employmentWork experience placementFlexible hours
$205k - $275k
...startup focused on leveraging AI to transform drug discovery and... ...an experienced research engineer to join our team. As a critical... ...opportunity to apply cutting-edge AI techniques in production settings... ...campaigns involve heavy inference workloads and the inference harness...SeniorFlexible hours- ...security-first enterprise AI company. We build cutting-edge foundation AI models and end... ...is a team of researchers, engineers, designers, and more, who... .... Model Vault is Cohere’s inference platform for deploying and... ...workloads. As a Senior/Staff Software Engineer, you...SeniorFull timeWork at officeLocal areaRemote workHome office
$200k - $250k
...Us At You.com, we are building the AI Search Infrastructure that powers modern... ...transparent, and useful. Our team includes engineers, researchers, product builders, and... ...passes through one layer: our inference gateway. It allows users to select a model and...SeniorImmediate startRemote workWork from homeFlexible hours- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway...Senior
$188k - $275k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...'ll Do Description Of The Team The Inference team is responsible for delivering high-performance... ...Role We are looking for an Applied AI Engineer to help us understand, measure, and...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$242.25k - $285k
...JoinCarta is the connected platform and AI-native ecosystem for private capital. Built... ...You'll Work WithYou’ll join Carta’s ML Engineering team, embedded in Carta Law, our legal... ...understand the training, evaluation, and inference systems around them. You are equally...SeniorFull timeContract work$122k - $240.5k
Position Summary Agentic AI is moving from experimentation... .... We're growing a team of engineers who want to work at the center... ...Engineering leverages cutting-edge engineering capabilities to build... ...From entry-level employees to senior leaders, we believe there’s...SeniorWork at officeLocal areaVisa sponsorshipShift work$270k - $325k
...organization specializing in advanced AI solutions that help... ...deployments, it is investing in the engineering foundations required to... ...organization is looking for a Senior AI Engineer to drive the... ...different foundation models, inference platforms, AI service providers...Senior$211k - $235k
...combining Spiking Neural Networks, Graph Neural Networks, and causal inference to deliver real-time analytics that were previously impossible.The RoleWe're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend systems that power our...SeniorWork at office$220k - $350k
...profit research organization using AI to accelerate frontier biology... ...questions at the cutting edge of biological discovery. Our flagship... ...compute, dedicated software engineering support, and mentorship from... .... Role We are seeking a Senior AI Engineer to serve as a...SeniorFull timeWork at office- ...information, please see our Privacy Policy We're looking for Senior AI Engineers to design, build and run LLM-powered agents and AI features... ...OpenAI, Google, AWS Bedrock and others) behind a shared LLM gateway, with MCP for tool access. We work AI-native: agentic coding...SeniorContract workSummer workRemote work
- ...You Are Strong Python backend engineer who has designed and shipped production... ...operations across distributed/edge environments, remote hosts,... ...experience (AWS Lambda, API Gateway) and time-series/relational... ...exec team — and grow into a senior operator. Interested candidates...SeniorContract workLive inRemote work
$168.1k - $312.3k
...people we love. As an imaging-focused machine learning engineer within the AI Enablement team, you will be working closely with folks that... ...Zarr, HDF5). Optimize GPU memory footprint, batching, and inference throughput for large image pipelines and deep neural...SeniorLocal areaRelocation package3 days per week$150.7k - $251.2k
...world. The opportunity We are seeking an AI Security Engineer to own the security posture of EY’s... ...secrets, secure execution and sandboxing, gateway and egress, data and state, delivery... ...tenant platforms across cloud, on-prem, edge, client-managed, and air-gapped deployment...SeniorContract workSummer holidayFlexible hours$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers... ...About The Role As a Software and AI Engineer, IT Systems, you’ll design and develop AI... ...to talk. You love to leverage cutting-edge GenAI tools (like Cursor, Claude, or Copilot...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Gateway Engineer — Edge Inference. Be the first to apply!
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer San Francisco, CA
- senior living San Francisco, CA
- senior associate vice president San Francisco, CA



