Model Operations Lead, AI Gateway
$230k - $317kCloudflare, Inc.
Austin, TX, United States Position Title: Model Operations Lead, AI Gateway About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the worlds largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazines Top Company Cultures list and ranked among the Worlds Most Innovative Companies by Fast Company. At Cloudflare, were not looking for people who wait for a polished roadmap; were looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If youre the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, youll fit right in. Available Locations: Austin, TX | New York City, NY | San Francisco, CA About AI Gateway AI inference is becoming core infrastructure. Every serious application will need access to many models across many providers, with reliability, observability, security, cost control, and routing built in from the start. AI Gateway is Cloudflare's bet that this layer belongs at the network edge: close to users, close to compute, and simple enough that a developer can adopt it with one API change. Developers using AI Gateway need answers to two questions. Is the model I'm calling working the way you say it does? And which model should I be using at all? You'll lead the models team that answers both. You'll start with model operations. That's the work behind every model in the catalog: provider integrations, capability testing, pricing and metering, capacity, security reviews, docs, health, and deprecations. Sometimes a launch needs to go live within minutes of a lab's announcement. Sometimes the right call is to hold it. Cloudflare is an infrastructure company at heart, so reliability and accuracy come first; speed comes from preparation and automation. Then you'll bring model intelligence online. That means turning what we learn from Gateway traffic into decisions for customers: capability maps, per-task rankings, auto-routing profiles that pick the right model for each request, evals and regression detection, and market intelligence developers can trust. This is a people-management role reporting to the AI Gateway Engineering Manager. You'll hire, develop, and lead the team, and you'll stay hands‑on: writing code, building agent-driven workflows, and getting into the details of a failed launch or a suspicious eval SLO. Expect to manage people, projects, model stock, and operations all at once. About the Role Build and lead the models team: Hire, coach, and grow the people who run the catalog today and build its intelligence over time. Give people real ownership, give direct feedback, and grow leads who can run their own areas. Run model launches end-to-end: Scope integrations, coordinate testing and evals, confirm pricing, metering, capacity, and security, and get docs and announcements ready. Prepare day-zero launches in advance so they can ship in minutes. Keep the catalog true: Make sure what we publish (capabilities, limits, versions, prices) matches what developers actually get. Catch silent regressions, such as broken tool calling, truncated streams, quantization changes, or usage and pricing mismatches, before customers do. Build model intelligence: As it comes online, own the evals, capability maps, and per-task rankings behind our auto-routing profiles and model recommendations. Make sure they measure what they claim to, and connect regressions to routing decisions so customers who chose "auto" aren't the ones who discover a problem. Treat the catalog and intelligence as products: Have a point of view on which models belong in the catalog, which routing profiles to ship, and what market intelligence to publish. Base it on usage, quality, reliability, and cost data. Turn what you learn into roadmap input. Run a lightweight operating cadence: Keep one source of truth for what's in flight, who owns it, what's blocked, and what ships next. Keep Engineering, Product, Partnerships, and other stakeholders aligned and informed without status meetings. Automate relentlessly: Turn repeatable steps into scripts, tools, and agent workflows: endpoint validation, eval runs, catalog and pricing reconciliation, regression detection, and provider follow-ups. Manual effort per launch should fall as the catalog grows. Responsibilities Day-Zero & Quality Launches: Ensure new models launch on day zero with tested capabilities, accurate pricing, docs, and a clear call on routing eligibility. Catalog Reliability & Health: Ensure the catalog reflects reality, and proactively identify when a model or provider is underperforming before customers notice. Auto-Routing & Optimization: Deliver auto-routing that measurably beats a fixed model choice on cost or quality for users. Developer Trust & Methodology: Build and maintain trusted rankings and recommendations grounded in solid methodology. Partner & Stakeholder Management: Set clear expectations for providers, while keeping Engineering, Product, Partnerships, and other stakeholders aligned. Team Leadership & Growth: Provide clear ownership and direction so the team knows what's next, who owns it, and how to grow into bigger roles. Operational Scalability: Continually drive down the human effort required for each launch, eval, and routing update through tools and automation. Desirable Skills, Knowledge, and Experience People Leadership: Experience hiring, managing, and growing engineers or operators, giving direct feedback, delegating real ownership, and expanding scope without becoming a bottleneck. Technical & Shipping Capabilities: Proven track record of taking technical launches or integrations from ambiguity to production across teams and partners. Hands-on ability to write TypeScript, Python, or Rust, read API docs, inspect endpoints, and debug using terminal tools (logs, cURL). Model Ecosystem Expertise: Deep familiarity with new models, labs, and inference providers. Hands-on understanding of streaming, tool calling, structured outputs, rate limits, token pricing, and provider-specific model behavior variations. Product & SRE Mindset: Data-driven product instincts to advocate for adding, modifying, or retiring catalog items. SRE approach to defining, measuring, and alerting on service health, managing incidents calmly, and fixing root causes. Agent Workflows & Detail-Oriented Execution: Daily experience building with agentsscoping work, verifying outputs, and integrating deterministic checks or human judgment appropriately. Meticulous attention to detail regarding model IDs, context limits, per-token prices, and response fields. Bonus Qualifications (Nice to Have): Experience at an inference provider, model lab, model router, eval platform, or API company. Background in evals, ranking/recommendation systems, observability, metering, or usage-based billing. Familiarity with Cloudflare Workers, AI Gateway, Workers AI, or Replicate. Relevant domain backgrounds in engineering management, SRE, partner engineering, evals/applied ML, technical program management, or solutions engineering. Compensation Compensation may be adjusted depending on work location. For Bay Area based hires: Estimated annual salary of $230,000 - $317,000 For New York City, New Jersey, Washington, Washington DC, and California (excluding Bay Area) based hires: Estimated annual salary of $275,000 - $303,000 Equity This role is eligible to participate in Cloudflares equity plan. Benefits Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S. Health & Welfare Benefits Medical/Rx Insurance Dental Insurance Vision Insurance Flexible Spending Accounts Commuter Spending Accounts Fertility & Family Forming Benefits On-demand mental health support and Employee Assistance Program Global Travel Medical Insurance Financial Benefits Short and Long Term Disability Insurance Life & Accident Insurance 401(k) Retirement Savings Plan Employee Stock Participation Plan Time Off Flexible paid time off covering vacation and sick leave Leave programs, including parental, pregnancy health, medical, and bereavement leave What Makes Cloudflare Special? Were not just a highly ambitious, large-scale technology company. Were a highly ambitious, large-scale technology company with a soul. Fundamental to our mission to help build a better Internet is protecting the free and open Internet. Project Galileo: Since 2014, we've equipped more than 2,400 journalism and civil society organizations in 111 countries with powerful tools to defend themselves against attacks that would otherwise censor their work, technology already used by Cloudflares enterprise customers--at no cost. Athenian Project: In 2017, we created the Athenian Project to ensure that state and local governments have the highest level of protection and reliability for free, so that their constituents have access to election information and voter registration. Since the project, we've provided services to more than 425 local government election websites in 33 states. 1.1.1.1: We released 1.1.1.1 to help fix the foundation of the Internet by building a faster, more secure and privacy-centric public DNS resolver. This is available publicly for everyone to use - it is the first consumer-focused service Cloudflare has ever released. Heres the deal - we dont store client IP addresses never, ever. We will continue to abide by our privacy commitment and ensure that no user data is sold to advertisers or used to target consumers. Sound like something you’d like to be a part of? Wed love to hear from you! Please note that applicants who progress to the offer stage of the interview process may be asked to attend an in-person interview within one of the Cloudflare Offices or Cloudflare Hubs. More details about this will be available at that stage of the interview process. This position may require access to information protected under U.S. export control laws, including the U.S. Export Administration Regulations. Please note that any offer of employment may be conditioned on your authorization to receive software or technology controlled under these U.S. export laws without sponsorship for an export license. Cloudflare is proud to be an equal opportunity employer. We are committed to providing equal employment opportunity for all people and place great value in both diversity and inclusiveness. All qualified applicants will be considered for employment without regard to their, or any other person's, perceived or actual race, color, religion, sex, gender, gender identity, gender expression, sexual orientation, national origin, ancestry, citizenship, age, physical or mental disability, medical condition, family care status, or any other basis protected by law. We are an AA/Veterans/Disabled Employer. Cloudflare provides reasonable accommodations to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job. Examples of reasonable accommodations include, but are not limited to, changing the application process, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment. If you require a reasonable accommodation to apply for a job, please contact us via e‑mail at View email address on click.appcast.io or via mail at 101 Townsend St. San Francisco, CA 94107. Equal employment opportunity, including veterans and individuals with disabilities.
PI287984693
#J-18808-Ljbffr Cloudflare, Inc.$230k - $317k
...normalized problem and the AI-native curiosity to... ...Francisco CA About AI Gateway AI inference is... ...will need access to many models across many providers with... ...be using at all Youll lead the models team that... ...Youll start with model operations. Thats the work behind...SuggestedFull timeTemporary workLocal areaFlexible hours- Cloudflare seeks a Senior Operations leader for AI Gateway to build and lead the models team, oversee end-to-end model launches, and ensure catalog accuracy. You’ll drive model intelligence, routing decisions, and vendor partner coordination while managing a growing group...Suggested
- Cloudflare in San Francisco, CA is seeking a Model Operations Lead for AI Gateway. You will build and lead the models team, manage day-zero launches, and ensure pricing, metering, and routing are correct. You will own evaluations, capability maps, and per-task rankings...Suggested
$110k - $140k
...IT Operations LeadWe're hiring our first dedicated IT Operations Lead to own the systems, devices, and access that everyone at Office Hours relies on. This is a hands... ...time, including on how to get real value out of our AI tools.Device and fleet management. Own hardware...SuggestedFull timeWork at officeRemote work$260k - $350k
...legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform,... ...the Engineering Manager for Model Infrastructure, you'll lead the team responsible for the platform... ...inference platforms, model gateways, traffic routing systems, or...SuggestedFull time- ...hires across engineering, sales, risk, and operations. You will own the recruiting systems end... ...major changes in tooling, data, and AI workflows to improve speed and quality of... ...collaborate with the Staff Recruiting Operations Lead, delivering scalable solutions that...Remote job
- Anthropic Limited, a leader in AI safety, seeks a Procurement Operations Business Partner to own the software purchasing lifecycle—from request to signed contract and PO, ensuring accurate accruals and clean month-end spend data. This high-volume role partners with Security...Contract work
- ...long-term Customer Success strategy and operational execution. You will partner with CS leadership to shape segmentation, coverage models, and playbooks while owning tooling, data... ...programs, build executive dashboards, and lead a high‑visibility team to deliver measurable...
- ...Sr. Director of Global Sales Strategy and Operations to own the sales org’s operating... ...renewal/expansion operations. This data-first, AI-forward role partners across Marketing, Customer... ...decisions and scalable growth. You will lead a global team, champion governance, and...
$190k - $220k
HeyGen in Los Angeles is seeking a Revenue Operations Lead to enhance its AI-driven revenue model. This role requires ownership of revenue signals management and collaboration across product and data teams to operationalize behaviors effectively. The ideal candidate should...- The OpenAI Foundation is seeking a founding grantmaker for the AI Model Safety program. You will lead end-to-end grantmaking across independent testing, standards, and foundational safety research, and help identify and build the field by recruiting founders and seeding...
- ...at the intersection of product demand, model deployment, inference, research, fleet,... ...seeking a Technical Program Manager to lead the operating system for Chat capacity and model deployment... ...responsible access to advanced AI systems. About OpenAI OpenAI is an AI...Work at officeRelocation package
$218.5k - $288k
Who Are We?Postman is the world’s leading API platform, used by more than 45 million+ developers and 500,000 organizations, including... ...an Applied Scientist specializing in Small Language Models and AI Training, you will lead research and development efforts focused...Full timeWork at officeFlexible hours3 days per week- ...artificial intelligence company based in San Francisco, California. The Role: As a Research Engineer - Model Architectures , you will be a core contributor to Zyphra’s AI Architecture Research Team. This will involve designing and rigorously testing novel model...Work at officeRelocation package
$100k - $280k
..., all the way to the executive who signs. Own the full sales motion at a fast-growing AI startup. A seed-stage AI startup in San Francisco helps companies own their AI with a model router across hundreds of models, hosted anywhere, plus AI agents that carry out real...Full timeWork at officeVisa sponsorshipRelocation package- ...Francisco, California. The Role: As a Research Engineer - Language Model Pre-Training , you'll shape our language model roadmap through... ...low as possible We all enjoy what we do and love discussing AI Benefits and Perks: Comprehensive medical, dental, vision...Work at officeRelocation package
- Anthropic Limited is seeking several Product Operations Managers to embed within core product... ...readiness, sign-offs, early access programs, and model deployment readiness. You will build and... ..., Security, and GTM to ship reliable AI products. You will work across launch...
- Mondo in San Francisco seeks a proactive Social Operations & Community Manager to support social media operations and community engagement across our AI-focused platform. The role emphasizes growing the AI business presence on key channels and requires a hands-on generalist...
- Thinking Machines Lab is seeking a Safety Operations Lead to fortify safety by default while enabling rapid product iteration in human-AI collaboration tools. You’ll triage cases,... ...Based in San Francisco, you’ll influence model safety, abuse detection, and account reviews...
$180.8k - $226k
Scale's Generative AI business unit is at the front of the industry, fueling the development of frontier AI models. As a Product Operations Manager, you will build and support the critical processes... ...own the ops product connection and lead our highest priority initiatives....Full time$50 - $75 per hour
A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in...Hourly payContract work$220k - $300k
About OpenAI Foundation AI is already changing how people work, learn, and access care.... ...part of the work of our mission. Advanced AI models will also present new challenges that are... ...the program’s strategy with the team lead: what we should fund, what others in the ecosystem...- TypeSafe AI is seeking a safety researcher to examine model behavior and help evaluate safety concerns within the team. You’ll build evals, document findings, and contribute to responsible research practices. During the six-week period, you’ll set up access, meet the team...
- Thinking Machines is hiring multiple product leaders to turn models, research, and infrastructure into understandable products. You will shape product direction, connect user needs with research progress, and decide what to build next across platforms for customizing models...
- idler, a frontier data research lab in San Francisco, is hiring a Research Scientist to measure and improve how models learn from our tasks. You’ll validate data quality, identify where improvements are needed, and create new datasets in collaboration with frontier researchers...
- ...hiring a Product Manager for Grid to build the next generation of AI infrastructure. You will own the Grid roadmap, collaborate with... ...engineers, and shape how developers control intelligent routing across models, aiming to improve quality, speed, and cost for production AI...
$201k - $261k
...power MSCI's quantitative risk and factor model research. The team develops the systems and... ...research infrastructure that integrates AI to accelerate model development, validation... ...decisions. You'll be part of an industry-leading network of creative, curious, and entrepreneurial...Flexible hours$192k - $278k
...with modern LLMs, multimodal models, and agentic systems. Experience... ...Experience building scalable operating models and repeatable... ...boundaries. Experience with AI platforms, data acquisition, and... ...cross-product AI initiatives, leading executive review forums focused...- ...world At Bedrock, we're moving AI out of the lab and onto real... ...to work, build the field and operations teams behind every deployment,... ...are seeking a Data Operations Lead to own ongoing data collection... ...data they need to mature our models. Own data yield as a first-...Full timeFor contractors
- ...silicon neocloud designed for fast, efficient AI inference. We combine large-scale... ...to technical problems spanning frontier models, production infrastructure, and emerging... ...is seeking a Data Center Facilities Operations Lead to own the critical facilities operating...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Model Operations Lead, AI Gateway. Be the first to apply!
- operations leader San Francisco, CA
- operations lead San Francisco, CA
- network operations center team lead San Francisco, CA
- veterinary operations San Francisco, CA
- ticketing consultant - operations San Francisco, CA
- import export operations San Francisco, CA
- franchise operations San Francisco, CA
- nonprofit operations San Francisco, CA
- data center operations technician San Francisco, CA
- operation strategy cost manager San Francisco, CA




