Kong AI Gateway Engineer (Remote, United States)
$100k - $170.5kAllstate
At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
The Software Engineer Lead Consultant will serve as a technical lead focused on Kong AI Gateway, bringing strong experience in API Gateway management, Kong administration, and AI/LLM proxy development. This role will architect, design, build, test, and support modern digital products, while owning applications through production and driving their overall success against key performance goals.Candidates must be able to work Central Time or Eastern Time hours.
Required Skills
- Kong Gateway (OSS/Enterprise), Kong Konnect
- API Management & API Lifecycle Management
- AI Gateway / LLM Proxy Development
- OpenAI / Azure OpenAI Integration
- REST APIs, GraphQL
- OAuth2, JWT, OIDC, API Security
- Kubernetes, Docker, Helm
- CI/CD (Jenkins, GitHub Actions, Azure DevOps)
- Monitoring: Prometheus, Grafana, ELK/Splunk
- Cloud Platforms: Azure, AWS, or GCP
- Kong AI Gateway Configuration & Administration
- LLM Traffic Routing, Load Balancing and Failover Management
- Prompt Management, Prompt Security and Guardrails
- AI Security, Responsible AI and Model Governance
- Token Usage Monitoring, Rate Limiting and Cost Optimization
- Multi-LLM Integration (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama)
- Retrieval-Augmented Generation (RAG) Architecture Concepts
- Vector Databases
- LLMOps, AI Observability and Model Performance Monitoring
- AI API Governance, Compliance and Data Protection
- Prompt Caching, Semantic Caching and Response Optimization
- Model Gateway Policy Development and AI Consumption Controls
- MCP (Model Context Protocol) and AI Agent Integration Concepts
- GenAI Platform Engineering and Enterprise AI Enablement
Key Responsibilities
- Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
- Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.
- Enable secure access to multiple LLM providers through a unified gateway architecture.
- Implement AI observability, token analytics, usage tracking, and cost governance.
- Develop routing strategies across multiple AI models based on latency, cost, and availability.
- Integrate RAG-based AI services through secure API management frameworks.
- Ensure compliance with enterprise AI governance, security, and regulatory requirements.
- Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption.
- Support AI agent and MCP-based integrations within enterprise ecosystems.
- Drive AI platform reliability, scalability, and operational excellence.
- Configure, administer, and support Kong Gateway environments.
- Develop and manage AI Gateway proxies for GenAI/LLM services.
- Implement API security, authentication, throttling, and governance policies.
- Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways.
- Deploy and manage Kong in Kubernetes-based environments.
- Monitor, troubleshoot, and optimize gateway performance and availability.
- Automate deployments and operational processes using DevOps tools.
Experience
- 8 Plus years of experience in API Management, Middleware, or Platform Engineering.
- Minimum 3 to 5 years of hands-on experience with Kong Gateway Administration.
- Experience with cloud-native and microservices architectures preferred.
Skills
AI Architecture, AI Systems, LLM Evaluation, LLM Guardrails, Product Ownership, Software Architectures, Software DevelopmentCompensation
Compensation offered for this role is 100,000.00 - 170,500.00 annually and is based on experience and qualifications.The candidate(s) offered this position will be required to submit to a background investigation.
Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger – a winning team making a meaningful impact.
Allstate generally does not sponsor individuals for employment-based visas for this position.
Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.
For jobs in San Francisco, please click “ here ” for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click “ here ” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.
To view the “EEO Know Your Rights” poster click “ here ”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs.
To view the FMLA poster, click “ here ”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.
It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.
Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs.
When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload.
To help create a more personal and engaging experience, we ask that you join with your camera on if your interview is virtual. Please also have a Valid Photo Identification available at the start of your interview. If you require any accommodations or have questions ahead of your interview please reach out to your recruiter.
Note: Internal candidates are only asked to join on video; a Valid Photo Identification is not needed for the interview.
$148.19k - $231.98k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...and close to Product, Engineering, Support, and delivery... ...problems, not just the stated requirements. You are... ..., and education.In the United States, compensation... ...- New York; Florida - Remote; Illinois - Chicago; Massachusetts...Remote workFull timeWork experience placementImmediate start$155k
...more than 3,000 tech experts united by a drive to make a difference... ...and clients to fully embrace AI. Our product offerings span from... .... As a Forward Deployed AI Engineer you'll be part of our rapidly... ...manner consistent with applicable state and local laws. BCG is an E...SuggestedFull timeSummer workInternshipWork at officeLocal areaHome office$90k - $110k
...Apply: JobWe are seeking an experienced AI Data Analytics Engineer to accelerate data-driven engineering... ...software engineering practices: unit/integration testing, code reviews, CI,... ...veteran status. Except where prohibited by state law, some offers of employment are...SuggestedFlexible hours$173.46k - $231.98k
...About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer... ...role sits at the intersection of data engineering, platform architecture, and applied AI.... ...recall, training, and education. In the United States, compensation offered will be determined...SuggestedFull time- ...Number: 197739Apply: JobWe are seeking an AI Solutions Engineer who is passionate about applying... ...our Transportation Solutions Business Unit. The team collaborates across product management... ...authorized to work in the United States without requiring current or future employer...SuggestedRelocation packageFlexible hours
- ...Apply: JobThe Senior Cloud Engineer at KBX is a high-impact... ...to work in the United States on a permanent basis without... ...responsible adoption of cloud and AI technologies. We value... ...such as Istio, and an API gateway, such as Gloo, kgateway, Kong, or a comparable...Permanent employmentImmediate startFlexible hours
$197.3k - $225.1k
AI Engineer 4 (LLM Gateway, FM Hosting) At Capital One, we are creating responsible and reliable AI systems... ...across the company to advance the state of the art in science and AI engineering... ...Canada, any position posted in the United Kingdom is for Capital One Europe and...Full timePart timeLocal area$150k - $160k
...AI Software Engineer Second Front Systems is looking for an ambitious,... ..., Terraform, Helm) and LLM gateway patterns across AWS Bedrock... ...parental leave • Flexible remote work opportunities • Employee... ...security and gives the United States and its allies a lasting competitive...Remote workFull timeHome officeFlexible hours- ...looking for a Software Engineer to design, build and support... ...ways to apply AI and automation to how we... ...AWS Lambda, Amazon API Gateway, Amazon DynamoDB)Strong... ...authorized to work in the United StatesWhat Will Put You... ...Except where prohibited by state law, some offers of...Flexible hours
- ...AI Engineer Certa is the AI-first third-party operating... ...robust system design with state-of-the-art AI. What... ...(golden sets, prompt unit tests, offline checks,... ...AWS (ECS/EKS/Lambda, API Gateway/ALB, S3, DynamoDB/... ...Professional development support, remote workspace setup bonus....Remote workWork at office
$79.5k - $158.5k
...important research programs. Where You'll Work This is a home-based Clinical Research Associate role supporting sites across the United States. Candidates must reside within the territory to effectively support site visits and study activities. You will collaborate with...Remote workHourly payWork from homeWorldwide- ...JobAs the Application Security Engineer, you will be dedicated to... ...authorization to work permanently in the United States for any employer without... ...controls, firewalls, and remote access technologiesExperience... ...building tools utilizing AI, LLM, machine learning, and code...Remote workWork at officeWorldwideFlexible hours3 days per week
$10k
...Ramp is building a new AI business, and you’ll... ...governance, and security with Engineering and IT teams. In the... ...Familiarity with AI gateways, model routing, usage... ...coffee stipend United States ~ 100% medical,... ...Location Type Remote Department Sales...Remote workFull timeWork at officeRelocationHome officeFlexible hours$14.5 per hour
...Search Quality Rater - English (United States)Are you curious, tech-savvy, and passionate about... ...and help shape the future of search engines from the comfort of your home!As a Web Search... ...hours and achieve work-life balance.Remote Work: Enjoy the freedom of working from...Remote workBi-weekly payPart timeWork from homeFlexible hours$25 - $60 per hour
...playable scenes that test how AI systems analyze, debug, and build... .... This is that work, done remotely around your schedule. What you... ...sequences, expected visuals, and game states you can verify Why this is... ...schedule; fully remote, United States About OpenTrain AI OpenTrain...Remote jobHourly payPart timeFor contractorsFlexible hours$170.35k - $275.55k
...globally distributed, remote-first team building the... ...and delivered. As AI agents redefine software... ...The Role Docker AI Gateway is our answer to the complexity... ...we need exceptional engineers to help us build the... ..., and location. United States: $170,350 – $275,550...Remote workFull timeWork from homeHome officeVisa sponsorshipShift work- ...Remote Data Entry Operator (Work from Home)-United States Enter customer and account data from various sources into corresponding fields within Company database software. Identify and correct errors using appropriate quality control methods. Review data for discrepancies...Remote jobWork from home
- ...Previous experience in Part 135/91K or corporate aircraft desirable Applicants must possess the legal right to work in the United States and have the ability to travel in and out of the US and to all cities/countries where Flexjet serves Required Skills:...Remote workWork from home
- ...Blake Willson Group (BWG) unites deep domain experts... ...This role is 100% remote. Clearance: Must... ...to work in the United States on a full-time basis and... ...Senior Cloud, Data & AI Engineer to lead the architecture... ...on AWS, including API Gateway, Lambda, Fargate, DynamoDB...Remote workFull timeLocal area
$1,500 per month
...consumer applications. AI Platform Engineer About the Role We are... ...Familiarity with model gateways (OpenRouter, LiteLLM, Portkey... ...our full time employees: ~ Remote first global workforce ~... ...plan specific. *401k is for United States employees only Polygon...Remote workFull timeTemporary workHome officeFlexible hoursShift work$120k - $150k
...Systems & TechnologyJob Number: 195632Apply: JobAs a Data & AI Solutions Engineer at Molex, you will be a vital contributor to our Enterprise... ...disability and protected veteran status. Except where prohibited by state law, some offers of employment are conditioned upon...Flexible hours$135.4k - $159.5k
...AI Platform Engineer Location: Remote, Open to all US states; preferred locations: Colorado, Massachusetts, New Hampshire.... ...systems. Design REST API endpoints, gateway layers, and versioned contracts... ...authorized to work in the United States for the duration of their...Remote workFull timeVisa sponsorshipWork visa- ...57Apply: JobThe Cloud Engineer at KBX is an individual... ...adoption of cloud and AI technologies. We value... ...EKS, Istio, Solo Gloo, Kong, Amazon MSK/Kafka, and... ...Istio or similar) and API gateway technologies such as Gloo... ...where prohibited by state law, some offers of employment...InternshipFlexible hours
$125.7k - $203.1k
...infrastructure that powers AI features across Webex. This includes our AI Gateway, managed model hosting,... ...Science, Computer Engineering, Electrical Engineering... ...Cisco restricted stock units, which vest following continued... ...position, by specific state, are listed below:New...Full timeTemporary workWork experience placementLocal areaFlexible hours- ...Job Description Senior AI Engineer Agentic AI Platform... ...Tuesday to Thursday) Remote Monday and Friday... ...vector databases, API gateways, and modern AI engineering... ...Conversation memory o Agent state persistence o... ...used by multiple business units. Experience with...Remote workTemporary workMonday to Friday
$179.13k - $234.1k
...Job Function: Software Engineering Position Overview... ...will combine agentic AI development tools with... ...containers, DNS, TLS, API gateways, networking and... ...authorized to work in the United States without the need for visa... ...time for any reason. #LI-REMOTE #LI-HB1...Remote workFull timeContract workFor contractorsWork at officeVisa sponsorship- ...Internet Rater - (United States) Welocalize is a global data and translation... ...translation to generative AI and deep learning. We are... ...internet content to help online engines work better. In other words,... ...Location: US-based, Remote/home office/work from home –...Remote workPart timeCurrently hiringWork at officeImmediate startWork from homeHome office10 hours per week
$100k - $180k
...production-ready, enterprise-governed AI agents. Educate & Enable:... ..., MCP servers, Canvas, Agent Gateway/Registry) and how to manage... ...gates for write actions. Engineer Enterprise Integrations & MCP... ...permitted to work in the United States. Preferred...Remote workFull timeWork experience placementWork at officeNight shift$194.3k - $243k
...changing environment. We're remote-first, with office spaces... ...looking to hire a Sr. Staff AI Security Engineer to lead the secure deployment... ...a secure foundation—gateways, orchestration layers, and... ...authorization to work in the United States without requiring visa sponsorship...Remote workTemporary workWork at officeFlexible hours$125.7k - $203.1k
...hardware platforms central to the AI era, powering Cisco’s core... ...You are a passionate software engineer with expertise in developing scalable... ...of Cisco restricted stock units, which vest following... ...for this position, by specific state, are listed below: New York...Full timeTemporary workWork experience placementInternshipLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Kong AI Gateway Engineer (Remote, United States). Be the first to apply!






