Backend Engineer - AI Gateway (Bilingual Korean)
$100k - $130kFull-time
Cinter Technology Services
▶ Job Details
• Job Title: Backend Engineer - AI Gateway
• Client: Korean IT Services and IT Consulting
• Working Location: NJ then Plano TX
• Working Style: Onsite
• Employment Type: 1 year Contract / W-2
• Salary: $100,000 - 130,000/year (DOE)
• Benefit: Insurance and 401K March
• Visa Support: No
• Working Hours: 9AM to 6PM
• Language: English and Bilingual Korean Highly Preferred ▶ Position Summary
We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale. ▶ The Right Candidate Will Possess
A proactive, detail-oriented professional with strong communication, ownership, and problem-solving skills who can collaborate effectively across business and technical teams. ▶ Required Qualifications & Skills
• Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aio low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
• Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
• Protocol Knowledge – Working familiarity with & (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
• FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
• Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
• Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
• PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
• Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
• IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.
Preferred Qualifications
• Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
• IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
• AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymization, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
• API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
• Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimization and 24/7 incident response (SLA/SLO).
• Bilingual Korean Highly Preferred ▶ Important Notice
Beware of scams: Cinter Technology will never contact candidates from an email address ending in @cintertechnology.work. Any such email is fraudulent.
No C2C: We do not accept Corp-to-Corp (C2C) arrangements for this position.
• Job Title: Backend Engineer - AI Gateway
• Client: Korean IT Services and IT Consulting
• Working Location: NJ then Plano TX
• Working Style: Onsite
• Employment Type: 1 year Contract / W-2
• Salary: $100,000 - 130,000/year (DOE)
• Benefit: Insurance and 401K March
• Visa Support: No
• Working Hours: 9AM to 6PM
• Language: English and Bilingual Korean Highly Preferred ▶ Position Summary
We are building an AI Gateway — a high-performance, secure intermediary layer that routes, inspects, and governs all traffic between enterprise clients and LLM/AI service providers. This role requires deep expertise in network programming, async Python, and cloud infrastructure to design and operate a latency-sensitive, policy-driven gateway that handles massive concurrent streaming connections at scale. ▶ The Right Candidate Will Possess
A proactive, detail-oriented professional with strong communication, ownership, and problem-solving skills who can collaborate effectively across business and technical teams. ▶ Required Qualifications & Skills
• Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aio low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
• Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
• Protocol Knowledge – Working familiarity with & (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
• FastAPI‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and OpenAPI docs.
• Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
• Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
• PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus HashiCorp Vault (dynamic secrets, transit encryption) for key management.
• Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let’s Encrypt).
• IaC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.
Preferred Qualifications
• Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
• IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
• AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymization, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
• API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
• Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimization and 24/7 incident response (SLA/SLO).
• Bilingual Korean Highly Preferred ▶ Important Notice
Beware of scams: Cinter Technology will never contact candidates from an email address ending in @cintertechnology.work. Any such email is fraudulent.
No C2C: We do not accept Corp-to-Corp (C2C) arrangements for this position.
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Backend Engineer - AI Gateway (Bilingual Korean) in Plano, TX vacancy
- ...DescriptionWe are building an AI Gateway — a high-performance,... ...protocol parsers.FastAPI‑Based Backend (3 + yrs) - Design, develop... ...- Building prompt‑engineering workflows, PII anonymisation... ...incident response (SLA/SLO).Bilingual Korean Highly PreferAdditional InformationAll...BilingualKorean language skills
$10.57k
...Time, On Site Pay Rate: ~$10,570/mo DOE Korean Bilingual Required Job Description We are building an AI Gateway—a high‑performance intermediary that routes,... ...Experience: Around 5 years of professional backend development experience, with a solid track...BilingualKorean language skillsFull timeContract workTemporary workWork experience placementSBT Global, Inc.
Plano, TX5 days ago- ...Junior Full Stack Developer - Bilingual in KoreanWe are looking for a motivated Junior Full... ...end development, database design, modern AI/LLM technologies, and RPA (Robotic Process... ...engagementPreferred QualificationsEnglish-Korean bilingual communication skills.All your...BilingualKorean language skills
SBT Global
Plano, TX2 days ago - Woongjin, Inc. is seeking a System Admin & Service Desk professional fluent in English and Korean to join a dynamic team. This role covers system administration tasks, user access management, and continuous process improvements while supporting Jira/MSP+ and web-based...BilingualKorean language skillsFull time
- ...detail-oriented Software Quality Assurance Tester (Korean bilingual preferred) for on-site QA of AI-driven voice assistant performance in Plano, TX. The... ...period. Candidates should have a Bachelor’s degree in CS/Engineering, strong English skills, and Korean proficiency as a...BilingualKorean language skillsFor contractors
- ...Position Overview ~ Job Title: Software Tester (AI Feature QA) ~ Job Type: Full-Time, Hourly ~ Bachelor's Degree in... ...testing on schedule and seeing issues through to resolution ~ Korean-English bilingual ability is a strong plus ~ Interest in or familiarity with...BilingualKorean language skillsHourly payFull timeWork experience placementH1b
Jnd Corp
Plano, TX3 days ago - ...the current solutions Work closely with customers, and other engineers to define requirements and deliver innovative solutionsImplement... ..., excel and deliver at a quick pace is required.Korea/English Bilingual is a plus, not mandatoryAdditional InformationAll your...BilingualKorean language skills
$7.92k
...Business Systems Analyst (SCM System Support) Korean Bilingual Required Contract Company Description Contract Period: 1 yr. Work... ...motivated. Bilingual (Korean) required Candidate can use Gen AI such as Claude Chat, Cowork - plus Candidate must have the...BilingualKorean language skillsContract work$70k
...Systems) Data Analysis (Excel/KPI/Reporting) AI-Driven Automation & AI-assisted... ...and escalation Ability to leverage prompt engineering techniques to create, optimize, and maintain... ...communication skills in both English and Korean in order to communicate or make...BilingualKorean language skills$30 per hour
...Position: Software Quality Assurance (AI Performance) Location: Plano, TX Job... ...Title: Software Quality Assurance Tester (Korean Bilingual Preferred) Role: QA Tester - AI... ...Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent...BilingualKorean language skillsBi-weekly payFull timeContract workFor contractorsImmediate startTrial period- ...the current solutions Work closely with customers, and other engineers to define requirements and deliver innovative solutions... ...excel and deliver at a quick pace is required. Korea/English Bilingual is a plus, not mandatory Additional Information All...BilingualKorean language skillsTemporary work
Woongjin, Inc
Plano, TX2 days ago - The 10 BTI Solutions, Inc. team in Plano, TX seeks a Korean bilingual Business Analyst AO7177220 to collect, analyze, and interpret data to support product safety initiatives, risk management, and reporting. You will work with stakeholders to align on goals, develop dashboards...BilingualKorean language skills
- SBT Global, Inc. is seeking a Business Consultant and Data Analyst (Korean bilingual) to support system implementation, process improvement, data analysis, and project management initiatives. The ideal candidate has 5+ years of experience in data/BA/PM roles, a BA/BS degree...BilingualKorean language skills
- ...and TMS, and building scalable ETL pipelines. Candidates should have 2-3 years of analytics experience in transportation/logistics, a bachelor’s degree, and strong Excel skills. Korean language is a plus in a collaborative, fast-paced team. #J-18808-Ljbffr Woongjin, IncBilingualKorean language skills
- BTI Solutions is seeking a Korean bilingual Business Analyst to collect, analyze, and interpret data to provide actionable insights. You will generate reports, create dashboards, and collaborate with stakeholders to drive risk assessment and process improvements. The role...BilingualKorean language skills
- ...service teams to ensure accurate business records in SAP. The role requires a Bachelor's degree in Accounting or Finance and 3+ years of experience, with Korean/English bilingual ability. Proficiency in SAP, Salesforce, and Excel is essential. #J-18808-Ljbffr Woongjin, INC.BilingualKorean language skillsContract work
- ...Reference21-00033Top 3 must haves: 1. Ability multiple tests 2. QA background 3. Regular reporting skills (Word, Excel, Powerpoint) - Bilingual would be a great benefitDuties and Responsibilities • Collaborate closely with other team members and departments • Detect and...BilingualKorean language skills
$61k - $101k
...or certification in software engineering concepts, plus 5+ years of applied... ...use of enterprise-approved AI-assisted software development... ...AWS ECS, S3, Aurora, and API Gateway. We require excellent... ...automation at scale. We optimize backend applications for maximum...Full timeFor contractorsJ.P. Morgan
Plano, TX3 days ago- ...quantitative analysis skills with financial literacy and numeracy ~ Bilingual in Korean and English (required) ~ Excellent written and verbal... .... We also have opportunities in software development, QA engineering, mobile applications, UX/UI design, and many more! Our...BilingualKorean language skillsHourly payFull timeH1b
Jnd Corp
Plano, TX18 hours ago $8.68k
...Period: 1yr. Full-time, On-site Pay Rate: $8,680/mo DOE Korean Bilingual Job Description We are seeking an experienced... ...(BA or BS) in Business, Finance, Information Systems, Engineering, or a related field. At least 5 years of experience working...BilingualKorean language skillsFull timeContract workTemporary workWork at officeSBT Global, Inc.
Plano, TX9 days ago- ...procurement specialist in Plano, Texas, to manage IT infrastructure purchasing processes. The role requires fluency in both English and Korean, along with over 3 years of hands-on procurement experience. The ideal candidate will be proficient in MS Office and SAP,...BilingualKorean language skills
SBT Global, Inc.
Plano, TX2 days ago - ...BTI Solutions, Inc. is seeking a Korean bilingual Business Analyst to serve as the primary on-call support for our Travel system. The role requires understanding end users’ technical requirements, providing training and documentation, and maintaining strong user relationships...BilingualKorean language skills
BTI Solutions
Plano, TX1 day ago $50 - $53 per hour
Job-ID32790834Reference26-03535Remote50% RemotePay rate range - $50/hr.to $53/hr Fully Onsite Korean -Bilingual Job Description: Role and Responsibilities Responsible to execute procurement strategy to evaluate vendor risk and performance. This position will be responsible...BilingualKorean language skills- ...manner- Detail-oriented- Critical thinking, analytical, problem-solving, prioritizing, and time management skills desired.- Korean/English bilingual mandatoryAdditional InformationAll your information will be kept confidential according to EEO guidelines. *** NO C2C ***...BilingualKorean language skillsContract workRelocation
- ...and Sourcing professional to lead IT equipment and services purchases on a 1-year renewable contract. Start date ASAP. A bilingual English/Korean capability is essential for HQ communications. Responsibilities include vendor selection, contract negotiation, PO management...BilingualKorean language skillsContract workImmediate start
Ultimate Staffing
Plano, TX18 hours ago - ...provisioning of MPLS/DIA/VPN/Satellite circuits, maintain ATO and technical docs, and report on circuit status and costs. The role requires Korean language fluency, 1-5 years in telecom/billing environments, and travel for onboarding. Strong analytical and coordination skills...BilingualKorean language skills
- JND Inc. is seeking a Supply Chain Analyst 2 in Plano, Texas. This position requires Korean language skills and involves coordinating the flow of work and materials, reviewing schedules, and managing inventory. Candidates should have a High School Diploma or GED, along...BilingualKorean language skills
$40 - $42 per hour
...ability to collaborate across teams. • Attention to detail and ability to manage multiple projects simultaneously. • Bilingual English and Korean highly preferred • Regulatory familiarity not required but a plus Skills of a Business Analyst: • Analytical...BilingualKorean language skills- JND in Plano, TX, seeks a Supply Chain Analyst 2 who is bilingual in Korean. The role involves coordinating workflows, reviewing production schedules, and compiling reports on inventory levels. Strong attention to detail and problem-solving skills are essential. Candidates...BilingualKorean language skillsHourly payFull time
- ...network. The Circuit Manager is responsible for maintaining the engineering process and establishing consistency of the product’s or... ...meetings.QualificationsLanguage Proficiency: Professional fluency in Korean (both written and spoken) is strictly required to effectively...BilingualKorean language skills
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer - AI Gateway (Bilingual Korean). Be the first to apply!
Related searches
- back-end developer Plano, TX
- backend software engineer Plano, TX
- java developer backend Plano, TX
- bilingual manager Plano, TX
- bilingual customer support specialist Plano, TX
- bilingual part time Plano, TX
- bilingual account manager Plano, TX
- bilingual tech support Plano, TX
- bilingual executive assistant Plano, TX
- bilingual Plano, TX