Backend Engineer_AI Gateway (Korean Required)

1 yr Contract

Full-Time, On Site

Pay Rate: ~$10,570/mo DOE

Korean Bilingual Required

Job Description

We are building an AI Gateway—a high‑performance intermediary that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers. In this role you will own the entire full‑stack lifecycle of the gateway, from core Python API service design and implementation to containerization, deployment, monitoring, and day‑to‑day operations.

While you can consult network and security specialists for architecture reviews, threat modeling, and policy definition, the application code, testing, CI/CD pipeline, and production operations will be developed and maintained solely by you. You’ll have full technical autonomy to design, build, and scale a robust, production‑grade system.

Qualifications

What we are looking for

• Experience: Around 5 years of professional backend development experience, with a solid track record of building and operating production-grade services.
• Async Python & Core Web Frameworks (3+ yrs): Deep understanding of asyncio and hands-on production experience with FastAPI (Pydantic, dependency injection, OpenAPI).
• Network Protocol & Streaming Fundamentals:
  • Strong grasp of and SSE (Server-Sent Events) / Chunked transfer encoding essential for real-time LLM inference streaming.
  • Practical understanding of the TCP/IP lifecycle, connection pooling, keep-alive, and managing back-pressure.
• Database & Async Messaging:
  • Proficiency in PostgreSQL (query tuning, connection pooling via PgBouncer).
  • Experience with message queues or event streams (e.g., Redis Streams, RabbitMQ, or Kafka) for decoupled task processing.
• Containerization & CI/CD:
  • Docker, Kubernetes (basic workload management, deployment, HPA), and setting up CI/CD pipelines (GitHub Actions / GitLab CI).

Work experience desired

• Collaborative Security & Infra Awareness: Willingness to work with internal security/network teams on NGINX/Envoy reverse-proxy setup, mTLS, or IAM/SSO (OIDC/SAML) integrations.
• AI/LLM Integration: Experience handling LLM API payloads, managing rate limits, or implementing simple proxy/gateway patterns for AI services.
• Infrastructure as Code: Basic familiarity with Terraform for multi-env infrastructure management.

Additional Information

All your information will be kept confidential according to EEO guidelines.