Principal Software Engineering (AI Infrastructure)

Responsibilities

• Lead the architecture and long-term technical strategy for TSMC’s AI platform, enterprise AI gateway, multi-model inference platform, GPU infrastructure, governance, and observability.
• Design and build scalable enterprise AI infrastructure for LLM serving, GPU scheduling, model routing, model lifecycle management, RAG infrastructure, vector databases, and AI orchestration.
• Lead distributed-systems architecture for highly available AI services, multi-region deployment, disaster recovery, service mesh, distributed caching, event-driven architecture, and global load balancing.
• Drive AI platform engineering practices involving Kubernetes, Platform-as-a-Service, and AI deployment automation.
• Collaborate with engineering teams in North America and Taiwan to support secure, scalable, and reliable AI services across global regions.

Requirements

• BS, MS, or PhD in Computer Science or a related field.
• At least 7 years of software engineering experience.
• At least 3 years leading architecture for distributed systems or cloud infrastructure.
• At least 2 years of hands-on experience designing enterprise AI platforms.
• At least 1 year of experience as a Principal Engineer, Staff Engineer, Distinguished Engineer, or Technical Lead.
• Strong experience with LLM inference, enterprise AI gateways, AI serving infrastructure, GPU scheduling, multi-model AI architecture, and model lifecycle management.
• Deep expertise with cloud-native infrastructure and experience with NVIDIA GPU technologies, vLLM, TensorRT-LLM, Triton Inference Server, Ray, Kubeflow, MLflow, Kubernetes, Docker, Helm, ArgoCD, service mesh, and AWS, Azure, or GCP.
• Strong programming skills in one or more of Go, Python, or Java, plus experience with REST APIs, microservices, and SDKs.
• Strong technical communication skills for collaboration with global cross-functional teams.
• Legal authorization to work in the United States without current or future visa sponsorship; employment is contingent on passing a background check and drug screening.

Benefits

• Starting base salary typically ranges from $137,300 to $183,650 per year, with the full job-grade base salary range extending from $137,300 to $199,100.
• Profit sharing, incentive bonuses, and tuition assistance are included in the total compensation package.
• Medical, dental, vision, life insurance, and a 401(k) plan with employer match are provided.
• Employees receive 12 holidays per year and accrue paid time off annually.
• Onsite amenities include a fitness center, game room, physical therapist, and subsidized café.
• The position is onsite in Vancouver, Washington, Monday through Friday during core hours of 8 a.m. to 5 p.m.; additional hours may be required for project demands.