Principal AI Platform Engineer [Remote]

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Principal AI Platform Engineer based in United States.

This role offers the opportunity to shape the foundation of enterprise-scale generative AI solutions by building the infrastructure that powers intelligent products and workflows.
You will lead the design and development of secure, scalable AI platforms that connect advanced models with real-world applications.
Working across engineering and product teams, you will help transform AI capabilities into reliable, production-ready experiences.
The position requires deep expertise in AI infrastructure, cloud-native systems, and platform engineering practices.
You will influence architectural decisions, improve operational excellence, and enable teams to safely innovate with generative AI.
This is a high-impact opportunity for a technical leader passionate about building the next generation of AI-powered platforms.

Accountabilities:

The Principal AI Platform Engineer will be responsible for designing, developing, and operating the core infrastructure that enables generative AI products at scale. This role combines advanced software engineering, AI platform architecture, and cross-functional collaboration to deliver secure and reliable AI capabilities.

• Design, build, and maintain foundational AI platform components, including model gateways, prompt and version management systems, vector databases, and LLM evaluation frameworks.
• Develop secure platform architectures with integrated authentication, authorization, and access control mechanisms.
• Build and enhance observability solutions, including monitoring, logging, and performance tracking for AI workloads and infrastructure.
• Partner with product and engineering teams to integrate AI infrastructure with agent frameworks and downstream applications.
• Optimize AI platforms for scalability, reliability, availability, and cost efficiency in production environments.
• Establish best practices for AI platform operations, deployment workflows, and infrastructure management.
• Support continuous improvement of AI capabilities through strong engineering standards, automation, and technical leadership.

Requirements:

The ideal candidate brings extensive experience building AI infrastructure and highly scalable software platforms, with strong expertise in cloud-native technologies and production AI systems.

• Extensive experience designing, building, and maintaining AI platform infrastructure in production environments.
• Strong expertise with Kubernetes, containerized environments, and container security practices.
• Demonstrated experience with observability and monitoring frameworks, including technologies such as OpenTelemetry and MLflow.
• Hands-on experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI development environments.
• Strong understanding of authentication and authorization frameworks for secure AI platforms.
• Experience building scalable distributed systems and optimizing infrastructure performance.
• Familiarity with LLM inference frameworks such as vLLM, SGLang, or similar technologies is a plus.
• Experience with CI/CD pipelines, automation, and AI model deployment processes.
• Strong collaboration skills with the ability to work effectively across product, engineering, and technical teams.

Benefits:

• Competitive base salary range of $179,000 - $199,000 annually, plus bonus and benefits.
• Comprehensive total rewards package aligned with experience, skills, and market expectations.
• Remote work flexibility within the United States.
• Opportunity to work on cutting-edge generative AI infrastructure and enterprise-scale technology initiatives.
• Collaborative environment with experienced engineering and product teams.
• Access to professional growth opportunities while contributing to impactful AI solutions.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.