AI Platform Architect - Anthropic

Responsibilities

• Design, build, deploy, and maintain reusable platform capabilities, reference architectures, infrastructure patterns, deployment templates, and integration components for enterprise AI.
• Build secure integrations with the Anthropic API, Claude models, approved AI services, enterprise data, APIs, workflow systems, and authorized tools.
• Establish CI/CD, LLMOps, MLOps, versioning, evaluation, regression testing, deployment automation, monitoring, rollback, and lifecycle-management practices.
• Operate and improve AI services through incident response, troubleshooting, root-cause analysis, capacity planning, reliability improvements, and cost optimization.
• Design and manage cloud infrastructure, infrastructure-as-code, containerized deployments, identity and access controls, secrets management, security, privacy, compliance, disaster recovery, and business continuity.
• Build data-ingestion, transformation, indexing, retrieval, RAG, embeddings, vector-search, hybrid-search, reranking, and source-attribution capabilities.
• Implement responsible-AI safeguards, observability, tracing, output validation, guardrails, approval gates, human-in-the-loop workflows, auditability, and governance controls.
• Develop integrations with ServiceNow, enterprise APIs, identity providers, workflow and collaboration platforms, and line-of-business systems.
• Provide technical guidance, participate in architecture reviews and customer workshops, and convert recurring client needs into reusable platform features, accelerators, playbooks, and documentation.

Requirements

• 5+ years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles.
• Hands-on experience designing and deploying cloud-native applications and services on AWS, Microsoft Azure, and/or Google Cloud Platform.
• Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes.
• Experience with Docker, Kubernetes, serverless services, or comparable cloud-native platforms.
• Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages.
• Experience designing and consuming REST APIs, integrating enterprise applications, and implementing authentication and authorization patterns.
• Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, AI workflow automation, or related technologies.
• Familiarity with prompt and context engineering, token management, embeddings, vector search, structured outputs, tool use or function calling, evaluations, and model monitoring.
• Experience with observability practices, including logging, metrics, tracing, alerting, and incident management.
• Strong knowledge of cloud security, identity and access management, secrets management, network security, and secure software-development practices.
• Experience with relational databases, NoSQL databases, data warehouses, object storage, search platforms, or vector databases.
• Strong problem-solving, troubleshooting, communication, and documentation skills, with the ability to work in collaborative customer-oriented environments.
• Preferred qualifications include Claude, Anthropic API, Anthropic Console, Claude Code, Anthropic training, Model Context Protocol, LLM frameworks, LLM evaluation, prompt/version management, AI tracing, guardrails, model gateways, and AI observability experience.
• Preferred qualifications include MLOps platforms, data engineering and governance, vector databases, enterprise search, Terraform, Pulumi, CloudFormation, Bicep, Helm, Argo CD, GitHub Actions, GitLab CI/CD, Azure DevOps, Jenkins, Kubernetes operations, service meshes, API management, event-driven architecture, microservices, and FinOps.
• ServiceNow, consulting, professional services, enterprise architecture, or client-facing technical delivery experience is preferred.
• A bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline is required, with equivalent relevant professional experience considered; relevant certifications are a plus.

Benefits

• NewRocket offers a diverse and inclusive workplace and is an equal opportunity and affirmative action employer.
• The role includes travel based on client and business needs, with the posting indicating a location/hybrid/remote arrangement without specifying which applies.