Principal AI Architect

Principal AI Architect - Type

Contract with a right to hire – USC or GC only - 6+ months

Cincinnati 45202 or Atlanta (Norcross) strongly preferred – Hybrid -

Check out the role overview below If you are confident you have got the right skills and experience, apply today.

Key Skills

AWS, Bedrock, Claude, AI security

Notes

A hands-on architect who combines deep AWS and Amazon Bedrock expertise, advanced Claude application development, and enterprise-grade AI security with the ability to deliver production solutions.

Principal AI Architect – AWS, Amazon Bedrock, Claude & AI Security

We are seeking a highly experienced, hands-on Principal AI Architect to lead the design, development, and deployment of secure, scalable, enterprise-grade Generative AI solutions. The ideal candidate will have deep expertise in AWS cloud architecture, Amazon Bedrock, Anthropic Claude models, agentic AI, and enterprise AI security.

This role combines strategic architecture leadership with hands-on engineering. The candidate will define enterprise AI architecture standards, establish development best practices, and lead the transition of AI proofs of concept into production-ready applications and autonomous agents.

The architect will work closely with engineering, security, data, infrastructure, and business teams to identify opportunities for AI-driven transformation, integrate AI capabilities into enterprise applications, and deliver measurable business outcomes.

The ideal candidate is a hands-on AI architect who has built production-grade Claude applications and agents, understands AWS deeply, and can establish secure AI engineering practices across development teams.

Key Responsibilities

1. AWS & Amazon Bedrock Architecture

• Design and implement enterprise AI architectures using AWS and Amazon Bedrock.
• Demonstrate strong hands-on experience with Bedrock foundation models, model invocation, Knowledge Bases, Guardrails, Agents, and model evaluation capabilities.
• Architect scalable, resilient, cost-effective AI platforms using AWS Lambda, Step Functions, API Gateway, S3, IAM, CloudWatch, and other relevant AWS services.
• Design secure data ingestion, retrieval, processing, orchestration, and inference pipelines.
• Establish reusable architecture patterns, reference implementations, and technical standards for enterprise AI adoption.
• Evaluate models based on accuracy, latency, throughput, security, context requirements, and operating cost.

1. Anthropic Claude Development & Engineering Best Practices

• Demonstrate deep, hands-on experience developing production applications using Anthropic Claude models through Amazon Bedrock and, where appropriate, the native Anthropic API.
• Build Claude-powered applications using tool calling, structured outputs, prompt engineering, context management, and multi-step agentic workflows.
• Establish reusable Claude development frameworks, prompt templates, coding standards, model selection guidelines, and architecture patterns.
• Apply advanced techniques for context-window management, token optimization, caching where supported, latency reduction, and cost optimization.
• Implement robust application behavior through schema validation, error handling, retries, timeouts, fallback strategies, and deterministic business-rule enforcement.
• Develop automated evaluation and regression-testing frameworks to measure accuracy, hallucinations, instruction following, and consistency across model or prompt changes.
• Establish development best practices that separate model-generated outputs from trusted business logic and authorized execution.
• Keep current with relevant Claude capabilities, model changes, API features, and emerging agent development patterns.

1. AI Agents & Enterprise Automation

• Design and build AI agents capable of executing multi-step business workflows using tools, APIs, enterprise data, and business applications.
• Implement appropriate agent orchestration patterns, including single-agent and multi-agent architectures where justified by business requirements.
• Integrate AI agents with ERP, CRM, databases, document repositories, and enterprise services.
• Design human-in-the-loop approval mechanisms, authorization checks, exception handling, and escalation workflows.
• Implement reliable execution patterns with bounded retries, idempotency, transaction controls, and recovery mechanisms.
• Ensure agents operate within explicitly defined permissions and cannot independently perform unauthorized business actions.
• Identify opportunities to automate complex enterprise processes and deliver measurable improvements in productivity, accuracy, and cycle time.

1. AI Security, Privacy & Responsible AI

• Define and implement security-by-design standards for LLM applications, Claude-powered agents, RAG pipelines, and enterprise AI platforms.
• Conduct threat modeling for AI applications, including prompt injection, indirect prompt injection, jailbreaks, sensitive-data leakage, insecure tool execution, and excessive agent autonomy.
• Implement least-privilege IAM, workload identity, secrets management, encryption, network controls, and appropriate data access boundaries.
• Implement Amazon Bedrock Guardrails and complementary application-level controls for content filtering, sensitive-data protection, and policy enforcement.
• Secure RAG architectures against unauthorized document retrieval, cross-user data exposure, malicious retrieved content, and access-control bypasses.
• Enforce authorization and business policies outside the LLM, validating every privileged tool call and consequential action independently of model-generated instructions.
• Implement human approval controls for high-impact or sensitive operations, including financial transactions and critical enterprise data changes.
• Establish audit logging, security monitoring, incident response, adversarial testing, AI red teaming, and security regression testing.
• Integrate security checks into the software development lifecycle, including code review, dependency scanning, infrastructure-as-code validation, and CI/CD security gates.
• Partner with enterprise security, privacy, compliance, and risk teams to meet applicable organizational and regulatory requirements.

1. RAG, Knowledge Systems & Enterprise Data

• Design retrieval-augmented generation architectures using embeddings, vector search, metadata filtering, reranking where appropriate, and hybrid retrieval.
• Implement enterprise knowledge assistants grounded in authorized documents, structured data, and business systems.
• Evaluate vector storage and retrieval options based on data scale, relevance, security, operational complexity, and cost.
• Establish document ingestion, chunking, indexing, metadata management, freshness, and access-control strategies.
• Implement source attribution, retrieval-quality evaluation, hallucination reduction, and appropriate abstention behavior when evidence is insufficient.
• Optimize retrieval and context assembly to balance answer quality, latency, and token consumption.

1. Production Engineering, DevSecOps & MLOps/LLMOps

• Own the architecture and technical approach for moving AI proofs of concept into secure, production-ready applications.
• Establish CI/CD pipelines, infrastructure as code, automated testing, environment promotion, and controlled deployment practices.
• Implement observability for model invocations, agent traces, tool calls, latency, errors, token consumption, cost, and application-level outcomes.
• Establish evaluation datasets, quality thresholds, regression testing, canary releases, and rollback strategies.
• Design for availability, scalability, resilience, rate limits, quotas, concurrency, and graceful degradation.
• Establish operational runbooks, incident management, model and prompt versioning, and continuous improvement processes.
• Optimize total cost of ownership while maintaining security, reliability, and acceptable performance.

1. Enterprise Architecture & Technical Leadership

• Define the enterprise AI reference architecture, technical roadmap, and standards for AWS, Bedrock, Claude, and agentic AI.
• Lead architecture reviews and guide engineering teams on design decisions, implementation patterns, and production readiness.
• Establish reusable components and approved patterns that accelerate delivery without compromising security or quality.
• Evaluate emerging AI technologies and determine their suitability for enterprise adoption.
• Collaborate with business stakeholders to translate business needs into practical AI solutions with measurable value.
• Mentor developers and architects in Claude development, AI security, prompt engineering, agent orchestration, and production engineering.
• Communicate architectural trade-offs, risks, implementation plans, and business outcomes to technical and executive stakeholders.

Required Qualifications

• 10+ years of experience in software engineering, cloud architecture, application development, or enterprise technology, with substantial hands-on technical leadership.
• Strong hands-on AWS architecture and implementation experience, including cloud security, networking, IAM, serverless services, APIs, monitoring, and deployment automation.
• Demonstrated hands-on experience building and deploying production Generative AI applications using Amazon Bedrock.
• Deep practical experience developing applications or agents using Anthropic Claude models.
• Strong understanding of agentic AI, tool calling, RAG, embeddings, structured outputs, prompt engineering, and LLM evaluation.
• Proven experience integrating AI applications with enterprise systems, REST APIs, databases, and business workflows.
• Strong Python development skills and experience with API design, distributed systems, asynchronous processing, and automated testing.
• Demonstrated expertise in LLM security, threat modeling, prompt-injection mitigation, identity and access controls, data protection, and secure tool execution.
• Experience establishing software engineering standards, CI/CD practices, observability, and production operational processes.
• Proven ability to take AI initiatives from architecture and prototype through production deployment and ongoing support.
• Strong communication skills and the ability to lead technical discussions across engineering, security, infrastructure, and business teams.

Preferred Qualifications

• AWS Certified Solutions Architect – Professional, AWS Certified Machine Learning Engineer – Associate, or relevant equivalent certifications.
• Experience with LangGraph, LangChain, the Anthropic SDK, or comparable agent orchestration and development frameworks.
• Experience with Terraform, AWS CDK, CloudFormation, or equivalent infrastructure-as-code technologies.
• Experience with automated AI evaluation, LLM observability, security testing, and AI red teaming.
• Familiarity with enterprise ERP platforms such as Oracle or Infor, CRM platforms such as Salesforce, and complex enterprise integration architectures.
• Experience implementing AI governance, model risk management, responsible AI controls, and enterprise architecture standards.
• Experience leading AI platform engineering initiatives or enabling multiple development teams to build and operate AI applications.

Expected Deliverables & Success Measures

• An approved enterprise AI reference architecture covering AWS, Bedrock, Claude, security, and production operations.
• Secure, reusable Claude and Bedrock development patterns, templates, libraries, and implementation guidelines.
• Production deployment of AI applications and agents with measurable business outcomes.
• Documented threat models, security controls, evaluation criteria, and production-readiness checklists.
• Automated testing, evaluation, observability, and deployment processes for AI applications.
• Measurable improvements in automation, accuracy, operational efficiency, reliability, and cost per transaction.
• Engineering teams enabled to develop and deploy AI solutions consistently and securely.

Candidate Evaluation Expectations

• Candidates should be prepared to demonstrate their personal contributions to at least one substantial Claude-powered application or agent, preferably in production.
• They should be able to explain the architecture, code-level decisions, model and framework choices, security threat model, evaluation methodology, failure handling, deployment approach, and measurable results.
• The selection process should include a hands-on technical assessment covering Claude development, AWS architecture, agent security, RAG, and production engineering. xhyhwjd

CBTS provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws.