Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal, AI Architect

'The Baldwin Group'

Position SummaryThe Principal, AI Architect is the organization’s senior-most technical authority for designing and guiding the development of scalable, secure, and compliant AI platforms and capabilities. This role defines architectural direction, establishes engineering standards and reference patterns, and provides strategic technical leadership across multiple business and technology teams. Operating as an expert-level individual contributor, the Principal, AI Architect translates business use cases into robust platform designs, drives decisions on tooling, frameworks, and model integration, and ensures that AI systems meet enterprise requirements for performance, reliability, and regulatory compliance. This role tackles multi-dimensional, highly complex technical challenges with substantial autonomy. Additionally, this role influences senior leadership, partners across functions including Data, Product, Security, and Enterprise Technology, and provides guidance to engineering teams building AI solutions. The role introduces new architectural approaches, evaluates emerging technologies, and shapes the long-term roadmap for the firm’s AI ecosystem.Position SummaryThe Principal, AI Architect is the organization’s senior-most technical authority for designing and guiding the development of scalable, secure, and compliant AI platforms and capabilities. This role defines architectural direction, establishes engineering standards and reference patterns, and provides strategic technical leadership across multiple business and technology teams. Operating as an expert-level individual contributor, the Principal, AI Architect translates business use cases into robust platform designs, drives decisions on tooling, frameworks, and model integration, and ensures that AI systems meet enterprise requirements for performance, reliability, and regulatory compliance. This role tackles multi-dimensional, highly complex technical challenges with substantial autonomy. Additionally, this role influences senior leadership, partners across functions including Data, Product, Security, and Enterprise Technology, and provides guidance to engineering teams building AI solutions. The role introduces new architectural approaches, evaluates emerging technologies, and shapes the long-term roadmap for the firm’s AI ecosystem.Primary ResponsibilitiesDefine and maintain the enterprise‑grade AI platform architecture, including orchestration layers, LLM integration patterns, vector/RAG pipelines, agent frameworks, API mesh, and reusable shared services.Develop architectural standards, guardrails, and reference designs governing how engineering teams build and integrate AI workloads.Translate business and product requirements into detailed technical designs, ensuring scalability, security, reliability, and alignment with enterprise architecture principles.Evaluate build‑vs‑buy decisions for AI components, frameworks, and cloud services; develop recommendations and influence cross‑functional stakeholders.Review solution designs from engineering teams; identify risks, surface architectural gaps, and recommend long‑term, sustainable approaches.Partner with Security, Compliance, Legal, and Risk to embed SOX, SOC 2, PCI, PII, data residency, and other regulatory requirements into architectural designs.Collaborate with Data Platform teams to define data access patterns, boundaries, governance expectations, and integration mechanisms aligned with enterprise data strategy.Lead development of architectural decision records (ADRs), integration specifications, and platform documentation supporting engineering and compliance readiness.Assess LLM providers, model hosting patterns (e.g., Bedrock, SageMaker, open-source models), and orchestration frameworks; continuously recommend improvements based on evaluation of emerging capabilities.Drive cross-functional alignment on AI design choices and platform evolution; facilitate architectural reviews, design sessions, and technical deep dives.Provide expert-level guidance and mentorship to engineering teams implementing AI services, pipelines, and production applications.Ensure AI solutions follow cloud best practices across reliability, cost efficiency, observability, performance, and operational readiness.Partner with Product, Engineering, and Enterprise Architecture to influence long-term platform direction, including multi-tenant patterns, internal developer experiences, and future-state AI services.Support readiness for audits and risk assessments by ensuring AI platform design documentation, logs, and controls meet enterprise and regulatory expectations.Champion engineering excellence, standardization, and modernization through clear architectural principles, platform governance, and adoption of best‑in‑class tools and patterns.Required Knowledge, Skills & AbilitiesDeep technical expertise in AI/ML platform architecture, including LLMs, RAG pipelines, vector databases, agent frameworks, orchestration systems, and prompt/response patterns.Expert-level AWS knowledge (e.g., Bedrock, SageMaker, Lambda, ECS/EKS, API Gateway, IAM, KMS, networking, security controls).Strong understanding of enterprise integration patterns, API design, event-driven architectures, service mesh, and distributed systems engineering.Advanced knowledge of secure design principles, compliance frameworks, and architectural controls for regulated environments (SOX, SOC 2, PCI, PII, data residency).Ability to simplify highly complex concepts, communicate architectural decisions to technical and non-technical stakeholders, and influence senior leadership.Strong analytical and problem‑solving skills, capable of evaluating multiple technical paths and making sound recommendations under ambiguity.Demonstrated ability to drive architectural alignment across cross-functional engineering teams.Proficiency with cloud-native observability, monitoring, scalability design, and performance tuning for AI workloads.Ability to evaluate emerging AI technologies, model providers, and frameworks, and integrate them responsibly into a long-term architectural roadmap.High degree of ownership, judgment, and technical leadership with the ability to operate independently and make decisions with wide organizational impact.QualificationsBachelor’s degree in computer science, engineering, or related field required; master’s degree preferred.8–10+ years of progressive software/platform engineering experience, including substantial depth in AI/ML system architecture.Hands-on experience designing and deploying production AI systems using LLMs, RAG pipelines, orchestration frameworks (e.g., LangChain, LlamaIndex), and cloud-native AI services.Significant experience with AWS cloud architecture, including design of scalable, secure, highly available distributed systems.Experience operating in regulated industries or environments with strong compliance expectations preferred (financial services, insurance, or equivalent).Demonstrated ability to influence cross-functional leaders, drive architectural standardization, and guide complex technical initiatives.Strong written and verbal communication skills, including production of decision-quality technical documentation.Proven ability to lead architecture for large-scale platforms and guide engineering teams in adopting modern, standardized patterns.#LI-RL1IND1The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal, AI Architect in New York, NY vacancy
  •  ...OKX seeks a Compliance Engineer to lead the integration of AI and ML in compliance workflows. You will develop KYC onboarding processes and ensure regulatory adherence through innovative engineering. The role demands a strong systems mindset, experience in KYC and QA,... 
    Principal

    Framework Ventures

    New York, NY
    2 days ago
  •  ...Indeed, Inc. seeks a Distinguished Engineer specializing in AI to revolutionize hiring through artificial intelligence. You will lead cutting-edge initiatives that shape the hiring marketplace by building an AI platform impacting millions daily. The ideal candidate has... 
    Principal
    Full time

    Indeed, Inc., c/o CT Corporation (Indeed.com)

    New York, NY
    3 days ago
  • $215k - $270k

     ...A digital financial services company is seeking a Principal Engineer for Generative & Agentic AI. The role involves designing autonomous systems, collaborating across teams, and mentoring engineers. Ideal candidates have a background in AI, extensive experience in software... 
    Principal
    Work at office
    Remote work

    ZIP

    New York, NY
    8 days ago
  •  ...AI Solutions Architect Key Responsibilities Design comprehensive AI solutions integrating the latest AI technology developments. Lead architectural discussions with clients across AI PC, Edge, Data Centre, and Public Cloud. Drive AI and cloud architecture... 
    Principal
    Work at office

    E-Solutions

    Jersey City, NJ
    3 days ago
  •  ...Principal Software Engineer/Manager (Fully Remote) This position is remote within Taiwan only. The Goal We are building...  ...Text-to-Code automation engine. We need a strong C# Architect who has successfully integrated AI/LLMs into real-world projects. You will lead the... 
    Principal
    Remote work

    Zealogics

    New York, NY
    3 days ago
  • $173k - $190k

     ...PointClickCare, we empower our people to be the architects of a smarter healthcare future; one that is human-first and accelerated by AI to create meaningful and lasting change....  ...role. Position Summary We are seeking a Principal AI Architect who will own both the AI... 
    Principal
    Work at office
    Remote work
    Flexible hours

    PointClickCare

    New York, NY
    3 days ago
  •  ...A leading technology company is seeking a Principal Product Architect to shape the evolution of its MarTech ecosystem. In this remote role, you will lead efforts to design and integrate tools that enhance personalized experiences while ensuring the architecture meets enterprise... 
    Principal
    Remote work

    Beyond Hosting

    New York, NY
    3 days ago
  •  ...leading consultancy firm invites applications for the role of Principal Consultant – ServiceNow. In this position, you will offer...  ...collaborate with client teams. Key responsibilities include architecting and implementing financial service operations solutions using... 
    Principal

    Together We Talent

    New York, NY
    3 days ago
  •  ...Xsolla is seeking a Principal Engineer based in Los Angeles, CA to lead the design of its authentication and authorization stack. You will architect high-performance Golang microservices to manage user identity and access tokens. The ideal candidate should have over 1... 
    Principal

    Xsolla

    New York, NY
    1 day ago
  • $152k - $272.25k

     ...Autodesk, Inc. is looking for a Principal Machine Learning Engineer to design and lead large-scale machine learning platforms. This role requires expertise in system architecture and distributed computing, along with a strong background in Python and ML infrastructure.... 
    Principal
    Remote work

    Autodesk

    New York, NY
    22 hours ago
  • ITC Infotech is seeking an experienced professional for a role focused on PLM and Medical Device domains. The candidate must have strong expertise in Windchill implementations, with at least 10 years of relevant experience. This role involves leading work streams, ensuring...
    Principal

    ITC Infotech

    New York, NY
    3 days ago
  •  ...A technology company specializing in educational platforms is seeking a Principal Platform Architect to lead the design of their next-generation platform. This fully remote role requires collaboration with engineering and product teams to establish and evolve the platform... 
    Principal
    Remote work

    Finalsite

    New York, NY
    3 days ago
  •  ...Shutterfly is seeking a Principal Software Engineer (full stack) to design and develop the Snapfish website. This remote role will involve collaborating with teams to introduce architectural efficiencies and implement key portions of the architectural roadmap. Ideal candidates... 
    Principal
    Remote work

    Shutterfly

    New York, NY
    3 days ago
  • $180k - $200k

     ...Invesco Sr. Principal Architect The technology teams that align to the Capital Markets and Investment Compliance businesses build and support technology solutions that improve speed to market and speed to insight for our investment professionals. The CRD Platform team... 
    Principal
    Full time
    Work at office

    Telepathy Inc

    New York, NY
    2 days ago
  •  ...unique opportunity to blend traditional recruiting with innovative AI tools. You will be responsible for conducting full-cycle...  ...clients. This position provides a clear growth path to becoming a Principal Technical Recruiter within 18–24 months while gaining deep AI recruiting... 
    Principal
    Remote work

    HopHR

    New York, NY
    2 days ago
  • $140k - $260k

     ...advance the Xcelium logic simulator. The role involves designing language extensions, optimizing compiler architecture, and innovating AI chip design techniques. Candidates should have extensive experience in compiler development, C++, and SystemVerilog. The position... 

    Cadence Design Systems

    New York, NY
    3 days ago
  • A leading financial institution is seeking a Distinguished AI Engineer to spearhead innovative AI product development. This role involves working with a cross-functional team to design, develop, and implement advanced AI solutions using state-of-the-art technologies. The... 
    Remote work

    CloudDevs

    New York, NY
    22 hours ago
  • Anterior is looking for a member of the Technical Staff in New York, NY, to lead system design and production processes. This role involves scaling AWS infrastructure, designing backend services, and working directly with healthcare customers to integrate solutions. Candidates...

    Anterior

    New York, NY
    22 hours ago
  •  ...A leading AI platform company in the United States is looking for a Principal Software Engineer to design scalable systems and lead architectural initiatives. This senior role requires 15+ years of experience in software engineering, including architectural leadership... 

    Demandbase

    New York, NY
    3 days ago
  • $227.5k - $245k

     ...A tech solutions company is looking for an experienced candidate to lead complex AI deployments and manage customer relationships. You will also architect multi-agent solutions and mentor junior team members. The role requires strong system architecture expertise, excellent... 
    Remote work

    Smartsheet

    New York, NY
    3 days ago
  • A leading technology consultancy in the United States is seeking an experienced Senior Microsoft Consultant to enhance their Microsoft practice. The ideal candidate will have a solid background in Microsoft Dynamics 365 and Business Central, along with outstanding client...
    Remote work

    BugendaiTech Pvt Ltd

    New York, NY
    3 days ago
  •  ...A leading technology firm is seeking a Senior Agentic AI Architect to design and implement scalable architecture for AI-assisted data workflows. This role involves hands-on development of LLM integrations and requires over 5 years of experience in data or platform engineering... 
    Remote work

    Synchro

    New York, NY
    3 days ago
  •  ...The-Baldwin-Group is seeking a Principal, AI Architect to lead the design of scalable AI platforms. You will define architectural direction, review engineering designs, and ensure compliance with various regulations. Applicants should have deep expertise in AI/ML architecture... 

    The Baldwin Group

    New York, NY
    3 days ago
  • $165k - $175k

     ...We are seeking a senior engineering leader to architect and scale mission-critical backend platforms that support complex, data-intensive, long-running business processes. This role blends hands-on system design with cross-functional leadership, ensuring reliability, data... 
    Principal
    Local area

    Soni Resources

    New York, NY
    1 day ago
  • Wenger & Watson is seeking a Senior Backend Engineer to lead the design and development of scalable systems in the United States. This role requires 7+ years of engineering experience, deep expertise in distributed and event-driven systems, and a proven track record in...

    Wenger & Watson

    New York, NY
    3 days ago
  • A leading beverage company is seeking a Senior Principal Product Architect to lead the integration of cutting-edge coffee appliance technologies. This role involves coordinating global teams, mentoring engineers, and ensuring projects meet performance targets. Candidates... 
    Principal

    Keurig Dr Pepper

    New York, NY
    22 hours ago
  • Optro is seeking a highly motivated staff software engineer in the United States to lead large, strategic, and complex projects. The ideal candidate will have 10+ years of experience in developing web-based applications, strong expertise in REST/JSON APIs, and the ability...
    Remote work
    Flexible hours

    OPTRO

    New York, NY
    2 days ago
  • YASH Technologies is seeking a seasoned SAP professional with a deep expertise in SAP BTP for a Full-Time Direct Hire position. The role focuses on integrating advanced technologies and leading customer workshops to drive business transformation. Candidates should have...
    Full time
    Remote work

    Yash Technologies

    New York, NY
    3 days ago
  • $110k - $130k

     ...hiring a Lead Zendesk Administrator to strategically oversee the Member Services application ecosystem. The role involves designing AI workflows, managing the Zendesk platform, and enhancing operational efficiency across communication channels. Candidates should have... 

    Vida Health Inc

    New York, NY
    3 days ago
  •  ...A global digital solutions company is seeking a Lead AI Engineer for a full-time remote position in the USA. This role involves designing and building enterprise workflow automation systems, making critical technical decisions, and leveraging Generative AI to boost business... 
    Full time
    Remote work

    Svitla Systems

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal, AI Architect. Be the first to apply!