Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Architect

Full-time

Galent

About the Role:

We are looking for a senior AI Engineering & Architecture Leader to design, build, and scale production-grade AI systems for enterprise clients. This is a hands-on technical leadership role focused on taking AI solutions from prototype to production, with an emphasis on open-weight models, AI architecture, model fine-tuning, evaluation, performance optimization, and enterprise deployment .

The ideal candidate will combine strong AI/ML engineering expertise with experience leading large engineering teams and working directly with enterprise clients.

Key Responsibilities:

  • Define and own reference architectures for enterprise AI solutions, including model selection, model routing, retrieval, tool integration, orchestration, guardrails, observability, and evaluation.
  • Lead the transition of AI prototypes into reliable, production-ready systems.
  • Establish engineering standards covering architecture, code reviews, automated testing, quality gates, and release readiness.
  • Design and implement solutions using open-weight AI models , including determining when fine-tuning provides advantages over hosted models.
  • Lead model fine-tuning, training-data curation, evaluation, and production model serving.
  • Optimize AI systems for cost, latency, scalability, and performance using techniques such as quantization, distillation, routing, caching, and batching.
  • Build robust AI evaluation infrastructure, including offline evaluations, regression testing, CI/CD quality gates, online monitoring, and human review.
  • Assess enterprise data readiness, governance, and technical feasibility before AI implementations begin.
  • Lead and mentor a team of 30+ engineers and data scientists across multiple client engagements.
  • Develop reusable AI architectures, frameworks, accelerators, and engineering best practices.
  • Partner with sales and consulting teams on client workshops, proposals, technical due diligence, effort estimation, and solution design.
  • Serve as the senior technical escalation point for architecture, performance, deployment, and production challenges.

Required Qualifications

  • 12+ years of experience across software engineering, architecture, data platforms, and AI/ML.
  • Proven experience designing and deploying AI systems into production at scale using real enterprise data and users.
  • Strong hands-on experience with open-weight models and production fine-tuning .
  • Experience with full fine-tuning, LoRA, and/or QLoRA and the ability to evaluate models against baseline/frontier models.
  • Demonstrated experience improving AI system cost and/or latency through model and infrastructure optimization.
  • Strong understanding of AI evaluation and building evaluation infrastructure.
  • Experience with enterprise data readiness, AI governance, and risk management.
  • Working knowledge of NIST AI Risk Management Framework, ISO/IEC 42001, and EU AI Act risk tiers .
  • Strong hands-on Python development experience.
  • Experience with distributed systems, APIs, containers, Kubernetes, CI/CD, and GPU serving.
  • Experience with at least one major cloud platform.
  • Experience with platforms such as Databricks and/or Snowflake .
  • Proven experience leading and mentoring senior engineering teams.
  • Experience in a startup or product-company environment is preferred/required for the role.
  • Bachelor's degree in Computer Science, Engineering, or a related technical field.

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Principal AI Architect in New York, NY vacancy
  • $270k - $330k

     ...About the Role This principal-level role will shape the design and direction of AI solutions at a cybersecurity company. You will oversee AI architecture and strategy, helping guide how AI capabilities are designed and applied across the organization. What You'll... 
    Principal

    Clera

    New York, NY
    2 days ago
  • $190k - $199k

     ...careerThis could be a global role, e.g. based from UK or US or AUS - so unsure how we would tailor the above?What You Will Get To Do:Own the AI vision for the contact centre: Define and lead the global AI strategy across millions of customer interactions per year across voice,... 
    Principal
    Ongoing contract
    Full time
    Work at office

    SS&C Technologies

    New York, NY
    3 days ago
  •  ...enable holistic well-being for you and your family.What you'll doYou will combine deep expertise in full-stack engineering and advanced AI systems to deliver transformative outcomes for clients. You will design and build scalable, production-grade solutions, spanning data... 
    Principal
    Apprenticeship
    Immediate start
    Easy work
    Flexible hours

    McKinsey & Company

    New York, NY
    3 days ago
  • $215k - $275k

     ...engineering, analytics, automation, and AI-native delivery to build intelligent products...  ...safely at enterprise scale. As an AI/ML Architect, you’ll design and deliver production-...  ...targeted base salary pay range for a Sr. Principal is $215,000 to $275,000.For Atlanta, Charlotte... 
    Principal
    Temporary work
    Local area

    Slalom

    New York, NY
    2 days ago
  • $154.38k - $193.13k

    Job DescriptionAI Architect, AI & AutomationAbout the Role The applicant should have deep, hands-on experience architecting, designing, and implementing enterprise-grade AI, Machine Learning, and Generative AI solutions, and experience leading technical teams delivering... 
    Principal
    Full time
    Temporary work
    Work experience placement

    Infosys Technologies

    New York, NY
    10 hours ago
  •  ...alignment across engineering teams Drive AI-assisted and agentic development adoption...  ...and customers Report to the Chief Architect and partner with engineering leadership,...  ...significant time as a senior, staff, or principal-level architect or technical lead designing... 
    Principal

    Jobtailor

    New York, NY
    10 hours ago
  • $230k

     ...Transformation, Data & Digital Platforms, AI at Scale, Agile, Cybersecurity and...  ...at scale.What You'll DoPrincipal AI Tech Architects at BCG Platinion are:Collaborative. They...  ...critical business challenges.We are seeking Principal AI Tech Architects to design, guide, and... 
    Principal
    Work at office
    Local area

    The Boston Consulting Group

    New York, NY
    10 hours ago
  • $155.94k - $259.87k

     ...Principal Architect, AI Where Ambition Meets Innovation Build a career that matches all your initiative with an impressive dose of innovation. From cutting-edge resources and a collaborative environment to the freedom to make an impact and more, you'll find the ingredients... 
    Principal
    Immediate start
    Work from home

    The Private Trust Company, an affiliate of LPL

    New York, NY
    1 day ago
  •  ...Corp. is building real-time optimization and AI-driven predictions for energy and manufacturing plants. As a Principal backend engineer in NYC, you will own and evolve...  ...You’ll work across data ingestion pipelines, architect complex systems, mentor teams, and drive migrations... 
    Principal
    Work at office
    Remote work
    1 day per week

    Jobleads-US

    New York, NY
    5 days ago
  • Edison Scientific, Inc. is seeking a Principal Member of Technical Staff to lead the platform infrastructure that powers autonomous scientific...  ...and operators, and ensure reliable compute orchestration for AI agents and long-running workloads. Collaborating with backend,... 
    Principal

    Edison Scientific, Inc.

    New York, NY
    3 days ago
  • CVS Health Corporation seeks a Principal Applied AI Architect to own AI-powered product design across the enterprise. You will write specs, design systems, and ship production AI applications using agents and coding tools while collaborating with platform owners and security... 
    Principal
    Remote job

    CVS Health

    New York, NY
    3 days ago
  •  ...CVector - Industrial AI in New York City seeks a Principal backend engineer to evolve our core platform. You will own time-series data systems, AI-assisted analytics, cloud infrastructure, and data ingestion pipelines powering customer applications and modeling tools.... 
    Principal

    Jobleads-US

    New York, NY
    4 days ago
  • Presidio is seeking a Principal Architect to provide technical leadership in designing and developing Presidio's internal Managed Services platform and automations. You will work with the Product Owner and team members to solve complex technical and business challenges,... 
    Principal
    Remote job

    Opportunities

    New York, NY
    4 days ago
  • Cloudflare is seeking a Principal Content Engineer to lead content architecture and tooling for our Developer GTM. You will write flagship content across tutorials, runnable demos, and reference architectures, shaping the learning path for developers building on our platform... 
    Principal

    Webhosting

    New York, NY
    2 days ago
  •  ...our employees work at each day and is defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving... 
    Principal
    Full time
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Palo Alto Networks

    New York, NY
    10 hours ago
  • $270k - $330k

    About the Role This is a senior, principal-level architecture role at a cybersecurity ratings...  ...company, focused on shaping the AI strategy that powers enterprise-scale security...  ...architecture standards across the platform. Architect and deliver multi-agent and agentic AI... 
    Principal
    Remote job
    Relocation

    Jobleads-US

    New York, NY
    2 days ago
  • $140k - $155k

     ...markets.   Our challenge Synechron is seeking a senior Principal Data Architecture Engagement Lead to lead a strategic data-transformation...  ...narrative jointly with the Data-Mesh / Enterprise Architect, and defend it at the architecture board. Author the executive... 
    Principal
    Full time
    Temporary work
    Flexible hours

    Synechron

    New York, NY
    1 day ago
  • Job Description: Principal AI Driven SDLC CoachJob SummaryAs a Principal AI Driven SDLC Coach, you serve as the senior technical authority responsible forend-to-end coaching and governance of AI-driven full Software Development Lifecycle (SDLC).You design robust engineering... 
    Principal

    Virtusa

    New York, NY
    2 days ago
  •  ...with a leading specialist consultancy that is seeking to hire a Principal / Senior Principal to join its Building Envelope practice in...  ...Develop and maintain senior relationships with major owners, architects, developers and industry partners Drive business development... 
    Principal

    TYG

    New York, NY
    4 days ago
  •  ...provider and are proud to deliver our services through global simplicity with trusted transparency.ROLE SUMMARYWe are seeking a Principal Architect for Network Services who will understand existing engineering standards and reference architectures. The ideal candidate will... 
    Principal

    EOS IT Solutions

    New York, NY
    4 days ago
  •  ...and are proud to deliver our services through global simplicity with trusted transparency.WHAT YOU WILL DO:We are seeking a Principal Architect to define and lead next‑generation data center architecture spanning physical and logical design, software-defined infrastructure... 
    Principal

    EOS IT Solutions

    New York, NY
    4 days ago
  •  ...provider and are proud to deliver our services through global simplicity with trusted transparency.WHAT YOU WILL DO:We’re seeking a Principal Architect with deep expertise in Perimeter/DMZ architectures, network segmentation, and secure ingress/egress across on‑premises and... 
    Principal

    EOS IT Solutions

    New York, NY
    4 days ago
  •  ...Principal Architect | AWS & Databricks Experience: 15+ years Role Overview We are seeking a Principal Architect with 15+ years of cloud architecture experience and strong hands-on expertise designing and implementing AWS and Databricks solutions. This person will... 
    Principal

    LinkedIn

    New York, NY
    1 day ago
  • $272k - $431.25k

    NVIDIA is harnessing the power of AI and high-performance computing to build the future of mobility. DriveOS is the software platform...  ..., safety-critical applications. We are seeking a Senior Process Architect to make the system of work behind that platform coherent,... 
    Principal
    Full time
    Remote work

    Nvidia

    New York, NY
    1 day ago
  • $110.38k - $215.82k

     ...Serves as a resource to the designer and project manager as the design is developed. The role includes serving as the lead technical architect on medium to large scale projects.What You'll Do:Develops and presents lead technical viewpoint on assigned projects. Ensures that... 
    Principal
    Full time
    Contract work
    For contractors

    HNTB Companies

    New York, NY
    2 days ago
  • $152k - $221k

     ...a trusted advisory relationship with accounts and engage with Architects, Vice President Engineering, Chief Technical Officer and Chief...  ...cloud strategies in the public sector space. The Google Cloud Principal Architect role is a hybrid technical and business advisor role... 
    Principal
    Local area

    Google

    New York, NY
    3 days ago
  • $239k - $278.75k

     ...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the...  ...shared success where your work truly matters.Job SummaryAs a Principal Architect you will serve as a trusted executive advisor responsible for... 
    Principal
    Full time
    Remote work
    Visa sponsorship
    Work visa

    Palo Alto Networks

    New York, NY
    10 hours ago
  • $176.3k - $374.2k

     ...great benefits, and a team that wants you to grow and succeed. What you'll build As a Principal Forward Deployed Architect, you will provide technical leadership for SAP's most strategic AI engagements. You will define enterprise AI architectures, lead multidisciplinary... 
    Principal
    Permanent employment
    Full time
    Work at office
    Worldwide
    Flexible hours

    SAP

    New York, NY
    1 day ago
  •  ...transportation links in the New York/New Jersey region. Port Authority architects work on a wide range of projects within the general context of...  ...agency. The Port Authority is seeking to fill a position of Principal Architect in the Engineering Department’s Design Division,... 
    Principal
    Permanent employment
    Contract work
    Work at office
    Remote work
    1 day per week

    The Port Authority of New York and New Jersey

    New York, NY
    2 days ago
  •  ...Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the...  ...shared success where your work truly matters. Job Summary Principal Architect As a Principal Architect you will serve as a trusted... 
    Principal
    Remote work
    Visa sponsorship
    Work visa

    Palo Alto Networks

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Architect. Be the first to apply!