Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Architect

Galent

About the Role:

We are looking for a senior AI Engineering & Architecture Leader to design, build, and scale production-grade AI systems for enterprise clients. This is a hands-on technical leadership role focused on taking AI solutions from prototype to production, with an emphasis on open-weight models, AI architecture, model fine-tuning, evaluation, performance optimization, and enterprise deployment .

The ideal candidate will combine strong AI/ML engineering expertise with experience leading large engineering teams and working directly with enterprise clients.

Key Responsibilities:

  • Define and own reference architectures for enterprise AI solutions, including model selection, model routing, retrieval, tool integration, orchestration, guardrails, observability, and evaluation.
  • Lead the transition of AI prototypes into reliable, production-ready systems.
  • Establish engineering standards covering architecture, code reviews, automated testing, quality gates, and release readiness.
  • Design and implement solutions using open-weight AI models , including determining when fine-tuning provides advantages over hosted models.
  • Lead model fine-tuning, training-data curation, evaluation, and production model serving.
  • Optimize AI systems for cost, latency, scalability, and performance using techniques such as quantization, distillation, routing, caching, and batching.
  • Build robust AI evaluation infrastructure, including offline evaluations, regression testing, CI/CD quality gates, online monitoring, and human review.
  • Assess enterprise data readiness, governance, and technical feasibility before AI implementations begin.
  • Lead and mentor a team of 30+ engineers and data scientists across multiple client engagements.
  • Develop reusable AI architectures, frameworks, accelerators, and engineering best practices.
  • Partner with sales and consulting teams on client workshops, proposals, technical due diligence, effort estimation, and solution design.
  • Serve as the senior technical escalation point for architecture, performance, deployment, and production challenges.

Required Qualifications

  • 12+ years of experience across software engineering, architecture, data platforms, and AI/ML.
  • Proven experience designing and deploying AI systems into production at scale using real enterprise data and users.
  • Strong hands-on experience with open-weight models and production fine-tuning .
  • Experience with full fine-tuning, LoRA, and/or QLoRA and the ability to evaluate models against baseline/frontier models.
  • Demonstrated experience improving AI system cost and/or latency through model and infrastructure optimization.
  • Strong understanding of AI evaluation and building evaluation infrastructure.
  • Experience with enterprise data readiness, AI governance, and risk management.
  • Working knowledge of NIST AI Risk Management Framework, ISO/IEC 42001, and EU AI Act risk tiers .
  • Strong hands-on Python development experience.
  • Experience with distributed systems, APIs, containers, Kubernetes, CI/CD, and GPU serving.
  • Experience with at least one major cloud platform.
  • Experience with platforms such as Databricks and/or Snowflake .
  • Proven experience leading and mentoring senior engineering teams.
  • Experience in a startup or product-company environment is preferred/required for the role.
  • Bachelor's degree in Computer Science, Engineering, or a related technical field.

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, citizenship status, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable law.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal AI Architect in Jersey City, NJ vacancy
  •  ...Experience level - 12+ years Mandatory - Team management : 5 to15+ AI engineers and data scientists Skill required - Open source...  ..., you have not done the engineering this role requires. Data architect - Warehouse, lake house, and pipeline design is a prerequisite... 
    Principal
    Full time
    3 days per week

    SG Analytics

    Newark, NJ
    2 days ago
  • $144.2k - $288.4k

     ...something bigger - helping to simplify health care one person, one family and one community at a time. Position Summary The Principal AI Architect is the senior individual contributor accountable for AI architecture across Aetna Technology. This role sets the technical... 
    Principal
    Hourly pay
    Full time
    Contract work
    Temporary work
    Local area
    Shift work

    Jobleads-US

    Brooklyn, NY
    4 days ago
  •  ...Solution Architect In Data EngineeringTiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have... 
    Principal
    Remote work

    Tiger Analytics

    Jersey City, NJ
    3 days ago
  •  ...us develop game-changing, high-quality solutions. As a Senior Principal Architect at JPMorganChase within Corporate Technology - Corporate Data...  ...Position Data. You'll drive modernization, governance, and AI adoption across a portfolio supporting firmwide finance and risk... 
    Principal

    J.P. Morgan

    Jersey City, NJ
    3 days ago
  •  ...Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally....  ...talk to you. We are seeking an experienced and dynamic Solution Architect in Data Engineering to play a key role in designing and implementing... 
    Principal
    Local area
    Remote work

    Tiger Analytics

    Jersey City, NJ
    2 days ago
  •  ...Step into the role of a Principal Architect at JPMorganChase and become a driving force behind the development and adoption of cutting-edge, cloud-based technologies that power the firm's most critical AI and platform capabilities. As a Principal Architect at JPMorganChase... 
    Principal

    Next Frontier Capital

    Jersey City, NJ
    4 days ago
  •  ...companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM...  ...Your role and responsibilities We are seeking a Senior AI Architect - Enterprise Integrations to join our growing AI practice. As... 
    Worldwide

    IBM Computing

    Jersey City, NJ
    20 hours ago
  •  ...BCI-IT, Inc has an immediate opening for a Sitecore AI Architect to own the Sitecore platform, and its AI capabilities end to end for this engagement — architecture, implementation, and integration of AI-driven features into the Sitecore ecosystem. This is a hands-on... 
    Permanent employment
    Full time
    For subcontractor
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    2 days per week
    1 day per week

    BCI~IT

    Jersey City, NJ
    20 hours ago
  •  ...Step into the role of a Principal Architect at JPMorganChase and become a driving force behind the development and adoption of cutting‑edge,...  ...), batch analytics, MLOps, model governance, and responsible AI patterns Security and resiliency expertise: zero trust, secrets... 
    Principal

    Next Frontier Capital

    Jersey City, NJ
    2 days ago
  •  ...Job Description Step into the role of a Principal Architect at JPMorganChase and become a driving force behind the evolution of the firm's...  ...architecture accountability, and accelerate responsible adoption of AI-enabled engineering practices. Job Responsibilities... 
    Principal

    JPMorgan Chase & Co.

    Jersey City, NJ
    14 days ago
  •  ...impact across the firm and the communities we serve.As a Senior Principal Architect at JPMorganChase within Enterprise Technology (Infrastructure...  ...portfoliosLead reuse-first adoption of enterprise-authorized AI capabilities within the work environment to accelerate... 
    Principal

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  •  ...Talener is seeking a Principal Product Manager for Hoboken who will own complex initiatives, work across product, technology, and business...  ...into measurable outcomes, and comfort with rapid priority changes; AI exposure is strongly preferred. #J-18808-Ljbffr Jobleads-US
    Principal

    Jobleads-US

    Hoboken, NJ
    4 days ago
  •  ...JPMorgan Chase & Co. in the United States seeks a Principal Technical Program Manager within Asset & Wealth Management Technology to lead complex multi-functional initiatives across the firm, aligning technology with business goals and stakeholder needs. You will translate... 
    Principal

    Jobleads-US

    Jersey City, NJ
    20 hours ago
  • $142.6k - $261.5k

     ...and take your career wherever you want it to go.  Join EY and help to build a better working world. ServiceNow– ServiceNow AI Architect Manager In the digital economy, it takes more than good ideas and strong leadership to thrive. Upgrading outdated processes... 
    Summer holiday
    Worldwide
    Flexible hours

    EY

    Hoboken, NJ
    1 day ago
  •  ...architecture and our team is looking for people like you. As a Principal Architect at JPMorgan Chase within Global Technology supporting...  ...readiness.Leads reuse-first adoption of enterprise-authorized AI capabilities within the work environment to accelerate architecture... 
    Principal

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  •  ...industries through cutting-edge digital solutions and next-generation AI. We empower businesses - and their internal customers - to...  ..., automation, and intelligent insights. The Role The Role: Principal Architect, Digital Services A Presidio Digital Client Principal (CP)... 
    Principal

    Presidio

    Brooklyn, NY
    4 days ago
  • Job Summary: We are seeking a highly skilled and motivated Software Developer to join our dynamic team as a Lead Project Engineer. The ideal candidate will possess strong expertise in Python and will be responsible for designing, developing, and maintaining software applications...
    Full time

    TalentOla

    Jersey City, NJ
    2 days ago
  •  ...Job Description BCI-IT, Inc has an immediate opening for a Sitecore AI Architect to own the Sitecore platform, and its AI capabilities end to end for this engagement — architecture, implementation, and integration of AI-driven features into the Sitecore ecosystem.... 
    Permanent employment
    For subcontractor
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    2 days per week
    1 day per week

    BCI~IT

    Jersey City, NJ
    6 days ago
  •  ...have in this role: Being a member of CISO team and as a Security Architect for the Cybersecurity Architecture Team, you will be an...  ...with platform and engineering teams to ensure secure adoption of AI, low-code, and data governance capabilities . Mentor engineering... 
    Principal
    Full time
    Work experience placement
    Shift work

    The Depository Trust & Clearing Corporation (DTCC)

    Jersey City, NJ
    1 day ago
  • $61k - $101k

     ...SDKs, or reusable frameworks adopted at enterprise scale. Preferred: deep expertise in agent-native architecture, LLM tooling, and AI-assisted engineering. Preferred: experience shaping multi-year technical strategy for a portfolio of products. Responsibilities... 
    Principal
    Full time

    J.P. Morgan

    Jersey City, NJ
    14 days ago
  • $196.5k - $294.75k

    # Principal ArchitectAtlanta, Georgia | Engineering### ### Strength in TrustOneTrust’s mission...  ...through the responsible use of data and AI. We believe that ensuring data is trusted...  ...Challenge**We're looking for a Principal Architect to set technical direction across... 
    Principal
    Work experience placement
    Work at office
    Local area
    Worldwide
    Flexible hours
    3 days per week
    1 day per week

    OneTrust

    Brooklyn, NY
    3 days ago
  • $124.5k - $239k

     ...emerging technologies, you will leverage deep wireless expertise to architect complex solutions for enterprise and public sector customers....  ...across the broader Verizon portfolio. Operational AI Innovation: Integrate AI/AIOps capabilities into field operations... 
    Principal
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office
    Shift work

    Verizon

    Livingston, NJ
    8 hours ago
  •  ...this opportunity Being a member of IT Cybersecurity & Platform Strategy team, you will build and operate the next generation of AI-powered vulnerability discovery capabilities used to identify security weaknesses across thousands of applications and repositories.... 
    Principal

    The Depository Trust & Clearing Corporation (DTCC)

    Jersey City, NJ
    5 days ago
  •  ...communications, process video and evidence, and leverage cutting-edge AI-driven analytics for security and operational insights. We are...  ...Reporting to the VP of AI for Motorola Solutions, the Principal Technical Program Manager will be a critical, high-impact leader... 
    Principal

    Motorola Solutions

    Jersey City, NJ
    20 hours ago
  •  ...Senior Principal Software Engineer As a Senior Principal Software Engineer at JPMorgan Chase within the Chief Technology Office, you provide...  ...functions Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-... 
    Principal
    Work at office

    Chase

    Jersey City, NJ
    2 days ago
  • $121k - $161k

     ...of software engineering experience, including 4+ years leading AI and agentic architecture or technical delivery across multiple teams...  ...CI/CD Cloud LLM MCP Python RAG Security Architect Support More: We are collaborating with hackajob to connect... 
    Full time

    Verisk

    Jersey City, NJ
    5 days ago
  • $61k - $101k

     ...training or certification in software engineering concepts, along with 10+ years of applied experience. We need deep expertise in AI/LLMs and how they support software engineering workflows, including coding, design, security, testing, and release. We value hands... 
    Principal
    Full time

    J.P. Morgan

    Jersey City, NJ
    13 days ago
  •  ...Jersey City, New Jersey. Role type: Full-time, hands-on individual contributor About the role SimplifyVMS is building an AI-first platform for managing the contingent workforce. We are looking for an exceptional and passionate engineer to own the design and... 
    Principal
    Full time
    Flexible hours

    SimplifyVMS

    Jersey City, NJ
    3 days ago
  •  ...and help us develop game-changing, high-quality solutions.As a Principal Architect at JPMorganChase within Asset and Wealth Management, you are...  ...technical north star with a strong point of view on agentic AI-enabled engineering, platform modernization, and enterprise-scale... 
    Principal

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • $150k - $200k

     ...Principal Frontend Engineer Hybrid (NYC) $150k - $200k Base + Bonus & Equity Overview...  ...long‑term maintainability, and responsible AI‑assisted development. This role sits...  ...solutions and evaluate technical trade‑offs Architect and build frontend‑leaning, full‑stack... 
    Principal
    Worldwide

    Harnham

    Jersey City, NJ
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Architect. Be the first to apply!