Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Engineer

Compunnel

Job Summary The Principal AI Engineer will serve as the technical owner of how AI and machine learning engineering is designed, built, governed, and deployed across a portfolio of products. This is a hands-on engineering and technical leadership role spanning software engineering, data science, platform architecture, AI governance, security, and developer experience. The role will involve writing production code, architecting multi-tenant AI services, building reusable developer tooling, establishing security and governance practices, and mentoring engineering teams. Key Responsibilities

  • Design and own AI productization and governance playbooks covering service patterns, security and compliance standards, model evaluation rubrics, and production-readiness criteria.
  • Build and maintain reusable internal tooling, including AI service scaffolding, evaluation and monitoring tools, and data infrastructure.
  • Establish AI agent governance policies covering agent permissions, code execution controls, access to internal systems, and human-in-the-loop controls.
  • Partner with Security, Legal, and Compliance teams to define SOC 2 and ISO-aligned AI controls, vendor DPA requirements, and prompt data classification policies.
  • Establish standardized deployment patterns using containerization, infrastructure-as-code, and reusable CI/CD pipeline templates.
  • Champion AI-assisted development practices, including LLM-integrated development workflows, test-driven development patterns, and reusable engineering tools.
  • Establish and promote modern software development standards covering CI/CD, DevOps, testing, and delivery quality.
  • Mentor engineers and technical leads to improve delivery consistency, design quality, and production-readiness practices.
  • Serve as a technical authority on AI/ML, platform architecture, and engineering practices.
  • Translate complex architectural decisions, AI risk considerations, and platform tradeoffs into clear guidance for technical and non-technical stakeholders.
  • Lead the development and adoption of scalable AI and software engineering patterns across teams.
Required Qualifications
  • 15+ years of experience in software engineering, data science, or a closely related technical field.
  • Bachelor's degree or higher in Computer Science, Engineering, or a related field.
  • Deep expertise in AI/ML frameworks and the Python ecosystem, with hands-on experience deploying models to public cloud infrastructure.
  • Demonstrated experience designing and operating multi-tenant AI services and LLM integrations in production.
  • Proven experience leading microservices architecture, including decomposing monoliths, defining service contracts, and operationalizing CI/CD for distributed systems.
  • Strong hands-on experience with Docker, Terraform, and modern DevOps practices.
  • Substantive experience with AI and LLM security, including prompt injection, data boundary enforcement, model supply chain risk, and AI-specific threat modeling.
  • Strong problem-solving skills with experience building governance frameworks, evaluation rubrics, and reusable platform patterns at scale.
  • Excellent written and verbal communication skills in English, with the ability to communicate complex technical concepts to diverse audiences, including executive stakeholders.
  • Experience with Agile methodologies and cross-functional product team collaboration.
Preferred Qualifications
  • Experience applying AI/ML in business consulting, advisory, or professional services environments.
  • Familiarity with AI service interface and gateway design patterns, including emerging AI integration protocols.
  • Contributions to open-source AI/ML projects, publications, or active involvement in technical communities.
  • Experience defining AI compliance controls for SOC 2, ISO 27001, or TISAX frameworks.
  • Experience developing internal technical guides, conducting workshops, or building developer education programs.
  • Proficiency in Go or TypeScript.
  • Demonstrated experience mentoring and developing engineers or technical peers.
  • Willingness to work outside normal business hours when project requirements arise.
  • Ability to work effectively in a hybrid office and remote environment.
  • Willingness to travel based on client, team, and project requirements.
Certifications • Advanced certifications in AI, deep learning, cloud architecture, or security, such as AWS, GCP, Azure ML, or CISSP, preferred. Compunnel

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal AI Engineer in New York, NY vacancy
  • $185k - $264.5k

     ...Within the Tech, Data, AI, Ventures (TDAV) organization, our work is guided by a shared vision: deploying the power of technology...  ...a mutual company built to last. Role Overview As a Principal AI Engineer within the Artificial Intelligence & Data (AI&D) organization... 
    Suggested

    New York Life

    New York, NY
    2 days ago
  •  ...Experience - Ten (10) or more years of software engineering experience, including at least four (4) years owning production -Generative AI or applied-AI systems in the field —...  ...Description We're looking for a hands-on Principal AI Engineer to own the technical outcome of... 
    Suggested

    Insight Global

    New York, NY
    2 days ago
  • $230k - $250k

    Principal AI Engineer Brooklyn, NY (Hybrid) - 3 Days Onsite $230,000 - $250,000 Base + Bonus + RSUs (~$350K Total Comp) THE COMPANY Harnham is partnering with a global leader in professional software solutions across legal, tax, accounting, and audit. Their products... 
    Suggested

    Harnham

    New York, NY
    2 days ago
  • $175k - $235k

    Principal AI Engineer As a Principal AI Engineer, you will contribute to enterprise-scale AI & intelligent systems initiatives, working across architecture, engineering, product, and delivery teams to build scalable, secure, and high-performance systems aligned with long... 
    Suggested
    Full time
    H1b
    Immediate start
    Relocation

    Walsharp Technologies Inc

    New York, NY
    2 days ago
  • Principal AI Engineer Our client has embraced a hybrid work model to provide flexibility and support work-life integration. Travel is part of this position, but frequency may vary based on client, team, and individual circumstances. Relocation assistance is not available... 
    Suggested
    Relocation package

    Saxon Global

    New York, NY
    2 days ago
  •  ...Build and operate the governed enterprise MCP gateway and Azure AI environments Implement SAP identity passthrough in partnership...  ...patterns so the capability stays in-house Define the function's engineering standards, tooling, and practices, and serve as technical lead... 

    Hallmark Global Solutions Ltd

    New York, NY
    4 days ago
  • $206.6k - $284.3k

     ...decisions today about how it will leverage AI over the next decade. Few have leaders...  ...its viability through hands-on engineering. This role requires both. We build the...  ...healthcare outcomes for members. As a Principal AI Applied Engineer, you will define the... 
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Relocation
    3 days per week

    Humana

    New York, NY
    2 days ago
  •  ...Job Description Job Description Principal AI Engineer Recruits Lab exists to connect exceptional life sciences and technology talent with organizations that need them—through relationships, not volume. As Principal AI Engineer you will turn that mission into production... 
    Live in
    Remote work

    Recruits Lab

    New York, NY
    20 days ago
  • $150k - $210k

     ...the future of our communities. We have multiple Software Engineering positions open at Associate, Director and VP levels, which are...  ..., code quality) Learn and apply new technologies, including AI/ML and prompt‑based approaches , where they add value What... 
    Full time
    Temporary work
    Worldwide

    Morgan Stanley

    New York, NY
    more than 2 months ago
  •  ...DataCamp's mission is to empower everyone with the data and AI skills essential for 21st-century success. By providing practical...  ...+ years building complex LLM-based systems, with strong prompt engineering intuition and experience designing agentic workflows. ~ Ability... 
    Remote work
    Work from home
    Flexible hours

    DataCamp

    New York, NY
    28 days ago
  • To support a growing data platform, the full-time remote Principal AI/ML Engineer will contribute to building and scaling production-grade AI/ML systems, focusing on data ingestion, DevOps reliability, and security compliance. Key responsibilities: Contribute to the platform... 
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    5 days ago
  • $144.25k - $256.25k

     ...annually + bonus + equity (if applicable) + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeWorkplace: HybridCareer Area:...  ...innovative technology and data insights.At American Express, AI is reshaping the future of commerce and redefining the experiences... 
    Visa sponsorship

    American Express

    New York, NY
    3 days ago
  • $274.3k

     ...great benefits, and a team that wants you to grow and succeed. What you'll build In this role, you set the technical direction for AI engineering across strategic customer engagements and enterprise wide initiatives. As a Chief Expert, you are the deepest technical... 
    Permanent employment
    Full time
    Work at office
    Local area
    Worldwide
    Flexible hours

    SAP

    New York, NY
    7 hours ago
  •  ...safeguards Fortune 500 enterprises worldwide. Learn more at appgate.com.  About the Role We're looking for a AI/ML Engineer (Senior/Staff/Principal) - Agentic AI Security who will design, build, and operationalize the detection algorithms, ML inference pipelines... 
    For contractors
    Worldwide

    AppGate Cybersecurity, Inc.

    New York, NY
    15 days ago
  •  ...Director Of Ai Engineering The Director of AI Engineering is responsible for leading the research, design, development, and deployment of AI solutions as per the business strategy. This role bridges AI research with practical engineering, ensuring that AI models are... 

    ABM Industries

    New York, NY
    1 day ago
  • McGraw Hill seeks a Director of AI Enablement to own and build the function across business workflow, data, and developer enablement. You will lead a senior team, drive strategy, and partner with the Solution Architect to turn plans into scalable execution. This role demands... 
    Remote job

    McGraw Hill

    New York, NY
    1 day ago
  • $172.8k - $359k

     ...delivers unparalleled cross functional tech consulting services in artificial intelligence, machine learning, generative AI, agentic AI, and cloud engineering. We always support and enable big ideas with the ambition to keep doing more. We leverage leading practices and a... 
    Immediate start
    Remote work

    EY (Ernst & Young)

    New York, NY
    7 hours ago
  • Leading multiple engineering teams, the full-time salaried Director of AI Engineering will drive the organization's adoption of AI-augmented software delivery, shape engineering strategy, and ensure alignment across product, design, and engineering in a hybrid work environment... 
    Full time

    Virtual Vocations Inc

    New York, NY
    5 days ago
  • $320k - $405k

    Manager, Applied AI Engineering, Beneficial Deployments (Life Sciences) San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for... 
    Visa sponsorship

    Anthropic

    New York, NY
    4 days ago
  •  ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python, agentic AI, LLMs, RAG, AWS, APIs, microservices, and event-driven architectures to deliver production-ready AI applications. Roles... 
    Contract work

    2T Consulting

    New York, NY
    a month ago
  •  ...leader to drive biometric platform design, implementation, and governance across multiple lines of business. You will oversee AI-enabled engineering initiatives, coordinate cross-department delivery, and shape secure, scalable solutions with enterprise tools. You will... 

    Jobleads-US

    New York, NY
    3 days ago
  •  ...Chase & Co. in New York is seeking a Senior Director of Software Engineering within Equity Derivatives Technology. You will lead multiple...  ...innovative engineering practices. The role emphasizes agentic AI-enabled delivery, SDLC automation, governance, and cross‑... 

    Jobleads-US

    New York, NY
    3 days ago
  •  ...JPMorgan Chase & Co. in New York seeks a Senior Director of Software Engineering within Connected Commerce Technology to lead multiple technical...  .... You will manage cross-department teams, shape agentic AI-enabled engineering practices, and advance security, resilience... 

    Jobleads-US

    New York, NY
    3 days ago
  • $195k - $275k

     ...offices in 43 countries. DevGenAI has been an extraordinary AI development platform built internally within Morgan Stanley....  ...HR solution currently in the POC/Dev stage). With more than 200 engineers contributing code and more than 4,000 PRs per year, it is one of... 
    Full time
    Temporary work
    Work at office
    Worldwide

    Morgan Stanley

    New York, NY
    a month ago
  •  ...Type AnnuallyIndustry InsuranceSelling Points Shape the future of AI solutions in a dynamic, innovation-focused role. Collaborate...  ...drive meaningful change in cutting-edge projects.Job DescriptionAI Engineer OverviewThe AI Engineer will lead structured discovery sessions... 

    Green Key Resources

    New York, NY
    7 hours ago
  • $148.5k - $223.9k

     ...CategorySoftware EngineeringJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together....  ...acquisition. You’ll be working alongside the founding team and engineers in an organization offering the autonomy of a small team backed... 
    Full time
    Remote work

    Salesforce

    New York, NY
    7 hours ago
  •  ...processes that run it. That work changes the operating model an engineering organization runs on, the ways of working underneath it, and...  ...and that diagnosis sets the target. What we design from it is AI-native by construction. We redesign intake and prioritization,... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  • $130k - $180k

     ...who value entrepreneurship, intellectual rigor, hard work and continuous improvement.Role and Responsibilities:We are seeking an AI Engineer to drive innovation and automation across Prospect’s operations and our portfolio of 120+ companies. You will design and deploy advanced... 
    Daily paid
    Permanent employment
    Work at office

    Prospect Capital

    New York, NY
    2 days ago
  • $121k - $206k

     ...and make a difference in ways that matter to you. Role SummaryPositions are available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative team of engineers, product owners, and... 
    Full time
    Work at office
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    New York, NY
    1 day ago
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern... 
    Contract work

    2T Consulting

    New York, NY
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Engineer. Be the first to apply!