Principal AI Engineer
Compunnel
Job Summary The Principal AI Engineer will serve as the technical owner of how AI and machine learning engineering is designed, built, governed, and deployed across a portfolio of products. This is a hands-on engineering and technical leadership role spanning software engineering, data science, platform architecture, AI governance, security, and developer experience. The role will involve writing production code, architecting multi-tenant AI services, building reusable developer tooling, establishing security and governance practices, and mentoring engineering teams. Key Responsibilities
- Design and own AI productization and governance playbooks covering service patterns, security and compliance standards, model evaluation rubrics, and production-readiness criteria.
- Build and maintain reusable internal tooling, including AI service scaffolding, evaluation and monitoring tools, and data infrastructure.
- Establish AI agent governance policies covering agent permissions, code execution controls, access to internal systems, and human-in-the-loop controls.
- Partner with Security, Legal, and Compliance teams to define SOC 2 and ISO-aligned AI controls, vendor DPA requirements, and prompt data classification policies.
- Establish standardized deployment patterns using containerization, infrastructure-as-code, and reusable CI/CD pipeline templates.
- Champion AI-assisted development practices, including LLM-integrated development workflows, test-driven development patterns, and reusable engineering tools.
- Establish and promote modern software development standards covering CI/CD, DevOps, testing, and delivery quality.
- Mentor engineers and technical leads to improve delivery consistency, design quality, and production-readiness practices.
- Serve as a technical authority on AI/ML, platform architecture, and engineering practices.
- Translate complex architectural decisions, AI risk considerations, and platform tradeoffs into clear guidance for technical and non-technical stakeholders.
- Lead the development and adoption of scalable AI and software engineering patterns across teams.
- 15+ years of experience in software engineering, data science, or a closely related technical field.
- Bachelor's degree or higher in Computer Science, Engineering, or a related field.
- Deep expertise in AI/ML frameworks and the Python ecosystem, with hands-on experience deploying models to public cloud infrastructure.
- Demonstrated experience designing and operating multi-tenant AI services and LLM integrations in production.
- Proven experience leading microservices architecture, including decomposing monoliths, defining service contracts, and operationalizing CI/CD for distributed systems.
- Strong hands-on experience with Docker, Terraform, and modern DevOps practices.
- Substantive experience with AI and LLM security, including prompt injection, data boundary enforcement, model supply chain risk, and AI-specific threat modeling.
- Strong problem-solving skills with experience building governance frameworks, evaluation rubrics, and reusable platform patterns at scale.
- Excellent written and verbal communication skills in English, with the ability to communicate complex technical concepts to diverse audiences, including executive stakeholders.
- Experience with Agile methodologies and cross-functional product team collaboration.
- Experience applying AI/ML in business consulting, advisory, or professional services environments.
- Familiarity with AI service interface and gateway design patterns, including emerging AI integration protocols.
- Contributions to open-source AI/ML projects, publications, or active involvement in technical communities.
- Experience defining AI compliance controls for SOC 2, ISO 27001, or TISAX frameworks.
- Experience developing internal technical guides, conducting workshops, or building developer education programs.
- Proficiency in Go or TypeScript.
- Demonstrated experience mentoring and developing engineers or technical peers.
- Willingness to work outside normal business hours when project requirements arise.
- Ability to work effectively in a hybrid office and remote environment.
- Willingness to travel based on client, team, and project requirements.
$185k - $264.5k
...Within the Tech, Data, AI, Ventures (TDAV) organization, our work is guided by a shared vision: deploying the power of technology... ...a mutual company built to last. Role Overview As a Principal AI Engineer within the Artificial Intelligence & Data (AI&D) organization...Suggested- ...Experience - Ten (10) or more years of software engineering experience, including at least four (4) years owning production -Generative AI or applied-AI systems in the field —... ...Description We're looking for a hands-on Principal AI Engineer to own the technical outcome of...Suggested
$230k - $250k
Principal AI Engineer Brooklyn, NY (Hybrid) - 3 Days Onsite $230,000 - $250,000 Base + Bonus + RSUs (~$350K Total Comp) THE COMPANY Harnham is partnering with a global leader in professional software solutions across legal, tax, accounting, and audit. Their products...Suggested$175k - $235k
Principal AI Engineer As a Principal AI Engineer, you will contribute to enterprise-scale AI & intelligent systems initiatives, working across architecture, engineering, product, and delivery teams to build scalable, secure, and high-performance systems aligned with long...SuggestedFull timeH1bImmediate startRelocation- Principal AI Engineer Our client has embraced a hybrid work model to provide flexibility and support work-life integration. Travel is part of this position, but frequency may vary based on client, team, and individual circumstances. Relocation assistance is not available...SuggestedRelocation package
- ...Build and operate the governed enterprise MCP gateway and Azure AI environments Implement SAP identity passthrough in partnership... ...patterns so the capability stays in-house Define the function's engineering standards, tooling, and practices, and serve as technical lead...
$206.6k - $284.3k
...decisions today about how it will leverage AI over the next decade. Few have leaders... ...its viability through hands-on engineering. This role requires both. We build the... ...healthcare outcomes for members. As a Principal AI Applied Engineer, you will define the...Full timeTemporary workApprenticeshipWork at officeRemote workRelocation3 days per week- ...Job Description Job Description Principal AI Engineer Recruits Lab exists to connect exceptional life sciences and technology talent with organizations that need them—through relationships, not volume. As Principal AI Engineer you will turn that mission into production...Live inRemote work
$150k - $210k
...the future of our communities. We have multiple Software Engineering positions open at Associate, Director and VP levels, which are... ..., code quality) Learn and apply new technologies, including AI/ML and prompt‑based approaches , where they add value What...Full timeTemporary workWorldwide- ...DataCamp's mission is to empower everyone with the data and AI skills essential for 21st-century success. By providing practical... ...+ years building complex LLM-based systems, with strong prompt engineering intuition and experience designing agentic workflows. ~ Ability...Remote workWork from homeFlexible hours
- To support a growing data platform, the full-time remote Principal AI/ML Engineer will contribute to building and scaling production-grade AI/ML systems, focusing on data ingestion, DevOps reliability, and security compliance. Key responsibilities: Contribute to the platform...Full timeRemote work
$144.25k - $256.25k
...annually + bonus + equity (if applicable) + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeWorkplace: HybridCareer Area:... ...innovative technology and data insights.At American Express, AI is reshaping the future of commerce and redefining the experiences...Visa sponsorship$274.3k
...great benefits, and a team that wants you to grow and succeed. What you'll build In this role, you set the technical direction for AI engineering across strategic customer engagements and enterprise wide initiatives. As a Chief Expert, you are the deepest technical...Permanent employmentFull timeWork at officeLocal areaWorldwideFlexible hours- ...safeguards Fortune 500 enterprises worldwide. Learn more at appgate.com. About the Role We're looking for a AI/ML Engineer (Senior/Staff/Principal) - Agentic AI Security who will design, build, and operationalize the detection algorithms, ML inference pipelines...For contractorsWorldwide
- ...Director Of Ai Engineering The Director of AI Engineering is responsible for leading the research, design, development, and deployment of AI solutions as per the business strategy. This role bridges AI research with practical engineering, ensuring that AI models are...
- McGraw Hill seeks a Director of AI Enablement to own and build the function across business workflow, data, and developer enablement. You will lead a senior team, drive strategy, and partner with the Solution Architect to turn plans into scalable execution. This role demands...Remote job
$172.8k - $359k
...delivers unparalleled cross functional tech consulting services in artificial intelligence, machine learning, generative AI, agentic AI, and cloud engineering. We always support and enable big ideas with the ambition to keep doing more. We leverage leading practices and a...Immediate startRemote work- Leading multiple engineering teams, the full-time salaried Director of AI Engineering will drive the organization's adoption of AI-augmented software delivery, shape engineering strategy, and ensure alignment across product, design, and engineering in a hybrid work environment...Full time
$320k - $405k
Manager, Applied AI Engineering, Beneficial Deployments (Life Sciences) San Francisco, CA | New York City, NY About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for...Visa sponsorship- ...We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python, agentic AI, LLMs, RAG, AWS, APIs, microservices, and event-driven architectures to deliver production-ready AI applications. Roles...Contract work
- ...leader to drive biometric platform design, implementation, and governance across multiple lines of business. You will oversee AI-enabled engineering initiatives, coordinate cross-department delivery, and shape secure, scalable solutions with enterprise tools. You will...
- ...Chase & Co. in New York is seeking a Senior Director of Software Engineering within Equity Derivatives Technology. You will lead multiple... ...innovative engineering practices. The role emphasizes agentic AI-enabled delivery, SDLC automation, governance, and cross‑...
- ...JPMorgan Chase & Co. in New York seeks a Senior Director of Software Engineering within Connected Commerce Technology to lead multiple technical... .... You will manage cross-department teams, shape agentic AI-enabled engineering practices, and advance security, resilience...
$195k - $275k
...offices in 43 countries. DevGenAI has been an extraordinary AI development platform built internally within Morgan Stanley.... ...HR solution currently in the POC/Dev stage). With more than 200 engineers contributing code and more than 4,000 PRs per year, it is one of...Full timeTemporary workWork at officeWorldwide- ...Type AnnuallyIndustry InsuranceSelling Points Shape the future of AI solutions in a dynamic, innovation-focused role. Collaborate... ...drive meaningful change in cutting-edge projects.Job DescriptionAI Engineer OverviewThe AI Engineer will lead structured discovery sessions...
$148.5k - $223.9k
...CategorySoftware EngineeringJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer success together.... ...acquisition. You’ll be working alongside the founding team and engineers in an organization offering the autonomy of a small team backed...Full timeRemote work- ...processes that run it. That work changes the operating model an engineering organization runs on, the ways of working underneath it, and... ...and that diagnosis sets the target. What we design from it is AI-native by construction. We redesign intake and prioritization,...Full timeWork experience placementLive inWork at officeLocal area
$130k - $180k
...who value entrepreneurship, intellectual rigor, hard work and continuous improvement.Role and Responsibilities:We are seeking an AI Engineer to drive innovation and automation across Prospect’s operations and our portfolio of 120+ companies. You will design and deploy advanced...Daily paidPermanent employmentWork at office$121k - $206k
...and make a difference in ways that matter to you. Role SummaryPositions are available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative team of engineers, product owners, and...Full timeWork at officeLocal areaRemote work3 days per week- ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Engineer. Be the first to apply!
- principal developer New York, NY
- principal security engineer New York, NY
- senior director engineering New York, NY
- director of product engineering New York, NY
- director sales engineering New York, NY
- data center chief engineer New York, NY
- engineering director New York, NY
- principal network engineer New York, NY
- hotel chief engineer New York, NY
- principal cloud engineer New York, NY




