Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Applied AI Engineer

Talent Software Services

Job Details
  • Job Title: Lead Applied AI Engineer
  • Location: New York, NY / Louisville, KY
  • Duration: 6 months
  • Preferred Work Location:
    • 1700 Broadway, Suite 3400, New York, NY 10019
    • Louisville, KY
  • Experience Required: 8-10 years
  • Role Category: AI Engineer
  • Skill Category: AI and Automation
Role Summary
  • Architect, build, deploy, and scale production-grade AI solutions.
  • Integrate:
    • Generative AI
    • AI agents
    • Modern enterprise platforms
  • Support large-scale business operations.
  • Ensure strong standards for:
    • Security
    • Reliability
    • Governance
    • Responsible AI
  • Define enterprise AI technical standards and engineering best practices.
  • Lead enterprise AI adoption.
  • Mentor engineering teams.
  • Work across AI innovation, enterprise architecture, platform engineering, and responsible AI governance.
Key Responsibilities

AI Solution Architecture
  • Architect end-to-end AI systems.
  • Design advanced RAG (Retrieval-Augmented Generation) pipelines.
  • Develop multi-stage retrieval and re-ranking architectures.
  • Design agent orchestration frameworks for multiple specialized agents.
  • Integrate multiple AI models based on their specific strengths.
  • Build solutions with:
    • Modularity
    • Extensibility
    • Scalability
    • Operational excellence
AI Engineering Standards & Optimization
  • Define enterprise standards for:
    • Prompt engineering
    • Prompt templates
    • Prompt versioning
    • Testing methodologies
    • Evaluation frameworks
  • Establish performance optimization strategies covering:
    • Model selection
    • Caching
    • Resource utilization
    • Cost optimization
Production Deployment & Reliability
  • Lead deployment of AI solutions into production.
  • Implement:
    • Observability
    • Logging and tracing
    • Reliability engineering
    • Graceful degradation
    • Circuit breakers
    • Real-time monitoring dashboards
    • Automated alerting
    • Incident response procedures
  • Ensure AI services meet enterprise service-level objectives and reliability expectations.
Data & Retrieval Architecture
  • Design scalable data ingestion frameworks for:
    • Structured data
    • Unstructured documents
    • Real-time event streams
  • Develop:
    • Vector database architectures
    • Hybrid search capabilities
    • Data preprocessing pipelines
    • Data quality monitoring frameworks
  • Implement data cleansing, enrichment, and governance processes.
  • Ensure high-quality inputs for AI systems.
AI Evaluation & Continuous Improvement
  • Establish quantitative AI evaluation frameworks.
  • Implement:
    • A/B testing
    • Performance benchmarking
    • User feedback analysis
    • Telemetry-based optimization
  • Continuously improve:
    • Prompts
    • Retrieval strategies
    • Agent workflows
    • Model configurations
Platform & Infrastructure Collaboration
  • Partner with platform and infrastructure teams to support AI workloads.
  • Work with:
    • GPU infrastructure
    • Model-serving platforms
    • Feature stores
    • Scalable data storage
    • Networking infrastructure
  • Define requirements for enterprise AI platforms and integration patterns.
Technical Leadership & Mentoring
  • Mentor engineers through:
    • Architecture reviews
    • Design guidance
    • Code reviews
    • Career development
  • Promote engineering excellence through:
    • Best-practice documentation
    • Technical training
    • Communities of practice
  • Foster responsible and ethical AI development.
Responsible AI & Compliance
  • Ensure AI solutions meet enterprise governance and compliance requirements.
  • Maintain documentation covering:
    • System behavior
    • Decision logic
    • Evaluation methodologies
  • Apply responsible AI principles:
    • Fairness
    • Transparency
    • Accountability
    • Bias mitigation
  • Support applicable regulatory and industry requirements.
Required Qualifications
  • 7+ years of software engineering experience with a strong focus on AI/ML engineering.
  • Proven experience building and operating distributed systems at scale.
  • Demonstrated success delivering AI-driven business outcomes.
  • Experience leading large and complex technical initiatives.
  • Bachelor's degree in:
    • Computer Science
    • Engineering
    • Data Science
    • Related discipline
  • Equivalent practical experience may be considered.
Generative AI Expertise
  • Deep experience designing and deploying production-grade Generative AI solutions.
  • Experience with:
    • Advanced RAG architectures
    • Multi-hop retrieval
    • Reasoning systems
    • Agent orchestration frameworks
    • Tool-using AI agents
    • Memory-enabled AI systems
    • Multi-model AI architectures
    • Conversational AI platforms
Enterprise Solution Delivery
  • Lead complex AI initiatives involving multiple cross-functional teams.
  • Translate business objectives into:
    • Technical solutions
    • AI architectures
    • Delivery roadmaps
  • Drive initiatives from concept through:
    • Development
    • Production deployment
    • Optimization
Technical Skills
  • Python
  • FastAPI
  • React
  • Distributed systems
  • Vector databases
  • Embedding models
  • LLM APIs
  • Agent orchestration frameworks
  • Modern cloud-native architectures
AI Engineering Best Practices
  • Establish enterprise standards for:
    • Prompt engineering
    • Version control
    • Testing
    • AI evaluation
    • Model observability
    • Cost tracking
    • Performance tracking
    • Benchmarking
    • Data-driven optimization
Responsible AI & Governance
  • Strong understanding of:
    • Responsible AI principles
    • Model governance
    • Risk management
    • Model validation
    • Change management
    • Production monitoring
    • Deployment practices in regulated environments
Preferred Qualifications
  • Technical leadership across organizational boundaries.
  • Strong mentoring and coaching capabilities.
  • Ability to collaborate with:
    • Product Management
    • Data Science
    • Engineering
    • Security
    • Compliance
    • Architecture
    • Business stakeholders
  • Experience in regulated industries preferred:
    • Healthcare
    • Life Sciences
    • Insurance
Primary Skills for TAG Search

Must Have
  • Generative AI
  • Agentic AI
  • RAG Architecture
  • AI Agents
  • Multi-Agent Systems
  • Python
  • FastAPI
  • Vector Databases
  • LLM Integration
  • AI Platform Engineering
  • Production AI Deployment
  • AI Evaluation Frameworks
  • Prompt Engineering
  • Observability & Monitoring
  • Enterprise Architecture
Strongly Preferred
  • React
  • Cloud AI Platforms
  • Azure
  • OpenAI / Azure OpenAI
  • Healthcare Domain Experience
  • Responsible AI
  • AI Governance
  • Distributed Systems Engineering
Keywords
  • Lead Applied AI Engineer
  • AI Engineer
  • Applied AI
  • Generative AI
  • Agentic AI
  • AI Agents
  • Multi-Agent Systems
  • RAG
  • LLM
  • LLM Integration
  • Python
  • FastAPI
  • React
  • Vector Databases
  • AI Platform Engineering
  • AI Architecture
  • AI Evaluation
  • Prompt Engineering
  • AI Governance
  • Responsible AI
  • Azure OpenAI
  • Cloud AI
  • Distributed Systems
  • AI and Automation
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Lead Applied AI Engineer in New York, NY vacancy
  • $113.1k - $232.3k

    Position Summary Lead Applied AI Site Reliability Engineer II Role Overview: As a Lead Applied AI Site Reliability Engineer II, you will actively engage in your engineering craft, taking a hands-on approach to the reliability, performance, and operational integrity... 
    Suggested
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    New York, NY
    1 day ago
  • $180k - $250k

    Our client, an early-stage AI startup, are hiring a Founding Applied AI Engineer to join their team in New York. The successful candidate will design and build the intelligence layer that powers the company’s personalisation, recommendation systems and external APIs, including... 
    Suggested
    Full time

    Alldus International Consulting Ltd

    New York, NY
    more than 2 months ago
  • $157 per hour

     ...provider of niche consulting services within the architecture, engineering and construction industries focusing on high-performance...  ...workplace culture, Great Place to Work.Job DescriptionAs an Applied AI Engineer at SOCOTEC, you will be responsible for designing, developing... 
    Suggested
    Full time

    Socotec

    New York, NY
    1 day ago
  • $10k

     ...About the RoleThe Financial Intelligence team, part of Ramp's Applied AI org, powers the agentic analysis, FP&A, and book-close experiences...  ...artifacts on top of.This is a frontend-leaning role for an engineer who obsesses over interaction design and data-dense UX, but is... 
    Suggested
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    1 day ago
  • $171.3k - $214.12k

     ...and a winning culture? Start your Voyage -Apply NowGet to Know the OpportunityWe’re looking for a hands-on Applied AI and Engineering leader to help accelerate the practical adoption...  ...search, APIs, and workflow automation.Lead Applied AI Across Investment ManagementBuild... 
    Suggested
    Full time
    Part time
    Work experience placement
    Local area
    Remote work
    Flexible hours

    Benefitfocus

    New York, NY
    2 days ago
  • $102.5k - $210.6k

    Position Summary As an Applied AI Engineer III, you will actively engage in your engineering craft, taking a hands-on approach to building...  ...feasibility, and alignment with business and customer goals. Lead requirement analysis, component design, development, testing,... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Deloitte

    New York, NY
    4 days ago
  • $102.5k - $188.9k

     ...opportunity to reignite your professional career. Role Overview: As an Applied AI Engineer III, you will actively engage in your engineering craft,...  ...to build and sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage and prioritize... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    New York, NY
    3 days ago
  • $175k - $250k

    Forward Deployment AI EngineerAbout MillenniumMillennium is a global, diversified alternative investment firm, founded in 1989. Defined...  ...projects. What You'll DoOwn agentic process automation: reverse-engineer manual, undocumented workflows and build agents that execute... 
    Work at office
    Flexible hours

    Millennium Management

    New York, NY
    2 days ago
  •  ...TimeWorking Type HybridJob Reference 0000018129Salary Type AnnuallyIndustry Financial ServicesSelling Points Contribute to transformative AI projects in a hybrid work environment. Collaborate with experts to develop innovative solutions and optimize workflows. Advance your... 
    Remote work

    Green Key Resources

    New York, NY
    2 days ago
  • $10k

     ...manage billions, Ramp is the place to do it.About the RoleThe Applied AI team at Ramp is at the forefront of leveraging AI to drive innovation across our platform. We are seeking strong full-stack engineers who are proficient in web frameworks, backend development, and... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    1 day ago
  • $88.6k - $181.9k

    Position Summary As an Applied AI Engineer II, you will actively engage in your engineering craft, taking a hands-on approach to building...  ...to build and sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage and prioritize multiple... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    New York, NY
    19 hours ago
  • $165k - $260k

    Senior Applied AI Engineer - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10049309...  ...research findings in documentation, whitepapers or publications to leading academic venuesYou'll need to have:Practical experience with... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    1 day ago
  • $258.8k - $304.2k

    Are you ready to make an impact?Applied AI Engineer/Architect West Monroe is seeking an Applied AI Engineer/Architect to lead the design and delivery of enterprise AI solutions that solve complex business challenges. This role serves as the technical AI leader across client... 
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    4 days ago
  • $151.4k - $311k

    Position Summary Director, Applied AI Engineering Role Overview: As a Director, Applied AI Engineering, you will shape and own the engineering...  ...across multiple upstream and downstream systems. Leading across product groups and the service line, you will stay hands... 
    Work at office
    Local area
    Visa sponsorship
    3 days per week

    Deloitte

    New York, NY
    2 days ago
  • $141.2k - $278.3k

    Position Summary Agentic AI is moving from experimentation...  .... We're growing a team of engineers who want to work at the center...  .../30/2026. Work you’ll do As a Lead AI and Data Science Engineer II...  ...platformAt least 1 year of experience applying prompt engineering, context... 
    Work at office
    Local area
    Visa sponsorship
    Shift work

    Deloitte

    New York, NY
    1 day ago
  • $194.71k - $311.53k

     ...differences. We believe that belonging leads to better outcomes and a stronger community...  ...and learn new ones “I can succeed as a AI AppSec Engineer Lead at Capital Group”As a Lead AI...  ...certifications (CISSP, SANS GIAC, CISA, etc.)“I can apply in less than 4 minutes.” You’ve... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Capital Group

    New York, NY
    1 day ago
  •  ...oprecruiting.comPhone: (***) ***-****Applied AI / Machine Learning EngineerLocation: New...  ...foundational artificial intelligence platform for a leading financial services organization. This...  ...(Must-Have)6+ years of software engineering and machine learning experience (or 4+ years... 

    Objective Paradigm

    New York, NY
    2 days ago
  •  ...Lead Applied AI Engineer Role Summary We are seeking an accomplished Lead Applied AI Engineer to architect and deliver advanced AI systems that seamlessly integrate Generative AI capabilities, AI agents, and modern enterprise platforms. This role is responsible... 

    Q1 Technologies

    New York, NY
    6 hours ago
  • A technology company in San Francisco seeks a Forward Deployed Engineer to lead AI-driven enterprise solutions. Responsibilities include developing production-ready systems and collaborating with research teams to meet customer needs. Ideal candidates will have a strong... 

    Jobleads-US

    New York, NY
    2 days ago
  •  ...Job Title: Front Office Applied AI Engineer Global Markets Distribution Location: NY Work Model: Hybrid (3 4 days in office) Duration: 6 Months We are seeking a highly entrepreneurial Front Office Applied AI Engineer to sit directly with our Equities... 
    Work at office

    ReqRoute,Inc

    New York, NY
    1 day ago
  • Applied AI Engineer Location: Manhattan, NY Work Arrangement: Onsite Duration: 6 Months + Contract-to-Hire Experience: 6+ Years Job Summary STAFFXPERT LLC is seeking an Applied AI Engineer on behalf of our client in Manhattan, NY . The... 
    Contract work

    Staffxpert LLC

    New York, NY
    1 day ago
  • $220k - $300k

     ...software company in NYC.  They move fast and ship daily. AI-assisted engineering isn't a talking point here; agents like Devin, Claude, and...  ...ship multiples of what they could alone. About the Team Applied AI owns the intelligence layer, including aspects of... 
    Afternoon shift

    Simplex

    New York, NY
    13 days ago
  • $170k - $230k

     ...Job Description Job Description Applied AI Engineer (AI-Native Marketplace) Location: New York City (on-site, relocation supported) Compensation: USD 170,000 – 230,000 + Equity Hiring: Up to 2 engineers Company: Confidential (represented by Worthland)... 
    Relocation package

    Worthland

    New York, NY
    2 days ago
  • $155k - $300k

     ...institutions. In 2025, we started Handshake AI and built the fastest-growing AI data...  ...institutions Work together with engineers, scientists, operators, and more from Palantir...  ...scale. About the Role As an Applied AI Engineer at Handshake AI Enterprise, you... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    New York, NY
    9 days ago
  • $150k - $220k

     ...clinically-effective mental healthcare. Our AI-native care platform is loved by...  ...from 0→1→n, with visibility across product, engineering, and operations ~ High trust and autonomy...  ..., structured outputs, or similar applied AI patterns Think rigorously about evals... 
    Work at office

    Blossom Health

    New York, NY
    4 days ago
  • $140k - $160k

     ...boundaries of what’s possible. We invest heavily in advanced AI capabilities—specifically our Process Intelligence Graph—to...  ...work for people, companies, and the planet.The Role:As a Lead Applied Value Engineer, you are spearheading our mission of solving critical operational... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Celonis

    New York, NY
    4 days ago
  • Plot is building the next generation of social intelligence with an AI-native platform backed by a high-growth startup mindset. You will own features end-to-end, from concept to shipped product, collaborating closely with founders and a product designer from day one. The... 

    Mosaic.tech

    New York, NY
    1 day ago
  • About the team The Applied AI Engineer, Digital Natives team is responsible for ensuring the safe and effective deployment of Generative AI applications for developers and enterprises. We act as a trusted advisor and thought partner for our customers, working to build... 
    Work at office
    Relocation package

    OpenAI

    New York, NY
    2 days ago
  •  ...retrieval chains, and evaluation loops for our AI agents. Develop small internal tools that...  ...We’re Looking For Strong interest in applied LLM development (OpenAI, Claude,...  ...Supabase, or similar. Hands‑on with prompt engineering, data wrangling, and rapid prototyping. Understanding... 
    Remote job
    Internship
    Flexible hours

    Feedinkoo

    New York, NY
    19 hours ago
  • OpenAI is seeking an Applied AI Engineer for the Digital Natives team in NYC. You will partner with customers to establish AI strategic roadmaps and move from prototype to production, designing an enterprise architecture using OpenAI APIs to maximise value. You’ll work... 
    Relocation package

    OpenAI

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Applied AI Engineer. Be the first to apply!