Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Lead - Agentic & Conversational AI

IBM

Introduction

At IBM, we believe technology shapes the world. We’re a catalyst for that innovation. We’re driving change that improves businesses, society, and the human experience. Our Marketing, Communications & Corporate Social Responsibility (MCC) team tells this story. We shape IBM’s brand, capture attention in the market, and share our perspective with clients, partners, the media, and fellow IBMers. On our team, you’ll work with bright, collaborative minds who bring passion and creativity to everything they do. You’ll be part of a culture built on openness, trust, and teamwork. Where your ideas matter and your growth is supported. Join us, and help bring innovation to life.

Your role and responsibilities

We are building a small, elite AI strike team embedded in the Marketing, Communications, and CSR (MCC) Strategy & Operations team. The mission is to move fast, explore what’s possible with agentic and conversational AI, and prove value quickly—before anything is scaled or productionized elsewhere.

This role leads that squad. You will be a hands‑on AI leader with deep expertise in Large Language Models, conversational AI, and agent design. You will guide rapid experiments, build compelling proof‑of‑concepts, and help senior marketing leaders understand how AI can meaningfully change how work gets done.

This is not a traditional AI platform role, a reporting function, or a research lab. It is a high‑judgment, rapid‑execution role optimized for learning, momentum, and decision‑making. (editado)

This Role IS

• A hands‑on leader for a small, elite AI delivery team

• Focused on agentic AI, conversational experiences, and copilots

• Oriented around workflow transformation, not tools for their own sake

• Optimized for speed, experimentation, and proof‑of‑value

• Embedded directly in MCC Strategy & Operations Team

• Closely partnered with senior Marketing, Communications, and CSR leaders

This Role Is NOT

• A dashboarding or reporting function

• A long‑term AI platform or MLOps ownership role

• A research‑only or theory‑heavy AI role

• A large team or program management position

Core Responsibilities

  1. Leadership & Execution

• Lead a small, high‑trust AI squad focused on rapid delivery

• Set clear, time‑boxed missions with explicit learning or go/no‑go outcomes

• Balance hands‑on building with technical direction and coaching

• Operate with a "build → test → learn → decide" mindset

• Optimize for progress and insight, not polish or permanence

  1. Conversational AI & LLM Expertise (Core Focus)

• Apply deep understanding of LLM capabilities and constraints, including:

• Tokenization and context windows

• Latency and cost tradeoffs

• Failure modes and hallucination risks

• Design multi‑turn, high‑quality conversational experiences

• Manage conversation state, context, and memory deliberately

• Create flows that balance strong UX, deterministic logic, and LLM flexibility

  1. Query Understanding, Routing & Agent Selection

• Design systems that translate user input into confident routing decisions

• Apply intent detection, semantic similarity, and hybrid triage approaches

• Decompose complex requests into actionable subtasks

• Select and orchestrate agents based on role, context, confidence, and history

• Build fallback paths, confidence scoring, and uncertainty handling

• Implement guardrails to prevent unsafe, incorrect, or misleading behavior

  1. Agent Design & Orchestration Patterns

• Lead hands‑on experimentation with proven agent patterns, including:

• Router / Dispatcher

• Planner-Executor

• ReAct

• Tool‑calling agents

• Retrieval‑Augmented Generation (RAG)

• Make pragmatic choices between prompt‑driven and code‑driven controls

• Optimize for predictable, explainable behavior, not full autonomy

• Design agents that are credible and trusted in an enterprise marketing context

  1. Prompt Engineering & Rapid Iteration

• Develop advanced system, developer, and user prompt architectures

• Create prompt templates for routing, planning, classification, and tool use

• Manage prompt versioning and experimentation

• Use constraints, grounding, and structured outputs to reduce hallucinations

• Iterate quickly based on live usage and feedback

  1. Lightweight Governance & Enterprise Awareness

• Ensure experiments consider safety, bias, explainability, and privacy

• Apply governance thoughtfully, without slowing experimentation

• Implement basic logging, evaluation, and traceability

• Communicate risk, limitations, and tradeoffs clearly to stakeholders

  1. Partnership with MCC Leadership

• Translate marketing strategy and business needs into focused AI experiments

• Partner with senior marketing leaders as a thought partner and guide

• Clearly explain what AI can and cannot do—without hype

• Help leaders decide what to pursue further, what to iterate, and what to stop

Leaders are expected to spend time with their teams and clients and therefore are generally expected to be in the workplace a minimum of three days a week, subject to business needs.

Required technical and professional expertise

8-12+ years in AI, applied ML, software, data, or applied technology roles

· Deep, hands‑on experience with LLMs and conversational AI

· Strong understanding of agentic workflows and orchestration

· Experience operating in ambiguous, fast‑moving environments

· Experience with conversational AI platforms or orchestration tools

· Exposure to RAG systems, semantic search, or vectorization

· Familiarity with enterprise AI considerations and constraints

· Experience with tooling such as watsonx.ai, watsonx Orchestrate, or similar platforms

Mindset & Ways of Working

· Bias toward action, experimentation, and learning

· Comfortable showing early work and iterating in the open

· Strong communicator with both technical and non‑technical audiences

· Confident making tradeoffs between speed, quality, and risk

· Energized by small teams and high accountability

Preferred technical and professional experience

Mindset & Ways of Working

· Bias toward action, experimentation, and learning

· Comfortable showing early work and iterating in the open

· Strong communicator with both technical and non‑technical audiences

· Confident making tradeoffs between speed, quality, and risk

· Energized by small teams and high accountability

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Lead - Agentic & Conversational AI in New York, NY vacancy
  • $150k

     ...Overview We are seeking a highly skilled Senior Power BI & Agentic AI Engineer to lead the design, development, and optimization of enterprise-grade analytics and intelligent automation solutions. This role blends advanced data visualization expertise with emerging... 
    Suggested

    Garan, Incorporated

    New York, NY
    7 days ago
  • $73k - $122.28k

     ...Gen AI / Agentic AI Lead Infosys is seeking a hands-on Gen AI / Agentic AI Lead to drive the development and deployment of next-generation AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI frameworks. This role is... 
    Suggested
    Full time
    Temporary work
    Relocation

    Infosys

    New York, NY
    18 hours ago
  • $80.5k - $100k

     ...Lead - Talent Acquisition Ready to turn bold ideas into real-world impact? At Genpact...  ...don't just adapt to change, we lead it. AI and digital innovation are transforming the...  ...challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies... 
    Suggested
    Work at office
    Remote work
    Shift work

    Genpact

    New York, NY
    23 hours ago
  • $201k - $272k

     ...our Healthcare and Life Sciences (HCLS) Agentic AI Specialist Team. This is a team of...  ...job responsibilities · Building and leading a team that continually maintains leading...  ...and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon... 
    Suggested
    Flexible hours

    Amazon

    Jersey City, NJ
    4 days ago
  •  ...Cyclotron, Inc. is seeking a Senior AI Architect to lead the design and delivery of production AI systems for enterprise clients. This hands...  ...stakeholder communication skills, and a passion for building agentic solutions. Join a small, senior team focused on delivering impactful... 
    Suggested
    Remote work

    Cyclotron, Inc.

    New York, NY
    1 day ago
  • $170k - $200k

     ...A leading rehabilitation technology firm is looking for a Technical Leader in Agentic AI to define architectural strategies for AI-driven workflows. The role involves decomposing complex clinical business needs into scalable solutions while collaborating with product... 
    Remote work

    WebPT

    New York, NY
    1 day ago
  •  ...A leading EdTech company is looking for an Agentic Systems Architect to design and govern intelligent, agent-based systems for autonomous workflows. You will...  ...teams. The ideal candidate has extensive experience in AI tooling, strong programming skills in TypeScript or... 

    Imagine Learning

    New York, NY
    1 day ago
  •  ...A leading technology company in North America seeks a RISC-V AI / HPC & Agentic Software Engineering Lead to work at the hardware-software boundary on next-generation RISC-V CPUs. This role entails integrating and optimizing a low-level kernel for AI, leading software... 
    Remote work

    Tenstorrent Inc.

    New York, NY
    1 day ago
  •  ...Overview Role: Team Lead - Azure AI (Agentic) Engineer Location: India (Remote) Client: Middle East (Government) About the Role NorthBay Solutions...  ..., testing, and versioning Design intelligent conversational systems with fallback handling and contextual memory Build... 
    Remote work

    NorthBay Solutions

    New York, NY
    1 day ago
  • $150k

     ...Overview We are seeking a Microsoft Fabric Data Engineer with Agentic AI experience to design, build, and maintain scalable data solutions within the Microsoft Fabric ecosystem. This role is responsible for developing robust data pipelines, implementing Medallion architecture... 

    Garan, Incorporated

    New York, NY
    1 day ago
  • $200k - $290k

     ...world impact? At Genpact, we don't just adapt to change, we lead it. AI and digital innovation are transforming the way businesses work...  ...tackling complex challenges through large-scale models or agentic AI, our breakthrough solutions tackle companies' most complex... 
    Work at office
    Remote work
    Shift work

    Genpact

    New York, NY
    3 days ago
  •  ...A leading AI development company is seeking a Data Delivery Lead to own the architecture and execution of data pipelines. This technical operations role involves building AI agents, designing quality systems, and directly interfacing with clients. The ideal candidate... 

    Pareto

    New York, NY
    1 day ago
  •  ...of business professionals with AI-powered research tools to...  ...That is the opportunity as ML Lead. Rolling up directly to the VP...  ...labs. Hold your own in technical conversations: eval design, dataset construction...  ...agreement, RLHF data quality, agentic evaluation, red-teaming... 
    Full time
    For contractors
    Immediate start
    Flexible hours
    Shift work

    NewtonX

    New York, NY
    6 hours ago
  •  ...Dialogflow Architect to work remotely. You'll design and deploy conversational agents, collaborating with teams to integrate these into...  ...Strong expertise in natural language processing and conversational AI design is essential. Join us to shape engaging user experiences... 
    Remote work

    Avantdigitalnow

    New York, NY
    3 days ago
  • $150k - $180k

     ...Sale: Technical Advisor & POC Lead Join late-stage enterprise...  ...that demonstrate agentic value in the prospect's real environment...  ...customer's team hierarchy and conversation types to Airspeed's agentic...  ...structure their revenue team around AI-native ways of working Run... 
    Work at office
    Immediate start
    Remote work

    Glyphic

    New York, NY
    3 days ago
  •  ...Lead It Architects - Ai Platforms At Bcg Platinion Locations: Atlanta | Austin | Boston | Brooklyn...  .... They design robust ai platform and agentic system architectures that address...  ...through ongoing feedback and development conversations. Provide quality assurance by... 

    Boston Consulting Group

    New York, NY
    23 hours ago
  •  ...A leading data management company is seeking a Senior Architectural Leader to design and implement AI systems aligned with enterprise strategy. The role involves evaluating cloud AI platforms, overseeing multi-agent orchestration, and ensuring robust security measures... 
    Flexible hours

    Reltio

    New York, NY
    1 day ago
  •  ...extension-a private voice ring and conversational interface. Stream has been...  ...We're looking for a Lead ML Engineer to build Stream,...  ...a new interface which spans agentic control, multimodal interactions...  ...Work closely with other ML/AI engineers, infrastructure engineers... 
    Summer work

    Sandbar Inc

    New York, NY
    2 days ago
  •  ...Salesforce Lead/Architect Must be available in CST or EST working hours Remote Role...  ...in Salesforce platform development, AI-powered agentic systems, and solution prototyping. This...  ...on AI-enabled use cases involving: Conversational agents Workflow automation Knowledge retrieval... 
    Hourly pay
    Remote work

    Epik Solutions

    New York, NY
    6 hours ago
  •  ...Agentic AI Security Architect Lead – North America Radware is a global leader of cyber security and application delivery solutions for physical, cloud, and software defined data centers. At Radware, we live and breathe cybersecurity. It is our passion. Each day, our... 

    Radware

    Passaic, NJ
    1 day ago
  • $150k - $200k

     ...Lead AI Agent Architect New York Office About Parloa Parloa's mission is to make every customer conversation feel effortless for both customers and the companies serving them. As agentic AI accelerates, Parloans are shaping the foundation of a new era in customer... 
    Work at office

    Parloa

    New York, NY
    1 day ago
  •  ...Account Executive, Agentic AI Berlin, Germany About Workato Workato delivers enterprise infrastructure for the agentic era,...  ...requirements with a high degree of command Seek out uncomfortable conversations and build trust with champions in your accounts Consume a... 
    Work experience placement
    Remote work
    Flexible hours

    Workato

    New York, NY
    3 days ago
  • $164.35k - $260k

     ...velocity, modeling craft, and engineering rigor. As an AI Modeling Lead, within our Connected Commerce and Card organization, you...  ...tooling, including LLMs, generative AI patterns, and emerging agentic frameworks, with the practical judgment to select tools that... 

    JPMorgan Chase Bank, N.A.

    New York, NY
    2 days ago
  •  ...customers. You will be a key member of the intelligence delivery organization and part of a GenAI project. You will be required to lead a team of other engineers across different skill sets. In the past, the GenAI delivery organization has implemented industry leading... 

    Metalight Solutions INC

    Queens, NY
    2 days ago
  • $92k - $115k

     ...Lead, CS AI Content Flex is a growth-stage, NYC headquartered FinTech company that is creating the best rent payment experience....  ...support tools. This role sits at the intersection of content, conversational AI, and support operations. You'll build and maintain... 
    Full time
    Local area
    Relocation package
    Flexible hours
    2 days per week
    3 days per week

    FLEX Inc

    New York, NY
    3 days ago
  • $150k - $250k

     ...Department of Labor ( Group Details We are seeking an experienced AI/LLM Product Engineer to design and build intelligent, language-...  ...Prompt Architecture Design and own the integration between conversational AI agents and external large language model APIs Develop and... 
    Full time
    Work at office
    Immediate start
    Flexible hours

    Tradeweb

    New York, NY
    1 day ago
  •  ...We're hiring a Strategic Operations Lead to work inside one of our core business functions...  ...you put in place. Must Have AI-Native Builder. You don't just use AI tools...  ...and go do it. Strongly Preferred Agentic Systems Experience. You've built or prototyped... 
    Fixed term contract

    Petfolk

    New York, NY
    4 days ago
  • $150k - $180k

     ...looking for a Senior Solution Lead to join our high-performing Pre...  .../ FinOps Tooling - AI models, ISV licenses, tokens etc...  ...domains is essential, including: agentic automation across workflows and...  ...proactively pull you into strategic conversations because you "help deals close.... 
    Remote work
    Flexible hours

    Remote Jobs

    New York, NY
    1 day ago
  •  ...AI Consulting Lead Location: New York City, NY Duration: Fulltime Job Description: 12+ years AI Consulting lead Must Have...  ...Exposure to personalization engines, recommendation systems, and conversational AI. Roles & Responsibilities: The AI Specialist... 
    Full time

    JConnect Infotech

    New York, NY
    23 hours ago
  • $150k - $175k

     ...Job Title: Oracle Cloud Conversion Lead Job Summary: Next Generation, Inc, an Equal-Opportunity Employer, is seeking an experienced Oracle Cloud Conversion Lead to join our team. The ideal candidate will have a strong background in Oracle Cloud conversion processes and... 
    Full time
    Remote work

    Next Generation

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Lead - Agentic & Conversational AI. Be the first to apply!