Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AI Engineer

$225k - $250k

Black Osprey

About this role

Black Osprey is hiring on behalf of our client, Rafferty Holdings. This is a full-time role at Rafferty Holdings, based in the Long Island office in Garden City, NY, working on-site or hybrid. A second opening is based in New York City.

Rafferty is hiring two hands-on Lead AI Engineers. This is a forward-deployed role. You will work inside business operations with Rafferty's in-house IT lead and the people who run the work every day. You will find where AI helps in operations, compliance, risk management, and client service, then build the tools, put them into daily use, and keep improving them.

This is initially a senior individual contributor role with no direct reports. You own each solution end to end, from discovery to production support, and coordinate the input, decisions, and approvals of the right stakeholders.

What success looks like

  • Production AI tools in daily use by the business teams you sit with, with measurable outcomes defined up front and tracked after launch.
  • Solutions delivered in line with the firm's AI strategy and technology roadmap.
  • AI engineering, prompt engineering, and governance standards that teams use.
  • Reusable AI components, prompt libraries, and agent frameworks that make each new use case faster to build.
  • A pipeline of high-value use cases found inside business workflows.
  • The foundation of scalable, sustainable AI capability across the firm.

Key responsibilities

  • Work directly with operations, compliance, risk, and client service teams. Sit with the operators, learn how they do the work today, and find where AI removes friction.
  • Take each use case from discovery and scoping through build, deployment, adoption, and ongoing support.
  • Turn what you observe into clear problem statements, then into working software inside the systems people already use.
  • Put early versions in front of the people who will use them, watch how they work, and refine quickly based on their feedback.
  • Design, develop, deploy, and support enterprise AI applications and services.
  • Build solutions with LLMs, RAG architectures, AI agents, machine learning models, and intelligent automation.
  • Design, test, and optimize prompts to improve accuracy, consistency, reliability, and business outcomes.
  • Develop reusable prompt libraries, workflows, and AI solution frameworks.
  • Build APIs, integrations, and cloud-native services that speed AI adoption across the firm.
  • Set standards and best practices for AI architecture, prompt engineering, model evaluation, testing, and deployment.
  • Implement monitoring, governance, and controls for secure and responsible AI use.
  • Work with business, technology, compliance, risk, and security teams, and with the in-house IT lead, to deliver AI solutions that fit the firm's environment.
  • Before launch, document the production support model: ownership of monitoring, incidents, enhancements, controls, and solution retirement.
  • Evaluate emerging AI technologies and recommend where to adopt them.
  • Mentor future AI team members.

Required qualifications

  • 5+ years of software engineering experience delivering enterprise applications and technology solutions.
  • 3+ years developing and deploying AI or machine learning solutions in production.
  • A track record of working directly with business users to scope problems and ship tools they adopt, in a forward-deployed, solutions engineering, or embedded engineering role, or equivalent.
  • Hands-on experience with LLMs, prompt engineering, RAG, AI agents and workflow orchestration, vector databases and semantic search, and model evaluation and testing frameworks.
  • Experience building on enterprise AI platforms such as Azure OpenAI, Anthropic Claude, OpenAI, or equivalent.
  • Proven experience designing, testing, and optimizing prompts for enterprise AI applications.
  • Strong understanding of context engineering, structured outputs, grounding, retrieval optimization, and prompt evaluation methods.
  • Strong Python skills and experience building APIs, microservices, and cloud-native applications.
  • Experience with Microsoft Azure, AWS, or Google Cloud.
  • Familiarity with DevOps, CI/CD, MLOps, and AI governance practices.
  • Strong analytical, communication, and stakeholder management skills, including explaining technical trade-offs to non-technical colleagues.
  • Experience working in regulated environments with security, compliance, and governance requirements.

Preferred qualifications

  • Financial services experience in asset management, wealth management, banking, capital markets, brokerage, insurance, or fintech.
  • Experience with Azure OpenAI Service, Anthropic Claude, Azure AI Foundry, Microsoft Copilot Studio, Microsoft Fabric, Databricks, LangChain, LangGraph, or Semantic Kernel.
  • Experience building enterprise AI assistants, copilots, agentic AI solutions, or multi-agent systems.
  • Experience establishing AI governance and responsible AI frameworks.
  • Knowledge of investment operations, client servicing, compliance, risk management, or financial products.
  • Bachelor's degree in Computer Science, Engineering, Data Science, Mathematics, or a related field.

Compensation and benefits

Hiring salary range: $225,000 to $250,000, plus bonus.

Benefits: medical, dental, vision, 401(k) plan, life insurance, and unlimited PTO.

Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Lead AI Engineer in Garden City, NY vacancy
  •  ...to access legal representation because the system is broken. We believe this is not a legal problem—it's an engineering problem. SimpleCITI is seeking a Lead AI Architect for one of its portfolio companies to build the operating system for the modern law firm: a fully... 
    Suggested

    SimpleCiti Companies

    Garden City, NY
    2 days ago
  •  ...Lead Software Engineer (Backend Platform & APIs) Job Summary A client of mine is seeking a Lead Software Engineer to provide senior technical leadership for a team responsible for core backend services and APIs that power a large scale SaaS platform. This is a... 
    Suggested
    Remote work

    Conexess Group

    Hempstead, NY
    a month ago
  • $50 per hour

     ...and innovation. Our campus is a hub for engineering excellence, where we tackle some of the world...  ...engineer primarily responsible for leading technical efforts and projects for the U....  ...time management skillsets- Proficient in AI prompting as it applies to this position... 
    Suggested
    Full time
    Temporary work
    Work experience placement
    For subcontractor
    Casual work
    Local area
    Flexible hours

    Lockheed Martin

    Uniondale, NY
    13 hours ago
  • $103.71k - $138.28k

     ...Lumen is the trusted network for the AI‑powered world, connecting people, data, and...  ...join us today. The Role The Field Engineering Quality Control Engineer is responsible for...  ...Responsibilities Key Responsibilities Lead logistics projects from planning through... 
    Suggested
    Full time
    Temporary work
    For contractors

    Lumen

    Long Island City, NY
    13 hours ago
  • $71k

     ...Job Description HCLTech is looking for a highly talented and self-motivated Test Lead / Electrical Engineer / Lead Test Engineer to join it in advancing the technological world through innovation and creativity. Job Title: Test Lead / Electrical Engineer / Lead... 
    Suggested
    Full time
    Local area

    HCLTech

    Plainview, NY
    3 days ago
  • $75k - $250k

     ...Company Description Black Osprey is a boutique engineering firm that partners with private equity, startups, and Fortune 500 companies to solve complex technical challenges. The team focuses on building high-quality, scalable software solutions tailored to diverse business... 
    Full time
    Part time
    Work experience placement
    Remote work
    Work from home

    Black Osprey

    Garden City, NY
    11 days ago
  • $165.2k - $223.6k

     ...Services (AWS) is building a central pipeline of Software Development Engineer (SDE) talent for anticipated roles in 2026. This requisition...  ...Artificial Intelligence/Machine Learning Healthcare AI Infrastructure Services Firmware Development Cloud Computing... 
    Internship
    Local area
    Flexible hours
    Day shift

    Amazon

    Carle Place, NY
    2 days ago
  • $99k - $232k

     ...InnovationManagement LevelManagerJob Description & SummaryThe OpportunityAs a Lead Engineer you will guide the design, build, testing, and modernization of...  ...scalable software solutions- Supporting innovation by applying AI-enabled engineering techniques, rapid experimentation, and... 
    Full time
    H1b

    PwC

    Melville, NY
    4 days ago
  • $77k - $202k

    Industry/SectorNot ApplicableSpecialismSAPManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs an AI Engineer - Agentic AI & Applied Generative AI Senior Associate you will help design, build, and refine AI solutions that support client needs across... 
    Full time
    H1b

    PwC

    Melville, NY
    2 days ago
  • $124k - $280k

     ...InnovationManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Manager, Agentic Engineering Lead, you will guide the design and delivery of agentic and generative AI solutions for clients within our Advisory practice. In this role, you will bring together... 
    Full time
    H1b

    PwC

    Melville, NY
    4 days ago
  • 3- 4 Mainframe Developer / Cobol Developers EST & CST Zone 100% Remote 12 Months + Higher education experience is mandatory Looking for 3-4 mainframe/Cobol resources Experience with the transition from their legacy system to their new student system.
    Remote work

    Amtex Systems Inc

    Hempstead, NY
    19 hours ago
  •  ...Part-time ContractorBizmoni is building an AI Business Network designed to help people...  ...are seeking a skilled and proactive DevOps Engineer to help us optimize our infrastructure, automate...  ...design discussion with [CTO / technical lead].Offer (based on final positive feedback).... 
    16 hours
    Part time
    Remote work
    Flexible hours

    Bizmoni - The Next Gen AI Super APP

    Floral Park, Queens County, NY
    3 days ago
  •  ...mentoring to two junior IT team members, including coaching, task review, troubleshooting guidance, and skills development. Own or lead internal IT projects such as system upgrades, cloud migrations, security improvements, endpoint management, network changes, and... 

    Phaxis LLC

    Mineola, NY
    20 days ago
  • $116.2k - $229.1k

     ...2027The Work You’ll DoThe Knowledge Based Engineer Senior Consultant executes hands-on work to...  ...rules and models used by engineers and AI-enabled workflows. This role is expected to...  ...sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage... 
    Local area

    Deloitte

    Jericho, NY
    1 day ago
  •  ...Senior Full-Stack Engineering And Architecture RoleHealthCare Partners, IPA and HealthCare Partners...  ...% hands-on engineering as the "pro-code" lead and 20% architecture and strategy in...  ...reviews and penetration testingFluency with AI-assisted / agentic development tools (e.g... 
    Work experience placement
    Local area
    Shift work

    HealthCare Partners of Nevada

    Garden City, NY
    5 days ago
  •  ...The Opportunity As a Technical Lead, you’ll play a pivotal role in shaping the next...  ...This is an opportunity to lead a talented engineering team that’s passionate about delivering innovative...  ...of a company that is actively embracing AI-assisted development and emerging... 
    Work experience placement
    Summer work
    Work at office
    Remote work
    Shift work

    KWI

    Melville, NY
    29 days ago
  •  ...background aligns with future opportunities, we’ll reach out directly when formal applications become available. About Software Engineering Roles at Danaher Are you passionate about building real-world applications, writing clean code, and solving meaningful... 
    Remote job
    Internship

    Danaher

    Long Island City, NY
    3 days ago
  • $159.1k - $224.1k

     ...The Team This role sits within Zora AI by Deloitte, Deloitte's product-focused asset...  ...Transformation (I&DT) practice. I&DT brings an engineering- and innovation-led mindset to how...  ...ability to develop client-facing materials, lead technical discovery conversations, and... 
    Local area

    Deloitte

    Jericho, NY
    4 days ago
  • $99k - $232k

     ...ApplicableSpecialismData, Analytics & AIManagement LevelManagerJob Description & SummaryThe OpportunityAs a Engineering Manager, Google Cloud AI/ML you will lead the design and delivery of Google Cloud AI and machine learning solutions within our Data & Analytics Engineering... 
    Full time
    H1b

    PwC

    Melville, NY
    1 day ago
  • $124k - $280k

     ...ApplicableSpecialismData, Analytics & AIManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Engineering Manager, Google Cloud AI/ML you will lead engineering efforts that design, build, and scale AI and machine learning solutions on Google Cloud,... 
    Full time
    H1b

    PwC

    Melville, NY
    1 day ago
  • $141.2k - $278.3k

     ...Chain & Network Operations Offering team, you will lead a client workstream that converts tacit and documented engineering knowledge—including design rules, calculations,...  ...for common cases, artificial intelligence (AI) agents for exceptions, and engineer approval to... 
    Work at office
    Local area
    Night shift

    Deloitte

    Jericho, NY
    1 day ago
  • $77k - $202k

     ...ApplicableSpecialismProduct InnovationManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Senior Associate - Azure AI Engineer you will design and develop generative AI solutions for clients within our Advisory practice, applying Azure-based engineering to... 
    Full time
    H1b

    PwC

    Melville, NY
    4 days ago
  •  ...One of BroadStreet Partners' Core Partner agencies is seeking an experienced and motivated IT Technical Lead to support its growing organization and evolving technology needs. Based in the Amityville, NY area, this individual will serve as the primary technology lead... 
    Local area

    BroadStreet Partners

    Amityville, NY
    19 hours ago
  • $119.3k - $196.6k

     ...Lauder Companies Inc. is one of the world’s leading manufacturers, marketers, and sellers of...  ...Senior Lead, Finance Platform Engineering provides engineering leadership and is accountable...  ...BTP) adoption, OneStream integration, and AI-enabled engineering capabilities where... 
    Full time
    Local area

    Estée Lauder

    Long Island City, NY
    2 days ago
  • $105.1k - $172.6k

     ...Lauder Companies Inc. is one of the world’s leading manufacturers, marketers, and sellers of...  ....DescriptionThe Lead, Finance Platform Engineering is responsible for leading the day-to-day...  ...Business Technology Platform (BTP) adoption, AI-enabled engineering practices, and the... 
    Full time
    Local area

    Estée Lauder

    Long Island City, NY
    3 days ago
  • $128.19k - $184.01k

     ...explore and build with a wide variety of AI language models (bots), including o3, o4-...  ...and Role: We are seeking a talented iOS Engineer to join us in building Poe, an innovative...  ...that brings together the world’s leading AI models in one place. You will work at... 
    Remote job
    Full time

    Quora

    Flushing, NY
    13 hours ago
  • $131.2k - $240.5k

     ...controllers, and finance teams define and execute their finance and global business services agendas and strategies. You will work with leading-class teams and solutions, helping clients navigate challenging environments, market uncertainty, technology development, and... 
    Local area

    Deloitte

    Jericho, NY
    4 days ago
  • HR SAP Module Associate/ SAP Data EntryA Few Words About Us - Integrated Resources, Inc is a premier staffing firm recognized as one of the tri-states most well-respected professional specialty firms. IRI has built its reputation on excellent service and integrity since...
    Remote work

    Careers Integrated Resources Inc

    Uniondale, NY
    2 days ago
  • $150k - $160k

    Job PurposeArbor is looking for a Senior Software Engineer to join our Solutions Delivery team. This person will design, build and support...  ...the organization. The role will also help us expand how we use AI, both in the solutions we build and in the way our team develops... 

    Arbor Realty Trust

    Uniondale, NY
    4 days ago
  • $134.5k - $265.1k

     ...the Retirement Agentic Ecosystem (RAE), an AI-enabled platform that connects retirement...  ...skilled and client-facing Forward Deployed Engineer (FDE) to sit at the intersection of...  ...use casesExceptional communicator — able to lead technical conversations with senior engineers... 
    Local area

    Deloitte

    Jericho, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AI Engineer. Be the first to apply!