Lead AI Engineer
$225k - $250kBlack Osprey
About this role
Black Osprey is hiring on behalf of our client, Rafferty Holdings. This is a full-time role at Rafferty Holdings, based in the Long Island office in Garden City, NY, working on-site or hybrid. A second opening is based in New York City.
Rafferty is hiring two hands-on Lead AI Engineers. This is a forward-deployed role. You will work inside business operations with Rafferty's in-house IT lead and the people who run the work every day. You will find where AI helps in operations, compliance, risk management, and client service, then build the tools, put them into daily use, and keep improving them.
This is initially a senior individual contributor role with no direct reports. You own each solution end to end, from discovery to production support, and coordinate the input, decisions, and approvals of the right stakeholders.
What success looks like
- Production AI tools in daily use by the business teams you sit with, with measurable outcomes defined up front and tracked after launch.
- Solutions delivered in line with the firm's AI strategy and technology roadmap.
- AI engineering, prompt engineering, and governance standards that teams use.
- Reusable AI components, prompt libraries, and agent frameworks that make each new use case faster to build.
- A pipeline of high-value use cases found inside business workflows.
- The foundation of scalable, sustainable AI capability across the firm.
Key responsibilities
- Work directly with operations, compliance, risk, and client service teams. Sit with the operators, learn how they do the work today, and find where AI removes friction.
- Take each use case from discovery and scoping through build, deployment, adoption, and ongoing support.
- Turn what you observe into clear problem statements, then into working software inside the systems people already use.
- Put early versions in front of the people who will use them, watch how they work, and refine quickly based on their feedback.
- Design, develop, deploy, and support enterprise AI applications and services.
- Build solutions with LLMs, RAG architectures, AI agents, machine learning models, and intelligent automation.
- Design, test, and optimize prompts to improve accuracy, consistency, reliability, and business outcomes.
- Develop reusable prompt libraries, workflows, and AI solution frameworks.
- Build APIs, integrations, and cloud-native services that speed AI adoption across the firm.
- Set standards and best practices for AI architecture, prompt engineering, model evaluation, testing, and deployment.
- Implement monitoring, governance, and controls for secure and responsible AI use.
- Work with business, technology, compliance, risk, and security teams, and with the in-house IT lead, to deliver AI solutions that fit the firm's environment.
- Before launch, document the production support model: ownership of monitoring, incidents, enhancements, controls, and solution retirement.
- Evaluate emerging AI technologies and recommend where to adopt them.
- Mentor future AI team members.
Required qualifications
- 5+ years of software engineering experience delivering enterprise applications and technology solutions.
- 3+ years developing and deploying AI or machine learning solutions in production.
- A track record of working directly with business users to scope problems and ship tools they adopt, in a forward-deployed, solutions engineering, or embedded engineering role, or equivalent.
- Hands-on experience with LLMs, prompt engineering, RAG, AI agents and workflow orchestration, vector databases and semantic search, and model evaluation and testing frameworks.
- Experience building on enterprise AI platforms such as Azure OpenAI, Anthropic Claude, OpenAI, or equivalent.
- Proven experience designing, testing, and optimizing prompts for enterprise AI applications.
- Strong understanding of context engineering, structured outputs, grounding, retrieval optimization, and prompt evaluation methods.
- Strong Python skills and experience building APIs, microservices, and cloud-native applications.
- Experience with Microsoft Azure, AWS, or Google Cloud.
- Familiarity with DevOps, CI/CD, MLOps, and AI governance practices.
- Strong analytical, communication, and stakeholder management skills, including explaining technical trade-offs to non-technical colleagues.
- Experience working in regulated environments with security, compliance, and governance requirements.
Preferred qualifications
- Financial services experience in asset management, wealth management, banking, capital markets, brokerage, insurance, or fintech.
- Experience with Azure OpenAI Service, Anthropic Claude, Azure AI Foundry, Microsoft Copilot Studio, Microsoft Fabric, Databricks, LangChain, LangGraph, or Semantic Kernel.
- Experience building enterprise AI assistants, copilots, agentic AI solutions, or multi-agent systems.
- Experience establishing AI governance and responsible AI frameworks.
- Knowledge of investment operations, client servicing, compliance, risk management, or financial products.
- Bachelor's degree in Computer Science, Engineering, Data Science, Mathematics, or a related field.
Compensation and benefits
Hiring salary range: $225,000 to $250,000, plus bonus.
Benefits: medical, dental, vision, 401(k) plan, life insurance, and unlimited PTO.
- ...to access legal representation because the system is broken. We believe this is not a legal problem—it's an engineering problem. SimpleCITI is seeking a Lead AI Architect for one of its portfolio companies to build the operating system for the modern law firm: a fully...Suggested
- ...Lead Software Engineer (Backend Platform & APIs) Job Summary A client of mine is seeking a Lead Software Engineer to provide senior technical leadership for a team responsible for core backend services and APIs that power a large scale SaaS platform. This is a...SuggestedRemote work
$50 per hour
...and innovation. Our campus is a hub for engineering excellence, where we tackle some of the world... ...engineer primarily responsible for leading technical efforts and projects for the U.... ...time management skillsets- Proficient in AI prompting as it applies to this position...SuggestedFull timeTemporary workWork experience placementFor subcontractorCasual workLocal areaFlexible hours$103.71k - $138.28k
...Lumen is the trusted network for the AI‑powered world, connecting people, data, and... ...join us today. The Role The Field Engineering Quality Control Engineer is responsible for... ...Responsibilities Key Responsibilities Lead logistics projects from planning through...SuggestedFull timeTemporary workFor contractors$71k
...Job Description HCLTech is looking for a highly talented and self-motivated Test Lead / Electrical Engineer / Lead Test Engineer to join it in advancing the technological world through innovation and creativity. Job Title: Test Lead / Electrical Engineer / Lead...SuggestedFull timeLocal area$75k - $250k
...Company Description Black Osprey is a boutique engineering firm that partners with private equity, startups, and Fortune 500 companies to solve complex technical challenges. The team focuses on building high-quality, scalable software solutions tailored to diverse business...Full timePart timeWork experience placementRemote workWork from home$165.2k - $223.6k
...Services (AWS) is building a central pipeline of Software Development Engineer (SDE) talent for anticipated roles in 2026. This requisition... ...Artificial Intelligence/Machine Learning Healthcare AI Infrastructure Services Firmware Development Cloud Computing...InternshipLocal areaFlexible hoursDay shift$99k - $232k
...InnovationManagement LevelManagerJob Description & SummaryThe OpportunityAs a Lead Engineer you will guide the design, build, testing, and modernization of... ...scalable software solutions- Supporting innovation by applying AI-enabled engineering techniques, rapid experimentation, and...Full timeH1b$77k - $202k
Industry/SectorNot ApplicableSpecialismSAPManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs an AI Engineer - Agentic AI & Applied Generative AI Senior Associate you will help design, build, and refine AI solutions that support client needs across...Full timeH1b$124k - $280k
...InnovationManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Manager, Agentic Engineering Lead, you will guide the design and delivery of agentic and generative AI solutions for clients within our Advisory practice. In this role, you will bring together...Full timeH1b- 3- 4 Mainframe Developer / Cobol Developers EST & CST Zone 100% Remote 12 Months + Higher education experience is mandatory Looking for 3-4 mainframe/Cobol resources Experience with the transition from their legacy system to their new student system.Remote work
- ...Part-time ContractorBizmoni is building an AI Business Network designed to help people... ...are seeking a skilled and proactive DevOps Engineer to help us optimize our infrastructure, automate... ...design discussion with [CTO / technical lead].Offer (based on final positive feedback)....16 hoursPart timeRemote workFlexible hours
- ...mentoring to two junior IT team members, including coaching, task review, troubleshooting guidance, and skills development. Own or lead internal IT projects such as system upgrades, cloud migrations, security improvements, endpoint management, network changes, and...
$116.2k - $229.1k
...2027The Work You’ll DoThe Knowledge Based Engineer Senior Consultant executes hands-on work to... ...rules and models used by engineers and AI-enabled workflows. This role is expected to... ...sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage...Local area- ...Senior Full-Stack Engineering And Architecture RoleHealthCare Partners, IPA and HealthCare Partners... ...% hands-on engineering as the "pro-code" lead and 20% architecture and strategy in... ...reviews and penetration testingFluency with AI-assisted / agentic development tools (e.g...Work experience placementLocal areaShift work
- ...The Opportunity As a Technical Lead, you’ll play a pivotal role in shaping the next... ...This is an opportunity to lead a talented engineering team that’s passionate about delivering innovative... ...of a company that is actively embracing AI-assisted development and emerging...Work experience placementSummer workWork at officeRemote workShift work
- ...background aligns with future opportunities, we’ll reach out directly when formal applications become available. About Software Engineering Roles at Danaher Are you passionate about building real-world applications, writing clean code, and solving meaningful...Remote jobInternship
$159.1k - $224.1k
...The Team This role sits within Zora AI by Deloitte, Deloitte's product-focused asset... ...Transformation (I&DT) practice. I&DT brings an engineering- and innovation-led mindset to how... ...ability to develop client-facing materials, lead technical discovery conversations, and...Local area$99k - $232k
...ApplicableSpecialismData, Analytics & AIManagement LevelManagerJob Description & SummaryThe OpportunityAs a Engineering Manager, Google Cloud AI/ML you will lead the design and delivery of Google Cloud AI and machine learning solutions within our Data & Analytics Engineering...Full timeH1b$124k - $280k
...ApplicableSpecialismData, Analytics & AIManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Engineering Manager, Google Cloud AI/ML you will lead engineering efforts that design, build, and scale AI and machine learning solutions on Google Cloud,...Full timeH1b$141.2k - $278.3k
...Chain & Network Operations Offering team, you will lead a client workstream that converts tacit and documented engineering knowledge—including design rules, calculations,... ...for common cases, artificial intelligence (AI) agents for exceptions, and engineer approval to...Work at officeLocal areaNight shift$77k - $202k
...ApplicableSpecialismProduct InnovationManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Senior Associate - Azure AI Engineer you will design and develop generative AI solutions for clients within our Advisory practice, applying Azure-based engineering to...Full timeH1b- ...One of BroadStreet Partners' Core Partner agencies is seeking an experienced and motivated IT Technical Lead to support its growing organization and evolving technology needs. Based in the Amityville, NY area, this individual will serve as the primary technology lead...Local area
$119.3k - $196.6k
...Lauder Companies Inc. is one of the world’s leading manufacturers, marketers, and sellers of... ...Senior Lead, Finance Platform Engineering provides engineering leadership and is accountable... ...BTP) adoption, OneStream integration, and AI-enabled engineering capabilities where...Full timeLocal area$105.1k - $172.6k
...Lauder Companies Inc. is one of the world’s leading manufacturers, marketers, and sellers of... ....DescriptionThe Lead, Finance Platform Engineering is responsible for leading the day-to-day... ...Business Technology Platform (BTP) adoption, AI-enabled engineering practices, and the...Full timeLocal area$128.19k - $184.01k
...explore and build with a wide variety of AI language models (bots), including o3, o4-... ...and Role: We are seeking a talented iOS Engineer to join us in building Poe, an innovative... ...that brings together the world’s leading AI models in one place. You will work at...Remote jobFull time$131.2k - $240.5k
...controllers, and finance teams define and execute their finance and global business services agendas and strategies. You will work with leading-class teams and solutions, helping clients navigate challenging environments, market uncertainty, technology development, and...Local area- HR SAP Module Associate/ SAP Data EntryA Few Words About Us - Integrated Resources, Inc is a premier staffing firm recognized as one of the tri-states most well-respected professional specialty firms. IRI has built its reputation on excellent service and integrity since...Remote work
$150k - $160k
Job PurposeArbor is looking for a Senior Software Engineer to join our Solutions Delivery team. This person will design, build and support... ...the organization. The role will also help us expand how we use AI, both in the solutions we build and in the way our team develops...$134.5k - $265.1k
...the Retirement Agentic Ecosystem (RAE), an AI-enabled platform that connects retirement... ...skilled and client-facing Forward Deployed Engineer (FDE) to sit at the intersection of... ...use casesExceptional communicator — able to lead technical conversations with senior engineers...Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Engineer. Be the first to apply!





