Senior AI Engineer
$170k - $200kAmalgamated Bank of NY
Purpose of Position:
We are seeking an experienced Senior AI Engineer to serve as a hands-on technical lead and primary builder within the Data Governance Team. This individual will design, build, deploy, and operate governed, auditable agentic solutions on the Bank's Databricks foundation. The role combines production engineering and architecture judgment, with direct responsibility for translating business needs into scalable AI capabilities that deliver measurable value in a regulated environment.
Essential Job Functions:
• Act as a hands-on lead engineer and primary builder, writing production code and delivering agents and LLM applications while shaping the Bank's AI architecture on Databricks.
• Design, build, test, deploy, and operate production agents using retrieval-augmented generation, tool calling, multi-agent, supervisory, and human-in-the-loop patterns.
• Build and integrate Model Context Protocol (MCP) clients and servers; author secure custom tools and APIs; and establish reusable patterns for tool discovery, permissions, execution, and error handling.
• Lead prompt and context engineering, model selection, evaluation, and token-usage optimization to improve quality, latency, reliability, and cost efficiency.
• Configure and operate Databricks AI Gateway as the control point for model and agent access, including routing, access policies, rate limits, usage logging, cost controls, and guardrails.
• Establish agent identity and authorization patterns, including on-behalf-of and delegated identity approaches, so agent actions are properly attributed, authorized, and auditable.
• Partner with business stakeholders across credit, lending, relationship banking, and other functions to understand context and requirements and translate them into agent scope, delivery plans, and acceptance criteria.
• Manage backlog priorities and trade-off decisions across business value, risk, cost, complexity, and delivery timing; drive adoption and measure and communicate business KPI impact.
• Collaborate with BI engineers to architect dashboards that monitor agent cost, accuracy, usage, performance, traceability, and business outcomes.
• Partner with Information Security on AI observability by identifying relevant control-plane and agent telemetry, defining signals for enterprise SIEM platforms such as Google SecOps or Splunk, and recognizing anomalous patterns that warrant investigation.
• Partner with data stewards and data engineers to certify data sources and enforce classification, lineage, and entitlements through Unity Catalog.
• Integrate agents across platforms using Salesforce Data Cloud and Agentforce, Microsoft Copilot Studio, and MuleSoft.
• Collaborate with Information Security, Model Risk, Compliance, Legal, and Internal Audit to develop governance standards, documentation, control evidence, and testing artifacts.
• Build CI/CD, automated testing, evaluation, and operational monitoring for AI workloads; mentor junior engineers; evaluate vendors and implementation partners; and perform other duties as directed.
Knowledge, Skills and Experience Requirements:
• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent experience; Master's degree preferred.
• 7+ years of experience in software, data, or machine learning engineering, including 2+ years delivering LLM or agent-based solutions to production.
• Demonstrated experience delivering agentic capabilities in a regulated industry that produced measurable business value and scaled beyond proof of concept; financial services experience preferred.
• Strong Python and SQL skills with hands-on production experience using Databricks, Spark, Delta Lake, Unity Catalog, and Databricks AI Gateway or a comparable LLM gateway.
• Experience building and integrating MCP clients and servers, developing custom tools, implementing tool-calling workflows, and securing agent access to enterprise systems and data.
• Strong prompt and context engineering skills, including model selection, evaluation design, token-usage optimization, and cost/performance trade-off management.
• Knowledge of agent identity and authorization patterns, including on-behalf-of and delegated identity models.
• Experience implementing guardrails for cost, accuracy, safety, observability, and end-to-end traceability of LLM and agent workloads.
• Experience working directly with non-technical business teams to define scope, manage prioritization trade-offs, drive adoption, and connect AI delivery to measurable business outcomes.
• Understanding of AI and data governance, model risk management, privacy, and data security in a regulated environment.
• Excellent problem-solving and communication skills, with the ability to influence technical, business, risk, and executive stakeholders.
Preferred Qualifications:
• Production experience with LangGraph, LlamaIndex, or an equivalent agentic orchestration framework.
• Experience with Salesforce Data Cloud and Agentforce, MuleSoft, or Microsoft Copilot Studio.
• Experience with MLflow tracing, inference tables, or comparable LLM observability tooling.
• Familiarity with Google SecOps, Splunk, or comparable SIEM platforms and AI telemetry integration.
• Familiarity with SR 11-7 model risk guidance and emerging AI regulatory expectations.
• Databricks or Azure AI certifications.
.
Our job titles may span more than one career level. The starting base salary for this role is between $170,000 – $200,000. The actual base pay is dependent upon many factors, such as: training, transferrable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. Amalgamated Bank is an Equal Opportunity and Affirmative Action Employer, Minorities / Females / Individuals with Disability / Veterans. AmeriCorps, Peace Corps and other national service alumni are encouraged to apply. View our Pay Transparency Statement. Submission of a resume or any information regarding your qualifications does not constitute a promise or offer of employment. At Amalgamated Bank, we consider an applicant to be someone who has interviewed at least once, in person, with the hiring manager. Amalgamated Bank does not sponsor applicants for work visas. Hybrid Work Model
Effective February 18, 2025, employees in office-based positions will be working a Hybrid work schedule consisting of three days or more, on-site per week, Monday - Thursday, although the specific days may vary by site or organization, with Friday designated as a remote-working day, unless business critical tasks require an on-site presence. This Hybrid work model does not apply to, and daily in-person attendance is required for, the contact center, branch service roles, and general services where the work to be performed is located at a Company site; positions covered by a collective-bargaining agreement (unless the agreement provides for hybrid work); or any other position for which the Company has determined the job requirements cannot be reasonably met working remotely. Please note, this Hybrid work model guidance does not apply to roles that have been designated as “remote”.
Search Firm Representatives- Please Read Carefully
Amalgamated Bank does not accept unsolicited assistance from search firms for employment opportunities. All CVs / resumes submitted by search firms to any employee at our company without a valid written search agreement in place for the position will be deemed the sole property of our company. No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre-existing agreement is in place. Where agency agreements are in place, introductions are position specific. Please, no phone calls or emails.
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer in New York, NY vacancy
$110 - $150 per hour
...pay, diversity in tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Engineer to join their team in New York, NY! This role is ideal for an experienced software engineer who understands how to design...Senior$200k - $300k
...Firm: Top New York Hedge Fund Role: Senior / Staff Software Engineer - AI Core Systems Tech Stack: Python, C++/Java, AWS, GCP, Kafka, ClickHouse, Kubernetes, MLOps Compensation: $200,000-$300,000 base + bonus Location: NYC (Hybrid 4 days a week in-office...SeniorFull timeWork at officeRelocation$250k
...AI Software Engineer Location: New York City, NY Work Model: Hybrid, NYC office Compensation: Up to $250,000 base salary plus equity Authorization: No sponsorship available (if you need sponsorship post OPT, this cannot be provided) Job Description...SeniorFull timeWork at office$200k - $225k
...Senior AI Engineer - Agentic Systems Remote (NYC HQ) $200,000-225,000 Base Salary + Equity THE COMPANY Harnham is partnering with a high-growth AI-native technology company building a next-generation platform for the advertising and marketing industry. The business...SeniorWork at officeLocal areaRemote work$175k
Position SummaryAssured Guaranty is seeking a Senior AI Software Engineer to build production-grade AI applications using our emerging agentic AI framework. This role focuses on translating business workflows into scalable, governed software that integrates AI agents, enterprise...Senior$152k - $241.5k
We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency efforts. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers by implementing progressions throughout the entire stack...SeniorFull timeRemote work$115k - $130k
...Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...markets. About the Role We are seeking a hands-on Senior AI Engineer to design, build, and deploy production-grade artificial...SeniorFull timeTemporary workFlexible hours$190k - $235k
...SENIOR AI FULL-STACK ENGINEER Thresh Consulting — Strategy in Action for the AI Era Salary: $190,000 – $235,000 + up to 25% performance-based bonus Location: Hybrid (Denver, Chicago, or NYC preferred) ABOUT THRESH Thresh Consulting is a modern digital consulting...SeniorFull timeShift work- ...Senior AI Security Engineer Location: New York, NY Working Pattern: Hybrid Employment Type: Full Time We are partnering with a large financial services organization that is continuing to invest in its AI engineering and security capabilities. They...SeniorFull time
$180k - $250k
...Senior Applied AI Engineer Compensation: $180k - $250k base + equity Location: New York City (Chelsea) — fully on-site five days/ week We’re partnering with a fast-growing NYC AI startup that’s building agentic systems for complex, high-stakes insurance investigations...SeniorFull time$120k - $165k
...future of our communities. This is a Software Engineering position at the Director level, which is... ...Managers, Market Risk Analytics teams, Senior management, and various regulatory bodies... ...lead the development of Python-based AI applications and frameworks that empower...SeniorTemporary work- ...reputable quantitative trading firms in the world and they are at the forefront of AI and Machine Learning investment and development. They are looking for an experienced Senior AI Engineer who specializes in post-training and building foundation Large Language Models....SeniorFull timeWork at officeRelocation
$175k - $215k
...a 200-year legacy and a shared passion for what’s next, this is the right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-powered features that allow financial services users to generate data...SeniorFull timeLocal area- ...your future as we are, join our team.KPMG is currently seeking a Senior Engineer to join our Audit Technology Organization (ATO).Responsibilities:Develop and implement core components of our generative AI solutions, focusing on building robust, scalable features aligned...SeniorLocal area
$195k - $225k
...DescriptionPosition SummaryWe are pioneering a new AI development team dedicated to... ...entrepreneurial and deeply technical AI Engineer to be a foundational member of this team.... ...engineering and real world execution.As a Senior AI Engineer, you will design and build agentic...SeniorFull time$131k - $271.6k
...the design, development, and operation of AI-native enterprise applications within... ...-embedded delivery teams.You bring solid engineering fundamentals and a growing command of AI... ...business problems under the guidance of senior engineers and technical leads.This is a role...SeniorPermanent employmentFull timeWork at officeWorldwideFlexible hours$153.84k - $246.15k
...on-demand professional development resources that allow you to hone existing skills and learn new ones “I can succeed as a Senior AI AppSec Engineer at Capital Group”As a Senior AI AppSec Engineer, you will work with application teams to ensure the security of custom and...SeniorFull timeTemporary workLocal areaFlexible hours$142.32k - $213.48k
...United StatesSalary: $142,320.00 - $213,480.00Category: Technology, Applications Development, ProfessionalCompany: CitiGenerative AI Engineer At Citi, we are pioneering the future of enterprise operations through innovative technology. Our COO-Technology Engineering and...SeniorFull timeWork at officeWork from homeWorldwideFlexible hours$121k - $206k
...SummaryPositions are available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you... ...high-impact AI products with leverage across the firm.As a Senior Software Engineer on T. Rowe Price Labs' AI Engineering team,...SeniorFull timeWork at officeLocal areaRemote work3 days per week- ...This is a highly embedded, client-facing engineering role. The individual will serve as a Forward... ...The role involves identifying high-value AI use cases, translating business workflows... ...a consultative approach to working with senior business stakeholders in a regulated...SeniorFull timeContract work
$144k - $236k
...determined by the business needs of the team.Responsibilities: AI is at the core of how LinkedIn connects more than a billion... ...jobs, sales, marketing, content, and trust platforms. As a Senior AI Software Engineer you will own end-to-end machine learning systems that run...SeniorFor contractorsWork at officeImmediate startFlexible hours$204k - $255k
Joining Collibra’s Unstructured AI TeamWork at the forefront of context engineering - shaping how AI systems retrieve, structure, and leverage context to deliver... ...together, and keep making progress as a team.Senior AI Engineer at Collibra are responsible forShipping...SeniorWork experience placementWork at officeFlexible hours2 days per week$122k - $240.5k
Position Summary Agentic AI is moving from experimentation to production, and... ...responsibly and at scale. We're growing a team of engineers who want to work at the center of that... ...From entry-level employees to senior leaders, we believe there’s always room to...SeniorWork at officeLocal areaVisa sponsorshipShift work$148.5k - $223.9k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...working alongside the founding team and engineers in an organization offering the autonomy... ...for this for 20 years.”What you’ll doAs a Senior AI Angineer Agentforce & Missionforce Operations...SeniorFull timeRemote work$122k - $240.5k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...Professional development From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities...SeniorLocal areaVisa sponsorship$185k - $200k
...viewpoint matter. Learn about the Danaher Business System which makes everything possible. The Senior Legal Engineer is responsible for designing, building, and deploying AI-powered solutions that transform legal and compliance workflows across Danaher's corporate and...SeniorFull timeContract workRemote workWork from homeFlexible hours- ...Hedge FundSelling Points Lead impactful AI initiatives in financial services, driving... ...solutions. Manage and grow a high-performing engineering team.Job DescriptionSenior Vice President... ...and APIs to unlock new use cases.Senior Vice President, AI Engineering Key Responsibilities...Senior
$200k
...imprints to operate more efficiently, and the productionization of AI capabilities across the publishing lifecycle. This is a rare... ...is mandatory for consideration for this role.THE ROLEAs a Senior AI Engineer (Full-Stack / Applications), you will design, build, and operate...SeniorFull timeContract workTemporary workWork at officeLocal areaRemote work$141.1k - $194k
Become a part of our caring communityMost AI engineering jobs are a thin wrapper around a model API. This role is different.We build the platform... ..., auditable, and scalable is at the core of this role.As a Senior AI Applied Engineer, you will design, build, deploy, and...SeniorFull timeTemporary workApprenticeshipWork at officeRemote workRelocation3 days per week$220k - $300k
...Senior Applied AI Engineer $220,000 - $300,000 Base Salary + Equity A high-growth, venture-backed software company is hiring a Senior Applied AI Engineer to help build the intelligence layer behind its platform. This is an opportunity to work on the cutting edge...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Engineer. Be the first to apply!
Related searches
- senior ai engineer New York, NY
- ai engineer New York, NY
- ai developer New York, NY
- machine learning ai engineer New York, NY
- ai ml engineer New York, NY
- ai research engineer New York, NY
- ai engineer remote New York, NY
- ai prompt engineer New York, NY
- senior business development New York, NY
- senior research specialist New York, NY


