Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer

$170k - $200k

Amalgamated Bank of NY

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

New York, NY, US

3 days ago Requisition ID: 2282

Salary Range: $170,000.00 To $200,000.00 Annually

Purpose of Position

We are seeking an experienced Senior AI Engineer to serve as a hands‑on technical lead and primary builder within the Data Governance Team. This individual will design, build, deploy, and operate governed, auditable agentic solutions on the Bank's Databricks foundation. The role combines production engineering and architecture judgment, with direct responsibility for translating business needs into scalable AI capabilities that deliver measurable value in a regulated environment.

Essential Job Functions
  • Act as a hands‑on lead engineer and primary builder, writing production code and delivering agents and LLM applications while shaping the Bank's AI architecture on Databricks.
  • Design, build, test, deploy, and operate production agents using retrieval-augmented generation, tool calling, multi-agent, supervisory, and human-in-the‑loop patterns.
  • Build and integrate Model Context Protocol (MCP) clients and servers; author secure custom tools and APIs; and establish reusable patterns for tool discovery, permissions, execution, and error handling.
  • Lead prompt and context engineering, model selection, evaluation, and token-usage optimization to improve quality, latency, reliability, and cost efficiency.
  • Configure and operate Databricks AI Gateway as the control point for model and agent access, including routing, access policies, rate limits, usage logging, cost controls, and guardrails.
  • Establish agent identity and authorization patterns, including on‑behalf‑of and delegated identity approaches, so agent actions are properly attributed, authorized, and auditable.
  • Partner with business stakeholders across credit, lending, relationship banking, and other functions to understand context and requirements and translate them into agent scope, delivery plans, and acceptance criteria.
  • Manage backlog priorities and trade‑off decisions across business value, risk, cost, complexity, and delivery timing; drive adoption and measure and communicate business KPI impact.
  • Collaborate with BI engineers to architect dashboards that monitor agent cost, accuracy, usage, performance, traceability, and business outcomes.
  • Partner with Information Security on AI observability by identifying relevant control‑plane and agent telemetry, defining signals for enterprise SIEM platforms such as Google SecOps or Splunk, and recognizing anomalous patterns that warrant investigation.
  • Partner with data stewards and data engineers to certify data sources and enforce classification, lineage, and entitlements through Unity Catalog.
  • Integrate agents across platforms using Salesforce Data Cloud and Agentforce, Microsoft Copilot Studio, and MuleSoft.
  • Collaborate with Information Security, Model Risk, Compliance, Legal, and Internal Audit to develop governance standards, documentation, control evidence, and testing artifacts.
  • Build CI/CD, automated testing, evaluation, and operational monitoring for AI workloads; mentor junior engineers; evaluate vendors and implementation partners; and perform other duties as directed.
Knowledge, Skills and Experience Requirements
  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent experience; Master's degree preferred.
  • 7+ years of experience in software, data, or machine learning engineering, including 2+ years delivering LLM or agent‑based solutions to production.
  • Demonstrated experience delivering agentic capabilities in a regulated industry that produced measurable business value and scaled beyond proof of concept; financial services experience preferred.
  • Strong Python and SQL skills with hands‑on production experience using Databricks, Spark, Delta Lake, Unity Catalog, and Databricks AI Gateway or a comparable LLM gateway.
  • Experience building and integrating MCP clients and servers, developing custom tools, implementing tool‑calling workflows, and securing agent access to enterprise systems and data.
  • Strong prompt and context engineering skills, including model selection, evaluation design, token‑usage optimization, and cost/performance trade‑off management.
  • Knowledge of agent identity and authorization patterns, including on‑behalf‑of and delegated identity models.
  • Experience implementing guardrails for cost, accuracy, safety, observability, and end‑to‑end traceability of LLM and agent workloads.
  • Experience working directly with non‑technical business teams to define scope, manage prioritization trade‑offs, drive adoption, and connect AI delivery to measurable business outcomes.
  • Understanding of AI and data governance, model risk management, privacy, and data security in a regulated environment.
  • Excellent problem‑solving and communication skills, with the ability to influence technical, business, risk, and executive stakeholders.
Preferred Qualifications
  • Production experience with LangGraph, LlamaIndex, or an equivalent agentic orchestration framework.
  • Experience with Salesforce Data Cloud and Agentforce, MuleSoft, or Microsoft Copilot Studio.
  • Experience with MLflow tracing, inference tables, or comparable LLM observability tooling.
  • Familiarity with Google SecOps, Splunk, or comparable SIEM platforms and AI telemetry integration.
  • Familiarity with SR 11-7 model risk guidance and emerging AI regulatory expectations.
  • Databricks or Azure AI certifications.

.

Our job titles may span more than one career level. The starting base salary for this role is between $170,000 – $200,000. The actual base pay is dependent upon many factors, such as: training, transferrable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future.

Hybrid Work Model

Effective February 18, 2025, employees in office‑based positions will be working a Hybrid work schedule consisting of three days or more, on‑site per week, Monday - Thursday, although the specific days may vary by site or organization, with Friday designated as a remote‑working day, unless business critical tasks require an on‑site presence. This Hybrid work model does not apply to, and daily in‑person attendance is required for, the contact center, branch service roles, and general services where the work to be performed is located at a Company site; positions covered by a collective‑bargaining agreement (unless the agreement provides for hybrid work); or any other position for which the Company has determined the job requirements cannot be reasonably met working remotely. Please note, this Hybrid work model guidance does not apply to roles that have been designated as “remote”.

#J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer in New York, NY vacancy
  •  ...Role Overview We are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and scale distributed backend systems and production-grade Agentic AI solutions. The ideal candidate will have strong expertise in Node.js, TypeScript... 
    Senior
    Full time

    Neshent Technologies

    New York, NY
    7 days ago
  •  ...be capable of, work out how to achieve it and build it. Anon AI Labs, the company behind Serus. Location: San Francisco / New...  ...for deep practical knowledge of agents and models, strong engineering ability and good intuition about what is possible. You should be... 
    Senior

    Serus

    New York, NY
    5 days ago
  • $184k - $230k

     ...heavily in data & analytics to create better patient, provider, and operational experiences. Job Summary The position of Senior AI Engineer within the Data and Analytics function leverages skills across Predictive, Generative, and Agentic AI solutions to improve... 
    Senior
    Shift work

    Montefiore Medical

    New York, NY
    4 days ago
  •  ...Job DescriptionJob DescriptionTitle: Senior AI Engineer Location: New York, NY/Pittsburgh, PA/Lake Mary, FL (Hybrid (2-4 days a week work from office) Duration: 12 months :Minimum years of experience required: 5 years of relevant experience; 10 years of overall experience... 
    Senior
    Work at office
    2 days per week

    eTeam

    New York, NY
    2 days ago
  •  ...recommendation systems, behavioral simulation, and generative AI. In this role you'll set research direction, inform data...  ...to production in a tight partnership with product and engineering. As a senior member of the team you'll recruit, mentor, and set the bar for... 
    Senior

    Chronicle Media LLC

    New York, NY
    2 days ago
  • $190k - $250k

     ...Join deCircle to build end-to-end agentic AI systems that take Studio ventures from early scope to a first production release....  ...hybrid role in New York, NY or Chicago brings together hands‑on engineering, product collaboration, and real ownership of systems that ship... 
    Senior
    H1b
    Work at office
    Visa sponsorship

    deCircle

    New York, NY
    1 day ago
  • $250k

     ...AI Software Engineer Location: New York City, NY Work Model: Hybrid, NYC office Compensation: Up to $250,000 base salary plus equity Authorization: No sponsorship available (if you need sponsorship post OPT, this cannot be provided) Job Description... 
    Senior
    Work at office

    Stott and May

    New York, NY
    1 day ago
  •  ...partnering with a software company that is the industry leader in voice AI for customer service. They do this with AI that feels human,...  ...scenarios. You will be part of a cross-functional group of engineers that are applying the latest research in Generative AI and NLP -... 
    Senior
    Remote work

    Jecona

    New York, NY
    2 days ago
  •  ...Senior AI Engineer at Hermetic Remote · Full-time About Hermetic Restaurants and event venues lose bookings every day to slow replies. A guest asks about a rehearsal dinner on a Tuesday night, and by the time someone answers on Thursday, they've booked somewhere... 
    Senior
    Full time
    Remote work
    Night shift

    LinkedIn

    New York, NY
    3 days ago
  •  ...Senior AI Engineer – Talent Management New York City – Onsite 3 days per week *Must be US Citizen or Green Card holder to apply, no Contract or C2C arrangements are available for this opportunity* Position Summary This role is available with one of the most... 
    Senior
    Full time
    Contract work
    3 days per week

    1872 Consulting

    New York, NY
    3 days ago
  •  ...passionate individuals to join us. Learn more about our story at: about-us/About the role About the role We are looking for a Senior AI Engineer to own and scale the AI layer of one of our core D2C subscription products. You will be fully responsible for production LLM... 
    Senior
    For contractors
    Remote work
    Flexible hours

    Ruby Labs Ltd

    New York, NY
    2 days ago
  •  ...Experience: 5+ yrs Location: India Job Type: Full-time As a Data Engineering and Analytics professional, you will work on designing,...  ...data platforms that support analytics, business intelligence, and AI-driven use cases. You will collaborate with engineering, analytics... 
    Senior
    Full time

    Aimlroles

    New York, NY
    3 days ago
  • $120k - $165k

     ...future of our communities. This is a Software Engineering position at the Director level, which is...  ...Managers, Market Risk Analytics teams, Senior management, and various regulatory bodies...  ...lead the development of Python-based AI applications and frameworks that empower... 
    Senior
    Full time
    Temporary work

    Morgan Stanley

    New York, NY
    3 days ago
  • $110 - $150 per hour

     ...pay, diversity in tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Engineer to join their team in New York, NY! This role is ideal for an experienced software engineer who understands how to design... 
    Senior

    Eleven Recruiting

    New York, NY
    a month ago
  •  ...Description Hybrid 3 days onsite in New York, NY Our client is seeking a Senior AI Enablement Engineer to design, build, integrate, and operationalize AI-powered tools and workflows across the business. This hands-on individual contributor role focuses on transforming... 
    Senior

    Eliassen Group

    New York, NY
    12 days ago
  •  ...H2O.ai is on a mission to democratize AI for Good. As the world’s leading agentic AI company, H2O.ai converges Generative and...  ...company’s purpose. About This Opportunity We are looking for a Senior AI Engineer who builds things that matter. You will design and ship end‑to... 
    Senior
    Remote work
    Worldwide
    Flexible hours

    H2O.ai

    New York, NY
    3 days ago
  •  ...Job Title: Senior AI Engineer – AI Solutions & Validation Frameworks Experience: 8+ years Domain: AI / Generative AI / Enterprise Solutions Role Overview We are looking for an AI Engineer with 8+ years of professional experience in designing, developing... 
    Senior
    Full time

    Galent

    New York, NY
    3 days ago
  • $131k - $170k

     ...Senior AI Engineer Location: Hybrid, United States Employment: Full‑Time Benefits Offered: Vision, Medical, Life, Dental, 401(k) Gross Annual Base Salary: USD 131,000 - 170,000 Additional variable compensation and benefits may apply. Total compensation... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Work at office

    OneStream Software

    New York, NY
    2 days ago
  • $142.32k - $213.48k

     ...0-22 Location: New York, New York, United States Salary: $142,320.00 - $213,480.00 Category: Technology Company: Citi Generative AI Engineer At Citi, we are pioneering the future of enterprise operations through innovative technology. Our COO-Technology Engineering and... 
    Senior
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours

    Citigroup Inc

    New York, NY
    3 days ago
  •  ...Hybrid Environment Follow @Re:Sourced for the latest AI, Software and Data Engineering opportunities Benefits & Why This Opportunity Is Unique...  ...portfolio. A product team of ex-consulting operators and senior PMs sits with the businesses and brings you the problem... 
    Senior
    Work at office
    Remote work
    Flexible hours

    ResourcED, LLC

    New York, NY
    4 days ago
  •  ...Greetings from Skysoft Role: Senior AI Engineer with Claude experience Location: New York City, NY Work Arrangement: 100% Onsite – 5 Days a Week Experience: 15+ Years Overall IT Experience is Must Engagement: Contract Only US Citizens and H1B'S... 
    Senior
    Contract work
    H1b

    Skysoft Inc.

    New York, NY
    12 hours ago
  • $200k

     ...imprints to operate more efficiently, and the productionization of AI capabilities across the publishing lifecycle. This is a rare...  ...is mandatory for consideration for this role. THE ROLE As a Senior AI Engineer (Full-Stack / Applications), you will design, build, and... 
    Senior
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Remote work

    Macmillan

    New York, NY
    3 days ago
  • $190k - $250k

     ...Job Description Job Description Senior AI Engineer (Studio) Company: Confidential — venture-backed technology company Location: New York, NY (Flatiron, 21st & Broadway) or Chicago, IL (hybrid, 3 days in office) Compensation: $190,000 - $250,000 + competitive... 
    Senior
    Full time
    H1b
    Work at office
    Visa sponsorship

    AIVC

    New York, NY
    2 days ago
  • $166k - $214k

     ...this sounds like you, you'll fit right in. Department People Who You Are Reporting to the Senior Manager, People Strategy Operations, the Senior AI Engineer, People, is a technical founder embedded within the People function. You have a track record of... 
    Senior
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    2 days ago
  •  ...Position: Lead / Senior AI Engineer Location: NYC, NY “Hybrid Office BI-weekly “ Mode Of Hire: Long term Contract Role Overview The Senior AI Engineer designs, builds, and supports secure, reliable AI-enabled applications and backend services for firmwide... 
    Senior
    Long term contract
    Full time
    Work at office

    InfiCare Staffing

    New York, NY
    3 days ago
  •  ...Job Description Job Description Title: Senior Agentic AI Engineer (Palantir Foundry and AIP) Location: Remote Target Start Date: ASAP (by October 31) Type: C Salary / Pay Rate: DOE Why Work Here This is a data and AI consultancy of builders, not a slide... 
    Senior
    Contract work
    Immediate start
    Remote work

    ConsultNet

    New York, NY
    20 days ago
  •  ...Job Description Job Description Overview East West Bank is seeking an experienced Senior AI Engineering to design, build, and operationalize enterprise-grade AI and Generative AI solutions across the Bank. This senior technical leader will translate emerging AI... 
    Senior

    East West Bank

    New York, NY
    11 days ago
  • $85 per hour

     ...Job Description Job Description Senior AI Engineer Remote Rate: $85/hour Client : confidential Mandatory Skill :Agentic AI; Generative AI; LLMs; LangChain We are seeking a Senior AI Engineer to design, build, deploy, and operate enterprise-grade Large... 
    Senior
    Remote work

    Apolis

    New York, NY
    13 days ago
  • $225k - $275k

     ...Senior Applied AI Engineer Compensation: $225,000–$275,000 base + equity Location: New York City | 5 days onsite Employment Type: Full-time Join a venture-backed AI startup building production agents for complex decisions where accuracy and trust... 
    Senior
    Full time

    People In AI

    New York, NY
    3 days ago
  • $220k - $300k

     ...Senior Applied AI Engineer - New York, NY (On-site) | Series A AI Startup | $220k - $300k+ & Equity Most AI products are thin wrappers on someone else's model. This one is built on proprietary data that no foundation model has access to. We're working with a Series... 
    Senior
    Full time

    evoke

    New York, NY
    5 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer. Be the first to apply!