VP, AI/ML Software Engineer

Salary: $30,000 - 55,000 per year Requirements:

• Bachelors degree in Computer Science, Engineering, or a related discipline; an advanced degree is preferred.
• 6+ years of professional software engineering experience.
• 2+ years of experience building production AI/ML systems, not just notebooks or prototypes.
• Strong problem-solving ability with experience managing complex data workflows.
• Excellent collaboration and communication skills for working across functions.
• Strong RAG expertise, including embedding models, vector databases, chunking, retrieval optimization, context window handling, and prompt assembly.
• Experience with agentic AI, including orchestration frameworks, tool-use patterns, function calling, structured output parsing, and multi-turn memory/state management.
• Proficiency in Python 3.11+ with FastAPI, async patterns, Pydantic, Poetry, and pytest.
• Experience integrating LLMs, including prompt engineering, token management, streaming, error handling, and rate limiting.
• Experience with NLP and document processing, including OCR post-processing, text segmentation, and entity extraction.
• Strong testing discipline, including unit tests, integration tests, golden-truth validation, and retrieval metric evaluation.
• API design experience, including RESTful services, OpenAPI specifications, and versioning strategies.
• Preferred: knowledge graph construction from unstructured text.
• Preferred: familiarity with code AI concepts such as code generation, automated testing, and AI-assisted refactoring.
• Preferred: Java/Spring Boot experience for cross-stack contribution.
• Preferred: Angular/TypeScript experience for full-stack context.
• Preferred: experience with model evaluation such as F1, precision/recall, MRR, and NDCG.
• Preferred: exposure to fine-tuning or prompt optimization techniques.
• Preferred: understanding of graph RAG or hybrid retrieval architectures.
• Preferred: capital markets or financial services domain experience.
• Preferred: enterprise deployment experience with Docker, CI/CD, and artifact repositories.

• Design and implement agentic AI systems, RAG pipelines, and intelligent document processing services.
• Own major components of the AI platform, including embedding pipelines and vector retrieval.
• Build agent loops, tool registries, memory stores, reasoning traces, and self-correction mechanisms.
• Develop end-to-end RAG workflows covering ingestion, preprocessing, chunking, embedding generation, indexing, retrieval orchestration, context assembly, and prompt construction.
• Create and tune vectorization pipelines, including embedding model integration, batch processing, incremental index updates, and similarity search optimization.
• Implement multi-agent coordination patterns such as shared blackboards, inter-agent messaging, task decomposition, and consensus methods.
• Build prompt engineering infrastructure, including template management, few-shot selection, reasoning scaffolds, and output parsing.
• Develop evaluation harnesses for accuracy measurement, retrieval quality, regression detection, and A/B comparisons.
• Build FastAPI services that expose AI features as production APIs for extraction, validation, and classification.
• Contribute to Java/Spring Boot platform services where AI connects with business workflows.
• Design and maintain database schemas for AI metadata, including audit trails, pipeline runs, memory entries, and knowledge graphs.
• Implement content policy enforcement and data governance controls within AI pipelines.
• Partner closely with the SVP lead to translate architectural direction into production code.
• Mentor 2-3 mid-level engineers on AI engineering practices.
• Participate in architecture reviews and design discussions.
• Document patterns, decisions, and operational runbooks for AI systems.
• Work with product and business stakeholders to turn requirements into technical solutions.

• Agentic AI
• AI
• API
• Angular
• CI/CD
• Docker
• Embedding Models
• FastAPI
• Fine-tuning
• Java
• OpenAPI
• Python
• RAG
• Spring
• Spring Boot
• TypeScript
• pytest
• Azure
• Backend
• Cloud
• GitLab
• Support
• LLM
• Oracle
• PostgreSQL

More:

We are collaborating with hackajob to connect with exceptional professionals for this Vice President AI/ML Software Engineer opportunity in New York, NY. At BNY, we are a global financial services company with a culture that supports growth, success, and innovation. Our teams use cutting-edge AI and breakthrough technologies to deliver transformative solutions for clients and communities worldwide. We are known as a destination for innovators and inclusive talent, where bold ideas and advanced technology come together to shape the future of finance. We offer highly competitive compensation, benefits, and wellbeing programs, flexible global resources and tools, generous paid leave including paid volunteer time, and a strong pay-for-performance philosophy. We are an Equal Employment Opportunity/Affirmative Action Employer.

last updated 40 week of 2026