Lead Software Engineer - ML Agent Platform

Salary: $61,000 - 101,000 per year Requirements:

• Formal training or certification in software engineering concepts, with 5+ years of applied experience
• Hands-on experience delivering system design, application development, testing, and operational stability
• Advanced proficiency in one or more programming languages; strong Python skills required
• Experience leading the effective use of approved AI-assisted software development tools, including setting standards for validating outputs for correctness, performance, and security
• Understanding of responsible AI use in engineering workflows, including data sensitivity, secure input and output handling, resiliency, and security; experience coaching engineers in safe, compliant adoption
• Hands-on experience building LLM-powered or agentic systems, including tracing, evaluations, and guardrails
• Proficiency across the Software Development Life Cycle
• Advanced understanding of agile methods, including CI/CD, application resiliency, and security
• Demonstrated proficiency in software applications and technical processes in a technical discipline such as cloud, AI, or machine learning
• In-depth knowledge of the financial services industry and its IT systems
• Practical cloud-native experience, including production Kubernetes
• Preferred: Exposure to LLMs, RAG architectures, vector databases, and embedding-based retrieval; Graph RAG is a plus
• Preferred: Experience with agent protocols such as A2A or MCP, or multi-agent orchestration
• Preferred: Experience with sandboxed or secure code execution using containers or micro-VMs such as Firecracker, Kata, or gVisor
• Preferred: Experience with agent memory, including memory nodes or episodic and semantic memory, or graph-backed retrieval
• Preferred: Familiarity with building or running evaluations for LLM or agent systems
• Preferred: Proficiency with Infrastructure as Code such as Terraform and containerized deployments using Docker or Kubernetes
• Preferred: Experience with data observability, quality, and metadata management tools

• Design, develop, and troubleshoot creative software solutions, taking unconventional approaches to technical problems
• Build and operate major components of NEO, including agent execution and sandboxing, A2A and MCP integrations, memory, retrieval, and evaluation systems
• Develop secure, high-quality production code and review and debug colleagues code
• Lead adoption of enterprise-authorized AI-assisted engineering practices to improve code quality, delivery, and operations; establish validation standards and promote effective reusable patterns
• Apply software development lifecycle tools, including approved AI-assisted development and automation capabilities, to improve automation outcomes
• Identify recurring issues and opportunities to automate remediation and strengthen software and system stability
• Implement permission-aware, auditable agent execution, including fine-grained authorization and runtime policy checks
• Lead evaluations of vendors, startups, and internal teams, assessing architecture, technical credentials, and suitability for existing systems
• Lead software engineering communities of practice to promote emerging technologies and mentor Lead and senior engineers
• Contribute to a team culture grounded in diversity, opportunity, inclusion, and respect

• AI
• CI/CD
• Cloud
• Docker
• Support
• Kubernetes
• LLM
• Machine Learning
• MCP
• Python
• RAG
• Security
• Terraform

More:

We are partnering with hackajob to connect professionals with J.P. Morgan for a Lead Software Engineer - ML Engineer role on our Agent Platform in the Commercial and Investment Banks Data Analytics Payments team. You will help build NEO, our agent runtime platform for Payments Technology, as part of an agile team. J.P. Morgan Chase & Co. is a long-established financial institution serving consumers, businesses, and public-sector and institutional clients worldwide. Our Commercial & Investment Bank operates across banking, markets, securities services, and payments, serving clients in more than 100 countries. We offer competitive total rewards, with compensation based on role, experience, skills, and location, as well as eligible incentive pay and benefits that may include healthcare, wellness services, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value a diverse and inclusive workforce and provide reasonable accommodations.

last updated 42 week of 2026