Senior Lead Software Engineer - ML Engineer, Agent Platform

Salary: $61,000 - 101,000 per year Requirements:

• Formal software engineering training or certification, with at least 5 years of applied experience
• Practical experience delivering system design, application development, testing, and operational stability for production platforms, runtimes, or distributed systems
• Advanced proficiency in one or more programming languages; strong Python skills plus Go or Rust for performance-sensitive runtime work
• Experience leading the effective use of approved AI-assisted development tools, and setting expectations for validating their outputs for correctness, performance, and security
• Understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, resiliency, and security; experience coaching engineers on safe, compliant adoption
• Experience building or operating production LLM or agent systems, including tracing, evaluations, and guardrails
• Proficiency across the Software Development Life Cycle
• Advanced understanding of agile practices, including CI/CD, application resiliency, and security
• Demonstrated proficiency in software applications and technical processes within a technical discipline such as cloud, AI, or machine learning
• In-depth knowledge of financial services and its IT systems
• Practical cloud-native experience, including production Kubernetes
• Preferred: Experience architecting secure code execution and micro-VM sandboxing, such as Firecracker, Kata, or gVisor, for multi-tenant isolation
• Preferred: Experience designing or implementing agent protocols such as A2A and MCP, and multi-agent orchestration
• Preferred: Experience with agent or distributed memory systems, including memory nodes, episodic or semantic memory, and graph-backed retrieval (Graph RAG)
• Preferred: Exposure to LLMs, RAG architectures, vector databases, and embedding-based retrieval
• Preferred: Experience with fine-grained authorization such as OpenFGA or Zanzibar-style models, and policy engines such as OPA/Rego
• Preferred: Experience building agent evaluation infrastructure, including offline and online evaluations, regression suites, and LLM-as-judge quality or safety gates in CI
• Preferred: Proficiency with Infrastructure as Code such as Terraform and containerized deployments using Docker and Kubernetes

• Lead the architecture of NEO, our agent runtime platform, covering secure execution and isolation, agent communication, MCP tooling, memory, and evaluation infrastructure
• Design and deliver creative software solutions, and troubleshoot complex technical challenges
• Develop secure, high-quality production code; review and debug colleagues code; and establish standards adopted across teams using NEO
• Promote enterprise-authorized AI-assisted engineering practices to improve quality, delivery speed, and operational outcomes, with consistent validation through secure coding, peer review, and automated testing
• Shape the Software Development Life Cycle toolchain, including approved AI-assisted development and automation capabilities
• Identify recurring issues and opportunities to automate remediation, improving platform and agent stability
• Define an auditable, permission-aware runtime execution model using fine-grained authorization and policy controls for safe operation in a regulated environment
• Lead evaluations with external vendors, startups, and internal teams to assess architecture, technical capabilities, and fit with existing systems
• Lead Software Engineering communities of practice, encourage adoption of emerging technologies, and mentor Lead and senior engineers
• Foster a culture of diversity, opportunity, inclusion, and respect

• AI
• CI/CD
• Cloud
• Docker
• Support
• Kubernetes
• LLM
• Machine Learning
• MCP
• Python
• RAG
• Rust
• Security
• Terraform

More:

We are hiring a Senior Lead Software Engineer – ML Engineer for Agent Platform within J.P. Morgans Commercial and Investment Bank Data Analytics Payments Team. You will serve as a senior technical leader and core contributor to NEO, our agent runtime platform for Payments Technology, setting its technical direction and making complex decisions in support of our business. JPMorganChase is a longstanding global financial institution serving consumers, businesses, and prominent corporate, institutional, and government clients. Our Commercial and Investment Bank operates across banking, markets, securities services, and payments in more than 100 countries. We offer competitive total rewards and, for eligible roles, potential incentive compensation, along with benefits that may include health coverage, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value diversity and inclusion, provide equal employment opportunities, and make reasonable accommodations for religious practices and disability-related needs.

last updated 42 week of 2026