Lead Software Engineer - AI Foundation Services

Salary: $61,000 - 101,000 per year Requirements:

• Formal training or certification in software engineering concepts, plus 5+ years of applied experience
• Strong practical coding experience in one or more platform languages such as Python, Java, or Go, with a track record of delivering production-grade services or APIs
• Experience creating shared services, reusable modules, or platform capabilities used by multiple application or engineering teams
• Experience with infrastructure as code and cloud-native delivery practices, including Terraform, containers, Kubernetes, CI/CD pipelines, and automated deployment workflows
• Demonstrated experience leading the use of approved AI-assisted software development tools for coding, review, test acceleration, and troubleshooting, with clear standards for validating outputs for correctness, performance, and security
• Strong understanding of responsible AI practices in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resilience and security expectations; experience coaching engineers on safe, compliant adoption
• Hands-on experience with system design, application development, automated testing, debugging, and operational stability for production software
• Experience implementing observability, logging, metrics, alerts, service level objectives, incident response practices, and root-cause analysis for production services
• Working knowledge of software application development and technical processes, with depth in one or more areas such as cloud platforms, artificial intelligence, machine learning platforms, distributed systems, or infrastructure engineering
• Ability to break down technical requirements into executable engineering tasks, manage dependencies, and deliver against milestones with product and application teams
• Strong written and verbal communication skills, with the ability to explain technical decisions, trade-offs, issues, and risks to engineering teams and stakeholders
• Preferred experience supporting AI/ML or GenAI platform capabilities, including model hosting, inference services, model gateways, managed AI services, or developer-facing AI/ML infrastructure
• Preferred experience with GPU-enabled platforms or AI workload optimization, including inference latency, throughput, batching, capacity planning, or cost/performance tuning
• Preferred experience building reusable golden-path assets such as templates, reference implementations, SDKs, automated tests, onboarding guides, and deployment patterns
• Preferred familiarity with model serving patterns, rollout strategies, safety controls, authorization, rate limiting, policy enforcement, and evaluation hooks

• Partner with lines of business application teams to implement AI Foundation Services capabilities that unblock GenAI and AI use cases, supporting delivery from technical design through build, launch, and early operational support
• Build and improve reusable platform services, APIs, SDKs, and libraries that standardize how application teams consume model hosting, inference, and AI/ML managed services
• Translate functional and non-functional application requirements into technical designs, engineering tasks, and delivery milestones with support from senior engineers and architects
• Develop secure, stable, high-quality production code, and participate in code reviews, debugging, testing, and defect remediation across AI Foundation Services components
• Create and maintain reusable engineering assets such as reference implementations, runbooks, test harnesses, baseline configurations, and onboarding guides to speed adoption across teams
• Drive team adoption of enterprise-authorized AI-assisted engineering practices to improve code quality, delivery speed, and operational outcomes while promoting consistent validation standards and reuse of effective patterns
• Apply software development lifecycle tools, including enterprise-authorized AI-assisted development and automation capabilities, to increase the value delivered by automation
• Design and implement scalable software components using appropriate design patterns, cloud-native practices, and platform engineering standards
• Collaborate with cross-functional teams across product, architecture, security, infrastructure, and application development to resolve technical dependencies and deliver production-ready capabilities
• Contribute to technical methods, standards, documentation, and implementation patterns within AI Foundation Services to improve consistency, reliability, and reuse across delivery teams
• Communicate technical progress, risks, dependencies, and implementation options to engineering managers, product partners, and senior technical stakeholders

• AI
• CI/CD
• Cloud
• Support
• Java
• Kubernetes
• Machine Learning
• Marketing
• Model Serving
• Python
• Security
• Terraform

More:

We are collaborating with hackajob to connect with exceptional professionals for this Lead Software Engineer opportunity on JPMorganChases Chief Data & Analytics (AIML Data Platforms) team in Jersey City. In this role, we build AI foundation services for GenAI and machine learning at enterprise scale, with a focus on secure, reliable, cloud-native platform capabilities and close partnership with application teams. We are one of the oldest financial institutions, serving consumers, small businesses, and major corporate, institutional, and government clients under the J.P. Morgan and Chase brands, with more than 200 years of history and leadership across investment banking, consumer and small business banking, commercial banking, financial transaction processing, and asset management. We offer a competitive total rewards package, with base salary based on role, experience, skill set, and location, and eligible roles may include commission or discretionary incentive compensation. Our benefits may include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching, and more. We value diversity and inclusion, and we are an equal opportunity employer that provides reasonable accommodations for religious practices, beliefs, and mental health or physical disability needs. Our Corporate Functions team supports our business through areas such as finance, risk, human resources, and marketing, helping set our businesses, clients, customers, and employees up for success.

last updated 36 week of 2026