Lead Software Engineer, AI Platform Reliability

Salary: $61,000 - 101,000 per year Requirements:

• We require formal training or certification in software engineering concepts, plus 5+ years of applied experience.
• We need strong hands-on Python development experience, with a background in delivering production-grade services.
• We value demonstrated experience leading the effective use of approved AI-assisted software development tools, with the ability to set expectations for verifying correctness, performance, and security.
• We look for a strong understanding of responsible AI practices in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resiliency and security standards.
• We expect practical experience with system design, automated testing, debugging, and maintaining operational stability in production software.
• We require experience implementing observability, logging, metrics, alerts, service level objectives, incident response, and root-cause analysis for production services.
• We seek working knowledge of software development and technical processes, with depth in one or more areas such as cloud platforms, AI, machine learning platforms, distributed systems, or infrastructure engineering.
• We need the ability to break down technical requirements into actionable engineering tasks, manage dependencies, and deliver against milestones alongside product and application teams.
• We require strong written and verbal communication skills to explain technical decisions, trade-offs, issues, and risks to engineering teams and stakeholders.
• Preferred experience includes supporting AI/ML or generative AI platform capabilities such as model hosting, inference services, model gateways, managed AI services, or developer-facing AI/ML infrastructure.
• Preferred experience includes managing AI infrastructure on cloud platforms, including deployment, scaling, monitoring, and optimization of machine learning workloads.
• Preferred experience includes building reusable golden path assets such as templates, reference implementations, SDKs, automated tests, onboarding guides, and deployment patterns.
• Preferred experience includes developing generative AI applications or AI agents, and/or implementing AI-assisted operations with appropriate guardrails.

• We design and implement solutions that improve the reliability and scalability of AI/ML platforms and applications for rapidly growing demand.
• We develop secure, stable, high-quality production code and contribute to code reviews, debugging, testing, and defect remediation across AI Foundation Services components.
• We build and improve reusable platform services, APIs, SDKs, and libraries that standardize how application teams use model hosting, inference, and managed AI/ML services.
• We partner with application teams to implement AI Foundation Services capabilities that enable generative AI and other AI use cases, supporting delivery from technical design through build, launch, and early operational support.
• We own and evolve non-functional requirements and build tooling for observability, resilience, security controls, infrastructure management, and cost optimization.
• We establish and enforce standards and reference architectures for reliability, observability, automation, and operational readiness across services.
• We work with product and platform engineering teams to define and meet service reliability targets, including performance, availability, and recoverability.
• We take part in on-call rotations, troubleshoot and resolve complex production issues, identify systemic gaps, and drive lasting remediation.
• We mentor and guide engineers while raising the bar for engineering quality, documentation, and operational discipline.

• AI
• AI Agents
• Cloud
• Support
• Machine Learning
• Marketing
• Python
• Security

More:

hackajob is partnering with JPMorganChase to connect exceptional professionals with this opportunity. We are a Lead Software Engineer role within our AI/ML Data Platforms organization, on the Reliability Engineering team, where we focus on building trusted, market-leading technology products that improve the reliability and scalability of AI platforms. Our company has a history spanning over 200 years and serves consumers, small businesses, and major corporate, institutional, and government clients under the J.P. Morgan and Chase brands. We offer a competitive total rewards package, including base salary tied to role, experience, skill set, and location, with possible commission or discretionary incentive compensation for eligible roles. Our benefits and programs may include comprehensive health care, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value diversity and inclusion, provide reasonable accommodations where needed, and operate with a global workforce across Corporate Functions that supports finance, risk, human resources, marketing, and other essential business areas.

last updated 40 week of 2026