Senior Lead Software Engineer, Inference Platform

Salary: $61,000 - 101,000 per year Requirements:

• Formal training or certification in software engineering concepts, with at least five years of applied experience
• Hands-on experience with system design, application development, testing, and operational stability
• Strong experience with Kubernetes and Docker, including cluster operations and production troubleshooting
• Proficiency in at least one programming language, such as Python, Go, Java, or C#
• Ability to independently solve design and functionality problems with minimal oversight
• Strong knowledge of cloud delivery models (IaaS, PaaS, SaaS) and deployment models (public, private, hybrid)
• Foundational knowledge of machine learning concepts, including transformer architecture, training, and inference
• Experience with infrastructure as code
• Deep understanding of cloud architecture, including microservices, IaaS, storage, security, and routing and switching technologies
• Experience leading the effective use of enterprise-authorized AI-assisted software development tools, and setting team expectations for validating AI outputs for correctness, performance, and security
• Strong understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and security and resiliency expectations; experience coaching senior engineers or leads on compliant practices and controls
• Preferred: Foundational knowledge of NVIDIA GPU infrastructure software, such as DCGM, BCM, or Dynamo Inference
• Preferred: Proficiency with observability tools such as Prometheus and Grafana
• Preferred: Experience with MLOps and related tools, including MLflow
• Preferred: Experience building and scaling high-performance LLM inference platforms using vLLM and GPU/CPU serving optimization for low-latency, high-throughput production model serving

• Provide technical guidance aligned with business goals and collaborate with engineers, contractors, and vendors
• Develop secure, high-quality production code and review, debug, and improve code written by others
• Influence product design, application functionality, and technical operations through informed decisions
• Champion firmwide software development lifecycle frameworks, tools, and best practices
• Foster diversity, opportunity, inclusion, and respect
• Architect and deploy secure, scalable cloud platforms optimized for AI and machine learning workloads
• Work with AI teams to translate compute needs into infrastructure requirements
• Monitor, manage, and optimize cloud resources for performance and cost efficiency
• Build CI/CD pipelines, automation, and infrastructure-as-code solutions to streamline machine learning deployment and operations
• Drive adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes, including code review, refactoring, testing, release readiness, and incident analysis
• Establish measurable validation standards for secure coding, peer review, and automated testing, and encourage reuse of proven patterns and automation across the SDLC/TLM toolchain
• Apply knowledge of software development lifecycle tools, including approved AI-assisted development and automation capabilities, to increase the value of automation at scale

• AI
• Architect
• C#
• CI/CD
• Cloud
• Docker
• Grafana
• IaaS
• Support
• Java
• Kubernetes
• LLM
• Machine Learning
• Marketing
• MLflow
• MLOps
• PaaS
• Prometheus
• Python
• Security
• microservices
• vLLM
• Model Serving

More:

We are hiring a Senior Lead Software Engineer for our Corporate Sector Infrastructure Platforms team. You will be part of an agile team building and delivering trusted technology products in a secure, stable, and scalable way, with opportunities to make significant business contributions and address challenges across technologies and applications. We are one of the worlds oldest financial institutions, serving consumers, small businesses, and corporate, institutional, and government clients through the J.P. Morgan and Chase brands. Our Corporate Functions professionals work across areas such as finance, risk, human resources, and marketing to support our businesses, clients, customers, and employees. We offer a competitive total rewards package, with base salary determined by role, experience, skills, and location; eligible roles may also receive commission-based pay or discretionary incentives. Benefits for eligible employees include health care, on-site wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We are an equal opportunity employer, value diversity and inclusion, and provide reasonable accommodations for religious practices and disabilities.

last updated 42 week of 2026