Senior Lead Software Engineer - Inference Platform

Salary: $61,000 - 101,000 per year Requirements:

• We require formal training or certification in software engineering concepts, along with 5+ years of applied experience.
• We need hands-on experience in system design, application development, testing, and operational stability.
• We require strong Kubernetes and containerization expertise, including Docker, cluster administration, and production troubleshooting.
• We need proficiency in at least one programming language such as Python, Go, Java, or C#.
• You should be able to solve design and functionality issues independently with minimal oversight.
• We require strong knowledge of cloud delivery models such as IaaS, PaaS, and SaaS, as well as public, private, and hybrid deployment models.
• We need a foundational understanding of machine learning concepts, including transformer architecture, training, and inference.
• We require experience with Infrastructure as Code.
• We need a deep understanding of cloud architecture components, including microservices, storage, security, and routing/switching technologies.
• We require demonstrated experience leading the effective use of enterprise-approved AI-assisted software development tools, with the ability to set expectations for validating outputs for correctness, performance, and security.
• We need a strong understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resiliency and security expectations.
• We value experience coaching senior engineers and leads on compliant AI usage patterns and controls.
• Preferred: foundational understanding of NVIDIA GPU infrastructure software such as DCGM, BCM, and Dynamo Inference.
• Preferred: proficiency with observability tools such as Prometheus and Grafana.
• Preferred: experience in MLOps and related tooling, including MLflow.
• Preferred: experience building and scaling a high-performance LLM inference platform using vLLM and GPU/CPU serving optimization for low-latency, high-throughput production model serving.

• We provide technical direction aligned with business goals while collaborating with engineers, contractors, and vendors.
• We develop secure, high-quality production code, and review, debug, and improve code written by others.
• We influence product design, application functionality, and technical operations through well-informed decisions.
• We champion firmwide SDLC frameworks, tools, and best practices.
• We promote a culture of diversity, opportunity, inclusion, and respect.
• We architect and deploy secure, scalable cloud platforms optimized for AI and ML workloads.
• We partner with AI teams to translate compute requirements into infrastructure needs.
• We monitor, manage, and optimize cloud resources for performance and cost efficiency.
• We build CI/CD pipelines, automation, and infrastructure-as-code to streamline ML deployment and operations.
• We drive the adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes.
• We establish measurable validation standards, including secure coding, peer review, automated testing, and reuse of proven patterns and automation within the SDLC/TLM toolchain.
• We apply knowledge of tools in the software development life cycle toolchain, including approved AI-assisted development and automation capabilities, to increase the value delivered through automation at scale.

• AI
• Architect
• C#
• CI/CD
• Cloud
• Docker
• Grafana
• IaaS
• Support
• Java
• Kubernetes
• LLM
• Machine Learning
• Marketing
• MLflow
• MLOps
• Model Serving
• PaaS
• Prometheus
• Python
• Security
• microservices
• vLLM

More:

hackajob is collaborating with J.P. Morgan to connect them with exceptional professionals for this role. We are hiring for a Senior Lead Software Engineer position within our Corporate Sector, Infrastructure Platforms team. In this role, you will work as part of an agile team delivering trusted, market-leading technology products in a secure, stable, and scalable way. We offer a competitive total rewards package, with base salary based on role, experience, skill set, and location, and eligible roles may include commission or discretionary incentive compensation. Our benefits can include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching, and more. We are a global financial institution with over 200 years of history, serving consumers, small businesses, and major corporate, institutional, and government clients. Our Corporate Functions team spans finance, risk, human resources, and marketing, and plays an essential role in helping our businesses, clients, customers, and employees succeed. We are committed to diversity, inclusion, and equal opportunity.

last updated 36 week of 2026