Senior AI Platform Engineer

Salary: $61,000 - 101,000 per year Requirements:

• We require formal training or certification in software engineering concepts, along with 5+ years of applied experience.
• We need hands-on experience in system design, application development, testing, and operational stability.
• We value strong experience with Kubernetes and containerization, including cluster operations and production troubleshooting.
• We need proficiency in at least one programming language such as Python, Go, Java, or C#.
• You should be able to solve design and functionality issues independently with minimal oversight.
• We require strong knowledge of cloud delivery models such as IaaS, PaaS, and SaaS, as well as public, private, and hybrid deployment models.
• You should have a foundational understanding of machine learning concepts, including transformer architecture, training, and inference.
• We require experience with Infrastructure as Code.
• You should have a deep understanding of cloud component architecture, including microservices, storage, security, and routing/switching technologies.
• We need demonstrated experience leading the effective use of enterprise-authorized AI-assisted software development tools, with the ability to set expectations for validating outputs for correctness, performance, and security.
• We require a strong understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and adherence to resiliency and security expectations.
• Preferred: foundational understanding of NVIDIA GPU infrastructure software such as DCGM, BCM, and Dynamo Inference.
• Preferred: proficiency with observability tools like Prometheus and Grafana.
• Preferred: experience in MLOps and related tooling, including MLflow.
• Preferred: background in high-performance computing and ML frameworks such as vLLM, Ray.io, and Slurm.
• Preferred: strong knowledge of network architecture, database programming (SQL/NoSQL), and data modeling.
• Preferred: familiarity with cloud data services, big data processing tools, and Linux environments.

• We provide technical guidance aligned to business goals while collaborating with engineers, contractors, and vendors.
• We develop secure, high-quality production code and review, debug, and improve code written by others.
• We influence product design, application functionality, and technical operations through informed decisions.
• We champion firmwide SDLC frameworks, tools, and best practices.
• We promote a culture of diversity, equity, inclusion, and respect.
• We architect and deploy secure, scalable cloud platforms optimized for AI and ML workloads.
• We partner with AI teams to translate compute needs into infrastructure requirements.
• We monitor, manage, and optimize cloud resources for performance and cost efficiency.
• We build CI/CD pipelines, automation, and infrastructure-as-code to streamline ML deployment and operations.
• We drive adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes.
• We apply knowledge of tools within the SDLC toolchain, including approved AI-assisted development and automation capabilities, to increase the value delivered by automation at scale.

• AI
• Architect
• Big Data
• C#
• CI/CD
• Cloud
• Grafana
• IaaS
• Support
• Java
• Kubernetes
• Linux
• Machine Learning
• Marketing
• MLflow
• MLOps
• Network
• NoSQL
• PaaS
• Prometheus
• Python
• SQL
• Security
• microservices
• vLLM
• Docker

More:

hackajob is collaborating with J.P. Morgan to connect them with exceptional professionals for this role. We are seeking a Senior Lead Software Engineer within JPMorgan Chases Corporate Sector, Infrastructure Platforms team. You will join an agile group focused on enhancing and delivering trusted, market-leading technology products in a secure, stable, and scalable way, with the opportunity to make a significant business impact. JPMorganChase is one of the oldest financial institutions, serving consumers, small businesses, and some of the worlds largest corporate, institutional, and government clients through the J.P. Morgan and Chase brands. With over 200 years of history, we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing, and asset management. We offer a competitive total rewards package, with salary based on role, experience, skill set, and location, plus potential commission or discretionary incentive compensation in eligible roles. Our benefits may include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching, and more, subject to eligibility. We are committed to diversity and inclusion, provide reasonable accommodations where needed, and operate within our Corporate Functions team, which supports finance, risk, human resources, marketing, and other essential business areas.

last updated 41 week of 2026