Software Engineer, AI/ML & GPU Serving

Salary: $61,000 - 101,000 per year Requirements:

• Formal training or certification in software engineering concepts, with at least 3 years of applied experience
• Professional software development experience, particularly with machine learning systems
• Hands-on experience with enterprise-authorized AI-assisted development tools, including critically evaluating and validating generated outputs for correctness, performance, and security
• Ability to use AI responsibly in engineering workflows, protect sensitive data, handle inputs and outputs securely, follow resiliency and security expectations, and guide peers in safe practices
• Experience designing and developing scalable systems and services, such as web services or APIs
• Proficiency in Python and experience with machine learning frameworks such as TensorFlow or PyTorch
• Experience with cloud-native technologies such as Docker and Kubernetes
• Experience with a public cloud platform such as AWS or GCP
• Knowledge of system design fundamentals, including reliability, scalability, and performance trade-offs
• Experience with distributed systems and microservices architectures
• Experience with Cassandra or an equivalent NoSQL database
• Preferred: Working knowledge of additional languages such as Java or C++
• Preferred: Exposure to deploying or operating GPU workloads in Kubernetes environments
• Preferred: Exposure to machine learning model-serving frameworks such as TorchServe, TensorFlow Serving, or Triton Inference Server
• Preferred: Familiarity with distributed training and inference systems
• Preferred: Awareness of model compression techniques and edge deployment concepts
• Preferred: Familiarity with API management, Domain-Driven Design, and Agile development environments

• Design, develop, and troubleshoot software solutions, applying creative approaches to resolve complex technical problems
• Build secure, high-quality production code and maintain algorithms that operate in coordination with relevant systems
• Use authorized AI coding tools to improve code quality, delivery speed, and productivity; validate their outputs through peer review, automated testing, and secure coding practices, and share reusable learnings with the team
• Apply Software Development Life Cycle tools, including authorized AI-assisted development and automation capabilities, to improve automation outcomes
• Produce architecture and design artifacts for complex applications and ensure software implementation meets design constraints
• Analyze large and varied datasets, creating visualizations and reports to support ongoing improvements to applications and systems
• Identify underlying issues and patterns in data and use insights to improve coding practices and system architecture

• AI
• API
• AWS
• Cloud
• Cassandra
• Docker
• GCP
• Support
• Java
• Kubernetes
• Machine Learning
• NoSQL
• PyTorch
• Python
• Security
• TensorFlow
• Web
• microservices
• DDD
• Model Serving

More:

We are recruiting a Software Engineer III for our Commercial and Investment Banking team, where you will help build secure, stable, and scalable technology products as part of an agile team. J.P. Morgan Chase is a longstanding financial institution serving consumers, businesses, and public-sector and institutional clients, with operations spanning investment, commercial and consumer banking, payments, and asset management. Our Commercial & Investment Bank serves clients in more than 100 countries across banking, markets, securities services, and payments. We offer competitive compensation and, for eligible roles, incentive pay and benefits that may include health coverage, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value diversity and inclusion, provide reasonable accommodations, and are an equal opportunity employer. This role is subject to applicable Section 19 requirements, including a review of criminal conviction history as described in the posting.

last updated 42 week of 2026