Software Engineer - AI/ML GPU Serving

Salary: $61,000 - 101,000 per year Requirements:

• We need formal training or certification in software engineering concepts, plus 3+ years of applied experience.
• We need professional software development experience, with a strong focus on ML systems.
• We need hands-on experience using enterprise-authorized AI-assisted development tools in the work environment for coding, testing, troubleshooting, or documentation, along with the ability to review, validate, and refine AI-generated output for correctness, performance, and security.
• We need responsible AI usage practices in engineering workflows, including sensitivity awareness, secure handling of inputs and outputs, and adherence to resiliency and security expectations, with the ability to guide peers on safe usage.
• We need experience contributing to the design and build of scalable systems and services such as web services and APIs.
• We need proficiency in Python, including experience with ML frameworks such as TensorFlow, PyTorch, or similar.
• We need experience with cloud-native technologies such as Docker and Kubernetes.
• We need experience with one or more public cloud platforms, such as AWS or GCP.
• We need a solid understanding of system design fundamentals, including reliability, scalability, and performance trade-offs.
• We need experience working with distributed systems concepts and microservices architectures.
• We need experience with Cassandra or a comparable NoSQL database.
• Preferred: working knowledge of additional languages such as Java and/or C++.
• Preferred: exposure to deploying or operating GPU workloads in Kubernetes environments.
• Preferred: exposure to ML model serving frameworks such as TorchServe, TensorFlow Serving, or Triton Inference Server.
• Preferred: familiarity with distributed training and inference systems.
• Preferred: awareness of model compression techniques and edge deployment concepts.
• Preferred: familiarity with API management concepts, Domain-Driven Design (DDD), and Agile development environments.

• We execute software solutions, including design, development, and technical troubleshooting, while taking a creative approach to solving complex technical problems.
• We create secure, high-quality production code and maintain algorithms that run synchronously with the relevant systems.
• We use enterprise-authorized AI coding assistance tools to improve code quality, delivery speed, and productivity across complex work, while validating results through peer review, automated testing, and secure coding standards and sharing reusable learnings with the team.
• We apply knowledge of Software Development Life Cycle tools, including enterprise-authorized AI-assisted development and automation capabilities, to increase the value delivered by automation.
• We produce architecture and design artifacts for complex applications and ensure software code meets design constraints.
• We gather, analyze, synthesize, and visualize large, diverse data sets to support continuous improvement of software applications and systems.
• We proactively identify hidden issues and patterns in data and use those insights to improve coding hygiene and system architecture.

• AI
• API
• AWS
• Cloud
• Cassandra
• DDD
• Docker
• GCP
• Support
• Java
• Kubernetes
• Model Serving
• NoSQL
• PyTorch
• Python
• Security
• TensorFlow
• Web
• microservices

More:

We are collaborating with hackajob to connect with exceptional professionals for this opportunity. We offer an exciting role on our Software Engineer III team within JPMorgan Chases Commercial and Investment Banking business, where we design and deliver secure, stable, and scalable technology products in an agile environment. Our company is one of the oldest financial institutions, serving consumers, small businesses, and major corporate, institutional, and government clients around the world under the J.P. Morgan and Chase brands. We provide a competitive total rewards package, with base salary based on role, experience, skill set, and location, and eligible roles may include commission or discretionary incentive compensation. Our benefits can include comprehensive health care, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, financial coaching, and more. We value diversity and inclusion, offer reasonable accommodations where needed, and operate as an equal opportunity employer. Our Commercial & Investment Bank is a global leader across banking, markets, securities services, and payments, serving organizations in more than 100 countries.

last updated 37 week of 2026