Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer III- AI/ML Engineering, GPU ML Serving

JP Morgan Chase

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Banking team, you will be a key member of an agile team, designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across multiple technical areas, supporting the firm’s business objectives.. Job responsibilitiesExecutes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problemsCreates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systemsLeverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code developmentGathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systemsProactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architectureRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and 3+ years applied experienceProfessional software development experience, with emphasis on ML systems.Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.Responsible for AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.Experience contributing to the design and development of scalable systems and services (e.g., web services, APIs)Proficiency in Python, including experience with ML frameworks (e.g., TensorFlow, PyTorch, or similar)Experience with cloud-native technologies (e.g., Docker, Kubernetes)Experience with one or more public cloud platforms (AWS, GCP)Experience with system design fundamentals (e.g., reliability, scalability, performance tradeoffs)Experience working with distributed systems concepts and microservices architecturesExperience with Cassandra or equivalent NoSQL databasesPreferred qualifications, capabilities, and skillsWorking knowledge of additional languages such as Java and/or C++Exposure to deploying or operating GPU workloads in Kubernetes environmentsExposure to ML model serving frameworks (e.g., TorchServe, TensorFlow Serving, Triton Inference Server)Familiarity with distributed training and inference systemsAwareness of model compression techniques and edge deployment conceptsFamiliarity with API management concepts, Domain-Driven Design (DDD) and working in Agile development environmentsFEDERAL DEPOSIT INSURANCE ACT:This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries. JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/VeteransJ.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world. Full timePosting Date: 2026-09-04

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer III- AI/ML Engineering, GPU ML Serving in Palo Alto, CA vacancy
  •  ...JPMorgan Chase is seeking a Software Engineer III to join the Commercial & Investment Banking team. You will...  ...products, leveraging enterprise AI tools to improve code quality and delivery speed. The role focuses on ML systems, distributed architectures, APIs,... 
    Suggested

    Jobleads-US

    Palo Alto, CA
    4 days ago
  • $98.35k - $115.7k

     ...customers and businesses we serve to make better and...  ...maintenance of best in class software experiences. The...  ...ServicesBuild and support ML workflows using...  ...XGBoost.Collaborate with engineers and product teams to design...  ...develop, test, and deploy AI-enabled solutions.... 
    Suggested
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    Cupertino, CA
    16 hours ago
  • $61k - $101k

     ...certification in software engineering concepts, plus 3+...  ...a strong focus on ML systems. We need...  ...enterprise-authorized AI-assisted...  ...deploying or operating GPU workloads in Kubernetes...  ...to ML model serving frameworks such as...  ...Software Engineer III team within JPMorgan... 
    Suggested
    Full time

    J.P. Morgan

    Palo Alto, CA
    11 days ago
  • $207k - $300k

    Serve as the technical leader responsible for architecting, scaling...  ...that powers our AI/ML applications. You will operate...  ...infrastructure, including creative data engines, generation and rendering pipelines...  ....8 years of experience in software development.5 years of experience... 
    Suggested

    Google

    Mountain View, CA
    1 day ago
  •  ...build the next generation of AI: autonomous agents that can reason...  ...outcomes, while raising engineering and scientific standards across...  ...lifecycle management)Strong software engineering skills in modern...  ...computing patterns for training and serving, and with state management... 
    Suggested

    JP Morgan Chase

    Palo Alto, CA
    3 days ago
  •  ...opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorganChase within the AI/ML data platform team you serve as a seasoned member of an agile...  ...training workloads (often GPU-based), improve performance and... 

    JP Morgan Chase

    Palo Alto, CA
    1 day ago
  •  ...scientific discovery to powering AI and the technologies people rely...  ...ROLE: We are looking for a talented engineer to join our team: developing heterogeneous software for computer vision, image/video...  ...: Design, develop, and optimize GPU/CPU software for computer vision,... 

    AMD

    Santa Clara, CA
    2 days ago
  •  ...enabling human life on Mars.SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)The...  ...AI inference platform that serves the best models internally...  ...workloads, including low-level GPU kernel work, quantization,...  ...(aka green card holder), (iii) Refugee under 8 U.S.C. § 1... 
    Permanent employment
    Temporary work
    Remote work
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    2 days ago
  • $169k - $338k

     ...Segment: Home OfficeAI/ML & Agentic Systems Technical...  ...advanced agentic AI systems that can autonomously...  ...complex reliability engineering workflows, predictive...  ...productivity tools that serve all Walmart engineering...  ...with hybrid systems and software engineers who take... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    16 hours ago
  •  ...computing experiences—from AI and data centers, to...  ...:We are hiring AI / ML Platform Engineers to build the platform...  ...artifact management, and GPU cluster utilization....  ..., and hardware/software tooling, and you can partner...  ...kernel benchmarking, model serving, or distributed... 

    AMD

    Santa Clara, CA
    4 days ago
  •  ...Motors is seeking a Senior Performance Engineer to join the AV Capacity and...  ...help develop and optimize large-scale ML infrastructure and GPU platforms for autonomous-vehicle research...  ...and cross-functional collaboration with AI/ML research, infrastructure engineering... 

    Jobleads-US

    Sunnyvale, CA
    4 days ago
  •  ...Google LLC in Mountain View, CA is hiring a Software Engineer III in AI/ML for Omni-channel Shopping Ads Quality. You will contribute to the ads quality stack, study interdependent components, and help deliver reliable, scalable experiences for users and advertisers.... 

    Jobleads-US

    Mountain View, CA
    1 day ago
  •  ...Aug 20, 2026 Mid-Level to Senior | Engineering & Platform Ops US-based — CA preferred,...  ...processing billions of repair orders and serving live search at sub-second latency. We...  ...automotive skin. THE VIBE We need a AI/ML Infrastructure Engineer who wants more... 
    Part time
    Remote work

    Jobleads-US

    Palo Alto, CA
    3 days ago
  • $275.8k - $340.5k

     ...About the team: The AV ML Infra team at GM builds ML infrastructure...  ...to meet the unique demands of AI and ML innovation, supporting...  ...the productivity of ML engineers, and drive the adoption of cutting...  ...Experience with model serving frameworks such as RayServe, vLLM... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Mountain View, CA
    5 days ago
  •  ...top-tier technology products. As a Software Engineer III at JPMorgan Chase within the Consumer &...  ...expertise and effective communication Serves as a function-wide subject matter...  ...Cycle Leverages enterprise-authorized AI coding assist tools within the work environment... 

    Talentify.io

    Palo Alto, CA
    3 days ago
  •  ...Title: Software Engineer III Location: Menlo Park, CA (Hybrid) Duration: 12 Months Pay: $9...  ...personalization Email marketing with ML propensity and personalization layers...  ...platform background; dashboarding and self-serve tooling for non-engineers... 

    Tailored Management

    Menlo Park, CA
    2 days ago
  • $137.75k - $185k

     ...technology products. As a Software Engineer III at JPMorganChase within the...  ...and governance of approved AI-assisted engineering...  ...operations and processes Serves as a function-wide subject matter...  ...problems Understanding in common ML tools and frameworks such... 
    For contractors

    JPMorgan Chase Bank, N.A.

    Palo Alto, CA
    1 day ago
  •  ...Meta is seeking a Software Engineer, SystemML - AI Networking to join the AI Networking Software team within the DC...  ...own the NCCL-based stack that enables multi-GPU and multi-node communication, integral to Meta's distributed ML workloads and tightly integrated with PyTorch... 

    Jobleads-US

    Menlo Park, CA
    1 day ago
  •  ...GorusuCompany: SRI Tech SolutionsJob Title: AI / ML engineerLocation: Sunnyvale, CANOTE:...  ...and experienced Senior Machine Learning Engineer / AI Solutions Architect with over 7 years...  ...build REST APIs using FastAPI or Flask to serve models and integrate them with front-end... 
    Full time

    SRI Tech

    Sunnyvale, CA
    3 days ago
  •  ...Software Engineer III, AI/ML, Omni-channel Shopping Ads Quality Share Software Engineer III, AI/ML, Omni-channel Shopping Ads Quality corporate...  ...to learn and improve key components of the Google Ads serving system. You will get deep insights into how different interconnected... 

    Jobleads-US

    Mountain View, CA
    1 day ago
  • $147k - $210k

     ...Software Engineer III, AI/ML, Search Ads Bidding Share Software Engineer III, AI/ML, Search Ads Bidding corporate_fare Google place Mountain...  ...quality and low latency code/models that can train on and serve on every query. About the job Google's software... 

    Jobleads-US

    Mountain View, CA
    4 days ago
  •  ...notch technology products. As a Software Engineer III at JPMorganChase within the...  ...and governance of approved AI-assisted engineering practices...  ...operations and processes Serves as a function-wide subject matter...  ...Understanding in common ML tools and frameworks such Python... 
    For contractors

    Jobleads-US

    Palo Alto, CA
    1 day ago
  •  ...JPMorganChase is seeking a Software Engineer III to design and operate an end-to-end ML training platform on AWS and other clouds. You will run GPU workloads, optimize performance, and enable Gen AI workflows within a governed, secure environment. You will collaborate... 

    Jobleads-US

    Palo Alto, CA
    4 days ago
  • $189.3k - $320.7k

     ...intuitive design, intelligent software, and next-generation safety and...  ...driving? Join the Embodied AI team at General Motors. Our team...  ...world scenarios.As a Staff AI/ML Future Sensing Engineer in the Embodied AI organization, you will serve as a senior individual contributor... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  •  ...Full-Stack AI & ML Engineer - Build the AI Infrastructure Behind a Growing Investment Firm and our Portfolio Companies The opportunity...  ...data assets and the infrastructure to collect, structure, and serve them LLM-powered tools that reason with real business context... 

    Tide Rock

    Santa Clara, CA
    16 hours ago
  • $130k - $150k

     ...AI/Machine Learning Engineer - Python - Loops IFS is a billion-dollar revenue company...  ...award-winning enterprise software solutions, enabling our...  ...truly international company serving people from around the globe...  ...As a Software Engineer, AI/ML, you will design, build,... 
    For contractors
    Worldwide
    Flexible hours

    IFS

    Palo Alto, CA
    4 days ago
  • $165.2k - $223.6k

     ...team is looking for a Software Development Engineer to own the design and...  ...management, data movement, and serving integration.Our work...  ...kernels for a custom ML accelerator...  ...validation across CPU, GPU, simulator, and hardware...  ...Neuron, TPU or other AI acceleration hardware-... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  •  ...Job Overview: LiveX AI is building the next...  ...strong Machine Learning Engineer to help us train, fine‑tune, and serve the generative...  ...deployment infrastructure on GPU clusters (PyTorch,...  ...+ years of hands‑on ML engineering...  ...pipelines. ~ Solid software engineering fundamentals... 

    LiveX AI Inc.

    Palo Alto, CA
    1 day ago
  •  ...Google LLC in Mountain View, CA is seeking a Software Engineer III for AI/ML in Search Ads Bidding. You will design, implement, and optimize large-scale models that predict user value and maximize advertiser ROI. The role covers end-to-end ML lifecycle, from data processing... 

    Jobleads-US

    Mountain View, CA
    4 days ago
  • $147k - $210k

     ...Google LLC in Mountain View, CA is seeking a Software Engineer III for AI/ML in Recommendations, Rankings, and Predictions across Google Ads. You will work on large-scale systems, contribute to retrieval, ranking, and personalization models, and collaborate with research... 

    Jobleads-US

    Mountain View, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer III- AI/ML Engineering, GPU ML Serving. Be the first to apply!