Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer III- AI/ML Engineering, GPU ML Serving

Full-time

JP Morgan Chase

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Banking team, you will be a key member of an agile team, designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across multiple technical areas, supporting the firm’s business objectives.. Job responsibilitiesExecutes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problemsCreates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systemsLeverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code developmentGathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systemsProactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architectureRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and 3+ years applied experienceProfessional software development experience, with emphasis on ML systems.Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.Responsible for AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.Experience contributing to the design and development of scalable systems and services (e.g., web services, APIs)Proficiency in Python, including experience with ML frameworks (e.g., TensorFlow, PyTorch, or similar)Experience with cloud-native technologies (e.g., Docker, Kubernetes)Experience with one or more public cloud platforms (AWS, GCP)Experience with system design fundamentals (e.g., reliability, scalability, performance tradeoffs)Experience working with distributed systems concepts and microservices architecturesExperience with Cassandra or equivalent NoSQL databasesPreferred qualifications, capabilities, and skillsWorking knowledge of additional languages such as Java and/or C++Exposure to deploying or operating GPU workloads in Kubernetes environmentsExposure to ML model serving frameworks (e.g., TorchServe, TensorFlow Serving, Triton Inference Server)Familiarity with distributed training and inference systemsAwareness of model compression techniques and edge deployment conceptsFamiliarity with API management concepts, Domain-Driven Design (DDD) and working in Agile development environmentsFEDERAL DEPOSIT INSURANCE ACT:This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries. JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/VeteransJ.P. Morgan’s Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world. Full timePosting Date: 2026-09-04

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer III- AI/ML Engineering, GPU ML Serving in Palo Alto, CA vacancy
  • $61k - $101k

     ...certification in software engineering concepts, plus 3+...  ...a strong focus on ML systems. We need...  ...enterprise-authorized AI-assisted...  ...deploying or operating GPU workloads in Kubernetes...  ...to ML model serving frameworks such as...  ...Software Engineer III team within JPMorgan... 
    Suggested
    Full time

    J.P. Morgan

    Palo Alto, CA
    8 days ago
  • $275.8k - $340.5k

     ...About the team: The AV ML Infra team at GM builds ML infrastructure...  ...to meet the unique demands of AI and ML innovation, supporting...  ...the productivity of ML engineers, and drive the adoption of cutting...  ...Experience with model serving frameworks such as RayServe, vLLM... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Mountain View, CA
    9 days ago
  • $207k - $300k

     ...month Forward Deployed Engineer (FDE) embeds and 2-4-week...  ..., and high-throughput serving pipelines.Diagnose...  ...years of experience in software development.5 years of...  ...sequential decision making), ML infrastructure, or...  ...integrating generative AI tools or LLM interfaces... 
    Suggested
    Full time

    Google

    Mountain View, CA
    2 days ago
  •  ...build the next generation of AI: autonomous agents that can reason...  ...outcomes, while raising engineering and scientific standards across...  ...lifecycle management)Strong software engineering skills in modern...  ...computing patterns for training and serving, and with state management... 
    Suggested
    Full time

    JP Morgan Chase

    Palo Alto, CA
    4 days ago
  •  ...opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorganChase within the AI/ML data platform team you serve as a seasoned member of an agile...  ...training workloads (often GPU-based), improve performance and... 
    Suggested
    Full time

    JP Morgan Chase

    Palo Alto, CA
    2 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs,...  ...for a library enabling GPU and multicore operations powering...  ...-driven approach to surfacing engineering health Bug Detection & Reporting...  .... In-depth knowledge of software testing methodologies, frameworks... 
    Full time

    AMD

    Santa Clara, CA
    1 day ago
  •  ...computing experiences—from AI and data centers, to...  ...:We are hiring AI / ML Platform Engineers to build the platform...  ...artifact management, and GPU cluster utilization....  ..., and hardware/software tooling, and you can partner...  ...kernel benchmarking, model serving, or distributed... 
    Full time

    AMD

    Santa Clara, CA
    23 hours ago
  • $81.25 - $162.5 per hour

     ...Segment: Home OfficeAI/ML & Agentic Systems Technical...  ...advanced agentic AI systems that can autonomously...  ...complex reliability engineering workflows, predictive...  ...productivity tools that serve all Walmart engineering...  ...with hybrid systems and software engineers who take... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    1 day ago
  • $64.9 - $84.13 per hour

     ...enabling human life on Mars.SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING)The...  ...AI inference platform that serves the best models internally...  ...workloads, including low-level GPU kernel work, quantization,...  ...(aka green card holder), (iii) Refugee under 8 U.S.C. § 1... 
    Permanent employment
    Full time
    Temporary work
    Remote work
    Worldwide
    Weekend work

    SpaceX

    Palo Alto, CA
    3 days ago
  •  ...top-tier technology products. As a  Software Engineer III at JPMorgan Chase within the Consumer &...  ...expertise and effective communication ~ Serves as a function-wide subject matter...  ...Cycle ~ Leverages enterprise-authorized AI coding assist tools within the work environment... 

    JPMorgan Chase & Co.

    Palo Alto, CA
    2 days ago
  •  ...communications and collaboration software. We are fundamentally...  ...Artificial Intelligence ("AI") and Machine Learning ("ML") solutions. To succeed in...  ...teams (Product, Data, Engineering) to develop and implement...  ...large distributed systems serving millions of customers daily... 
    Full time
    Local area
    Remote work
    Flexible hours

    RingCentral

    Belmont, CA
    2 days ago
  • $170k - $185k

     ...on all continents. Our leading AI technology is the backbone of our award-winning enterprise software solutions, enabling our...  ...Description As a Senior AI/ML Engineer, you will design, develop, and...  ...Consultancy, we are proud to serve world-class customers all over... 
    Full time
    For contractors
    Flexible hours

    IFS

    Palo Alto, CA
    20 days ago
  •  ...GorusuCompany: SRI Tech SolutionsJob Title: AI / ML engineerLocation: Sunnyvale, CANOTE:...  ...and experienced Senior Machine Learning Engineer / AI Solutions Architect with over 7 years...  ...build REST APIs using FastAPI or Flask to serve models and integrate them with front-end... 
    Full time

    SRI Tech

    Sunnyvale, CA
    4 days ago
  • $130k - $150k

     ...all continents. Our leading AI technology is the backbone of...  ...our award-winning enterprise software solutions, enabling our customers...  ...truly international company serving people from around the globe,...  ...As a Software Engineer, AI/ML , you will design, build, and... 
    Full time
    For contractors
    Worldwide
    Flexible hours

    IFS

    Palo Alto, CA
    29 days ago
  • $98.35k - $115.7k

     ...journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the...  ...design, testing, development and maintenance of best in class software experiences. The candidate is a self-motivated individual who can... 
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    Cupertino, CA
    6 days ago
  • $98.35k - $115.7k

     ...journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the...  ...design, testing, development and maintenance of best in class software experiences. The candidate is a self-motivated individual who can... 
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    Cupertino, CA
    1 day ago
  • $91.01 - $154.18 per hour

     ...intuitive design, intelligent software, and next-generation safety and...  ...driving? Join the Embodied AI team at General Motors. Our team...  ...world scenarios.As a Staff AI/ML Future Sensing Engineer in the Embodied AI organization, you will serve as a senior individual contributor... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  •  ...builds Industrial AI for the world's leading...  ...state-of-the-art ML to large volumes of...  ..., fine-tuning, and serving them in large-scale...  ...a Senior/Staff AI Engineer, you will turn ML research...  ...AI Scientists, Software Engineers, and...  ...parallel training (multi-GPU/multi-node).... 
    Full time
    Shift work

    Gauss Labs

    Palo Alto, CA
    20 days ago
  • $165.2k - $223.6k

     ...~4 years of full software development life cycle...  ...~ Familiarity with ML frameworks such as...  ...Neuron, TPU, or other AI acceleration...  ...into open-source ML serving frameworks such as...  ...validation across CPU, GPU, simulator, and hardware...  ...serving engines with custom hardware... 
    Full time

    Annapurna Labs Inc.

    Cupertino, CA
    6 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs,...  ...is looking for an influential software engineer who is passionate about...  ...performance from the lowest-level GPU kernels to large-scale distributed...  ..., or the C++/HIP/CUDA core of ML frameworks like PyTorch,... 

    AMD

    Santa Clara, CA
    1 day ago
  • $165.2k - $223.6k

     ...team is looking for a Software Development Engineer to own the design and...  ...management, data movement, and serving integration.Our work...  ...kernels for a custom ML accelerator...  ...validation across CPU, GPU, simulator, and hardware...  ...Neuron, TPU or other AI acceleration hardware-... 
    Full time
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  •  ...Description Accellor is an AI-native services firm...  ...advanced AI, data, and engineering capabilities. Our mission...  ...inference runtime, model serving, GPU infrastructure,...  ...years of experience in software engineering, systems architecture, ML infrastructure, distributed... 

    Accellor

    Mountain View, CA
    27 days ago
  • $147k - $210k

    Design and build scalable ML infrastructure for Ember’s 0-to-...  ...Managers, UX, and cross-functional engineering teams to define technical...  ....2 years of experience with software development in Python and C++...  ...Google Images, a platform serving over a billion daily interactions... 
    Full time
    Worldwide

    Google

    Mountain View, CA
    1 day ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for...  ...high-performance GPU infrastructure across AI/ML, visual effects,...  ...inference. Our stack is engineered for speed, scale...  ...-scale model serving—squeezing...  ...GPU/accelerator software, or performance-...  ...card holder), (iii) refugee under 8... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    5 days ago
  •  ...applications for digital humans, health and AI. In this role, you will work closely with...  ...with Multimodal GenAI researchers and engineers to develop world-class audio-video perception...  ...-time systems within a large production software stack. Deep understanding of machine... 

    Socket

    Sunnyvale, CA
    23 hours ago
  • $144.7k - $261.3k

     ...environments, cloud infrastructure, and ML/AI GPU platforms for AV research and development...  ...GM is looking for a Senior Performance Engineer to join the AV Capacity and Performance...  ...or equivalent practical experience. Software Proficiency: Expert-level coding skills... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours
    3 days per week

    General Motors

    Sunnyvale, CA
    3 days ago
  •  ...About the Role We are seeking a Senior Data / AI / ML Software Engineer with 7+ years of experience building data-intensive systems. This role is ideal for someone who enjoys designing and improving core platform components at the intersection of software engineering,... 
    Full time
    Contract work
    Internship

    Next Ventures

    Palo Alto, CA
    9 hours ago
  • $150.4k - $277.6k

     ...California, United States Machine Learning and AI The Video Computer Vision organization...  ...with Multimodal GenAI researchers and engineers to develop world-class audio-video...  ...real-time systems within a large production software stack. Deep understanding of machine learning... 
    Relocation

    Apple

    Sunnyvale, CA
    3 days ago
  • $61k - $101k

     ...training or certification in software engineering concepts, along with 5+...  ...a particular focus on ML systems. We need...  ...enterprise-authorized AI-assisted development tools...  ...DDD Java Model Serving More: We are...  ...As a Software Engineer III within our Commercial and... 
    Full time

    J.P. Morgan

    Palo Alto, CA
    10 days ago
  • $207k - $300k

     ...systems at scale.Drive AI Innovation: Pioneer the...  ...Compute: Lead training and serving optimization strategies, maximizing TPU/GPU cluster utilization with...  ...C++).Manage and Mentor Engineers: Lead and grow a high-performing team of ML and software engineers, providing technical... 
    Full time

    Google

    Mountain View, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer III- AI/ML Engineering, GPU ML Serving. Be the first to apply!