Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer III - AI/ML Deep Learning & GPU ML Serving

Testing Site - JPMC

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Banking team, you will be a key member of an agile team, designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across multiple technical areas, supporting the firm’s business objectives. Job Responsibilities Develop, test, and troubleshoot software solutions, applying creative approaches to solve technical challenges. Write secure, high-quality production code and maintain algorithms integrated with firm systems. Produce architecture and design artifacts for complex applications, ensuring alignment with design constraints. Analyze and visualize large, diverse data sets to drive continuous improvement of applications and systems. Identify and address hidden issues and patterns in data to enhance code quality and system architecture. Collaborate with software engineering communities to explore and adopt new technologies. Participate in system design and architecture discussions, focusing on reliability and scalability. Optimize deep learning models for production inference, including quantization and batching. Deploy and manage GPU workloads in Kubernetes environments. Build scalable, low-latency systems using web services and APIs. Partner with product and program management teams to deliver business-driven solutions. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 3+ years applied experience Professional software development experience, with emphasis on ML systems. Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar). Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP). Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server). Experience deploying and managing GPU workloads in Kubernetes. Familiarity with scalable, low-latency systems based on web services and APIs. Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access. Understanding of GPU resource management and cost optimization. Experience with modern microservices architecture. Ability to lead the design of large-scale systems and evaluate tradeoffs. Preferred qualifications, capabilities, and skills MS/PhD in Computer Science, Machine Learning, or a related field. Proficiency in Java Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX). Knowledge of GPU programming (CUDA) and performance optimization. Experience with model monitoring, A/B testing, and ML observability tools. Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker). Experience serving large-scale models and optimizing for performance.

FEDERAL DEPOSIT INSURANCE ACT:

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase's review of criminal conviction history, including pretrial diversions or program entries. #J-18808-Ljbffr Testing Site - JPMC

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer III - AI/ML Deep Learning & GPU ML Serving in Palo Alto, CA vacancy
  •  ...to take your software engineering career to the...  ...Software Engineer III at JPMorgan...  ...-authorized AI coding assist...  ...contributes learnings and reusable...  ...emphasis on ML systems. Hands...  ...or operating GPU workloads in...  ...to ML model serving frameworks (e...  ...III - AI/ML Deep Learning & GPU... 
    Suggested

    Aumni

    Palo Alto, CA
    2 days ago
  •  ...computing experiences—from AI and data centers, to...  ...looking for a senior software engineer who combines deep systems performance...  ...shape software from GPU kernels through...  ...Thrust, CUB, NCCL), and ML framework cores such...  ...experience optimizing deep learning and OSS LLM inference... 
    Suggested
    Shift work

    AMD

    Santa Clara, CA
    15 hours ago
  • $147k - $210k

     ...maintain machine learning models using advanced AI techniques to...  ...experience with software development in Python...  ...to solve engineering or scientific problems...  ...or specialized ML tools such as...  ...can train on and serve on every query.Google...  ...a culture of deep collaboration,... 
    Suggested

    Google

    Mountain View, CA
    1 day ago
  • $61k - $101k

     ...certification in software engineering concepts, with at...  ...particularly with machine learning systems Hands-...  ...-authorized AI-assisted development...  ...or operating GPU workloads in Kubernetes...  ...learning model-serving frameworks such as...  ...Software Engineer III for our Commercial... 
    Suggested
    Full time

    J.P. Morgan

    Palo Alto, CA
    1 day ago
  • $61k - $101k

     ...Requirements: Formal software engineering training or...  ...machine learning training in cloud...  ...workflows for ML codebases, including...  ...with deep learning training...  ...systems across CPU/GPU utilization, memory...  ...of approved AI-assisted...  ...financial institution serving consumers,... 
    Suggested
    Full time

    J.P. Morgan

    Palo Alto, CA
    3 days ago
  • $147k - $210k

    Analyze ML workloads, identify compute and memory bandwidth bottlenecks...  ....Optimize auxiliary serving and distributed data pipelines...  ...issues at all levels of the ML software stack.Experience with ML compilers...  ...passes.Google's software engineers develop the next-generation technologies... 

    Google

    Mountain View, CA
    15 hours ago
  • $147k - $210k

     ...., log analysis, machine learning, simulations, headroom analysis...  ...shopping ads by refining ML models, auction, ads...  ...in analytics.Google's software engineers develop the next-generation...  ...components of the Google Ads serving system. You will get deep insights into how... 

    Google

    Mountain View, CA
    4 days ago
  • JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology...  ..., develop, and deploy secure, scalable ML-powered software solutions, with...  ...on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong... 

    Testing Site - JPMC

    Palo Alto, CA
    1 day ago
  • $165.2k - $223.6k

     ...builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI...  ...Inferentia and Trainium ML accelerators. This...  ...boundary, our engineers build systematic infrastructure...  ...'s possible in AI acceleration.As...  ...offline inference serving with vLLM, SGLang,... 
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $207k - $300k

     ...while mentoring engineers in measurement best...  ...experience in software development.5...  ...experience leading ML design and...  ...Science, Machine Learning, or a quantitative...  ...Engineer with a deep background in machine...  ...data science to serve as a technical...  ...will evaluate AI Overviews for factual... 

    Google

    Mountain View, CA
    2 days ago
  • $207k - $300k

    Serve as the technical leader responsible...  ...infrastructure that powers our AI/ML applications. You...  ...creative data engines, generation and...  ...experiment and learning infrastructure to...  ...of experience in software development.5 years...  ...projects.Proficiency in deep learning... 

    Google

    Mountain View, CA
    15 hours ago
  • $147k - $210k

     ...systems models, utilize ML infrastructure, and...  ...technologies.Google's software engineers develop the next-generation...  ...is at the forefront of AI innovation, applying cutting-edge machine learning and Generative AI models...  ...We foster a culture of deep collaboration,... 

    Google

    Mountain View, CA
    4 days ago
  • $169k - $338k

     ...Home OfficeAI/ML & Agentic Systems...  ...agentic AI systems that can...  ...complex reliability engineering workflows, predictive...  ...machine learning, natural language...  ...tools that serve all Walmart engineering...  ...across teams.Deep experience...  ...hybrid systems and software engineers who... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    3 days ago
  • $272k - $431.25k

    We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will...  ...frameworks and paradigms.Dedication to ongoing learning and staying updated on new technologies and innovative... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $165.2k - $223.6k

     ...right moment. As AI models outgrow...  ...largest models can serve real users. That...  ...looking for an engineer to work at the...  ...difference, and you'll learn to measure...  ...level data-movement software that transfers...  ..., or GPU/accelerator systems...  ...welcome.Prior AI/ML experience is not... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $125k - $175k

     ...powered by advanced AI, recommendation...  ...a Machine Learning Infrastructure Engineer to help build the...  ...backbone that trains, serves, and monitors the...  ...work across the ML lifecycle: making...  ...Familiarity with software development processes...  ...with major Deep Learning frameworks... 
    Full time
    Work experience placement
    Local area
    Work from home

    NewsBreak

    Mountain View, CA
    20 days ago
  •  ...SRI Tech SolutionsJob Title: AI / ML engineerLocation: Sunnyvale,...  ...and experienced Senior Machine Learning Engineer / AI Solutions Architect with...  ...background in data science, deep learning, and cloud-based model...  ...using FastAPI or Flask to serve models and integrate them with... 
    Full time

    SRI Tech

    Sunnyvale, CA
    1 day ago
  • $193.3k - $261.5k

     ...builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on AWS...  .... Neuron includes an ML compiler, runtime, collectives...  ...shape the direction of AI acceleration technology....  ..., and collectives engineers to land it. You will translate... 
    Internship
    Local area
    Work from home
    Flexible hours
    Shift work

    Amazon

    Cupertino, CA
    1 day ago
  • $165.2k - $223.6k

     ...AWS Neuron SDK, the software development kit used to accelerate deep learning and GenAI workloads...  ...a wide range of ML models and model architectures...  ...boundary, our engineers build systematic...  ...what'spossible in AI acceleration.As part...  ...solutions that serve customers at scale.... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $160.36k - $240.54k

     ...opportunity for AI to drive positive...  ...Autonomy ML Infrastructure team...  ...components in machine learning model life cycle...  ...with autonomy engineers to optimize,...  ...robust, high-quality software to increase our...  ...and optimizing GPU ML compilers & runtimes...  ...experience deep learning... 
    Work experience placement
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $207k - $300k

     ...of novel machine learning models, incorporating...  ...techniques like deep learning, reinforcement...  ...-throughput Ad serving systems.Explore,...  ...of experience in software development.5 years...  ...Google's software engineers develop the next-generation...  ...the forefront of AI innovation,... 

    Google

    Mountain View, CA
    4 days ago
  • $207k - $300k

     ...LLM training and serving benchmarks; use...  ...opportunities, drive XLA:GPU/Triton...  ...LLMs and machine learning models on GPU hardware...  ...bottlenecks and engineer scalable...  ...of experience in software development.5 years...  ...experience with ML design and ML...  ...their deployment on AI accelerators.... 

    Google

    Sunnyvale, CA
    15 hours ago
  • $70 per hour

     ...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo'...  ..., decision-making and deep learning, while collaborating with...  ...scenario discovery and serve as structured memory for automated...  ...papers in top-tier AI/ML, data mining, or computer vision... 
    Hourly pay
    Full time
    Internship
    Summer internship
    Relocation package

    Waymo

    Mountain View, CA
    2 days ago
  • $207k - $300k

     ...aspects of machine learning infrastructure...  ...(training and serving) to support new...  ...and launching software products.5...  ...experience leading ML design and optimizing...  ...or PhD in Engineering, Computer...  ...the forefront of AI innovation, applying...  ...a culture of deep collaboration,... 
    Immediate start

    Google

    Mountain View, CA
    2 days ago
  • $193.3k - $261.5k

     ...the right moment. As AI models outgrow any...  ...largest models can serve real users. That...  ...'re looking for an engineer to work at the frontier...  ...data-movement software across accelerators...  ...is a plus.Prior AI/ML experience is welcome...  ...solutions that for Machine Learning (ML) and High-... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $174k - $252k

     ...maintaining, or launching software products, and 1 year of...  ...voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization...  ...job Google's software engineers develop the next-...  ...representative of the users we serve, creating a culture of... 

    Google

    Mountain View, CA
    4 days ago
  • $262k - $364k

     ...development of advanced AI-generated content...  ....Optimize ML inference and resolve...  ...bottlenecks to improve serving efficiency for low...  ...of experience in software development.7...  ...degree or PhD in Engineering, Computer Science,...  ...organizational machine learning strategies.Google'... 

    Google

    Mountain View, CA
    2 days ago
  • $98.35k - $115.7k

     ...and businesses we serve to make better and...  ...career. Try new things, learn new skills and...  ...maintenance of best in class software experiences. The...  ...and support ML workflows using frameworks...  ....Collaborate with engineers and product teams...  ..., test, and deploy AI-enabled solutions.... 
    Full time
    Work experience placement
    Local area
    3 days per week

    US Bank

    Cupertino, CA
    3 days ago
  • $177k - $270k

     ...City, CASoftware - Software Systems /Full-...  ...mission. The ML Platform team at...  ...understanding, learned planning and trajectories...  ...ML tools, deep learning frameworks...  ...of cutting-edge AI innovation. This...  ..., validation, serving, and monitoring...  ...researchers, software engineers, and data... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    15 hours ago
  • $120k - $195k

     ...scaling LinkedIn’s AI model training, feature engineering and serving with hundreds...  ...infra, compute software, and hardware...  ...the power of our GPU fleet with...  ...GNNs, Incremental Learning, Online Learning...  ...and optimize deep learning training...  ...of new ML models per quarter... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer III - AI/ML Deep Learning & GPU ML Serving. Be the first to apply!