Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving

Testing Site - JPMC

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Banking team, you will play a pivotal role in an agile team, enhancing and delivering secure, stable, and scalable technology products. As a core technical contributor, you will drive critical technology solutions across multiple technical areas, supporting the firm’s business objectives. Job Responsibilities Lead the design, development, and troubleshooting of software solutions, applying innovative approaches to complex technical challenges. Write secure, high-quality production code and maintain algorithms integrated with firm systems. Produce architecture and design artifacts for advanced applications, ensuring compliance with design constraints. Analyze and visualize large, diverse data sets to improve software applications and systems. Identify and resolve hidden issues and patterns in data to enhance code quality and system architecture. Collaborate with software engineering communities to explore and adopt emerging technologies. Guide system design and architecture discussions, focusing on reliability and scalability. Optimize deep learning models for production inference, including quantization and batching. Deploy and manage GPU workloads in Kubernetes environments. Build scalable, low-latency systems using web services and APIs. Partner with product and program management teams to deliver business-driven solutions. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 5+ years applied experience Professional software development experience, with emphasis on ML systems. Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar). Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP). Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server). Experience deploying and managing GPU workloads in Kubernetes. Familiarity with scalable, low-latency systems based on web services and APIs. Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access. Understanding of GPU resource management and cost optimization. Experience with modern microservices architecture. Ability to lead the design of large-scale systems and evaluate tradeoffs. Preferred qualifications, capabilities, and skills MS/PhD in Computer Science, Machine Learning, or a related field. Proficiency in Java, Python, Scala, or C++. Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX). Knowledge of GPU programming (CUDA) and performance optimization. Experience with model monitoring, A/B testing, and ML observability tools. Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker). Experience serving large-scale models and optimizing for performance. FEDERAL DEPOSIT INSURANCE ACT: This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries. #J-18808-Ljbffr Testing Site - JPMC

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving in Palo Alto, CA vacancy
  • $61k - $101k

     ...Requirements: Formal software engineering training or...  ...machine learning training in...  ...for ML codebases, including...  ...experience with deep learning...  ...systems across CPU/GPU utilization,...  ...Experience leading the effective...  ...of approved AI-assisted software...  ...institution serving consumers,... 
    Suggested
    Full time

    J.P. Morgan

    Palo Alto, CA
    6 days ago
  • $207k - $300k

     ...Tech Lead Manager, Merchant Shopping, AI/ML Insights and Growth Share...  ...in backend software development and...  ...team of software engineers, including...  ...-scale machine learning models or high-...  .../B testing. Deep expertise in C++...  ...at hyper-scale, serving 5 trillion pricing... 
    Suggested
    Local area

    Jobleads-US

    Mountain View, CA
    2 days ago
  • $176k - $256k

    Supportability Technical Lead, AI/ML, Support, Google Cloud...  ...Science, Technology, Engineering, Mathematics, or...  ...Technical Solutions Engineer, Software Engineer, Customer...  ...application of AI or Machine Learning, with the ability to...  ...of the users we serve, creating a culture of... 
    Suggested

    Google LLC

    Sunnyvale, CA
    5 days ago
  • $129.6k - $194.4k

     ...portfolio of leading-edge technologies...  .... We believe AI will be a key...  ...with system engineers, algorithm...  ...mentor the AI and ML engineers...  ...calls. Raise software quality with...  ...foundations: deep learning in PyTorch, plus...  ..., and GPU-aware inference...  ...premises LLM serving.Security and... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Local area
    Shift work

    Onto Innovation

    Milpitas, CA
    1 day ago
  • GEICO is seeking a Senior Staff ML Engineer to lead Generative AI initiatives in Palo Alto, focusing on scalable AI solutions and cross-functional collaboration. You will guide architecture, ensure best practices, and deliver agentic workflows that drive measurable business... 
    Suggested

    Government Employees Insurance Company

    Palo Alto, CA
    8 days ago
  • $55 - $60 per hour

     ...Data Science, Machine Learning, or a related field...  ..., batching, GPU utilization). Exposure...  ...with roughly 10+ AI/ML projects deployed to production. Deep algorithmic and deep...  ...design, serving strategy, API design...  ...infrastructure footprint. Lead and mentor a team... 

    Cynet Systems

    Santa Clara, CA
    4 days ago
  •  ...Google LLC in Mountain View, CA seeks a Tech Lead Manager for Merchant Shopping, AI/ML Insights and Growth. You will guide a team building core pricing insights and a decision simulation engine to drive growth for merchants of all sizes. You will own architecture,... 

    Jobleads-US

    Mountain View, CA
    2 days ago
  • $207k - $300k

     ...discovery/recommendation engine and LLM-based...  ...team of engineers.Lead the design and implementation...  ...in specialized ML areas, optimize ML...  ...large scale software solutions.Minimum qualifications...  ...), reinforcement learning (e.g., sequential...  ...allow creating and serving these videos and... 

    Google

    Mountain View, CA
    2 days ago
  •  ...Platform team in Sunnyvale seeks a Senior Technical Solutions Engineer focusing on AI/ML support and platform reliability. You will partner with...  ...customer experiences. Requires 13+ years in technical roles, deep GCP and AI model training experience, and strong leadership... 

    Google

    Sunnyvale, CA
    2 days ago
  •  ...a Program Manager II (Technical Operations) to lead complex technical programs bridging vision and execution...  ...excellence across global initiatives such as AI/ML workflows and large-scale systems. You’ll partner with Engineering, Product, and Data Science to remove blockers,... 

    Uber Technologies Inc.

    Sunnyvale, CA
    23 hours ago
  • $184k - $287.5k

     ...Senior Systems Software test (lead) Engineer to join our Cloud...  ...team, focusing on ML software stack...  ...This role combines deep technical...  ...in running deep learning workloads and related...  .... The GPU, our invention, serves as the visual cortex...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...areMoveworks is the Agentic AI Assistant platform...  ..., and continuously learn and adapt.Moveworks...  ...ServiceNow’s leading workflow automation...  ...’ Reasoning Engine and natural language...  ...cases. Our product serves diverse user personas...  ...customer perceptions of ML/GAI's business... 
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    2 days ago
  • $254k

     ...Director, Applied AI & Engineering you will lead an elite, high-...  ...Your models will serve as the AI engine...  ...strategy, machine learning innovation, and business...  ...data science and ML engineering teams...  ..., and deploying deep learning models...  ...systems, software engineering, or related... 
    Full time
    Temporary work
    Part time
    Shift work

    Walmart

    Sunnyvale, CA
    1 day ago
  • Walmart Inc. is seeking a Principal Software Engineer to lead the design and delivery of scalable platform capabilities, including cloud-native architectures and AI/ML frameworks. You will guide the full SDLC, mentor teams, and ensure reliability and performance across... 

    Walmart Inc.

    Sunnyvale, CA
    4 days ago
  • $212.7k - $287.7k

    The Search Engine organization designs...  ...LLMs and other Deep Learning models in...  ...experience in GPU programming.Key...  ...responsibilitiesTechnical Leadership - Lead development of...  ...systems serving billions of...  ...distributed software systems using...  ...with the ML/DL infrastructure... 
    Local area
    Worldwide
    Flexible hours

    Amazon

    Palo Alto, CA
    1 day ago
  • $184k - $287.5k

     ...Generative AI Technical Engagement Lead to evangelize...  ...facilitate deep technical integration...  ..., and software libraries...  ...workflows. Serve as a primary...  ...includes NVIDIA GPU...  ...partner AI engineering and researchers...  ...include AI/ML, high-performance...  ...with core deep learning frameworks (... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $193.3k - $261.5k

     ...seeking an experienced engineer and technical leader to...  ...stack for EC2 distributed AI/ML systems. The team...  ...develops hardware and software components that are critical...  ...regarded. You'll be leading senior, mid-level, and...  ...it’s in our nature to learn and be curious. Our employee... 
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $160.98k - $265.87k

     ...and technically deep Senior Product...  ...our Data Center AI Software Portfolio. In...  ...products.You will lead the end-to-end...  ...Collaboration• Engineering Alignment:...  ...software domain.• AI/ML Technical...  ...leadership within deep learning, LLMs,...  ...experience with GPU software stack... 
    Full time
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    2 days ago
  • $240k - $333k

     ...for the hardware/software stack, ensuring unparalleled...  ...the training and serving of large ML models.Act as the...  ...across hardware engineering, compiler...  ....Experience as a lead architect driving...  ....Experience with deep learning frameworks (e.g.,...  ...the future of AI/ML hardware acceleration... 
    Worldwide
    Shift work

    Google

    Sunnyvale, CA
    3 days ago
  • $224k - $356.5k

     ...technical Engagement Lead to drive...  ...Generative and Agentic AI software with our highest-priority...  ..., strong AI/ML background with hands...  ...NVIDIA Product, Engineering, and Research, and...  ...and share what you learn with our Product,...  ...across industries.Grow deep expertise in... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • Knightscope, Inc. seeks an experienced ML Engineer to own the ICM 2.0 detection models, leading the transfer from a third‑party vendor and driving ongoing...  ...solution onsite in Sunnyvale. The role requires deep learning expertise, production experience in audio/video detection... 

    Knightscope, Inc.

    Sunnyvale, CA
    3 days ago
  • $143.85k - $221.55k

     ...challenges, driven to learn and grow, and dedicated...  ...ideally with a focus on AI, ML, and related technologies...  ...platforms and software. Solid understanding of...  ...computer science, computer engineering, AI/ML, or related field...  ...machine learning, and deep learning techniques and... 
    Flexible hours

    Hewlett-Packard Company

    Palo Alto, CA
    4 days ago
  •  ...looking for an engineering leader with...  ...imaging, AI, and...  ...platform. As the Software Manager for...  ..., you will lead a team...  ...and CUDA, serving as a technical...  ...and Machine Learning Integration...  ...multiprocessing, GPU...  ...Numba, OpenCL) Deep familiarity...  ...Knowledge of AI/ML techniques... 

    DeepSight Technology

    Santa Clara, CA
    1 day ago
  • $61k - $101k

     ...Requirements: Formal software engineering training or...  ...of machine learning, including...  ...as code. Deep understanding...  ...Experience leading the effective...  ...-approved AI-assisted software...  ...of NVIDIA GPU infrastructure...  ...Experience with ML operations...  ...institutions, serving consumers,... 
    Full time
    For contractors

    J.P. Morgan

    Palo Alto, CA
    4 days ago
  • $240k - $333k

     ...Technical Lead, Hardware/Software Codesign, TPU Inference...  ...degree in Electrical Engineering, Computer...  ...for massive-scale ML training and inference...  ...Experience with deep learning frameworks (e.g.,...  ...shape the future of AI/ML hardware...  ...the training and serving of large ML models... 
    Worldwide
    Shift work

    Jobleads-US

    Sunnyvale, CA
    1 day ago
  •  ...Program Manager III, Machine Learning for the Pixel Software group in Mountain View. You will lead cross-functional projects from...  ...through delivery, coordinating with engineers, product teams, and executives...  ..., risks, and tradeoffs across AI/ML initiatives. The Pixel... 

    Google LLC

    Mountain View, CA
    2 days ago
  • $175.75k - $260k

     ...As a Senior Lead Software Engineer at JPMorganChase within...  ...contributions, and apply deep technical expertise and...  ...governance of approved AI-assisted engineering practices...  ...and processes Serves as a function-wide...  ...Understanding in common ML tools and frameworks such... 
    For contractors

    JPMorgan Chase Bank, N.A.

    Palo Alto, CA
    1 day ago
  • Senior Lead Software Engineer Be an integral part of an agile team...  ...contributions, and apply deep technical expertise...  ...platforms optimized for AI/ML workloads. Partner...  ...understanding of machine learning concepts, including transformer...  ...of NVIDIA GPU infrastructure software... 
    For contractors

    Chase

    Palo Alto, CA
    5 days ago
  •  ...Job Description At ChatBotz.ai, we are seeking a highly skilled and motivated Tech Lead to join our innovative team....  ...degree in Computer Science, Engineering, or a related field. Proven...  ...language processing (NLP), machine learning (ML), and deep learning techniques.... 

    Forhyre

    Sunnyvale, CA
    8 days ago
  • $185k - $215k

     ...you will operate as a Lead AI Systems Engineer, setting technical direction...  .... You will serve as the technical lead...  ...team, integrating modern software development practices...  ...logs.Apply modern AI/ML methods (e.g., LLMs/VLMs...  ...the interview process.Learn more about our full benefits... 
    Work experience placement
    Local area
    Worldwide

    Robert Bosch

    Sunnyvale, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving. Be the first to apply!