Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving
Testing Site - JPMC
Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Banking team, you will play a pivotal role in an agile team, enhancing and delivering secure, stable, and scalable technology products. As a core technical contributor, you will drive critical technology solutions across multiple technical areas, supporting the firm’s business objectives. Job Responsibilities Lead the design, development, and troubleshooting of software solutions, applying innovative approaches to complex technical challenges. Write secure, high-quality production code and maintain algorithms integrated with firm systems. Produce architecture and design artifacts for advanced applications, ensuring compliance with design constraints. Analyze and visualize large, diverse data sets to improve software applications and systems. Identify and resolve hidden issues and patterns in data to enhance code quality and system architecture. Collaborate with software engineering communities to explore and adopt emerging technologies. Guide system design and architecture discussions, focusing on reliability and scalability. Optimize deep learning models for production inference, including quantization and batching. Deploy and manage GPU workloads in Kubernetes environments. Build scalable, low-latency systems using web services and APIs. Partner with product and program management teams to deliver business-driven solutions. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 5+ years applied experience Professional software development experience, with emphasis on ML systems. Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar). Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP). Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server). Experience deploying and managing GPU workloads in Kubernetes. Familiarity with scalable, low-latency systems based on web services and APIs. Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access. Understanding of GPU resource management and cost optimization. Experience with modern microservices architecture. Ability to lead the design of large-scale systems and evaluate tradeoffs. Preferred qualifications, capabilities, and skills MS/PhD in Computer Science, Machine Learning, or a related field. Proficiency in Java, Python, Scala, or C++. Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX). Knowledge of GPU programming (CUDA) and performance optimization. Experience with model monitoring, A/B testing, and ML observability tools. Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker). Experience serving large-scale models and optimizing for performance. FEDERAL DEPOSIT INSURANCE ACT: This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase’s review of criminal conviction history, including pretrial diversions or program entries. #J-18808-Ljbffr Testing Site - JPMC
$61k - $101k
...Requirements: Formal software engineering training or... ...machine learning training in... ...for ML codebases, including... ...experience with deep learning... ...systems across CPU/GPU utilization,... ...Experience leading the effective... ...of approved AI-assisted software... ...institution serving consumers,...SuggestedFull time$207k - $300k
...Tech Lead Manager, Merchant Shopping, AI/ML Insights and Growth Share... ...in backend software development and... ...team of software engineers, including... ...-scale machine learning models or high-... .../B testing. Deep expertise in C++... ...at hyper-scale, serving 5 trillion pricing...SuggestedLocal area$176k - $256k
Supportability Technical Lead, AI/ML, Support, Google Cloud... ...Science, Technology, Engineering, Mathematics, or... ...Technical Solutions Engineer, Software Engineer, Customer... ...application of AI or Machine Learning, with the ability to... ...of the users we serve, creating a culture of...Suggested$129.6k - $194.4k
...portfolio of leading-edge technologies... .... We believe AI will be a key... ...with system engineers, algorithm... ...mentor the AI and ML engineers... ...calls. Raise software quality with... ...foundations: deep learning in PyTorch, plus... ..., and GPU-aware inference... ...premises LLM serving.Security and...SuggestedPermanent employmentFull timeWork at officeLocal areaShift work- GEICO is seeking a Senior Staff ML Engineer to lead Generative AI initiatives in Palo Alto, focusing on scalable AI solutions and cross-functional collaboration. You will guide architecture, ensure best practices, and deliver agentic workflows that drive measurable business...Suggested
$55 - $60 per hour
...Data Science, Machine Learning, or a related field... ..., batching, GPU utilization). Exposure... ...with roughly 10+ AI/ML projects deployed to production. Deep algorithmic and deep... ...design, serving strategy, API design... ...infrastructure footprint. Lead and mentor a team...- ...Google LLC in Mountain View, CA seeks a Tech Lead Manager for Merchant Shopping, AI/ML Insights and Growth. You will guide a team building core pricing insights and a decision simulation engine to drive growth for merchants of all sizes. You will own architecture,...
$207k - $300k
...discovery/recommendation engine and LLM-based... ...team of engineers.Lead the design and implementation... ...in specialized ML areas, optimize ML... ...large scale software solutions.Minimum qualifications... ...), reinforcement learning (e.g., sequential... ...allow creating and serving these videos and...- ...Platform team in Sunnyvale seeks a Senior Technical Solutions Engineer focusing on AI/ML support and platform reliability. You will partner with... ...customer experiences. Requires 13+ years in technical roles, deep GCP and AI model training experience, and strong leadership...
- ...a Program Manager II (Technical Operations) to lead complex technical programs bridging vision and execution... ...excellence across global initiatives such as AI/ML workflows and large-scale systems. You’ll partner with Engineering, Product, and Data Science to remove blockers,...
$184k - $287.5k
...Senior Systems Software test (lead) Engineer to join our Cloud... ...team, focusing on ML software stack... ...This role combines deep technical... ...in running deep learning workloads and related... .... The GPU, our invention, serves as the visual cortex... ...vacancy. NVIDIA uses AI tools in its recruiting...Full timeLocal area- ...areMoveworks is the Agentic AI Assistant platform... ..., and continuously learn and adapt.Moveworks... ...ServiceNow’s leading workflow automation... ...’ Reasoning Engine and natural language... ...cases. Our product serves diverse user personas... ...customer perceptions of ML/GAI's business...Work at officeRemote workFlexible hours
$254k
...Director, Applied AI & Engineering you will lead an elite, high-... ...Your models will serve as the AI engine... ...strategy, machine learning innovation, and business... ...data science and ML engineering teams... ..., and deploying deep learning models... ...systems, software engineering, or related...Full timeTemporary workPart timeShift work- Walmart Inc. is seeking a Principal Software Engineer to lead the design and delivery of scalable platform capabilities, including cloud-native architectures and AI/ML frameworks. You will guide the full SDLC, mentor teams, and ensure reliability and performance across...
$212.7k - $287.7k
The Search Engine organization designs... ...LLMs and other Deep Learning models in... ...experience in GPU programming.Key... ...responsibilitiesTechnical Leadership - Lead development of... ...systems serving billions of... ...distributed software systems using... ...with the ML/DL infrastructure...Local areaWorldwideFlexible hours$184k - $287.5k
...Generative AI Technical Engagement Lead to evangelize... ...facilitate deep technical integration... ..., and software libraries... ...workflows. Serve as a primary... ...includes NVIDIA GPU... ...partner AI engineering and researchers... ...include AI/ML, high-performance... ...with core deep learning frameworks (...Full time$193.3k - $261.5k
...seeking an experienced engineer and technical leader to... ...stack for EC2 distributed AI/ML systems. The team... ...develops hardware and software components that are critical... ...regarded. You'll be leading senior, mid-level, and... ...it’s in our nature to learn and be curious. Our employee...Local areaFlexible hours$160.98k - $265.87k
...and technically deep Senior Product... ...our Data Center AI Software Portfolio. In... ...products.You will lead the end-to-end... ...Collaboration• Engineering Alignment:... ...software domain.• AI/ML Technical... ...leadership within deep learning, LLMs,... ...experience with GPU software stack...Full timeLocal areaImmediate startShift work$240k - $333k
...for the hardware/software stack, ensuring unparalleled... ...the training and serving of large ML models.Act as the... ...across hardware engineering, compiler... ....Experience as a lead architect driving... ....Experience with deep learning frameworks (e.g.,... ...the future of AI/ML hardware acceleration...WorldwideShift work$224k - $356.5k
...technical Engagement Lead to drive... ...Generative and Agentic AI software with our highest-priority... ..., strong AI/ML background with hands... ...NVIDIA Product, Engineering, and Research, and... ...and share what you learn with our Product,... ...across industries.Grow deep expertise in...Full time- Knightscope, Inc. seeks an experienced ML Engineer to own the ICM 2.0 detection models, leading the transfer from a third‑party vendor and driving ongoing... ...solution onsite in Sunnyvale. The role requires deep learning expertise, production experience in audio/video detection...
$143.85k - $221.55k
...challenges, driven to learn and grow, and dedicated... ...ideally with a focus on AI, ML, and related technologies... ...platforms and software. Solid understanding of... ...computer science, computer engineering, AI/ML, or related field... ...machine learning, and deep learning techniques and...Flexible hours- ...looking for an engineering leader with... ...imaging, AI, and... ...platform. As the Software Manager for... ..., you will lead a team... ...and CUDA, serving as a technical... ...and Machine Learning Integration... ...multiprocessing, GPU... ...Numba, OpenCL) Deep familiarity... ...Knowledge of AI/ML techniques...
$61k - $101k
...Requirements: Formal software engineering training or... ...of machine learning, including... ...as code. Deep understanding... ...Experience leading the effective... ...-approved AI-assisted software... ...of NVIDIA GPU infrastructure... ...Experience with ML operations... ...institutions, serving consumers,...Full timeFor contractors$240k - $333k
...Technical Lead, Hardware/Software Codesign, TPU Inference... ...degree in Electrical Engineering, Computer... ...for massive-scale ML training and inference... ...Experience with deep learning frameworks (e.g.,... ...shape the future of AI/ML hardware... ...the training and serving of large ML models...WorldwideShift work- ...Program Manager III, Machine Learning for the Pixel Software group in Mountain View. You will lead cross-functional projects from... ...through delivery, coordinating with engineers, product teams, and executives... ..., risks, and tradeoffs across AI/ML initiatives. The Pixel...
$175.75k - $260k
...As a Senior Lead Software Engineer at JPMorganChase within... ...contributions, and apply deep technical expertise and... ...governance of approved AI-assisted engineering practices... ...and processes Serves as a function-wide... ...Understanding in common ML tools and frameworks such...For contractors- Senior Lead Software Engineer Be an integral part of an agile team... ...contributions, and apply deep technical expertise... ...platforms optimized for AI/ML workloads. Partner... ...understanding of machine learning concepts, including transformer... ...of NVIDIA GPU infrastructure software...For contractors
- ...Job Description At ChatBotz.ai, we are seeking a highly skilled and motivated Tech Lead to join our innovative team.... ...degree in Computer Science, Engineering, or a related field. Proven... ...language processing (NLP), machine learning (ML), and deep learning techniques....
$185k - $215k
...you will operate as a Lead AI Systems Engineer, setting technical direction... .... You will serve as the technical lead... ...team, integrating modern software development practices... ...logs.Apply modern AI/ML methods (e.g., LLMs/VLMs... ...the interview process.Learn more about our full benefits...Work experience placementLocal areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Software Engineer - AI/ML Deep Learning & GPU ML Serving. Be the first to apply!
- lead infrastructure engineer Palo Alto, CA
- lead operating engineer Palo Alto, CA
- lead network engineer Palo Alto, CA
- lead engineer Palo Alto, CA
- software quality assurance Palo Alto, CA
- entry level software sales Palo Alto, CA
- id software Palo Alto, CA
- software sales Palo Alto, CA
- software asset management analyst Palo Alto, CA
- internship software Palo Alto, CA




