Software Engineer III - AI/ML Deep Learning & GPU ML Serving
Testing Site - JPMC
Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Banking team, you will be a key member of an agile team, designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across multiple technical areas, supporting the firm’s business objectives. Job Responsibilities Develop, test, and troubleshoot software solutions, applying creative approaches to solve technical challenges. Write secure, high-quality production code and maintain algorithms integrated with firm systems. Produce architecture and design artifacts for complex applications, ensuring alignment with design constraints. Analyze and visualize large, diverse data sets to drive continuous improvement of applications and systems. Identify and address hidden issues and patterns in data to enhance code quality and system architecture. Collaborate with software engineering communities to explore and adopt new technologies. Participate in system design and architecture discussions, focusing on reliability and scalability. Optimize deep learning models for production inference, including quantization and batching. Deploy and manage GPU workloads in Kubernetes environments. Build scalable, low-latency systems using web services and APIs. Partner with product and program management teams to deliver business-driven solutions. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 3+ years applied experience Professional software development experience, with emphasis on ML systems. Strong proficiency in Python and experience with ML frameworks (TensorFlow, PyTorch, or similar). Experience with cloud technologies (Docker, Kubernetes, EKS) and public clouds (AWS, GCP). Hands-on experience with ML model serving frameworks (TorchServe, TensorFlow Serving, Triton Inference Server). Experience deploying and managing GPU workloads in Kubernetes. Familiarity with scalable, low-latency systems based on web services and APIs. Experience with NoSQL databases (Cassandra or equivalent) for high-throughput data access. Understanding of GPU resource management and cost optimization. Experience with modern microservices architecture. Ability to lead the design of large-scale systems and evaluate tradeoffs. Preferred qualifications, capabilities, and skills MS/PhD in Computer Science, Machine Learning, or a related field. Proficiency in Java Experience with graph neural networks and graph processing frameworks (DGL, PyTorch Geometric, NetworkX). Knowledge of GPU programming (CUDA) and performance optimization. Experience with model monitoring, A/B testing, and ML observability tools. Familiarity with MLOps tools and practices (MLflow, Kubeflow, SageMaker). Experience serving large-scale models and optimizing for performance.
FEDERAL DEPOSIT INSURANCE ACT:
This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase's review of criminal conviction history, including pretrial diversions or program entries. #J-18808-Ljbffr Testing Site - JPMC- ...to take your software engineering career to the... ...Software Engineer III at JPMorgan... ...-authorized AI coding assist... ...contributes learnings and reusable... ...emphasis on ML systems. Hands... ...or operating GPU workloads in... ...to ML model serving frameworks (e... ...III - AI/ML Deep Learning & GPU...Suggested
- ...computing experiences—from AI and data centers, to... ...looking for a senior software engineer who combines deep systems performance... ...shape software from GPU kernels through... ...Thrust, CUB, NCCL), and ML framework cores such... ...experience optimizing deep learning and OSS LLM inference...SuggestedShift work
$147k - $210k
...maintain machine learning models using advanced AI techniques to... ...experience with software development in Python... ...to solve engineering or scientific problems... ...or specialized ML tools such as... ...can train on and serve on every query.Google... ...a culture of deep collaboration,...Suggested$61k - $101k
...certification in software engineering concepts, with at... ...particularly with machine learning systems Hands-... ...-authorized AI-assisted development... ...or operating GPU workloads in Kubernetes... ...learning model-serving frameworks such as... ...Software Engineer III for our Commercial...SuggestedFull time$61k - $101k
...Requirements: Formal software engineering training or... ...machine learning training in cloud... ...workflows for ML codebases, including... ...with deep learning training... ...systems across CPU/GPU utilization, memory... ...of approved AI-assisted... ...financial institution serving consumers,...SuggestedFull time$147k - $210k
Analyze ML workloads, identify compute and memory bandwidth bottlenecks... ....Optimize auxiliary serving and distributed data pipelines... ...issues at all levels of the ML software stack.Experience with ML compilers... ...passes.Google's software engineers develop the next-generation technologies...$147k - $210k
...., log analysis, machine learning, simulations, headroom analysis... ...shopping ads by refining ML models, auction, ads... ...in analytics.Google's software engineers develop the next-generation... ...components of the Google Ads serving system. You will get deep insights into how...- JPMorgan Chase’s Software Engineer III role sits within the Commercial and Investment Banking technology... ..., develop, and deploy secure, scalable ML-powered software solutions, with... ...on cloud/Kubernetes expertise, including GPU workloads and modern microservices. Strong...
$165.2k - $223.6k
...builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI... ...Inferentia and Trainium ML accelerators. This... ...boundary, our engineers build systematic infrastructure... ...'s possible in AI acceleration.As... ...offline inference serving with vLLM, SGLang,...Work experience placementInternshipLocal areaFlexible hours$207k - $300k
...while mentoring engineers in measurement best... ...experience in software development.5... ...experience leading ML design and... ...Science, Machine Learning, or a quantitative... ...Engineer with a deep background in machine... ...data science to serve as a technical... ...will evaluate AI Overviews for factual...$207k - $300k
Serve as the technical leader responsible... ...infrastructure that powers our AI/ML applications. You... ...creative data engines, generation and... ...experiment and learning infrastructure to... ...of experience in software development.5 years... ...projects.Proficiency in deep learning...$147k - $210k
...systems models, utilize ML infrastructure, and... ...technologies.Google's software engineers develop the next-generation... ...is at the forefront of AI innovation, applying cutting-edge machine learning and Generative AI models... ...We foster a culture of deep collaboration,...$169k - $338k
...Home OfficeAI/ML & Agentic Systems... ...agentic AI systems that can... ...complex reliability engineering workflows, predictive... ...machine learning, natural language... ...tools that serve all Walmart engineering... ...across teams.Deep experience... ...hybrid systems and software engineers who...Full timeTemporary workPart time$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will... ...frameworks and paradigms.Dedication to ongoing learning and staying updated on new technologies and innovative...Full time$165.2k - $223.6k
...right moment. As AI models outgrow... ...largest models can serve real users. That... ...looking for an engineer to work at the... ...difference, and you'll learn to measure... ...level data-movement software that transfers... ..., or GPU/accelerator systems... ...welcome.Prior AI/ML experience is not...InternshipLocal areaFlexible hours$125k - $175k
...powered by advanced AI, recommendation... ...a Machine Learning Infrastructure Engineer to help build the... ...backbone that trains, serves, and monitors the... ...work across the ML lifecycle: making... ...Familiarity with software development processes... ...with major Deep Learning frameworks...Full timeWork experience placementLocal areaWork from home- ...SRI Tech SolutionsJob Title: AI / ML engineerLocation: Sunnyvale,... ...and experienced Senior Machine Learning Engineer / AI Solutions Architect with... ...background in data science, deep learning, and cloud-based model... ...using FastAPI or Flask to serve models and integrate them with...Full time
$193.3k - $261.5k
...builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on AWS... .... Neuron includes an ML compiler, runtime, collectives... ...shape the direction of AI acceleration technology.... ..., and collectives engineers to land it. You will translate...InternshipLocal areaWork from homeFlexible hoursShift work$165.2k - $223.6k
...AWS Neuron SDK, the software development kit used to accelerate deep learning and GenAI workloads... ...a wide range of ML models and model architectures... ...boundary, our engineers build systematic... ...what'spossible in AI acceleration.As part... ...solutions that serve customers at scale....InternshipLocal areaFlexible hours$160.36k - $240.54k
...opportunity for AI to drive positive... ...Autonomy ML Infrastructure team... ...components in machine learning model life cycle... ...with autonomy engineers to optimize,... ...robust, high-quality software to increase our... ...and optimizing GPU ML compilers & runtimes... ...experience deep learning...Work experience placementImmediate startFlexible hours$207k - $300k
...of novel machine learning models, incorporating... ...techniques like deep learning, reinforcement... ...-throughput Ad serving systems.Explore,... ...of experience in software development.5 years... ...Google's software engineers develop the next-generation... ...the forefront of AI innovation,...$207k - $300k
...LLM training and serving benchmarks; use... ...opportunities, drive XLA:GPU/Triton... ...LLMs and machine learning models on GPU hardware... ...bottlenecks and engineer scalable... ...of experience in software development.5 years... ...experience with ML design and ML... ...their deployment on AI accelerators....$70 per hour
...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo'... ..., decision-making and deep learning, while collaborating with... ...scenario discovery and serve as structured memory for automated... ...papers in top-tier AI/ML, data mining, or computer vision...Hourly payFull timeInternshipSummer internshipRelocation package$207k - $300k
...aspects of machine learning infrastructure... ...(training and serving) to support new... ...and launching software products.5... ...experience leading ML design and optimizing... ...or PhD in Engineering, Computer... ...the forefront of AI innovation, applying... ...a culture of deep collaboration,...Immediate start$193.3k - $261.5k
...the right moment. As AI models outgrow any... ...largest models can serve real users. That... ...'re looking for an engineer to work at the frontier... ...data-movement software across accelerators... ...is a plus.Prior AI/ML experience is welcome... ...solutions that for Machine Learning (ML) and High-...InternshipLocal areaFlexible hours$174k - $252k
...maintaining, or launching software products, and 1 year of... ...voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization... ...job Google's software engineers develop the next-... ...representative of the users we serve, creating a culture of...$262k - $364k
...development of advanced AI-generated content... ....Optimize ML inference and resolve... ...bottlenecks to improve serving efficiency for low... ...of experience in software development.7... ...degree or PhD in Engineering, Computer Science,... ...organizational machine learning strategies.Google'...$98.35k - $115.7k
...and businesses we serve to make better and... ...career. Try new things, learn new skills and... ...maintenance of best in class software experiences. The... ...and support ML workflows using frameworks... ....Collaborate with engineers and product teams... ..., test, and deploy AI-enabled solutions....Full timeWork experience placementLocal area3 days per week$177k - $270k
...City, CASoftware - Software Systems /Full-... ...mission. The ML Platform team at... ...understanding, learned planning and trajectories... ...ML tools, deep learning frameworks... ...of cutting-edge AI innovation. This... ..., validation, serving, and monitoring... ...researchers, software engineers, and data...Full timeTemporary workRelocation package$120k - $195k
...scaling LinkedIn’s AI model training, feature engineering and serving with hundreds... ...infra, compute software, and hardware... ...the power of our GPU fleet with... ...GNNs, Incremental Learning, Online Learning... ...and optimize deep learning training... ...of new ML models per quarter...For contractorsWork experience placementWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer III - AI/ML Deep Learning & GPU ML Serving. Be the first to apply!
- scientific software engineer Palo Alto, CA
- intel software engineer Palo Alto, CA
- director software engineering Palo Alto, CA
- software engineer Palo Alto, CA
- senior robotics software engineer Palo Alto, CA
- financial software developer Palo Alto, CA
- graduate software developer Palo Alto, CA
- part time software developer remote Palo Alto, CA
- software engineer remote Palo Alto, CA
- part time software developer Palo Alto, CA




