Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Software Engineer - Machine Learning (AI/ML Data Platforms)

Hackajob

Lead Software Engineer At JPMorganChase Within AI/ML Data Platforms We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within AI/ML Data Platforms, you are an integral part of an agile team that works to build and operate scalable, reliable ML training systems and pipelines on AWS and other cloud platforms. You will productionize training workloads (often GPU-based), improve performance and cost efficiency, and enable repeatable, well-governed training across environments. Job Responsibilities Design, build, and maintain end-to-end ML training platform. Run and optimize GPU training workloads (single-node and distributed), improving throughput, utilization and reproducibility. Build and operate training infrastructure on Kubernetes (e.g., EKS and other manage Kubernetes platforms), including resource management and workload troubleshooting. Enable Gen AI/LLM training and fine-tuning workflows (e.g., supervised fine-tuning), including evaluation harnesses, artifact/version governance, and scalable GPU execution patterns aligned to enterprise controls. Implement observability for training systems: metrics, logs, dashboards, alerting, and operational runbooks. Partner with data engineering and platform teams to define interfaces, standards, and guardrails (security, access, cost controls) Improve developer experience for training: standardized containers, CI/CD, templates, documentation, and self-service workflow Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team. Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 5+ years applied experience. Demonstrated experience running ML training in cloud environments and debugging issues across infrastructure & code. Strong Python skills with solid engineering practices (testing, code reviews, modular design, dependency management). Experience building automation/CI for ML codebases (build, test, release, deployment/promotion workflows). Hands on experience with deep learning training workflows and at least one major framework (eg., PyTorch or TensorFlow). Understanding of training performance and stability: data loading bottlenecks, mixed precision, checkpointing, reproducibility, and evaluation methodology. Experience with distributed training and related concepts (e.g., DDP/FSDP/DeepSpeed concepts, collective communication basics, scaling and bottleneck analysis). Ability to profile and optimize training systems (CPU/GPU utilization, memory, I/O throughput, networking, scheduling). Experience with Kubernetes fundamentals for running compute-intensive workloads and AWS (eg., EKS/ECR, S3, IAM, VPC/networking, Cloudwatch, EC2) Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security. Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices. Preferred qualifications, capabilities, and skills Experience running training workloads across multiple cloud platforms and managing portability, performance, and governance across environments. Familiarity with cloud-native networking/storage patterns for high-throughput training and artifact management. Experience optimizing training input pipelines (sharding, prefetching, caching, format choices such as Parquet/WebDataset) and working with large datasets. Familiarity with distributed compute frameworks (Spark, Ray, Dask) for feature/dataset generation. Familiarity with workflow orchestration tools (Airflow-like systems, Argo Workflows-like patterns) and model registry concepts. Experience optimizing training cost/performance (right-sizing, scheduling policies, interruptible capacity strategies where applicable budge guardrails, quota planning). Strong observability practice for training systems: metrics/logs/traces, GPU telemetry, dashboards, and alert tuning. Hackajob

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Software Engineer - Machine Learning (AI/ML Data Platforms) in Palo Alto, CA vacancy
  • C3 AI (NYSE: AI), is the Enterprise...  ...application software company. C3 AI...  ...C3 Agentic AI Platform, an end-to-end...  ...enterprise. Learn more at: C3 AIWe...  ...experienced lead software engineer experienced in the field of machine learning and artificial...  ...managers, data scientists and... 
    Platform
    Data

    C3 IoT

    Redwood City, CA
    2 days ago
  • $216.3k - $280.8k

     ...the TeamCisco’s AI Defense is dedicated...  ...enterprise AI platforms, autonomous...  ...distributed systems engineers, security...  ...ImpactAs a Technical Lead, you will serve...  ...and 3+ years of software engineering experience...  ...systems, or AI/ML infrastructure....  ...how data and infrastructure... 
    Platform
    Data
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    CISCO Systems

    Milpitas, CA
    3 days ago
  • $230k - $315k

     ...a high-agency, hands-on Lead Analytics Engineer to bridge the gap between...  ...our complex enterprise data sources and our AI-driven decision-making systems...  ...large-scale enterprise platforms (SAP S/4HANA, Salesforce...  ...of robotics, machine learning, and design, Zoox aims to... 
    Platform
    Data
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    1 day ago
  • $85 per hour

     ...range of vehicle platforms and product use...  ....S. states. Software Engineering builds the...  ...making and deep learning, while collaborating...  ...research in machine learning, reinforcement...  ...(RL), agentic AI, or human-...  ...learning, ML systems, human...  ...code, prompts, or data. Practical experiences... 
    Platform
    Data
    Hourly pay
    Full time
    Internship
    Summer internship

    Waymo

    Mountain View, CA
    1 day ago
  • $230k - $300k

     ...motivated, hands-on Lead AI Engineer to spearhead the end-...  ...integrating enterprise data sources, and...  ...Qualifications:10+ years in Data/Software Engineering, with 2+...  ...)Familiarity with AI platform vendor evaluations (...  ...of robotics, machine learning, and design, Zoox aims... 
    Platform
    Data
    Full time
    Contract work
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    1 day ago
  •  ...Description Teach AI how business...  ...access to data. They need to...  ...it can be learned, so AI agents...  ...will define and lead our research...  ...science or machine learning, or...  ...a product or platform. An MS or PhD...  ...with skeptical engineers. Preferred...  ...open-source software, datasets or... 
    Platform
    Data
    Permanent employment
    Full time
    Work at office
    Flexible hours
    Shift work
    3 days per week

    SAP

    Palo Alto, CA
    2 days ago
  •  ...citations to source data. Design and...  ...tools: alarms and KPI platforms, ticketing,...  ...functionally with data engineering, platform/security...  ...stores (e.g., Azure AI Search) Prompt...  ...experience in AI/ML engineering, data...  ...including: ~ Azure Machine Learning; Azure AI Services... 
    Platform
    Data

    Cloud Analytics Technologies LLC

    Palo Alto, CA
    27 days ago
  •  ...opportunity for AI to drive...  ...universal autonomy platform: self-driving...  ...Price, and other leading investors....  ...Role As a software engineering intern, you will...  ...the field of machine learning, robotics, and...  ...the following: Data Platform, Onboard Systems, ML Infrastructure... 
    Platform
    Data
    Internship
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $156k - $226k

    Senior Data Engineer In Technical Solutions Much of the organization...  ...business teams and AI agents to understand...  ...processing (NLP), or machine learning data pipelines....  ...or metadata management platforms for large-scale unstructured...  ...Experience optimizing ML vs. LLM compute unit... 
    Platform
    Data

    CompliancePoint

    Mountain View, CA
    2 days ago
  •  ...The beginning of a new Data & AI decade that will...  ...spanning classical AI/ML, Generative AI, Agentic...  ...and enterprise-scale AI platforms, with strong hands-on...  ...leveraging both classical machine learning and advanced AI...  ...Models, Recommendation Engines, Optimization Models,... 
    Platform
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    1 day ago
  • $150.7k - $251.2k

     ...are seeking an AI Security Engineer to own the security...  ...'s Agentic AI platform end to end....  ...authority, model and data supply chain,...  ...-agent calls. Lead AI red teaming...  ...expectation. Software supply-chain...  ...securing AI or ML systems in production...  ...culture. Learn more at ey.com/... 
    Platform
    Data
    Contract work
    Summer holiday
    Immediate start
    Flexible hours

    EY

    Palo Alto, CA
    3 days ago
  • $33 - $51 per hour

     ...Sponsorship Join Rivian's AI platform team to build...  ...Rivian designs, engineers, and delivers its...  ...LLMs, agentic AI, and machine learning....  ...enterprise APIs, databases, data platforms, and internal software systems. Perform...  ...technically substantial AI/ML or LLM applications... 
    Platform
    Data
    Full time
    Contract work
    Internship
    Summer internship
    Local area
    Visa sponsorship
    Shift work

    Rivian

    Palo Alto, CA
    2 days ago
  • $145k - $170k

     ...opportunity for AI to drive...  ...universal autonomy platform: self-...  ..., and other leading investors....  ...Role Our software team is growing...  ...talented engineers who are graduating...  ...areas: Data Platform,...  ...Onboard Systems, ML...  ...and Python; machine learning, multithreading... 
    Platform
    Data
    Full time
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $237.5k - $321.5k

     ...minded Manager 2, AI Science who is...  ...about applying machine learning to solve...  ...while building the data foundations and...  ...data stack and ML lifecycle. Data...  ...functions - including engineering, product,...  ...for a AI Science lead a team of...  ...recommendation platform strategies. They... 
    Platform
    Data
    Temporary work

    Intuit

    Mountain View, CA
    5 days ago
  • $175k - $287k

     ...LinkedIn’s AI model training...  ..., feature engineering and serving...  ..., data infra, compute software, and hardware...  ...Incremental Learning, Online Learning...  ...Feature Platform, which empowers...  ...Utilizing leading open-source...  ...of new ML models per...  ...systemsExpertise in machine learning... 
    Platform
    Data
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  •  ...Practice Leader - Data and AI to build and lead the practice serving...  ...deliver analytics and machine learning solutions, and...  ...combines deep data engineering, analytics, machine...  ...solutioning, product and platform thinking, and...  ...engineers, scientists, ML engineers, AI... 
    Platform
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    1 day ago
  • C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family...  ...C3 Agentic AI Platform, an end-to-end...  ...the enterprise. Learn more at: C3 AIC3...  ...is looking for a Lead/Senior Software Engineer, Full-Stack to join...  ...Developers, Data Scientists, and... 
    Platform
    Data

    C3 IoT

    Redwood City, CA
    4 days ago
  • $230k - $300k

     ...Content Intelligence platform shaping the future...  ...by advanced AI, recommendation systems...  ...seeking a Staff Machine Learning Engineer to provide technical...  ...systems, lead complex projects across...  ...product, infra, and data teams to align technical...  ...large-scale ML or recommendation... 
    Platform
    Data
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    1 day ago
  •  ...Since 2022, AI has entered the...  ...education and software development to...  ...Silicon Validation Engineer, you will be a...  ...novel computing platform.   Responsibilities...  ...Bring-up: Lead the initial...  ...repeatability, and data reporting....  ...design concepts for machine learning inference or... 
    Platform
    Data
    Work at office

    Unconventional, Inc.

    Mountain View, CA
    6 days ago
  • $213.48k - $319.72k

     ...opportunity for AI to drive positive...  ...autonomy platform: self-driving for...  ...Price, and other leading investors.About...  ...refine our routing engine to calculate more...  ...Redis, etc), and data warehouses (BigQuery...  ...are willing to learn.You have a wide-...  ...and inferencing ML models.... 
    Platform
    Data
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    8 hours ago
  • $316k - $427k

     ...financial technology platform that powers...  ...a Distinguished Engineer to shape the technical...  ...expertise in AI science and machine learning with hands-on...  ...long-term AI and ML strategy,...  ...product, design, data science, and security...  ...capabilities.Strong software and systems... 
    Platform
    Data
    Worldwide

    Intuit

    Mountain View, CA
    8 hours ago
  • $144.36k - $199.39k

     ...Research Scientist, AI Agent Architect to...  ...review, data collection, coding...  ...providers; evaluate platforms and agent tooling;...  ...needs to data and software professionals. Teamwork...  ...skills, including machine learning methods, data collection...  .... Multiple lead-authored publications... 
    Platform
    Data

    Stanford University

    Palo Alto, CA
    2 days ago
  •  ...Description Job Title: Lead Engineer – AI Agents Location:...  ...that can reason, learn, and act across complex data environments...  ...internal data platforms and enterprise systems...  ...experience in Software Development / Machine Learning ~...  ...Computer Science, AI/ML, or related field... 
    Platform
    Data
    Contract work
    Local area
    Remote work

    Artech LLC

    Sunnyvale, CA
    26 days ago
  • $33 - $51 per hour

     ...Rivian's Autonomy AI Platform team builds the software that connects vehicle data to trained and evaluated...  ...compute and storage, machine learning infrastructure, evaluation...  ...AI tools that help engineers build better software....  ...release decisions. ML Infrastructure: Help... 
    Platform
    Data
    Full time
    Contract work
    Summer work
    Internship
    Local area
    Shift work

    Rivian

    Palo Alto, CA
    1 day ago
  • $155k - $185k

     ...are looking for an AI Agent & LLM Engineer who combines strong software engineering...  ..., and the shared platform required to operate...  ...retrieval, tools, data pipelines, backend...  ...Agent engineering, machine learning engineering, or...  ...ai is the world’s leading tool for meeting... 
    Platform
    Data
    Permanent employment

    Otter.ai

    Mountain View, CA
    2 days ago
  • $209.5k - $283.5k

     ...financial technology platform that powers...  ...Group (CG) AI Team as a Staff...  ...Scientist. You will lead the application...  ...managers, engineers, and designers...  ...experience through data-driven decision...  ..., NLP, and machine learning paradigms (classification...  ...current with ML advancements... 
    Platform
    Data
    Worldwide

    Intuit

    Mountain View, CA
    3 days ago
  • $147k - $210k

     ...architecture and algorithms for AI products today and...  ...creating similar new data sets to improve the...  ...or multimodal machine learning tasks.Experience in developing...  ..., hardware and software performance analysis,...  ...compilers for mobile platforms, as well as core search... 
    Platform
    Data

    Google

    Mountain View, CA
    1 day ago
  •  ...Description Job Title: Lead AI Agent Engineer Location:...  ...agents that can reason, learn, and act across diverse data landscapes. Lead the...  ...I the Apple data and platforms ecosystem. Tackle...  ...Qualification - 8 years of software development or machine learning experience.... 
    Platform
    Data

    eTeam Inc.

    Sunnyvale, CA
    26 days ago
  • $188k - $274k

    Drive generative AI experiences on Search...  ...managers, and engineers to develop strategic...  ...solutions based on data analysis, prompt...  ...years of experience leading design projects....  ...Models (LLMs), or machine learning products.Experience...  ...narratives across multiple platforms and touch points.... 
    Platform
    Data
    Worldwide

    Google

    Mountain View, CA
    4 days ago
  • $150k - $300k

     ...Applied AI Engineer Location: Palo Alto, California...  ..., Multimodal Data, LLMs, AI...  ...factory floor. Their platform learns from real-world manufacturing...  ...Strong backend software engineering...  ...retrieval systems, or machine learning...  ...deploying applied AI or ML systems to production... 
    Platform
    Data
    Full time

    NxT Level

    Palo Alto, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Software Engineer - Machine Learning (AI/ML Data Platforms). Be the first to apply!