Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer

$209k

Zoom Video Communications, Inc.

Immigration sponsorship is not available for this position

Responsibilities:

• Develop the Machine Learning Platform management system.

• Design and implement intuitive user interfaces and APls for seamless interaction with the platform.

• Ensure robust access control and security measures for the Machine Learning Platform.

• Regularly evaluate and enhance platform performance, scalability, and reliability. Integrate tools for data versioning, experiment tracking, and workflow orchestration.

• Build the toolchains, service, pipeline for model development workflow, and model serving architecture.

• Create automated pipelines for data preprocessing, feature engineering, and dataset versioning.

• Develop Cl/CD pipelines for deploying models into production environments with minimal downtime.

• Enable support for distributed model training and hyperparameter optimization.

• Incorporate A/B testing frameworks for evaluating multiple model deployments.

• Collaborate with data scientists and engineers to streamline the model development lifecycle.

• Prioritize various metrics for model training and inferencing monitoring. Implement logging and monitoring tools to track model performance, resource utilization, and throughput.

• Develop dashboards to visualize key metrics such as latency, accuracy, and drift detection in realtime.

• Establish alerting mechanisms to detect and respond to anomalies or performance degradation.

• Continuously refine metric prioritization based on stakeholder feedback and evolving business goals.

• Develop and maintaining the high-performance LLM training GPU infrastructure and cluster.

• Optimize GPU utilization for large-scale training workloads, ensuring minimal resource wastage.

• Implement fault-tolerant and distributed training strategies for handling large language models (LLMs).

• Evaluate and integrate emerging hardware technologies, such as TPUs, into the training infrastructure.

• Regularly update cluster configurations to support new frameworks and model architectures.

• Manage scheduling and resource allocation for multi-tenant GPU clusters.

• Understand the auto scale for inference service and multi-models for dynamical loading.

• Design systems that dynamically allocate resources based on real-time demand for inference services.

• Develop mechanisms for loading and unloading models in memory to optimize latency and resource usage.

• Implement strategies for caching frequently used models to improve inference performance.

• Experiment with serverless architectures to further enhance scalability and cost efficiency.

• Ensure compatibility with edge devices and deploy lightweight models for edge inference.

• Support, troubleshoot, and resolve any issues during the training and inferencing.

• Create detailed runbooks for common troubleshooting scenarios to reduce resolution times.

• Perform root cause analysis for failures and implement long-term fixes to prevent recurrence.

• Collaborate with DevOps and IT teams to ensure the stability of underlying infrastructure.

• Develop self-healing systems that can automatically recover from common training or inference issues.

• Provide technical support and guidance to data scientists and engineers working on the platform.

What we're looking for:

Requires a Bachelor's degree in Communications Engineering, Artificial Intelligence, Software Engineering, a related field, or a foreign degree equivalent. Must have 2 years of experience in job offered or related occupation. Must have 2 years of experience in:

• Designing, Implementing, or optimizing large-scale distributed training systems using technologies like Horovod, DeepSpeed, PyTorch Distributed, or Ray;

• Tensor/model parallelism and pipeline parallelism;

• Utilizing cloud-native or on-prem infrastructure (Kubernetes, Docker, Slurm) to support scalable, fault-tolerant, and resource-efficient AI workloads across multi-node GPU clusters;

• Using Performance Profiling and Optimization to diagnose and improve end-to-end training performance by optimizing data pipelines (e.g., DALI, tf.data), minimizing communication overhead (e.g., NCCL, gRPC), and tuning hardware-specific kernels (e.g., CUDA, Triton);

• Systems Programming and Automation in systems-level programming with Python, Bash, and C++ or Go;

• Automating deployment and orchestration of AI workloads and monitoring using Prometheus, Grafana, Weights & Biases.

• Telecommuting work arrangement permitted one day a week. Four days in office required. Position does not require domestic or international travel

Zoom Communications, Inc.#LI-DNI#Ind0

Salary Range or On Target Earnings:

Minimum:

$209,000.00

Maximum:

$275,400.00

In addition to the base salary and/or OTE listed Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus and equity value.

Note: Starting pay will be based on a number of factors and commensurate with qualifications & experience.

We also have a location based compensation structure; there may be a different range for candidates in this and other locations.

Ways of WorkingOur structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

BenefitsAs part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn ( for more information.

About UsZoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars.We’re problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.

Our Commitment​

At Zoom, we believe great work happens when people feel supported and empowered. We’re committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us know—we’re here to support you at every step.

We welcome people of different backgrounds, experiences, abilities and perspectives including qualified applicants with arrest and conviction records and any qualified applicants requiring reasonable accommodations in accordance with the law.

If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form ( and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.

Think of this opportunity as a marathon, not a sprint! We're building a strong team at Zoom, and we're looking for talented individuals to join us for the long haul. No need to rush your application – take your time to ensure it's a good fit for your career goals. We continuously review applications, so submit yours whenever you're ready to take the next step.

Our interviews are supported by BrightHire, a tool that helps us create a consistent and thoughtful interview experience and may include recordings. Please refer to our candidate privacy statement ( for more information of how we use your data.

We believe that the unique contributions of all Zoomies is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. Zoom is proud to be an equal opportunity workplace and is an affirmative action employer. All your information will be kept confidential according to EEO guidelines

Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer in San Jose, CA vacancy
  • $123.24k - $200k

     ...Overview Of Role As a Sr./Principal AI Engineer within TSMC's Artificial Intelligence for Business Intelligence Innovation (AI4BII) Center...  ...complex technical concepts to both engineering teams and senior management audiences. Education: B.S. or higher in Computer Science... 
    Senior
    Work at office

    TSMC

    San Jose, CA
    12 hours ago
  •  ...who is passionate about crafting, implementing, and operating AI solutions that have a direct and measurable impact on Apple Sales and its customers. Description We’re looking for a Senior AI Engineer with strong software development skills and a passion for applying... 
    Senior
    Work experience placement

    Apple

    Cupertino, CA
    23 hours ago
  • $98k - $182k

     ...Want To Make An Impact On The World Of Technology We are looking for a talented Software Engineer with experience in Machine Learning. You will work at the intersection of AI, high-performance software engineering, and electronic design automation (EDA) to build... 
    Senior

    Cadence Inc

    San Jose, CA
    2 days ago
  • $98k - $182k

     ...want to make an impact on the world of technology. We are looking for a talented Software Engineer with experience in Machine Learning. You will work at the intersection of AI, high-performance software engineering, and electronic design automation (EDA) to build... 
    Senior

    Cadence Design Systems

    San Jose, CA
    4 days ago
  • $152k - $241.5k

    2100 NVIDIA USA is seeking an AI Research Engineer / Applied Scientist to develop innovative technologies in machine learning compilers and AI systems. The ideal candidate will have strong expertise in AI/ML, particularly in compiler optimization and low-level programming... 
    Senior

    2100 NVIDIA USA

    Santa Clara, CA
    4 days ago
  • $184k - $356.5k

    NVIDIA Gruppe is seeking a Senior Developer Technology Engineer in Santa Clara, California, to innovate AI workloads through GPU acceleration. This role involves deep research into optimizing algorithms for deep learning and enhancing CPU and GPU architecture designs. Ideal... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $153.5k - $310.5k

    Hobbsnews is looking for a Senior Technical Program Manager in Cupertino, California, to drive AI-powered software development productivity initiatives. This hybrid...  ...cross-functional AI initiatives and improving engineering efficiency. The ideal candidate will have a... 
    Senior

    Hobbsnews

    Cupertino, CA
    3 days ago
  • $129.3k - $193.9k

    Qualcomm is seeking an AI Model Training Engineer to design and optimize machine learning models. You will collaborate with data scientists and engineers to ensure models meet performance and ethical standards. The ideal candidate should have a strong background in programming... 
    Senior

    Qualcomm

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA Corporation is seeking a Senior Software Engineer to help build a platform for ML/AI infrastructure specifically focusing on topology data aggregation. This role requires strong experience in distributed systems and Kubernetes, along with proficiency in Go. The engineer... 
    Senior
    Remote job

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    NVIDIA Gruppe is seeking versatile software engineers for their XLA team in Santa Clara, California. The role involves developing compiler...  ...deep learning workloads and collaborating with teams to accelerate AI systems. Candidates must have a strong background in C/C++ and 4... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • A leading technology company is seeking a Senior AI Software Engineer to join their team in Santa Clara, California. In this role, you will innovate and develop groundbreaking AI systems software for inference applications including deep learning framework optimizations... 
    Senior

    NVIDIA

    Santa Clara, CA
    12 hours ago
  • $127.1k - $198.6k

     ...A global consulting firm is seeking a Senior AI Native Engineer based in California. The successful candidate will play a pivotal role in revolutionizing business AI systems, enhancing data pipelines, and collaborating with clients across diverse industries. Candidates... 
    Senior

    Ernst & Young Oman

    San Jose, CA
    4 days ago
  • $152k - $241.5k

    NVIDIA seeks an experienced engineer for AI-based GPU compiler technology in Santa Clara, California. The role involves designing technology for GPU code generation and implementing training pipelines using AI techniques. The ideal candidate holds an M.S. or Ph.D., has... 
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    NVIDIA Gruppe is seeking an AI & Deep Learning Compiler Engineer for its Deep Learning & AI Compiler team in Santa Clara, California. This role involves analyzing and optimizing deep learning networks, as well as developing compiler algorithms to enhance performance on... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • CrowdStrike is seeking experienced AI engineers to build advanced AI applications on cloud platforms. In this hybrid role, you will design scalable implementations while ensuring code quality and performance. Candidates should have expertise in AI frameworks and be adept... 
    Senior

    Dormont Manufacturing Co

    Sunnyvale, CA
    4 days ago
  • $152k - $287.5k

    NVIDIA Gruppe is seeking a Senior AI Developer Technology Engineer for the Financial Sector to design and optimize parallel algorithms for high-performance AI workloads. The role involves researching GPU acceleration techniques for AI and HPC workloads, collaborating with... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $181.73k - $213.8k

     ...your career. Try new things, learn new skills and discover what you excel at—all from Day One. Job Description The Gen AI Engineering Senior Director leads the strategy, architecture, and delivery of enterprise-scale AI platforms, including GenAI, machine learning,... 
    Senior
    Temporary work
    Work experience placement
    Local area
    3 days per week

    U.S. Bank

    Cupertino, CA
    12 hours ago
  • $180k - $240k

     ...fleet, facilitating effortless integration into customers' logistics operations. About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers... 
    Senior
    Odd job
    Work at office

    Gatik AI

    Santa Clara, CA
    12 hours ago
  •  ...AI Agent Engineer At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from... 
    Senior
    Work at office

    F5

    San Jose, CA
    1 day ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    3 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real‑time,... 
    Senior
    Local area

    Capital One National Association

    San Jose, CA
    4 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    12 hours ago
  • NVIDIA Corporation in Santa Clara is seeking a Senior Software Engineer to lead the optimization of large-scale AI systems. This role will involve profiling and tuning workloads using cutting-edge NVIDIA technology. The ideal candidate will have over 8 years of experience... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • Nutanix is seeking a candidate to join their team focused on the development of advanced AI agents and systems. Responsibilities include designing and deploying complex multi-agent systems and collaborating closely with product managers and UX designers to create impactful... 
    Senior

    Nutanix

    Santa Clara, CA
    3 days ago
  • $96.8k - $306.4k

     ...Senior Principal Ai Agent / Ml Software Engineer The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical leadership role responsible for defining, building, and operating next-generation AI systems on Oracle Cloud Infrastructure... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Santa Clara, CA
    12 hours ago
  • $184k - $287.5k

    We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build innovative AI systems software to accelerate for AI inference. As a member of the team, you'll develop libraries, code generators... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • General Motors in Sunnyvale, California, is seeking a Senior Engineer to enhance developer productivity and engineer coaching. The role includes creating observability systems and improving development processes. The successful candidate will lead code contributions, mentor... 
    Senior

    General Motors

    Sunnyvale, CA
    4 days ago
  • $152k - $241.5k

    NVIDIA's GPUs are at the core of modern AI infrastructure, from training large-scale models to running inference in production. That...  ...position depends on software as much as hardware, and compiler engineering is a big part of what makes it work. We are looking for an... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $170.7k - $300.2k

    Apple Inc. in Cupertino is seeking an experienced engineer to define and deliver key performance metrics for Siri. This role involves partnering with engineering teams and maintaining data systems. The ideal candidate must have substantial development experience and relevant... 
    Senior

    Apple

    Cupertino, CA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer. Be the first to apply!