Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

$45k - $121k

Wipro

Job Title: AI Infrastructure Engineer


City: San Jose


State/Province: California


Posting Start Date: 7/9/26


Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at


Job Description:


Job Description

Role Description:


Architect and build custom Artificial Intelligence (AI) infrastructure solutions leveraging the client Kubernetes Platform and AI. You will be responsible for designing high-performance computational stacks that integrate AI, high-speed software-defined storage, and GPU-accelerated nodes. Your mission is to make AI infrastructure "invisible" by optimizing for performance, power consumption, and seamless hybrid-multicloud scalability across on-prem.

͏

Summary

As an AI Infrastructure Engineer, you will design tailored AI solutions that bridge the gap between private data centers and public cloud. Your day-to-day will involve optimizing the client computational stack for large language models (LLMs) and generative AI workloads. You will serve as the SME for AI, ensuring that compute, storage (client Objects/Files), and networking (Flow) are perfectly tuned for AI model training and inference.

Responsibilities
  • Hybrid Multicloud Architecture: Design seamless AI workflows using NC2 on Prem, allowing for rapid bursting of AI workloads from on-prem AHV clusters to the public cloud.
  • Data Services for AI: Architect high-performance storage backends using Objects (S3-compatible) to handle the massive datasets required for AI/ML.
  • Kubernetes & Orchestration: Deploy and manage AI workloads using client Kubernetes Platform to ensure containerized AI models are scalable and resilient.
  • Infrastructure-as-Code: Implement IaC using Calm or Terraform to automate the lifecycle of GPU-enabled nodes.
  • Observability: Design frameworks (monitoring, logging, alerting) for proactive issue detection. Hands on experience on Prometheus, Grafana, ELK, and OpenTelemetry.
͏
  • Ensure high availability, disaster recovery, and fault tolerance across all systems.
  • Networking & Security: Familiarity with Zero-Trust architectures, enterprise networking, storage, and virtualization.
  • Invisible Infrastructure: Modernize legacy 3-tier AI silos into a unified, web-scale environment.
Professional & Technical Skills
  • Core: Deep proficiency in AOS (Acropolis Operating System) and AHV (Native Hypervisor).
  • AI Performance: Experience with GPU Passthrough and vGPU configurations to optimize AI training performance.
  • Security: Applying work Flow for micro segmentation to secure sensitive AI training data.
  • Cost Management: Using Cloud Manager (NCM) Cost Governance to monitor and optimize spend across hybrid environments.

Mandatory Skills: GenAI for Internet Software Products.


Experience: 3-5 Years.


The expected compensation for this role ranges from $45,000 to $121,000 .


Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.


Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.


Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.


Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in San Jose, CA vacancy
  •  ...next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded...  ...PERSON: We are seeking a DevOps / Platform Engineer to join our team building and operating large-scale GPU compute infrastructure that powers AI and ML workloads. The ideal... 
    Suggested

    Advanced Micro Devices , Inc.

    San Jose, CA
    13 hours ago
  • $163.5k - $212.4k

     ...About the Position We are seeking a senior AI Inference Infrastructure Software Engineer with extensive experience designing, building, and optimizing high‑performance, scalable inference systems for Large Language Models (LLMs) and Vision‑Language Models (VLMs). The role... 
    Suggested
    Temporary work
    Flexible hours

    1600 NIO USA, Inc.

    San Jose, CA
    1 day ago
  • $180k - $240k

     ...facilitating effortless integration into customers' logistics operations. About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus... 
    Suggested
    Odd job
    Work at office

    Gatik AI

    Santa Clara, CA
    1 day ago
  • $274k - $304k

     ...AI Platform Engineer - Training & Inference Saviynt's AI-powered identity platform manages and governs human and non-human access to...  ...between self-hosted SLMs and cloud LLMs • Build RL training infrastructure: define Flyte workflows for RL pipelines (rollout, reward... 
    Suggested

    Saviynt

    Milpitas, CA
    3 days ago
  • $168k - $270.25k

     ...looking to hire a deeply technical, creative, and Senior AI Platform Engineer to build, support, and maintain the next generation of AI-...  ...What you will be doing: Define and lead AI-native infrastructure roadmaps and cross-organizational initiatives. Architect... 
    Suggested

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $269.1k - $307.2k

    Distinguished AI Engineer (Agentic AI Platform) At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Work at office
    Local area

    Capital One

    San Jose, CA
    4 days ago
  • $197.3k - $225.1k

     ...Overview Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) At Capital One, we are creating responsible and reliable...  ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in... 
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    4 days ago
  • $151.8k - $265.35k

     ...Staff Engineer - AI For Engineering Adobe empowers individuals and organizations to create exceptional content effortlessly. The AI for Engineering team builds a scalable, production-grade AI platform that powers creativity across design, imaging, motion, and personalization... 
    Temporary work
    Local area
    Worldwide

    Adobe

    San Jose, CA
    4 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (Gen AI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    2 days ago
  • $139.23k - $163.8k

     ...from Day One. Job Description Job Summary The Lead Engineer (Generative AI) is a senior technical role responsible for designing,...  ...-throughput, low-latency AI workloads Leverage modern infrastructure practices: Containerization (Docker) Orchestration (... 
    Temporary work
    Work experience placement
    Local area
    3 days per week

    U.S. Bank

    Cupertino, CA
    1 day ago
  • $170k - $277k

    A leading cybersecurity company is seeking an experienced engineer to join their Cloud Network and AI Security team. The role involves designing and implementing next-generation virtualization features for their firewalls and AI solutions, across both public and private... 

    Palo Alto Networks

    Santa Clara, CA
    1 day ago
  •  ...Vice President of AI Engineering & Agent Platforms About the Company Industry-shaping healthcare technology (HealthTech) & software...  ...the AI platform, leading the engineering organization in AI infrastructure, agent orchestration, and MLOps capabilities. This role... 

    Confidential

    San Jose, CA
    2 days ago
  • ChatGPT Jobs is looking for an AI Engineer (Fresh Graduate) in Santa Clara, CA. This position offers excellent hands-on learning and mentorship opportunities to help you develop into a skilled AI Engineer in a supportive environment. Ideal candidates should have a strong... 
    Remote job

    ChatGPT Jobs

    Santa Clara, CA
    3 days ago
  • $182k - $242k

    CoreWeave is seeking an experienced professional to contribute to building distributed systems and ML infrastructure. The successful candidate will play a pivotal role in designing an optimal research cluster experience, including a Python SDK, while collaborating closely... 

    Jobr

    Sunnyvale, CA
    4 days ago
  • $100k - $150k

     ...technologies to create scalable, secure, and user-friendly applications. As we continue to grow, we’re looking for a skilled AI Infrastructure Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology. This is... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship
    Work visa

    Bright Vision Technologies

    San Jose, CA
    7 days ago
  •  ...small smart high-end electric cars with the FIREFLY brand. About the Position   We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference systems... 
    Full time
    Temporary work
    Immediate start
    Flexible hours

    NIO USA, INC

    San Jose, CA
    25 days ago
  • $174k - $253k

    Google is seeking an Applied AI Customer Engineer in Sunnyvale, CA, offering a competitive salary ranging from $174,000 to $253,000 plus a bonus and equity. In this role, you will leverage your technical expertise to assist customers in adopting Conversational AI solutions... 

    Google

    Sunnyvale, CA
    5 days ago
  • A leading AI-powered fraud and risk platform in Mountain View, CA, is hiring a Software Engineer to architect high-scale services and data pipelines. The role involves working with distributed systems and machine learning frameworks. The ideal candidate will have strong... 

    DataVisor

    Mountain View, CA
    4 days ago
  • NVIDIA AI in Santa Clara is seeking a CUDA Product Marketing Manager to help drive the future of accelerated computing. This role involves owning the messaging for CUDA and overseeing go-to-market strategies for releases, requiring deep technical expertise in AI/ML software... 

    NVIDIA AI

    Santa Clara, CA
    5 days ago
  •  ...opportunity to shape the marketing narrative for CUDA and its associated frameworks, significantly impacting technology. You will leverage AI tools to develop material and execute go-to-market strategies for launches. The ideal candidate possesses extensive technical... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  • A next-generation SaaS company in Mountain View is seeking a Software Engineering Manager to lead their Platform Engineering team. The role entails designing and delivering an AI-powered fraud detection platform, managing and mentoring a talented team while applying cutting... 

    DataVisor Inc.

    Mountain View, CA
    3 days ago
  • $190k - $260k

     ...has developed an artificial intelligence (AI) powered technology stack purpose-built...  ...large-scale world models - depends on infrastructure that turns thousands of hours of multimodal...  ...training throughput. We are looking for engineers who make model training fast: streaming... 
    Full time
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    Mountain View, CA
    3 days ago
  •  ...business stakeholders to understand their problems and propose AI solutions, including Generative AI, that deliver business value...  ...and performance Collaborate with data scientists and data engineers to design, develop and maintain scalable data pipelines for AI solutions... 
    Temporary work

    3B Staffing LLC

    San Jose, CA
    3 days ago
  • Dexmate is looking for a Product Manager for Physical AI Agents in Santa Clara, California. In this role, you will define the roadmap...  ...into usable features, and collaborating with research, engineering, and users. The ideal candidate has over 5 years of product management... 

    Dexmate

    Santa Clara, CA
    2 days ago
  •  ...AI Solution Engineer Immediate need for a talented AI Solution Engineer. This is a 12+months contract opportunity with long-term potential...  ...~ Self-directed problem solver — given an unfamiliar infrastructure, you figure it out ~ Strong understanding of APIs, data... 
    Contract work
    Immediate start

    Pyramid Consulting

    Cupertino, CA
    1 day ago
  •  ...AI Engineer Research and prototype advanced RAG techniques (e.g., chunking strategies, retrieval optimization, knowledge graph integration). Explore and implement agentic AI patterns (e.g., supervisor vs plan-execute workflows). Investigate and develop methods... 

    Kasmo Global

    San Jose, CA
    3 days ago
  •  ...Job Title: AI Engineer Location: Santa Clara CA (Hybrid ) Need Only Locals Responsibilities: Design, develop, and implement AI/ML models and algorithms using Python. Deploy and manage AI solutions on cloud platforms (e.g., AWS,... 
    Local area

    United IT Solutions

    Santa Clara, CA
    2 days ago
  • $168k - $270.25k

     ...We are seeking an AI Engineer to design and build intelligent systems that transform how we do customer support. Our organization processes large amounts of data from various sources, such as customers, end users, and web and social media platforms. This role focuses on... 
    Remote work

    NVIDIA

    Santa Clara, CA
    4 days ago
  •  ...Job Title: AI Engineer Location: Cupertino, CA FULLTIME ONLY Job Description Required • 3-6 years of experience in ML, AI engineering, or a related applied role • Strong Python skills - pipelines, model training, API development... 
    Full time

    AceStack LLC

    Cupertino, CA
    2 days ago
  • $269.1k - $307.2k

    Distinguished AI Engineer Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good...  ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in... 
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!