Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems

$140k - $165k

SK hynix memory solutions America Inc.

Job Description

Job Description

About the Company:

At SK Hynix Memory Solution, we're at the forefront of semiconductor innovation, developing advanced memory solutions that power everything from smartphones to data centers. As a global leader in DRAM and NAND flash technologies, we drive the evolution of advancing mobile technology, empowering cloud computing, and pioneering future technologies. Our cutting-edge memory technologies are essential in today's most advanced electronic devices and IT infrastructure, enabling enhanced performance and user experiences across the digital landscape.

We're looking for innovative minds to join our mission of shaping the future of technology. At SK Hynix Memory, you'll be part of a team that's pioneering breakthrough memory solutions while maintaining a strong commitment to sustainability. We're not just adapting to technological change – we're driving it, with significant investments in artificial intelligence, machine learning, and eco-friendly solutions and operational practices. As we continue to expand our market presence and push the boundaries of what's possible in semiconductor technology, we invite you to be part of our journey to creating the next generation of memory solutions that will define the future of computing.

 

Why Join Us?

  • Build foundational AI infrastructure that powers next-gen enterprise systems.
  • Work on cutting-edge agentic AI — not just chatbots, but autonomous systems that reason, plan, and act.
  • Opportunity to influence AI strategy, deployment, and governance in a high-impact environment.

 

About the Role:

We are seeking a hands-on AI Engineer to design, deploy, and maintain on-prem AI infrastructure and build agentic AI systems that drive real-world automation. You'll be responsible for setting up scalable AI environments, implementing RAG pipelines, fine-tuning embedded models, and architecting AI agents that operate autonomously in enterprise settings. This role sits at the intersection of AI systems engineering and applied ML — you'll bridge infrastructure, model deployment, and agent logic.

 

Responsibilities :

  • Design and deploy on-prem AI infrastructure — including GPU clusters, model serving (e.g., vLLM, TGI, Triton), vector DBs (e.g., Milvus, Qdrant, FAISS), and orchestration (Kubernetes, Helm, Docker).
  • Build and optimize RAG pipelines — including document chunking, retrieval strategies (hybrid, re-ranking), and evaluation of retrieval accuracy and latency.
  • Develop agentic AI systems — design stateful agents with memory, tool use, and planning capabilities (e.g., using LangGraph, AutoGen, or custom frameworks).
  • Fine-tune and deploy embedded models — work with LoRA, QLoRA, or full fine-tuning for domain-specific tasks; optimize for edge/on-device inference.
  • Implement Model Control Protocols (MCP) — ensure model governance, versioning, access control, and monitoring for production AI systems.
  • Collaborate with product and engineering teams to integrate AI capabilities into enterprise workflows — especially in storage, QA, or systems engineering contexts.
  • Automate and monitor AI pipelines — build CI/CD for model deployment, logging, and performance tracking.

 

Minimum Qualifications :

  • 2+ years of experience in AI/ML engineering, with hands-on deployment of AI systems on-prem or private cloud.
  • Proven experience building agentic AI systems — including state management, tool integration, and multi-step reasoning.
  • Strong working knowledge of RAG architectures — chunking, retrieval, re-ranking, evaluation metrics.
  • Experience with model fine-tuning (LoRA, QLoRA, full fine-tuning) and embedding models for retrieval.
  • Familiarity with Model Control Protocols (MCP) or similar governance frameworks (model versioning, access control, audit trails).
  • Proficiency in Python, Linux, Docker/Kubernetes, and vector databases (e.g., Milvus, Qdrant, Pinecone).
  • Experience with AI serving frameworks (vLLM, TGI, Triton, Ollama, etc.).

 

Preferred Qualifications:

  • Experience deploying AI in enterprise storage or hardware-adjacent environments.
  • Background in systems engineering or QA automation — bonus if you've used AI to automate testing or validation.
  • Familiarity with embedded AI or edge inference (ONNX, TensorRT, GGUF, etc.).
  • Experience with AI agent frameworks (LangGraph, AutoGen, BabyAGI, etc.).
  • Knowledge of AI observability tools (LangSmith, Weights & Biases, Prometheus/Grafana for AI).
  • As a Storage company, knowledge of storage area/NVMe is a PLUS.

 

Education Requirement:

  • Bachelor of Science in CS, EE, ME, or other applicable Engineering field.

 

COMPENSATION $140,000/yr - $165,000/yr

 

REGARDING COMPENSATION :

SK hynix memory solutions America Inc. offers you the opportunity to apply your skills to exciting projects while working with innovative teams. Our compensation package is complimented by a generous benefits package including medical, dental, vision, life insurance and a company 401(k) match, as well as cafeteria, onsite gym and much more. If you are motivated by technical challenges, we offer a collaborative work environment that encourages career growth.

The salary offered to a selected candidate will be tailored based on several factors, including the location, job grade, relevant knowledge, skills, and experience. We also take into account the internal equity among our current team members to ensure fairness and competitiveness

Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems in San Jose, CA vacancy
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote code...  ..., ServiceNow is the AI control tower for business...  ...group building the agentic AI and enterprise-scale search systems that power Now Assist, AI...  ...as foundational platform infrastructure — prioritizing robustness... 
    Senior
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $178k - $321k

     ...an early but working AI-native capability: a multi...  ...platform (Hive Mind), agentic workflows, data...  ...governed data and AI infrastructure everything else depends...  ...This is a two-person engineering team: you deploy, debug...  ...build production-grade systems end to end on what exists... 
    Senior

    OKX

    San Jose, CA
    4 days ago
  • $176.1k - $308.2k

     ...all started when engineer Fred Luddy wrote code...  ...ServiceNow is the AI control tower for...  ...the TeamThe Agentic Engineering organization...  ...in this role:As a Staff AI Engineer, you...  ...agent harness — the infrastructure layer that enables...  ...prompt management systems — versioning,... 
    Suggested
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $130.7k - $261.3k

     ...OPPORTUNITYThis Senior Staff AI/ML Engineer position can work out...  ...robust, scalable AI infrastructure. The Senior Staff AI/...  ..., scalable cloud/on-prem hybrid ML infrastructure...  ...with GenAI and Agentic AI development infrastructure...  ...and distributed systems.Experience in reviewing... 
    Senior
    Shift work

    Abbott

    Santa Clara, CA
    5 days ago
  • $180k - $240k

     ...We are seeking a Senior AI Infrastructure Engineer to design, build, and scale...  ...Distributed Training & ML Systems Support Scale Research...  ...and batch processing Agentic Infrastructure & Automation...  ...Experience in hybrid cloud and on-prem GPU cluster management for... 
    Senior
    Odd job
    Work at office

    Gatik AI

    Santa Clara, CA
    4 days ago
  •  ...DescriptionWho we areMoveworks is the Agentic AI Assistant platform that...  ...with all of their business systems through natural language to...  ...with Moveworks’ Reasoning Engine and natural language...  ...help build cutting edge ML infrastructure for building and serving LLM... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    2 days ago
  • $229.9k - $262.4k

     ...description": "Senior Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services...  ...and reliable AI systems, changing banking for good....  ...investments in technology infrastructure and world-class talent - along...  ...VA: $229,900 - $262,400 for Sr. Lead AI Engineer... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    San Jose, CA
    13 hours ago
  • $190k - $237k

     ...our differences, and supports and celebrates all of our team members.What You’ll DoAs a Staff AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure services required for large-scale AI model training and inference. You will ensure our machine... 
    Local area

    Archer Aviation

    San Jose, CA
    2 days ago
  •  ...United StatesProducts - Engineering /Fulltime /HybridOver 50...  ...Extreme team.Position : Agentic Product Engineer /Staff SW Systems EngineerExperience : 8 to...  ...or JavaScript,AI coding agents Claude Code...  ...This includes: AI workflow infrastructure: Automation, integrations... 
    Full time

    Extreme Networks, Inc.

    San Jose, CA
    4 days ago
  • $169k - $338k

     ...What you'll do...As a Distinguished AI/ML Engineer within Walmart Global Tech’s Reliability...  ...development of next-generation agentic AI systems and intelligent automation solutions...  ...technology landscape.Develop self-healing infrastructure platforms that leverage AI to... 
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    5 days ago
  • $139k - $257.55k

     ...consistency, reusable design systems, and collaboration...  ...next generation of AI-native creative systems...  ...foundational branding infrastructure, our focus is on...  ...enterprise collaboration, and agentic creative workflows.We...  ...for forward-thinking engineers who are excited to... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Jose, CA
    6 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services) Overview...  ...responsible and reliable AI systems, changing banking for good....  ...investments in technology infrastructure and world-class talent - along...  ...: $229,900 - $262,400 for Sr. Lead AI Engineer... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    2 days ago
  • $152k - $241.5k

     ...'s Isaac Applications Engineering team and help build the...  ...platform for Physical AI robots — assembling...  ...for it, and build the infrastructure that keeps it true as...  ...skill evaluations so agentic workflows are measured...  ...in robotics, embedded systems, or another domain where... 
    Senior
    Full time
    Live in
    Night shift

    Nvidia

    Santa Clara, CA
    2 days ago
  • $244.14k - $413.16k

     ...innovation, integrating advanced AI and autonomous driving...  ...are looking for a hands-on Senior Staff AI Engineer to build and scale production-grade AI systems that drive measurable impact across...  ...systems using LLMs, retrieval, and agentic workflows. You will also define... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    3 days ago
  •  ...Senior Applied AI Engineer Agentic Systems Location: Mountain View, CA Job Description Agentic Feature Development & Full Stack Delivery Design, build, and ship agentic features directly within EAS - autonomous workflow agents, multi-step task orchestration... 
    Senior

    Swift Hire LLC

    Mountain View, CA
    1 day ago
  • $171k

    Sr. Staff ll, AI Engineer - Search (L7-2)We exist to wow our customers. We know...  ...strategy, building systems that are not just AI-enhanced...  ...and manage production AI infrastructure, including vector databases...  ...advanced prompt engineering, agentic design, and complex LLM chains... 
    Senior
    Temporary work
    Flexible hours

    Coupang

    Mountain View, CA
    3 days ago
  • $142.8k - $274.8k

     ...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewThe AI Infrastructure Engineering Systems team at Microsoft builds the cloud platform, engineering infrastructure, and developer systems that enable teams to... 
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    3 days ago
  • $286.2k - $326.7k

     ...Senior Director, AI Engineering -Agentic AI PlatformAt Capital One, we are creating...  ...and reliable AI systems, changing banking for good....  ...investments in technology infrastructure and world-class talent — along...  ...): $286,200 - $326,700 for Sr. Director, AI EngineeringCambridge... 
    Senior
    Full time
    Part time
    Remote work

    Capital One

    San Jose, CA
    2 days ago
  • $190.2k - $360.5k

     ...Opportunity We are looking for a Principal AI Systems Engineer with deep C++ expertise to help build...  ...You will design and build the native infrastructure, service integration layers,...  ...designing tool/function-calling interfaces, agentic workflows, or AI orchestration... 
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide

    Adobe Systems

    San Jose, CA
    3 days ago
  • $100k

     ...leading the industry on cutting-edge AI technology, revolutionizing...  ..., and emerging autonomous AI systems. As the RISC-V AI / HPC & Agentic Software Engineering Lead, you will operate at the hardware...  ...’s LLK (Low-Level Kernel) infrastructure for CPU execution, while... 
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    6 days ago
  • $188k - $300k

     ...re driving the transformation to AI-enabled software-defined...  ...Sonatus is seeking a highly motivated Staff AI Engineer to define and develop next-generation agentic AI applications for software-defined...  ...deploying end-to-end agentic AI systems in a production environment.In-... 
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    6 days ago
  • Palo Alto Networks, Inc. is hiring AI Engineers at Principal and Senior Principal levels to join the IT Business Applications team. You will...  ...architecture, own end-to-end delivery, and push intelligent, agentic workflows that improve GTM and customer #J-18808-Ljbffr Palo... 

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  • $136.5k - $276.5k

    AI/ML Engineer - AgenticThis role has been designed as ‘Hybrid’ with an...  ...Definition:The AI/ML Engineer - Agentic is a senior individual...  ...workflows and MCP server-based tool infrastructure. The role focuses on...  ...and high‑performance backend systems that power agent execution.... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    San Jose, CA
    5 days ago
  •  ...computing experiences—from AI and data centers, to...  ..., gaming and embedded systems. Grounded in a culture...  ...Deployed Research Engineer to build, evaluate, and...  ...reinforcement learning, agentic workflows, and post-...  ...across models, data, infrastructure, orchestration, and tooling... 
    Senior

    AMD

    Santa Clara, CA
    3 days ago
  • $160k - $235k

     ...role sits within our Low-Voltage GaN Marketing & Systems Group, acting as a Sr Staff System Engineer to define the future of our power semiconductor portfolio...  ...and charge pump supplies. Strong knowledge basic infrastructure and communications blocks like current/voltage... 
    Senior
    Full time
    Temporary work
    Local area
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work

    Renesas Electronics

    San Jose, CA
    20 days ago
  •  ...computing, cloud, and AI. Whether you’re designing...  ...-scale AI/ML clustered infrastructure. You will be working with the latest agentic tools and patterns to...  ...team of multi-disciplined engineers that operates across...  ...fundamentals: Linux operating systems, networking,... 
    Flexible hours

    AMD

    Santa Clara, CA
    2 days ago
  • $108k - $162k

     ...are seeking a highly skilled Sr. Systems & Infrastructure Engineer to join a dynamic, security...  ...365 administration, AI-augmented tooling, and endpoint...  ...architectures and hybrid on-prem/cloud failover workflows.Implement...  ...AI-assisted tooling and agentic workflows (e.g., Copilot... 
    Permanent employment
    Full time

    Onto Innovation

    Milpitas, CA
    3 days ago
  • $160k - $198k

     ...differences, and supports and celebrates all of our team members.What You’ll DoAs a Senior AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure services required for large-scale AI model training and inference. You will ensure our machine... 
    Senior
    Local area

    Archer Aviation

    San Jose, CA
    4 days ago
  •  ...technical professional to lead system level test solution...  ...support scalable test software infrastructure to enable automation and AI assisted flows Develop...  ...’s degree in Electrical Engineering, Computer/Electrical...  ...experience with generative and agentic AI tools Additional... 
    Senior
    Full time
    Temporary work
    Remote work
    Flexible hours
    Shift work

    Sandisk

    Milpitas, CA
    7 days ago
  • $189k - $301k

     ...RoleWe are seeking a Senior Staff Engineer to build and optimize the EDA...  ...and large-scale compute infrastructure that supports our semiconductor...  ...)Hands-on large-scale Linux system administration experienceWorking...  ...Artificial Intelligence (AI) tools in the recruitment... 
    Senior
    Contract work
    Work at office
    Remote work
    Flexible hours

    Samsung Semiconductor

    San Jose, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Staff AI Engineer - On-Prem AI Infrastructure & Agentic Systems. Be the first to apply!