Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer, Model Training, Inference & Infra

International Recruiting LLC

Job Description

Job Description

Full-time · On-site · San Jose, CA · Austin, TX or Taiwan

About Our Clients

Our client is building the next generation of design automation for the semiconductor industry.

Our mission is to enable every engineering organization to build its own self-improving agentic design workforce. It combines AI agents, engineering knowledge, agent-native tools, advanced models, and continuous learning to automate complex chip-design workflows.

The team brings deep experience in artificial intelligence, electronic design automation, semiconductor design, GPU-accelerated computing, and production software systems. We work closely with leading semiconductor companies to turn advanced research into technology that improves engineering productivity, design quality, and time to market.

The Role

We are looking for an exceptional AI Engineer to own the model training, inference, and infrastructure that power its agentic design workforce.

You will drive the full model lifecycle: data pipelines, pretraining and post-training, reinforcement learning, evaluation, and high-performance serving. You will build and operate the GPU training and serving stack — on the compute substrate our infrastructure team provides — that keeps large-scale training reliable and low-latency inference efficient at production scale. You will work on evaluation systems, model training, and the self-improving, self-evolving learning loops that let our models and agents get better over time from real execution feedback.

Your work directly determines how capable, fast, and cost-effective our agents are. This role is ideal for someone who combines strong research ability with exceptional systems and performance engineering skills, and who wants the models they train and serve deployed in real semiconductor design environments—not left in notebooks or benchmarks.

What You'll Do
  • Train, post-train, and fine-tune large language models for agentic engineering workflows, including supervised fine-tuning, RLHF/RLAIF, reinforcement learning, and distillation.

  • Build scalable data pipelines for pretraining, post-training, and evaluation, including sparse, private, and domain-specific engineering data.

  • Design and operate distributed training on multi-node GPU clusters, using data, tensor, pipeline, and sequence parallelism (for example FSDP, DeepSpeed, or Megatron-style approaches).

  • Build high-throughput, low-latency inference systems with continuous batching, KV-cache management, paged attention, quantization, and speculative decoding.

  • Write and optimize custom GPU kernels (CUDA, Triton) and profile end-to-end performance across CPUs and GPUs.

  • Build core model infrastructure: cluster orchestration, ML job scheduling, checkpointing, fault tolerance, reproducibility, model and environment management, observability, and cost and utilization tracking.

  • Build automated evaluation systems, benchmarks, and reward models that measure agent capability, reliability, and regression across complex engineering tasks, including problems where design data is private or customer-specific.

  • Design self-improving and self-evolving algorithms and learning loops, where models and agents learn from execution feedback, outcomes, and new data to improve continuously over time.

  • Integrate models with agent runtimes, tool use, retrieval, and the production serving stack.

  • Improve reliability, throughput, and cost efficiency across the training and inference platform.

  • Translate promising research ideas into reliable, scalable product capabilities.

  • Collaborate with research, product, platform, and solutions teams across San Jose, Austin, and Taiwan.

  • Contribute to patents, publications, technical presentations, and the broader development of Agentic Design Automation.

What We're Looking For
  • PhD or master's degree in Computer Science, Electrical Engineering, Computer Engineering, or a related field, or equivalent practical experience.

  • Strong programming skills in Python and proficiency in at least one systems language such as C++ or Rust.

  • Deep experience with machine learning frameworks such as PyTorch or JAX.

  • Hands-on experience with one or more of the following:

    • Large-scale or distributed model training

    • High-performance model inference and serving

    • GPU programming and performance optimization

    • ML infrastructure and platform engineering

    • Automated evaluation, reward modeling, or self-improving and continuous-learning systems

  • Ability to take a model from data and problem formulation through training, evaluation, and production deployment.

  • Strong analytical, software engineering, performance-optimization, and debugging skills.

  • High ownership, intellectual curiosity, and willingness to work across research and product boundaries.

  • Clear written and verbal communication skills.

Particularly Valuable Experience
  • Pretraining or post-training large language models at scale.

  • Distributed training frameworks such as Megatron-LM, DeepSpeed, FSDP, or Ray.

  • Production inference engines such as vLLM, TensorRT-LLM, SGLang, or TGI.

  • Custom kernel development with CUDA, Triton, or CUTLASS.

  • Inference optimization techniques such as quantization (FP8, GPTQ, AWQ), speculative decoding, or KV-cache optimization.

  • Reinforcement learning, RLHF, or reward-model training for LLMs.

  • Automated evaluation, benchmarking, or LLM-as-judge systems for agents.

  • Self-improving, self-evolving, or continuous-learning systems, including learning from execution feedback, automated curricula, or synthetic data generation.

  • GPU cluster infrastructure with Kubernetes, Slurm, or Ray, and high-performance networking such as NCCL or InfiniBand.

  • Data pipelines and MLOps for training and continuous learning.

  • Experience deploying AI systems in enterprise or security-sensitive environments.

  • A strong record of implementation through research systems, open-source projects, production software, or technical competitions.

Why Our Client

At this company, you will have the opportunity to:

  • Help define a new category of semiconductor design technology.

  • Build the training and inference stack that powers autonomous engineering agents.

  • Develop GPU-accelerated systems that make large-scale training and low-latency serving practical and cost-effective.

  • Build the evaluation and self-improvement loops that let agents learn and get better from real engineering work.

  • Build AI systems that perform complex, consequential engineering work—not just generate recommendations.

  • Work with real semiconductor workflows, tools, and private engineering knowledge.

  • See your models deployed directly with leading chip-design organizations.

  • Work in a small, highly technical team where individual contributions can shape the product and company.

  • Collaborate with colleagues across San Jose, Austin, and Taiwan.

  • Change how chips are designed, rather than focus on only one design or one point tool.

Our client is an equal opportunity employer. We welcome candidates from diverse backgrounds who are excited to combine ambitious research with meaningful engineering impact.

Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the AI Engineer, Model Training, Inference & Infra in Bellevue, WA vacancy
  • $154.56k - $193.2k

     ...edge, delivering modular AI infrastructure from...  ...seeking exceptional AI Engineers to build and deploy intelligent...  ...and vision-language models, robotics,...  ...detection, or distributed AI inference. This role is intended...  ...architectures. Design, train, fine-tune, and deploy... 
    Training
    Work at office
    Remote work
    Flexible hours

    Armada

    Bellevue, WA
    2 days ago
  •  ...exploring the next generation of AI technologies that will...  ...Intern focused on foundational models, you will contribute to research...  ...Responsibilities) Research post-training techniques for foundation...  ...with AI researchers and software engineers. Present experimental findings... 
    Training
    Permanent employment
    Summer work
    Internship
    Relocation package

    GE Vernova

    Bellevue, WA
    3 days ago
  • $201.3k - $352.3k

     ...Description It all started when engineer Fred Luddy wrote code that...  ...work. Today, ServiceNow is the AI control tower for business reinvention...  ...Software Engineer - AI/ML Inference Engineering to lead the...  ...—from onboarding cutting-edge models to deploying optimized inference... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Kirkland, WA
    12 days ago
  •  ...individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI...  ...bridging the gap between high-performance model development and optimized deployment environments...  ..., compensation, promotion, benefits, training, discipline, and termination. F5... 
    Training
    Full time
    Local area
    Immediate start

    F5 Networks

    Seattle, WA
    1 day ago
  • $216.2k - $394k

     ...DescriptionAs a Senior Staff/Principal Engineer on the Foundation Model Compute Infrastructure team,...  ...powering foundation model training, fine-tuning, evaluation, and inference.You will tackle challenging...  ...sandbox infrastructure for running AI agents, code execution, and... 
    Training
    Relocation

    Apple

    Seattle, WA
    2 days ago
  • $27 - $50 per hour

     ...stop! Get hands-on experience, training-and a leg up on a bright...  ...My team delivers end to end AI-Native solutions for churn retention...  ...You will work with senior AI Engineers to develop, deploy, and maintain...  ...Requirement analysis, data processing, model development and evaluation (... 
    Training
    Internship
    Summer internship
    Local area
    Immediate start
    Relocation package

    T-Mobile

    Bellevue, WA
    17 hours ago
  • $250k - $350k

     ...photorealistic, real-time AI avatars with emotional...  ...research with ruthless engineering needed for consumer-...  ...developing foundation models designed for it from the...  ...About the Role We can train a great model. The next...  ...lab, or a high-traffic inference team. Everyone at... 
    Training
    H1b
    Work at office
    Visa sponsorship

    Nuance Labs

    Seattle, WA
    1 day ago
  •  ...bring You're a senior security engineer with expert-level Microsoft...  ...Experience in automation and AI engineering, with proficiency...  ...well-being, and flexible working models help ensure that everyone - regardless...  ...apply for roles in Vocational Training. Qualified applicants will... 
    Training
    Permanent employment
    Full time
    Flexible hours

    SAP

    Bellevue, WA
    3 days ago
  • Job Title: Applied AI EngineerLocation: 100%...  ...Role As an Applied AI Engineer, you will turn model capabilities into real...  ..., orchestration, infra, UX)Optimize for latency...  ...APIs, LLaMA, Qwen, etc.)Inference / serving (e.g. vLLM)...  ...-on experience with training, fine-tuning, or... 
    Training

    Spectraforce Technologies

    Seattle, WA
    1 day ago
  •  ...startup on a mission to reinvent AI inference infrastructure from the...  ...design, where every layer, from model architecture to kernels to...  ...Inference Infrastructure Software Engineer to own and evolve the cloud...  ...with AI inference and/or training workflows and the operational... 
    Training
    Remote job
    Full time
    Work at office
    Flexible hours
    3 days per week

    elastix

    Seattle, WA
    4 days ago
  •  ...Description Job Description Position: AI Engineer Location: Redmond, WA Salary:...  .... Key Responsibilities Model Development: Design, train, and optimize machine learning and...  ...preprocess large datasets for training and inference. Deployment: Implement and... 
    Training

    Yantran LLC

    Redmond, WA
    21 days ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers...  ...Role Description As an AI engineer on the CRAFT (Capabilities,...  ...experience through backend services and model integrations. You'll turn research in post-training and model evaluation into... 
    Training
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    2 days ago
  • $272k - $431.25k

    We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware...  ...substantial distributed training operations using PyTorch (DDP, FSDP...  ..., involving data processing, model training, and inference pipelines.Proficiency in programming... 
    Training
    Full time

    Nvidia

    Redmond, WA
    2 days ago
  •  ...Computer Vision Engineer Location: Bellevue, WA. Onsite Job Type: Full-time...  ...deploy YOLO/CNN-based computer vision models , including training, fine-tuning, and optimization. Deploy...  ...re passionate about Computer Vision + AI + Edge Computing + Industrial... 
    Training
    Full time
    Work at office
    Relocation

    SID Global Solutions

    Bellevue, WA
    4 days ago
  • $176.76k - $232k

     ...company for yoga, running, training, and other athletic...  ...The Enterprise Data & AI team is a strategic and...  ...As a Senior AI/ML Engineer, you will lead the delivery...  ...challenges from setting up model training and fine-...  ...design for serving AI/ML inference solutions in production... 
    Training
    Permanent employment
    Full time
    Contract work
    Part time
    Work visa

    Lululemon athletica

    Seattle, WA
    1 day ago
  • $106k - $176.6k

     ...Help Build a New AI-Native Operating Model At Pfizer, we're investing in the future of AI-enabled...  ...RAG) Knowledge Graphs Distributed Training and Inference AI Platforms and MLOps AI...  ...’ll work alongside experts in AI, engineering, computational biology, and drug discovery... 
    Training
    Permanent employment
    H1b
    Local area
    Visa sponsorship
    Work visa
    Relocation package
    2 days per week

    Pfizer

    Bothell, WA
    4 days ago
  •  ...role involves working with data ingestion, model training, and production deployment systems. The...  ...Experience with Azure ML and Open AI Understanding of DevOps and MLOps/CI-...  ...Preferred Skills & Qualifications AI engineering skills for building custom co-pilots and... 
    Training
    Work experience placement
    Immediate start

    Artech LLC

    Bellevue, WA
    21 days ago
  • $153.07k - $276.12k

     ...UNSTOPPABLE for our employees! Engineer the intelligent core of T-...  ...experience. We’re seeking a Senior AI Engineer to architect and...  ...and coordinates across models, internal APIs, and third‑party...  ...optimization, fine‑tuning, and efficient inference strategies to enhance customer... 
    Temporary work
    Work experience placement
    Local area

    T-Mobile

    Bellevue, WA
    1 day ago
  • $112.8k - $153.7k

     ...your ideas. This is a senior engineering role. You will architect, operate...  ...project architecture, access models, capacity planning,...  ..., etc.) are a plus. Hands-on AI/ML/GenAI enablement experience...  ...of absence, compensation and training. Armanino expressly prohibits... 
    Training
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    Bellevue, WA
    4 days ago
  •  ...building machine learning models and systems to protect...  ...MoE architecture training and routing optimization...  ...stability3. Context engineering and tool collaboration...  ...represents the frontier of AI today. This topic...  ...for training/finetuning/inference; Being familiar with... 
    Training
    Flexible hours
    Shift work

    TikTok

    Seattle, WA
    2 days ago
  • $152k - $241.5k

     ...outstanding Senior High Performance AI Engineers to build the next generation of agentic...  ...the full agentic AI stack—from training and improving models, to designing agent architectures and...  ...and hardware stack, from models and inference through compilers, runtimes, libraries... 
    Training
    Full time
    Remote work

    Nvidia

    Redmond, WA
    16 hours ago
  • $184k - $287.5k

     ...are looking for a strong engineer to join the DRIVE Road...  ..., learned 3D/4D world model that fuses navigation,...  ...inventing human-level AI for navigation in the unconstrained...  ...modal attention.Create training, fine-tuning, and...  ..., and efficient GPU inference using NVIDIA software... 
    Training
    Full time
    Remote work
    Shift work

    Nvidia

    Seattle, WA
    4 days ago
  •  ...are seeking a highly motivated Applied AI Engineer with a strong foundation in Machine Learning...  ...and a deep interest in Large Language Models (LLMs) and Generative AI . This role...  ...) , fine‑tuning workflows, and scalable inference pipelines. Design and implement LLM‑... 
    Work at office
    Worldwide

    ZS

    Bellevue, WA
    4 days ago
  • $168.1k - $227.4k

     ...Senior Forward Deployed Engineer (Senior FDE) on the Custom Model and Optimization team, you...  ...running the custom generative AI models at the heart of...  ...foundation models, post-training frontier-scale open-...  ...migrating large training and inference workloads onto AWS Trainium... 
    Training
    Internship
    Local area
    Flexible hours

    AmazonWebServices

    Seattle, WA
    16 hours ago
  • $91.1k - $179.5k

     ...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI...  ...ship production pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT/Codex-, Gemini... 
    Training
    Local area

    Deloitte

    Seattle, WA
    2 days ago
  • $143.7k - $194.4k

    As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with...  ..., and run custom generative AI models in production alongside their...  ...bar and preparing data, through training and inference optimization, to production deployment... 
    Training
    Temporary work
    Internship
    Flexible hours

    AmazonWebServices

    Seattle, WA
    3 days ago
  • $122k - $240.5k

     ...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI...  ...ship production pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT/Codex-, and Gemini... 
    Training
    Local area
    Visa sponsorship

    Deloitte

    Seattle, WA
    2 days ago
  • $175k - $308.5k

     ...26-10-29SummaryWe are looking for senior engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing...  ...systems, capacity projection models, and data analysis pipelines that directly... 
    Worldwide
    Relocation

    Apple

    Seattle, WA
    2 days ago
  • $160k - $250k

     ...our Colossus supercomputers, to Grok models, to our suite of applications, including...  ...powerful flywheel where more compute trains better models, better models power...  ...shapes what we build next. SOFTWARE ENGINEER, TRAINING/INFERENCE (C++) At SpaceXSI we are building the... 
    Training
    Temporary work

    SpaceXSI

    Bellevue, WA
    13 days ago
  • $106k - $159k

     ...Scientist Lead II - ML Engineering Who We...  ...Develop Foundation Models: Contribute to the...  ...-scale model pre-training, alignment, and benchmarking...  ...high-impact AI solutions at top-tier...  ...QLoRA, vLLM, Triton Inference Server. Data & Vector Infra: Pinecone, Milvus, Weaviate... 
    Training
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Flexible hours

    UST Inc

    Bellevue, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer, Model Training, Inference & Infra. Be the first to apply!