AI Engineer, Model Training, Inference & Infra
International Recruiting LLC
Job Description
Job Description
Full-time · On-site · San Jose, CA · Austin, TX or Taiwan
About Our ClientsOur client is building the next generation of design automation for the semiconductor industry.
Our mission is to enable every engineering organization to build its own self-improving agentic design workforce. It combines AI agents, engineering knowledge, agent-native tools, advanced models, and continuous learning to automate complex chip-design workflows.
The team brings deep experience in artificial intelligence, electronic design automation, semiconductor design, GPU-accelerated computing, and production software systems. We work closely with leading semiconductor companies to turn advanced research into technology that improves engineering productivity, design quality, and time to market.
The RoleWe are looking for an exceptional AI Engineer to own the model training, inference, and infrastructure that power its agentic design workforce.
You will drive the full model lifecycle: data pipelines, pretraining and post-training, reinforcement learning, evaluation, and high-performance serving. You will build and operate the GPU training and serving stack — on the compute substrate our infrastructure team provides — that keeps large-scale training reliable and low-latency inference efficient at production scale. You will work on evaluation systems, model training, and the self-improving, self-evolving learning loops that let our models and agents get better over time from real execution feedback.
Your work directly determines how capable, fast, and cost-effective our agents are. This role is ideal for someone who combines strong research ability with exceptional systems and performance engineering skills, and who wants the models they train and serve deployed in real semiconductor design environments—not left in notebooks or benchmarks.
What You'll Do-
Train, post-train, and fine-tune large language models for agentic engineering workflows, including supervised fine-tuning, RLHF/RLAIF, reinforcement learning, and distillation.
-
Build scalable data pipelines for pretraining, post-training, and evaluation, including sparse, private, and domain-specific engineering data.
-
Design and operate distributed training on multi-node GPU clusters, using data, tensor, pipeline, and sequence parallelism (for example FSDP, DeepSpeed, or Megatron-style approaches).
-
Build high-throughput, low-latency inference systems with continuous batching, KV-cache management, paged attention, quantization, and speculative decoding.
-
Write and optimize custom GPU kernels (CUDA, Triton) and profile end-to-end performance across CPUs and GPUs.
-
Build core model infrastructure: cluster orchestration, ML job scheduling, checkpointing, fault tolerance, reproducibility, model and environment management, observability, and cost and utilization tracking.
-
Build automated evaluation systems, benchmarks, and reward models that measure agent capability, reliability, and regression across complex engineering tasks, including problems where design data is private or customer-specific.
-
Design self-improving and self-evolving algorithms and learning loops, where models and agents learn from execution feedback, outcomes, and new data to improve continuously over time.
-
Integrate models with agent runtimes, tool use, retrieval, and the production serving stack.
-
Improve reliability, throughput, and cost efficiency across the training and inference platform.
-
Translate promising research ideas into reliable, scalable product capabilities.
-
Collaborate with research, product, platform, and solutions teams across San Jose, Austin, and Taiwan.
-
Contribute to patents, publications, technical presentations, and the broader development of Agentic Design Automation.
-
PhD or master's degree in Computer Science, Electrical Engineering, Computer Engineering, or a related field, or equivalent practical experience.
-
Strong programming skills in Python and proficiency in at least one systems language such as C++ or Rust.
-
Deep experience with machine learning frameworks such as PyTorch or JAX.
-
Hands-on experience with one or more of the following:
-
Large-scale or distributed model training
-
High-performance model inference and serving
-
GPU programming and performance optimization
-
ML infrastructure and platform engineering
-
Automated evaluation, reward modeling, or self-improving and continuous-learning systems
-
-
Ability to take a model from data and problem formulation through training, evaluation, and production deployment.
-
Strong analytical, software engineering, performance-optimization, and debugging skills.
-
High ownership, intellectual curiosity, and willingness to work across research and product boundaries.
-
Clear written and verbal communication skills.
-
Pretraining or post-training large language models at scale.
-
Distributed training frameworks such as Megatron-LM, DeepSpeed, FSDP, or Ray.
-
Production inference engines such as vLLM, TensorRT-LLM, SGLang, or TGI.
-
Custom kernel development with CUDA, Triton, or CUTLASS.
-
Inference optimization techniques such as quantization (FP8, GPTQ, AWQ), speculative decoding, or KV-cache optimization.
-
Reinforcement learning, RLHF, or reward-model training for LLMs.
-
Automated evaluation, benchmarking, or LLM-as-judge systems for agents.
-
Self-improving, self-evolving, or continuous-learning systems, including learning from execution feedback, automated curricula, or synthetic data generation.
-
GPU cluster infrastructure with Kubernetes, Slurm, or Ray, and high-performance networking such as NCCL or InfiniBand.
-
Data pipelines and MLOps for training and continuous learning.
-
Experience deploying AI systems in enterprise or security-sensitive environments.
-
A strong record of implementation through research systems, open-source projects, production software, or technical competitions.
At this company, you will have the opportunity to:
-
Help define a new category of semiconductor design technology.
-
Build the training and inference stack that powers autonomous engineering agents.
-
Develop GPU-accelerated systems that make large-scale training and low-latency serving practical and cost-effective.
-
Build the evaluation and self-improvement loops that let agents learn and get better from real engineering work.
-
Build AI systems that perform complex, consequential engineering work—not just generate recommendations.
-
Work with real semiconductor workflows, tools, and private engineering knowledge.
-
See your models deployed directly with leading chip-design organizations.
-
Work in a small, highly technical team where individual contributions can shape the product and company.
-
Collaborate with colleagues across San Jose, Austin, and Taiwan.
-
Change how chips are designed, rather than focus on only one design or one point tool.
Our client is an equal opportunity employer. We welcome candidates from diverse backgrounds who are excited to combine ambitious research with meaningful engineering impact.
$154.56k - $193.2k
...edge, delivering modular AI infrastructure from... ...seeking exceptional AI Engineers to build and deploy intelligent... ...and vision-language models, robotics,... ...detection, or distributed AI inference. This role is intended... ...architectures. Design, train, fine-tune, and deploy...TrainingWork at officeRemote workFlexible hours- ...exploring the next generation of AI technologies that will... ...Intern focused on foundational models, you will contribute to research... ...Responsibilities) Research post-training techniques for foundation... ...with AI researchers and software engineers. Present experimental findings...TrainingPermanent employmentSummer workInternshipRelocation package
$201.3k - $352.3k
...Description It all started when engineer Fred Luddy wrote code that... ...work. Today, ServiceNow is the AI control tower for business reinvention... ...Software Engineer - AI/ML Inference Engineering to lead the... ...—from onboarding cutting-edge models to deploying optimized inference...SuggestedFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours- ...individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI... ...bridging the gap between high-performance model development and optimized deployment environments... ..., compensation, promotion, benefits, training, discipline, and termination. F5...TrainingFull timeLocal areaImmediate start
$216.2k - $394k
...DescriptionAs a Senior Staff/Principal Engineer on the Foundation Model Compute Infrastructure team,... ...powering foundation model training, fine-tuning, evaluation, and inference.You will tackle challenging... ...sandbox infrastructure for running AI agents, code execution, and...TrainingRelocation$27 - $50 per hour
...stop! Get hands-on experience, training-and a leg up on a bright... ...My team delivers end to end AI-Native solutions for churn retention... ...You will work with senior AI Engineers to develop, deploy, and maintain... ...Requirement analysis, data processing, model development and evaluation (...TrainingInternshipSummer internshipLocal areaImmediate startRelocation package$250k - $350k
...photorealistic, real-time AI avatars with emotional... ...research with ruthless engineering needed for consumer-... ...developing foundation models designed for it from the... ...About the Role We can train a great model. The next... ...lab, or a high-traffic inference team. Everyone at...TrainingH1bWork at officeVisa sponsorship- ...bring You're a senior security engineer with expert-level Microsoft... ...Experience in automation and AI engineering, with proficiency... ...well-being, and flexible working models help ensure that everyone - regardless... ...apply for roles in Vocational Training. Qualified applicants will...TrainingPermanent employmentFull timeFlexible hours
- Job Title: Applied AI EngineerLocation: 100%... ...Role As an Applied AI Engineer, you will turn model capabilities into real... ..., orchestration, infra, UX)Optimize for latency... ...APIs, LLaMA, Qwen, etc.)Inference / serving (e.g. vLLM)... ...-on experience with training, fine-tuning, or...Training
- ...startup on a mission to reinvent AI inference infrastructure from the... ...design, where every layer, from model architecture to kernels to... ...Inference Infrastructure Software Engineer to own and evolve the cloud... ...with AI inference and/or training workflows and the operational...TrainingRemote jobFull timeWork at officeFlexible hours3 days per week
- ...Description Job Description Position: AI Engineer Location: Redmond, WA Salary:... .... Key Responsibilities Model Development: Design, train, and optimize machine learning and... ...preprocess large datasets for training and inference. Deployment: Implement and...Training
$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers... ...Role Description As an AI engineer on the CRAFT (Capabilities,... ...experience through backend services and model integrations. You'll turn research in post-training and model evaluation into...TrainingFull timeTemporary workCasual workWork at officeFlexible hours$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware... ...substantial distributed training operations using PyTorch (DDP, FSDP... ..., involving data processing, model training, and inference pipelines.Proficiency in programming...TrainingFull time- ...Computer Vision Engineer Location: Bellevue, WA. Onsite Job Type: Full-time... ...deploy YOLO/CNN-based computer vision models , including training, fine-tuning, and optimization. Deploy... ...re passionate about Computer Vision + AI + Edge Computing + Industrial...TrainingFull timeWork at officeRelocation
$176.76k - $232k
...company for yoga, running, training, and other athletic... ...The Enterprise Data & AI team is a strategic and... ...As a Senior AI/ML Engineer, you will lead the delivery... ...challenges from setting up model training and fine-... ...design for serving AI/ML inference solutions in production...TrainingPermanent employmentFull timeContract workPart timeWork visa$106k - $176.6k
...Help Build a New AI-Native Operating Model At Pfizer, we're investing in the future of AI-enabled... ...RAG) Knowledge Graphs Distributed Training and Inference AI Platforms and MLOps AI... ...’ll work alongside experts in AI, engineering, computational biology, and drug discovery...TrainingPermanent employmentH1bLocal areaVisa sponsorshipWork visaRelocation package2 days per week- ...role involves working with data ingestion, model training, and production deployment systems. The... ...Experience with Azure ML and Open AI Understanding of DevOps and MLOps/CI-... ...Preferred Skills & Qualifications AI engineering skills for building custom co-pilots and...TrainingWork experience placementImmediate start
$153.07k - $276.12k
...UNSTOPPABLE for our employees! Engineer the intelligent core of T-... ...experience. We’re seeking a Senior AI Engineer to architect and... ...and coordinates across models, internal APIs, and third‑party... ...optimization, fine‑tuning, and efficient inference strategies to enhance customer...Temporary workWork experience placementLocal area$112.8k - $153.7k
...your ideas. This is a senior engineering role. You will architect, operate... ...project architecture, access models, capacity planning,... ..., etc.) are a plus. Hands-on AI/ML/GenAI enablement experience... ...of absence, compensation and training. Armanino expressly prohibits...TrainingFull timeContract workLocal areaFlexible hours- ...building machine learning models and systems to protect... ...MoE architecture training and routing optimization... ...stability3. Context engineering and tool collaboration... ...represents the frontier of AI today. This topic... ...for training/finetuning/inference; Being familiar with...TrainingFlexible hoursShift work
$152k - $241.5k
...outstanding Senior High Performance AI Engineers to build the next generation of agentic... ...the full agentic AI stack—from training and improving models, to designing agent architectures and... ...and hardware stack, from models and inference through compilers, runtimes, libraries...TrainingFull timeRemote work$184k - $287.5k
...are looking for a strong engineer to join the DRIVE Road... ..., learned 3D/4D world model that fuses navigation,... ...inventing human-level AI for navigation in the unconstrained... ...modal attention.Create training, fine-tuning, and... ..., and efficient GPU inference using NVIDIA software...TrainingFull timeRemote workShift work- ...are seeking a highly motivated Applied AI Engineer with a strong foundation in Machine Learning... ...and a deep interest in Large Language Models (LLMs) and Generative AI . This role... ...) , fine‑tuning workflows, and scalable inference pipelines. Design and implement LLM‑...Work at officeWorldwide
$168.1k - $227.4k
...Senior Forward Deployed Engineer (Senior FDE) on the Custom Model and Optimization team, you... ...running the custom generative AI models at the heart of... ...foundation models, post-training frontier-scale open-... ...migrating large training and inference workloads onto AWS Trainium...TrainingInternshipLocal areaFlexible hours$91.1k - $179.5k
...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI... ...ship production pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT/Codex-, Gemini...TrainingLocal area$143.7k - $194.4k
As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with... ..., and run custom generative AI models in production alongside their... ...bar and preparing data, through training and inference optimization, to production deployment...TrainingTemporary workInternshipFlexible hours$122k - $240.5k
...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI... ...ship production pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT/Codex-, and Gemini...TrainingLocal areaVisa sponsorship$175k - $308.5k
...26-10-29SummaryWe are looking for senior engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing... ...systems, capacity projection models, and data analysis pipelines that directly...WorldwideRelocation$160k - $250k
...our Colossus supercomputers, to Grok models, to our suite of applications, including... ...powerful flywheel where more compute trains better models, better models power... ...shapes what we build next. SOFTWARE ENGINEER, TRAINING/INFERENCE (C++) At SpaceXSI we are building the...TrainingTemporary work$106k - $159k
...Scientist Lead II - ML Engineering Who We... ...Develop Foundation Models: Contribute to the... ...-scale model pre-training, alignment, and benchmarking... ...high-impact AI solutions at top-tier... ...QLoRA, vLLM, Triton Inference Server. Data & Vector Infra: Pinecone, Milvus, Weaviate...TrainingFull timeTemporary workPart timeWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer, Model Training, Inference & Infra. Be the first to apply!






