ML Systems Engineer LLM Inference & Multi-Node Performance
ScOp Venture Capital LLC.
ChipAgents seeks an ML Systems Engineer to optimize the performance and efficiency of large language model inference powering its agentic AI platform. This role centers on low-level systems optimization and building scalable multi-node clusters for training and inference that push LLM throughput and latency limits. You will implement performance optimizations, build evaluation harnesses, and collaborate with researchers to integrate new model architectures into production infrastructure. #J-18808-Ljbffr ScOp Venture Capital LLC.
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer LLM Inference & Multi-Node Performance in Eastern, KY vacancy
- ...career. THE ROLE: We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation... ...evaluating correctness, measuring performance, managing long-latency rewards... ...inference and tool-use pipelines for LLM agents that interact with...Performance
- ...hiring a Member of Technical Staff to build ML systems that enable sustained AI research. You will own performance-critical components across model serving, GPU... ...workloads, and you will push beyond a simple inference engine to improve correctness and efficiency. You will...Performance
- ...platform with a focus on scalable LLM serving and RL integration.... ...spans cloud LLM serving, inference optimization, and RL systems. You will advance our... ...RL Lab at scale, building multi-tenant serving, scheduling,... ...regions. Requires 3+ years on ML/LLM infra, experience with...Suggested
$178.2k - $232.65k
Engineering | Seattle, United States | Remote, Remote | San... ...a legal entity. As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and... ..., Triton, TensorRT-LLM, etc.). It would be great... ...have: 1+ years of system performance optimization experience...PerformanceWork at officeLocal areaRemote work- ...Corporation is seeking a Machine Learning Systems Engineer, Networking to design and implement ML algorithms for real-time... ...-end ML pipelines and optimize performance within strict CPU/memory budgets... ...proactive AI training and inference across massive-scale infrastructure...Performance
- ...seeking a Machine Learning Engineer to join our Inference Infrastructure team.... ...-latency distributed systems that power models... .... Monitor system performance, troubleshoot bottlenecks... ...systems or ML infrastructure. Deep... ...frameworks (vLLM, TensorRT-LLM, Megatron). Benefits...PerformanceWorldwideFlexible hours
- ...is an AI-native engineering firm... ...solutions, and high-performance infrastructure... ...build innovative systems that drive measurable... ...of production multi-agent systems... ...Architect distributed inference pipelines,... ...research-grade ML into resilient... ...vLLM, TensorRT-LLM, or equivalent...PerformanceLong term contractTemporary work
AKIVA AI, LLC
Eastern, KY1 day ago $184.7k - $324.8k
...within the Hardware Engineering Group. As a vital... ...organization, the System RF group designs... ...ensuring world‑class performance from prototype to... ...by building AI/ML‑powered analytics... ...pipelines and oversee LLM fine‑tuning... ...Design and Architect Multi‑Agent Systems: Lead...PerformanceWorldwideRelocation$180k
# ML Runtime and Kernel Engineer - Core MLCerebrasSunnyvale, CA... ...components and high-performance kernels that... ...ideas to Cerebras systems. They work... ...improve training and inference performance and... ...frameworks, kernels, and LLM workloads.##... ...announced a multi-year partnership...PerformancePermanent employmentRemote work$272.7k - $356.03k
...Principal Machine Learning Systems Engineer, Search Platform... ...to determine where new ML capabilities can meaningfully... ...query processing, and ML inference. Turn advances in information... ...expertise across performance, concurrency, availability, multi-tenancy, capacity planning...PerformanceWork at officeLocal areaRemote work$70 per hour
...an experienced AI/ML Engineer with strong expertise... ..., agentic systems, cloud AI infrastructure... ...using LLMs, RAG, multi-agent orchestration... ...Responsibilities LLM & RAG Systems Design... ...standards to performance, scalability, and... ...for AI training and inference Design and manage...PerformanceFull timeRemote work- ...AKIVA is an AI-native engineering firm specializing... ..., and high-performance infrastructure from... ...build innovative systems that drive measurable... ...engineering, or SRE for ML systems ~ Hands-... ...vLLM, TensorRT-LLM, or Triton Inference Server in production Multi-cluster GPU...PerformanceLong term contractTemporary work
AKIVA AI, LLC
Eastern, KY1 day ago - ...compiler” in the world for physics and performance‑critical numerical computing. We are fully... ...code should feel natural to write. Engineers write plain Python in a NumPy or PyTorch... ...optimal, and the ability to keep the whole system coherent as it grows. The core tradeoff...Performance
$184.7k - $324.8k
Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference Santa Clara... ...to build the most highly performant, secure and private... ...largest foundation models.Our systems serve billions of queries... ...Hands-on experience with LLM inference stacks. Working...PerformanceWorldwideRelocation$150k - $300k
## Senior Staff ML EngineerApply: Hybrid:... ...architecting a centralized multi-modal fraud defense... ...Machine Learning Engineer, you will be a... ...elegance, system reliability, and is... ...implement scalable, high-performance machine learning platforms... ...deploying LLM in production (RAG,...PerformanceHourly payFull timeWork experience placementLocal areaGEICO
Eastern, KY1 day ago- ...Seattle is seeking a Machine Learning Engineer to advance governance algorithms for... ...seller/creator groups and develop LLM-based multi-modal systems to detect false advertising and low-... ...time-series forecasting for logistics performance, contributing to safer, more...Performance
$236.7k - $309.03k
Principal Machine Learning Systems Engineer (GenAI Products & Knowledge Innovations... ...with reliable, high-performance infrastructure. Working at... ...You’ll Do Design and Build ML Systems Architect and implement... ...large‑scale model training, inference pipelines, or search/...PerformanceWork at officeLocal areaRemote work$153.9k - $300.96k
Machine Learning Engineer, E-commerce Governance... ...Neural Networks, Multi-Objective... ...Language Models (LLM) to tackle some of... ...based multi-modal systems using cross-modal... ...innovation for logistics performance metrics (e.g., delivery... ...through causal inference frameworks, identifying...PerformanceTemporary workLocal area- ...Staff / Principal Machine Learning Engineer, Serving, to help scale realtime TTS... ..., and reliability of high-performance inference systems across multi-GPU hardware and distributed clusters... ...track record of shipping production ML systems. Relocation assistance is offered...PerformanceWork at officeRelocation package
- ...IT has an opening for an experienced System Engineer with Linux system administration experience... ...changes to help improve system performance; Regularly work with government and contractor... ...building, optimizing, and maintaining multi-node environments that run parallel...PerformanceFull timeFor contractors
Aqua IT
Eastern, KY1 day ago - ...Infrastructure Engineer (SRE) Department: Engineering... ...cars and aerospace systems to medical devices and... ...systems that power high-performance simulation, geometry... ...engineers on simulation, ML, and backend teams to... ...large GPU fleets or multi-node compute tasks Security...PerformanceVisa sponsorship
Blackwing
Eastern, KY1 day ago $7.5k
...mission-critical contract providing systems architecture and engineering in a world-wide multi-level Enterprise IT environment... ...that may be logically inferred and implied as essential to system... ...developing system architectures, and performing technical/non-technical...PerformanceContract workWork experience placementImmediate startFlexible hoursRealmOne
Eastern, KY1 day ago- ...Python REST APIs LLMs RAG multi-agent orchestration... ...Job Job Title: AI/ML Engineer Job Type: Full-... ...the most advanced AI systems, powering the breakthroughs... ...routes, and improves performance at scale. Job... ...data for AI training and inference. Create and maintain...PerformanceFull time
Artha Nexgen
Eastern, KY1 day ago $150k - $170k
...seeking a Software Engineer specialized in AI/ML applications to... ...of AI-powered systems. This role sits... ...workloads across multi-node clusters. Design... ...to benchmark performance and swap models... ...low-latency AI inference workloads. AI evaluation... ...and systematic LLM evaluations....PerformanceFlexible hours$150k - $200k
...AI / Machine Learning Engineer to design, build,... ...focuses on applying modern ML and GenAI techniques in production systems — from... ...GenAI solutions (e.g., LLM-based workflows, retrieval... ...support model training and inference Evaluate model performance, bias, drift, and...PerformanceContract workFor contractorsWork at officeRemote workFlexible hoursOddball
Eastern, KY1 day ago- Apple Inc. in Santa Clara, CA seeks a System Performance Engineer - AI/ML to benchmark AI experiences across devices. You will curate AI workloads, define metrics, and analyze performance to guide hardware and software optimizations. You will collaborate with silicon, OS...Performance
- ...Senior Machine Learning Engineers leverage their... ...factory inside the health system of the University of Utah... ...maintaining, and refactoring ML codebases, pipelines,... ...and workflows for high-performance computing (HPC)... ...Tasting or Smelling, Walking Multi-lingual Candidates Welcomed...PerformanceFull timeTemporary workWork at officeMonday to FridayShift work
$130k - $190k
...We are seeking a Staff ML Engineer to lead the design, delivery... ...of production-grade AI systems. You will build the... ...of traditional ML and LLM-based components.* Establish... ..., latency, and inference cost.* Partner with Product... ...of failure recovery, multi-tenancy, and capacity planning...For contractorsLocal areaPress Ganey
Eastern, KY1 day ago$160k - $300k
...mission-critical systems up to 10x faster and... ...automate complex engineering judgment. As a Senior... ...for training, inference, labeling, and evaluation... ...the entire ML Lifecycle Proficiency... ...achieving high performance results -... ...Prior experience with multi-modal deep learning...PerformancePermanent employmentFull timeRelocation packageFlexible hoursTelemetry Today LLC
Eastern, KY1 day ago- ...seeking a senior MLOps Engineer to support... ...Bureau's AWS-based LLM Autocoder. You will... .... Working with AI/ML engineers and evaluators... ...; connect model-performance monitoring with... ...changes, and verify system behavior after... ...Experience operating LLM inference workflows, batch...PerformanceContract workWork at officeFlexible hours
Ignite IT, LLC
Eastern, KY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer LLM Inference & Multi-Node Performance. Be the first to apply!
Related searches
- senior ml engineer Eastern, KY
- data scientist machine learning engineer Eastern, KY
- machine learning ai engineer Eastern, KY
- machine learning software engineer Eastern, KY
- ai ml engineer Eastern, KY
- machine learning engineer Eastern, KY
- graduate machine learning engineer Eastern, KY
- computer vision machine learning engineer Eastern, KY
- data systems engineer Eastern, KY
- director systems engineering Eastern, KY