LLM Systems Engineer
International Recruiting LLC
Job Description
Job Description
About the role
We’re looking for a motivated LLM Systems Engineer willing to explore new and unconventional inference systems based on emerging hardware.
This role is part engineering, part research – you’ll be responsible for searching and prototyping various algorithms suitable for our inference hardware, as well as guiding our hardware team on the product definition. The ideal candidate has a proven track of record of pursuing ML systems research, and is very familiar with industry-standard LLM inference systems.
This role will be performed on-site from one of our offices in Santa Clara, CA or Boston, MA.
Essential Duties and Responsibilities
• Prototype and optimize emerging ML inference systems.
• Develop novel memory models for expandable vRAM.
• Write efficient GPU kernels for data movement.
• Perform design-space exploration, implementation, and benchmarking of inference engines, both in simulations and on real hardware.
Qualifications
• MS or PhD in computer systems, ideally with a focus on LLM inference and/or distributed systems.
• Prior experience contributing to the core LLM inference infrastructures (vLLM, SGLang, TensorRT, etc.).
• Prior experience in accelerator programming (e.g. CUDA, JAX/Pallas, ROCm).
• Advanced computer architectures and performance engineering skills is a big plus.
Compensation & Benefits
• Competitive salary commensurate with experience including base salary, incentive-based bonus, and early stage equity grant.
• Comprehensive benefits including health, dental, vision, and life insurance.
• Well-equipped, sunny offices in Santa Clara, CA and Boston, MA.
• Relocation assistance and visa sponsorship.
• Perks include a daily lunch stipend, 401k match, and more.
• A collaborative, continuous-learning work environment with smart, dedicated colleagues engaged in developing the next generation of architecture for high-performance computing.
The Opportunity
• Impact: We are tackling a fundamental challenge at the infrastructure layer: unlocking greater AI capability while dramatically improving efficiency. The work we do here compounds across state-of-the-art AI models, systems, and real-world applications.
• Timing: Joining now means real ownership of the company and meaningful influence over product direction and execution. You’ll work from first principles, move quickly from insight to execution, and see your contributions directly reflected in what we build.
• Culture: You’ll work alongside a group of people who care deeply about rigor, clarity, and impact. We value thoughtful disagreement, fast learning, and intellectual fearlessness. This is a place where strong ideas shine, curiosity is encouraged, and growth is a daily practice.
$236k - $330k
...work gets done.We are looking for talented systems developers and researchers to join the... ...team and advance the state of the art in LLM inference systems and optimization.Our mission... ...manual tuning. We embrace AI-native engineering, using AI not only as the workload we optimize...Suggested$153k - $204k
...Senior Systems Engineer, Test Frameworks & Validation Platform Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is... ...run into a root cause quickly. Explore AI-native testing — LLM-driven log triage, failure classification, and regression detection...SuggestedPermanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hours- ...matters to the world. The Production Engineering Team Examples of key exciting problems... ...company, not a hundred scripts. Make the system's view of itself always match reality:... ...move on. You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks...SuggestedLocal area
$75 - $80 per hour
...RF Systems Engineer Help Build and Scale Next-Generation Wireless Infrastructure Are you the type of engineer who loves solving complex problems at scale? Do you enjoy digging deep into RF systems, automating away operational pain points, and building resilient...SuggestedContract workTemporary work- ...Title :System Engineer Location: Redmond,WA ( Day 1 onsite) Experience: 5-10Years Job Description We are seeking a System Engineer with strong experience in UEFI/Firmware and Windows system-level development. The role involves kernel driver development...Suggested
$165.2k - $223.6k
...powers AI at scale? Do you want to work on systems that serve millions of Alexa customers... ...team is looking for Software Development Engineers to join our Inferences Services Team.We build... ...owners to analyze, forecast, and manage LLM infrastructure drivers, costs, and usage...InternshipLocal areaFlexible hours$170k - $190k
...audio and video hardware and software for the business jet industry. We are looking for a skilled and customer focused Senior Systems Engineer to provide frontline technical support and troubleshooting, engage with customers to understand their needs, provide solutions...Full timeTemporary workNight shiftWeekend work$52 - $85 per hour
...Senior Fuel Handling & Dry Storage System Engineer Company: System One Location: (Remote/Offsite) Position Type: Long-Term Contract Pay Rate: $52.00 - $85.00/hour Schedule: 40 hours/week Position Overview System One is seeking an experienced Senior...Long term contractTemporary workFor contractorsLocal areaRemote work$117k - $161k
...This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Senior Systems Engineer Opportunity As a Senior Systems Engineer at Okta, you will be at the heart of how our global workforce communicates, collaborates...Permanent employmentLocal areaWorldwideFlexible hours$142k - $177k
...About Volant Partners Volant Partners provides business and engineering consulting services to companies across the United States. We... ...Job Description Volant Partners, Inc is seeking a Senior Systems Engineer with a strong electrical engineering background to assist...Permanent employmentRelocationFlexible hours$47 - $85 per hour
...Job Title: Systems & Requirements Management Engineer Location: Remote Pay $47-$85 an hour Position Type: Long term Contract Position Overview System One is seeking a highly motivated Systems & Requirements Management Engineer to support advanced nuclear...Long term contractFor contractorsFor subcontractorLocal areaRemote work$46 - $77 per hour
...Job Description Position Title: Systems and Requirements Management Engineer Position Description: Protingent Staffing has an exciting contract Systems and Requirements Management Engineer opportunity. Job Responsibilities: Develop and maintain programmatic...Permanent employmentContract workFor contractorsFor subcontractorStart working todayRemote work$56 - $95 per hour
...Job Description Position Title: Senior Systems Engineer - Applications Position Description: Protingent Staffing has an exciting contract Senior Systems Engineer - Applications opportunity. Job Responsibilities: Application Management & Support: Serve...Permanent employmentContract workWork experience placementRemote work$153.86k - $205.15k
...System Transients Analysis Engineer Bellevue, Washington, United States TerraPower is a nuclear technology company based in Bellevue, Washington. At its core, the company is working to raise living standards globally through a more affordable, secure, and environmentally...Permanent employmentTemporary workLocal areaRelocation package$10 per hour
...challenges that impact business, society, and the environment? Come join us. The Opportunity: Flexport IT is looking for a Senior Systems Engineer (Identity & Access) . In this role, you will design, implement, and administer our Identity and Access Management (IAM)...Remote workFlexible hours- ...contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.LEAD SYSTEMS DEBUG ENGINEER THE ROLE: We are looking for a dynamic, energetic and experienced Systems Debug Engineer to join our Server Customer...
- ...we're making a difference. Are you passionate about creating safe, resilient environments? We're looking for a Life Safety Systems Engineer to design solutions that safeguard cutting-edge facilities where innovation thrives. From semiconductor manufacturing to data...Work at officeLocal areaRemote work
$200k - $287.5k
...future of how work gets done.Senior Software Engineer — Cortex TrainingThe Snowflake ML... ...inside Snowflake. Cortex Training is our LLM post-training platform: it turns scarce,... ...problems while we handle the hard distributed-systems parts, including scheduling, orchestration...$182k - $242k
...company (Nasdaq: CRWV) in March 2025. Learn more at What You'll Do: CoreWeave is seeking a highly skilled and motivated Senior Systems Engineer, Legal Systems to build and scale our contract lifecycle management (CLM) and legal technology ecosystem, with a primary focus...Permanent employmentFull timeContract workTemporary workCasual workWork at officeFlexible hours- ...Job Description Job Description Job Title: System Transients Analysis Engineer Location: Bellevue, WA Job Type: Contract Work Model: Hybrid/Onsite Preferred Overview System One is seeking a highly capable and motivated System Transients Analysis Engineer...Contract workWork at office
$69 - $115 per hour
...Job Title: System Design Engineer, EM Pump Location: Bellevue, WA Type: Contract Compensation: $69.00 - $115.00 Work Model: Remote – offsite Hours: 40.0 Overview: System One is seeking an experienced System Design Engineer to support the design...Contract workTemporary workFor contractorsLocal areaRemote work$45 - $60 per hour
...stage of engagement to help them succeed. WHO YOU ARE Prowess Consulting is looking for an enthusiastic junior System Administrator/System/Test Engineer to join our team. The ideal candidate will have skills in a variety of technologies including storage, compute and...Hourly payFull timeTemporary workPart timeWork at officeRemote workFlexible hours3 days per week- ...System One is seeking a System Design Engineer to support advanced nuclear reactor development. This role will support the Sodium Processing Systems team , focusing on system design, vendor coordination, and integration of hardware into overall plant system architecture...Temporary workWork at officeLocal area
$69 - $115 per hour
...Job Description Position Title: System Design Engineer Position Description: Protingent Staffing has an exciting REMOTE contract System Design Engineer opportunity. Job Responsibilities: Design of nuclear and industrial components and systems from requirements...Permanent employmentContract workFor contractorsRemote work$100k - $150k
...AI Learning Systems Engineer – Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. Job Title: AI Learning Systems Engineer Location: 100...Full timeH1bLocal areaRemote workVisa sponsorship- ...Job description Must Have Skills Experience with Windows validation servicing security testing or systems engineering Ability to understand CC systems or driver code Familiarity with Azure DevOps Windows build environments VMs and TAEF or similar test...
$70 per hour
...Job Description Job Description Role : Infrastructure Engineer Duration : 12 Months to start Location : Bellevue and Everett... ...recovery procedures ~ Hands-on experience with APC UPS systems or similar enterprise UPS platforms ~ Familiarity with PDU management...For contractorsWork experience placementWork at officeLocal areaImmediate start$56 - $95 per hour
...Job Description Position Title: CRD System Design Engineer (Mechanical) Position Description: Protingent Staffing has an exciting contract CRD System Design Engineer (Mechanical) opportunity. Job Responsibilities: Design nuclear and industrial mechanical...Permanent employmentContract workRemote work$97.08k
Job DescriptionUW Information Technology has an outstanding opportunity for HPC Systems Engineer to join their team.About this OpportunityReporting to Director, the HPC Systems Engineer is responsible for supporting the HPC efforts for the research computing group and...Full timeTemporary workWork at officeImmediate startRemote workShift work2 days per week$120k - $145k
...Systems Engineer III - Windows - Hyper-V & Defender, Entra, Intune, AD Location: Lynnwood, WA -100% remote in the US. This is a remote first role with occasional travel to HQ in greater Seattle. Pay: 120k - 145k DOE**We are looking for those with strong Windows domain...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Systems Engineer. Be the first to apply!
- distributed systems engineer Bellevue, WA
- sr systems engineer Bellevue, WA
- system engineer contract Bellevue, WA
- senior linux systems engineer Bellevue, WA
- mission system engineer Bellevue, WA
- operations support system engineer Bellevue, WA
- healthcare systems engineer Bellevue, WA
- application system engineer Bellevue, WA
- senior staff systems engineer Bellevue, WA
- operating system engineer Bellevue, WA



