LLM Systems Engineer: AI Agents & Evaluation
ByteDance
ByteDance is hiring in Seattle for roles within the Applied Machine Learning Ark team. You will help design, develop, and operate MaaS platforms using LLMs and multimodal models, spanning training, inference, prompt engineering, and evaluation pipelines. The team builds end-to-end solutions, analyzes large-scale log data, and collaborates across research, platform, and product groups to drive product improvements. A strong background in ML and Python is essential. #J-18808-Ljbffr ByteDance
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Systems Engineer: AI Agents & Evaluation in Seattle, WA vacancy
- ...LLM/Prompt-Context Engineer – Fullstack Python (AI Agents, LangGraph, Context Engineering) Location – 1st Atlanta, 2nd... ...develop, and integrate intelligent systems focused on large language models... ...: Design, optimize, and evaluate prompts for LLMs to achieve precise...SuggestedRemote work
Diversity Nexus
Seattle, WA3 days ago - ByteDance in Seattle is seeking engineers and researchers to join the Applied Machine Learning Ark team. You will help build MaaS... ...to end-to-end MaaS solutions across markets. You will design evaluation systems, run benchmarks, and analyze large-scale logs to drive model...Suggested
- Atlassian is seeking a Systems Engineer to build observability for AI-assisted software development. The role includes designing pipelines and working directly with Git to collect AI-generated code data. Ideal candidates will have systems engineering experience, particularly...Suggested
$185k - $230k
...and passionate Senior Software Engineer to join our highly skilled... ...sophisticated enterprise search system, spearheading the design, development... ...the best user experience. Evaluate and optimize algorithm... ...major advantage. About Otter.ai We are in the business of shaping...Suggested$124k - $280k
...in data and analytics engineering focus on leveraging advanced... ...implementing advanced AI and ML solutions to... ...algorithms, models, and systems to enable intelligent decision... ...prompt engineering for LLM outputs- Developing... ...with team members. We evaluate these factors...SuggestedFull timeH1b$99k - $232k
...in data and analytics engineering focus on leveraging advanced... ...implementing advanced AI and ML solutions to... ...algorithms, models, and systems to enable intelligent decision... ...prompt engineering for LLM optimization-... ...with team members. We evaluate these factors thoughtfully...Full timeH1b$180k - $225k
Remitly, Inc. in Seattle is seeking a Senior AI Native Software Engineer to orchestrate AI agents in building complex production-grade systems. You'll lead efforts in rebuilding legacy systems and guide teams on effective AI tools. The ideal candidate has proficiency in...$236k - $339.2k
...this new era, we seek AI-native thinkers across... ...intersection of autonomous agents and large language... ...will build the models and systems that turn enterprise data... ..., including:Arctic LLM: Enterprise foundation... ...coordinationEstablish evaluation standards for reliability...Shift work- ByteDance Networking is seeking talented researchers and engineers to design and deploy high-speed network technologies supporting AI/LLM applications at massive scale. You will design and develop platforms for monitoring, analysis and diagnosis of large-scale AI networks...
- ...Learning Ark team combines system engineering and machine learning... ...Large Language Model (LLM) service platforms... ...alignment, and intelligent agent systems. Beyond model... ...Language Models and AI Agent systems to join... ...your resume. Design evaluation systems for LLM-based...Internship
- We are hiring an AI Research Scientist (New Grad... ..., self‑improving AI systems — building agents that reason, code,... ...strategies Build and evaluate autonomous research agents... ...experience in LLM post‑training, fine‑tuning... ...researchers and engineers building the next generation...
$200.8k - $251k
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning... ...for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch...Full time- ...Generative Ai Applications Engineer (Agents & Rag) Seattle, WA At Accenture Federal Services, nothing... ..., rag, prompt/policy design, llm evaluation, and platform integration. You'll own... ...Genai: Build agentic workflows and rag systems tailored to mission data and...
Accenture Federal Services
Seattle, WA4 days ago $127.4k - $191.2k
...opportunityUnity's Vector AI team builds the machine learning systems that decide which ads... ...the world's leading game engine. Recommendation and ranking... ...doingDesign, build, and evaluate next-generation ranking and... ...reinforcement learning, LLM post-training or alignment...Full timeInternshipWork at officeWorldwideShift work$148.5k - $293k
...complete and complex framework, system or product. Defines processes... ...a Systems Design/Architecture Engineer and play a pivotal role in... ...structured mentoring programs.Evaluate new technologies and determine... ...ideas into impact, powered by AI and driven by human ingenuity....Full timeTemporary workWork at officeLocal areaWorldwide$103.2k - $203.4k
...government forward! Build AI that matters . We... ...prompt/policy design, LLM evaluation, and platform... ...agentic workflows and RAG systems tailored to mission data... ...predictable cost. Agent frameworks & orchestration... ...; mentorship of engineers. Clear communication...Live inWork at officeLocal areaAccenture
Seattle, WA3 days ago$162.8k - $244.2k
...company and a leading AI platform for managing people, money, and agents, we’re shaping the future... ...production AI agent systems and want to do it again... ...with agent architectures, evaluation frameworks, and... ...viability before committing engineering resourcesDesign production...Full timeWork at officeRemote workHome officeFlexible hoursWeekend work$168.1k - $227.4k
Lead our pioneering AI initiative at AWS and define the future of AI agents. Shape how businesses leverage... ...& orchestration, agent evaluation, or knowledge... ...projects requiring multiple engineers, balancing business goals... ...) of new and existing systems experience- Experience...InternshipFlexible hoursDay shift- ...DC, United StatesProducts - Engineering /Fulltime /HybridOver 50,000... ...Product Engineer /Staff SW Systems EngineerExperience : 8 to 14... ...Python,TypeScript or JavaScript,AI coding agents Claude Code, Copilot, Cursor... ...workflows where you direct, evaluate, and iterate on agent-...Full time
$130.4k - $195.6k
...content into other game engines and 3D environments —... ....We’re building systems that allow real-time 3... ...orchestration by future AI-driven tools and systems... ...training, data collection, evaluation loops, agents, tool use, or model-... ...tool interfaces, LLM agents, multimodal models...Full timeWork at officeRemote workWorldwide- ...seeks a senior machine learning engineer to join the Traveler Discovery &... ...design and deploy multi-step agentic AI systems, integrate LLMs with tools and... ...engineers, advance state-of-the-art agent architectures, and help shape evaluation frameworks for reliability,...
$145k - $200k
...RoleWe are seeking an experienced Software Engineer to join a newly-formed team focused on developing and deploying advanced AI systems to the tactical edge. This role involves training, evaluating, and deploying LLM agents to edge hardware for interfacing with sensors...Full timeWork experience placementWork at officeRemote workWork from homeRelocation package$146.88k - $220.32k
Senior Software Engineer, Agent Platform (AI for the Planet) Seattle, WA Persons in... ...focus on understanding the system, not blaming individuals. Failures... ...something breaks, and the evaluation tooling that tells them... ...‑on experience shipping LLM agents to production, including...Work at officeLocal areaWeekend work$205.6k - $257k
Scale has been the leading AI data foundry, helping... ...to develop reliable AI systems for the world’s most... ...Healthcare vertical within our Agents Data & Reinforcement... ...labs use to train and evaluate agents) and the “data... ...execution across engineering, operations, and go-to-...Full time$152k - $240k
...effortlessly. Brex’s AI-native automation and... ...need to grow your career.Engineering at BrexEngineering at... ...Brex is about building systems that scale with speed... ...ll doWe're building AI agents to automate and... ...and data sources.Define evaluation frameworks, success metrics...Work at officeRemote workWork from home$120k - $145k
...suppliers. Summary The Senior Systems Specialist is responsible for installing, engineering and maintaining operating systems... ...routine analysis to include evaluation of hardware and software based... ...Microsoft Copilot Administration - Agent building, Prompt Engineering...Full timeContract workWork at officeRemote workWorldwideHome office$134.25k - $214.8k
...Axon's Platform team is the engine behind what hundreds of... ...architectural fingerprints will be on systems that process evidence for... ...with agentic AI tooling or building LLM-powered developer toolsDeep... ...information from applicants to evaluate candidates for employment....Work experience placementWork at officeRemote work$56 - $95 per hour
Job Description Position Title: CRD System Design Engineer (Mechanical) Position Description: Protingent... ...) to implement system requirements Evaluate equipment and technology development... ...innovation - from Software and Aerospace to AI, Clean Tech, Medical Devices, and...Permanent employmentContract workRemote workProtingent
Bellevue, WA3 days ago- ...Performance Consulting is seeking an Engineer to support the development, integration, sustainment, and evaluation of software, databases, data... ..., interoperability with DoD systems, data processing, technical... ...architecture, automation, analytics, or AI‑assisted methods. Experience...For contractorsFlexible hours
H2 Performance Consulting
Seattle, WA16 hours ago $200k - $275k
Secure Every Identity, from AI to HumanIdentity is the key to unlocking... ...of users. Okta for AI Agents extends that work to the agentic... ..., platform, and security engineering teams, write production code in... ...experience and operational maturity in systems that authenticate and...Local areaWorldwideFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Systems Engineer: AI Agents & Evaluation. Be the first to apply!
Related searches
- senior windows systems engineer Seattle, WA
- software system engineer Seattle, WA
- entry level systems engineer Seattle, WA
- mission system engineer Seattle, WA
- healthcare systems engineer Seattle, WA
- operating system engineer Seattle, WA
- system engineer remote Seattle, WA
- application system engineer Seattle, WA
- advanced systems engineer Seattle, WA
- active directory systems engineer Seattle, WA