LLM MaaS Engineer - Agents & Evaluation
ByteDance
ByteDance in California's San Jose area seeks engineers and researchers for the Applied Machine Learning Ark team to build MaaS platforms and end-to-end LLM services, spanning training, inference, and multi-model workflows. The role emphasizes designing evaluation systems for LLM-based agents, building benchmarks, and turning failure patterns into concrete improvements that influence product decisions at scale. #J-18808-Ljbffr ByteDance
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM MaaS Engineer - Agents & Evaluation in San Jose, CA vacancy
- ...Learning Ark team in San Jose develops and operates LLM service platforms that offer MaaS solutions to businesses and researchers, spanning... .... This full-time role emphasizes designing evaluation systems for LLM agents, building benchmarks and pipelines, analyzing traces...SuggestedFull time
- ...Machine Learning Ark team develops end-to-end MaaS platforms that combine system engineering with large language models to serve businesses... ...solid ML background, Python skills, and hands-on LLM experience to build evaluation pipelines, benchmarks, and production-grade components...Suggested
$175k - $287k
...LinkedIn’s Core AI is building the Evaluation Operating System (EOS), a foundational Agent Evaluation platform that defines... ..., evaluator models (e.g., LLM-as-a-judge, reward models), and real... ...all LinkedIn AI Agents.As a Staff Engineer, you will own the end-to-end technical...SuggestedFor contractorsWork experience placementWork at officeFlexible hours$162k - $316.8k
...Ark team combines system engineering and machine learning to... ...Large Language Model (LLM) service platforms that... ...Model-as-a-Service (MaaS) solutions, serving both... ...alignment, and intelligent agent systems. Beyond model... ...dynamic team. Design evaluation systems for LLM-based agents...SuggestedTemporary workInternshipLocal area- Otter.ai is seeking a Senior AI Agent & LLM Engineer in Mountain View, CA. You will build and improve AI systems behind Otter's conversational... ...and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform for scalable, reliable operation...Suggested
- Nutanix is seeking a software engineer based in Santa Clara, California, to develop AI-powered product features. The role requires building backend services and APIs, implementing LLM workflows, and collaborating with product managers and designers. The ideal candidate...
$184k - $287.5k
...and secure for millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and... ...level security architecture.Proven understanding of LLM inference pipelines (Ollama, Llama.cpp, vLLM), GPU...Full timeLocal areaShift work- ...span text and multimodal capabilities. You will help build end-to-end MaaS solutions, data pipelines, and evaluation systems across US and international markets. The internship blends system engineering with cutting-edge AI research, offering hands-on experience,...Internship
- ByteDance's Applied Machine Learning Ark team in San Jose seeks engineers and researchers to advance LLM MaaS platforms. You will work across model serving, evaluation, and data pipelines, collaborating with cross-functional teams to deploy reliable AI services. Candidates...
$150.4k - $225.3k
Cupertino, California, United States Machine Learning and AI Join the team building the evaluation systems that enable Apple's next generation of AI experiences. As a Machine Learning Engineer, you will develop scalable infrastructure, intelligent evaluators, and data-driven...InternshipRelocation$187.04k
...to build the foundational AI agent platform and intelligent automation... ...safety needs into scalable engineering solutions. Qualifications... ...Practical experience integrating LLM/ML capabilities into products... ..., handling model latency, evaluation flows). Prior experience in a...Temporary workLocal areaShift work- Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products. You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and...
$171.6k - $222.2k
...elite team of world-class scientists and engineers to pioneer the next generation of AI-driven... ...development tools. Join the Amazon Kiro LLM-Training team and help create... ...production systemsAbout the teamThe AWS Developer Agents and Experiences (DAE) team is reimagining...Work at officeLocal areaWorldwideFlexible hours$184k - $287.5k
...accelerated computing.We’re looking for a research engineer to join our team to develop simulation... ...to build the industry's leading tool for evaluating robot foundation models in simulation.... ...foundation models.Integrating modern LLM and agentic workflows into simulation and...Full time$184k - $287.5k
...We are now looking for a Senior High-Performance LLM Training Engineer!NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads, which are shaping the world's most advanced computing...Full timeWork experience placement$272k - $431.25k
...NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full... ...engineering. You will analyze and optimize frontier-scale LLM workloads running on thousands of GPUs, drive improvements across...Full time$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars...Full time$155k - $185k
The OpportunityWe are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus... ...engine and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably...Permanent employment$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Architecture and Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars...Full time$87.95k - $203.95k
...now.We are currently seeking a API LLM Integration / ReactJS Engineer - Hybrid to join our team in Santa Clara... ...improve AI functionalityBuild AI agent from scratch using product requirementsThis... ...negative conversations using evaluation tools, creating issues for bad conversations...Temporary workWork at officeRemote workFlexible hours$212.8k - $387.6k
...teams on advanced R&D projects, focusing on LLM/AI + Infrastructure technologies, which... ...Deployment Of Large Language Models (LLMs) And AI Agents, Traditional Cloud-native Infrastructure... ...cloud-native distributed vector indexing engine to support ultra-large-scale vector search...Temporary workLocal area- Google seeks a Software Engineering Manager to lead multiple teams across... ...-latency scoring, automated evaluation, and RAG integrations. You... ...data science, and help scale agent-based commerce platforms globally... ...emphasizes building reliable LLM tooling, Ground Truth...
$85 per hour
Responsibilities About the team The Seed LLM Post Training team is responsible for researching... ...key areas including reasoning, coding, agent, and omni model. Responsibilities Explore... ...enterprise customers through Volcano Engine and BytePlus. Third‑party data shows that...Hourly payInternship- NVIDIA is seeking a Senior Software Engineer for Agent Architecture and Evaluation to build agentic AI systems and analyze inference workloads in realistic settings. You will work with teams advancing evaluation across software and hardware to improve accuracy and efficiency...
- ServiceNow in Santa Clara, CA is seeking a leader for the Build Agent evaluation framework. You will own eval strategy, roadmap, telemetry, and cross-team quality standards, guiding an 8‑engineer team to deliver scalable, data‑driven improvements. You will benchmark models...
$156.85k - $187.68k
...innovators stay Ahead of What's Possible. Learn more at and on LinkedIn and X.Employer: Analog Devices, Inc. Job Title: Senior Engineer, Design Evaluation EngineeringJob Requisition: R262582Job Location: San Jose, CaliforniaJob Type: Full TimeRate of Pay: $156,853.00 to $187,...Permanent employmentFull timeWork at officeLocal areaRemote workWork from homeDay shift2 days per week- A forward-thinking technology firm in San Jose is looking for an LLM Engineer to design and deploy large language models that drive innovative AI solutions. The role includes designing models, building inference pipelines, and collaborating with cross-functional teams....
- Apple is seeking a highly experienced AIML - Machine Learning Engineer to join the Information Intelligence team in Cupertino. You will... ...is required. Role focuses on large-scale model training, evaluation, and deployment, with opportunities to influence research #J-...
- A leading software company in San Jose is seeking a Prompt Engineer to enhance AI applications across business workflows. This role involves crafting LLM strategies, developing templates, and working closely with AI engineers. Candidates should have a solid background...
- ...agentic systems to automate simulation, evaluation, and performance analysis for AI workloads... ...characteristics and automate critical engineering workflows like capacity planning and release... ...2 years specifically building AI agents. Candidates must be proficient in Python...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM MaaS Engineer - Agents & Evaluation. Be the first to apply!
