Distributed Systems Engineer: AI Agent Orchestration
ServiceNow
ServiceNow in Mountain View, CA is hiring a distributed systems engineer to build the runtime infrastructure powering Moveworks' AI agents, emphasizing orchestration, execution, and real-time delivery of agent responses. This is not an individual ML engineering role.
You will own an agent orchestration engine, implement lease-based session management, and optimize an event-driven pipeline using SQS, Kafka, gRPC, and Socket.IO, with Python and Go for production-grade concurrency.
#J-18808-LjbffrVacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer: AI Agent Orchestration in Mountain View, CA vacancy
$200k - $300k
...Machine Learning Systems EngineerLocation - Palo Alto... ...Learning, Generative AI, AI Infrastructure, Developer... ...research-driven, with engineers working directly... ...of machine learning, distributed systems, GPU infrastructure... ...Kubeflow and other ML orchestration platformsInvestigate...SuggestedH1bWork at officeRecruiting from Scratch
Palo Alto, CA9 hours ago- Nebius B.V. is building an AI training and model post-training capability focused... .... You will work at the intersection of distributed systems, GPU performance, and ML framework integration... ...requires strong Python and PyTorch engineering skills, hands-on experience with...Suggested
- A leading AI infrastructure company in California seeks a Member of Technical Staff — Training to design and optimize large-scale distributed training systems for frontier AI models. Candidates should have 5+ years of experience in ML systems and be proficient in Python...Suggested
- ...research-backed AI infrastructure startup... ...enterprise multi-agent applications.... ...by applying deep systems programming, software... ...to AI workflow orchestration. We recently... ...Collaborate across distributed systems design,... ...production experience engineering ML systems, OR a...SuggestedShift work
Success Matcher Recruitment
Sunnyvale, CAa month ago $90.1k - $191.8k
...the world!The Data Labeling Engineering team designs, builds, and operates... ...cloud platforms and workflow orchestration tools (e.g., Airflow) to... ...leadership, and work directly on systems that unblock the next... ..., and latency goals.Champion AI‑assisted engineeringUse and advocate...SuggestedFull timeWork experience placementLocal areaRemote workWork from homeRelocation packageFlexible hours$160.36k - $240.54k
...combining cutting-edge AI with automotive-grade... ...re looking for senior engineers to build/scale Nuro's... ...cloud/data center. This system is the foundation of... ...frameworks: BATES to orchestrate and execute large-scale... ...large-scale distributed applications (e.g. Kubernetes...Full timeNuro
Mountain View, CA1 day ago- ...areMoveworks is the Agentic AI Assistant platform... ...of their business systems through natural... ...’ Reasoning Engine and natural... ...cutting edge of AI agents? This may be the role... ...following areas: agent orchestration, sandboxed file... ...PersonasWe approach our distributed world of work with...Work at officeImmediate startRemote workFlexible hours
- Elastic, the Search AI Company, is seeking a tech lead for the Agent Framework team to own architecture and set technical direction for Elastic's agent layer... ...reviews, drive decision-making, and guide a distributed team across projects, balancing performance, backward...
$174k - $252k
Write and test product or system development code in Java... ..., next-generation distributed caching and database architectures... ...technologies or engineering highly reliable, planet-... ...and developing Generative AI applications or LLM-based orchestration frameworks.Google's software...- Join Sekai as we build an AI-driven consumer platform reminiscent of TikTok for... ...leader to design and own our agent runtime and orchestration layer, build workflows, and develop evaluation... ...will have experience with agentic systems, modern frameworks like LangChain, and...Remote job
$158k - $237k
...The Forge Team: Engineering the Backbone of Rubrik... .... As the platform and systems engineering team, founded... ...structures, algorithms, and distributed systems design ~... ...RBRK), the Security and AI Operations Company,... ...across clouds. Rubrik Agent Cloud accelerates trusted...Full timeLocal areaRubrik
Palo Alto, CA1 day ago$152k - $241.5k
NVIDIA is hiring experienced software engineers to help scale up its AI Infrastructure. We expect you to... ...Cloud team responsible for production systems that enable large scalable GPU clusters... ...and developing a massively distributed scalable platform which would be used...Full timeRemote work$215k - $250k
...and make available to any downstream query engine and use case (from traditional analytics to real-time AI / ML).We are a team of self-driven, inspired... ...that have created large-scale data systems and globally distributed platforms that sit at the heart of some of...Odd jobWork at officeLocal areaRemote workRelocationRelocation packageOneHouse LLC
Sunnyvale, CA3 days ago- ...Zettabyte, we’re on a mission to make AI compute ubiquitous, seamless, and... ...role exists We need a Backend Engineer to build the systems that orchestrate GPU clusters for AI workloads. You... ...engineering experience with distributed systems ~ Strong proficiency in...Hourly payFull timeWork at officeWork from homeVisa sponsorship
SproutsAI
Palo Alto, CA7 hours ago $224k - $356.5k
...millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes... ...of the desktop AI operating system.What You Will Be Doing:Act as... ...experience with modern AI orchestration and agentic frameworks (e.g.,...Full timeLocal areaShift work$170k - $275k
...machines at scale. At Scout AI, we’re developing Fury,... ...Role As a Software Engineer on the Agent Harnessing team, you... ...complex, real-world physical systems. This spans agent orchestration, tool integration, low-... ...—architecture, distributed systems, real-time pipelines...Full timeRelocation packageScout Ai
Sunnyvale, CA1 day ago- ...ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes for... ...tracing, and building non-deterministic systems that yield meaningful evaluation signals....
Servicenow
Mountain View, CA7 hours ago $117k - $234k
...organization, designs, engineers, and operates the next... ...We are hiring a Staff System & Infrastructure... ...Code, observability, and AI/AIOps-driven operational... ...replication, snapshots, backup orchestration, compliance validation... ..., object storage, and distributed storage systems,...Full timeTemporary workPart time$174.9k - $261.3k
...the world!The Data Labeling Engineering team designs, builds, and operates... ..., data engineering, and AI/ML, defining the strategies,... ...leadership, and direct impact on systems that unblock the next... ...of experience building robust distributed platforms and applications.Hands...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hours$155k - $185k
...are looking for a Senior AI Agent & LLM Engineer who combines strong software... ...build and improve the AI systems behind Otter’s conversational... ...agent infrastructure for orchestration, tracing, debugging,... ....Brings strong backend or distributed-systems engineering skills...Permanent employment$147k - $210k
...features for user-facing AI applications built on GDC,... ...and services for the GDC Agent Platform, focusing on enabling... ..., UX designers, and other engineering teams within GDC and... ...Experience building AI/ML systems and large-scale distributed systems.Google Cloud's software...- ...ultra-scale GPU supercomputing systems to train next-generation... ...communication performance, distributed reliability, and cross-layer... ...looking for a deeply technical engineer to co-design and optimize... ...· Co-design runtime orchestration with communication topology...Visa sponsorship
Institute of Foundation Models
Sunnyvale, CAmore than 2 months ago $166k - $225k
...the world's best data and AI infrastructure platform... ...business. Founded by engineers — and customer obsessed... ...building the next generation distributed data storage and processing systems that can outperform... ...simple and possible to orchestrate and operate tens of thousands...Local areaWorldwideDatabricks Inc.
Mountain View, CA7 hours ago$192.6k - $337.1k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ...work. Today, ServiceNow is the AI control tower for business... ...Access ManagementIntegrate IAM systems (Okta, Entra ID).Implement SSO... ...PersonasWe approach our distributed world of work with flexibility...Work at officeImmediate startRemote workFlexible hours$207k - $300k
...impact projects.Influence and coach a distributed team of engineers.Facilitate alignment and clarity across... ....Experience integrating generative AI tools or LLM interfaces into workflows... ...retrieval, distributed computing, large-scale system design, networking and data storage,...- NVIDIA Corporation in Santa Clara, CA seeks a Software Engineer to develop and deploy AI agents that optimize VLSI design flows. You will work with ML models, Python production systems, and frameworks like PyTorch/TensorFlow to enhance efficiency and quality across design...
- ...company in Palo Alto is looking for a Member of Technical Staff to lead efforts in multimodal AI understanding. This role involves engineering large-scale distributed systems to process multimodal data and enhance AI capabilities. The ideal candidate will have advanced...
$135k - $225k
NLP PEOPLE in Mountain View is seeking an AI Development Engineer to join their AI team. The role focuses on developing multimodal machine learning models for various mediums including audio, video, image, and text. The ideal candidate should possess a strong foundation...- ...Factory is building an AI training and model... ...the intersection of distributed systems, GPU performance, model... ...pipelines, and production engineering. Your... ...evaluation, and experiment orchestration components for RL training... ...rollout generation, or agent training workloads....
Nebius B.V.
Palo Alto, CA3 days ago - ...Armadin, we're a group of engineers, researchers, and... ...can do in the AI era. Cyberattacks are... ...security models and agents that discover risk and... ...Platform: Design the orchestration, tool use, planning loops... ...Scale: Build agentic systems with distributed execution, concurrency...Work at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer: AI Agent Orchestration. Be the first to apply!
Related searches
- senior windows systems engineer Mountain View, CA
- software system engineer Mountain View, CA
- mission system engineer Mountain View, CA
- healthcare systems engineer Mountain View, CA
- electronic systems engineer Mountain View, CA
- operating system engineer Mountain View, CA
- system engineer remote Mountain View, CA
- application system engineer Mountain View, CA
- advanced systems engineer Mountain View, CA
- systems engineer Mountain View, CA