Senior Inference Systems Engineer for Scalable AI
United States Digital Space LLC
United States Digital Space LLC in San Francisco seeks a skilled engineer to design and maintain distributed systems, ensuring AI functionality for millions globally. The role involves load balancing, request routing, and maximizing compute efficiency in a hybrid work environment. Ideal candidates have strong software engineering backgrounds, ideally with distributed systems and machine learning. A Bachelor’s degree is required, along with proficiency in tools like Kubernetes and Python. #J-18808-Ljbffr United States Digital Space LLC
- A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...candidates should have strong software engineering skills and experience with ML inference...Senior
- MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability. The ideal candidate will have 3+ years of experience in production...Senior
$300k
United States Digital Space LLC is seeking a skilled software engineer to join the Inference team in San Francisco. You will be responsible for building and maintaining systems that serve Claude to millions of users. The role emphasizes maximizing compute efficiency and...SeniorWork at office- A growing technology company in San Francisco is seeking a Senior Machine Learning Engineer to design and implement advanced ML systems. Responsibilities include optimizing data pipelines and collaborating with product teams. The ideal candidate has strong experience in...SeniorFlexible hours
$300k
A leading AI startup is seeking exceptional Backend Software Engineers to help architect, build, and scale the infrastructure behind their innovative AI systems. Candidates should have over 5 years of backend... ...role focuses on designing scalable backend systems and...SeniorRemote job- ...of experience in backend systems or infrastructure engineering Strong software engineering... ...Experience designing scalable APIs, backend systems and... ...context formatting, batch inference, prompt-tuning workflows)... ...critical in enabling our AI engineers, analysts, and data...SeniorFlexible hours
- United States Digital Space LLC is seeking a Senior Software Engineer to lead system design and technical architecture for our business product platform. You will drive architecture for scalable systems, incorporate AI into products, and work collaboratively with cross-...SeniorWork at office3 days per week
- TRM Labs, based in San Francisco, is seeking a Senior Infrastructure Engineer to design and build scalable infrastructure for AI-powered intelligence solutions. You will work... ...engineers to enhance security and automate systems. This role requires a minimum of 3 years of experience...Senior
- A tech-driven company focused on blockchain solutions is seeking a Senior ML Systems Engineer. In this role, you will build reusable workflows, automate model versioning, and deploy scalable AI systems. Candidates should have strong programming skills, experience with...Senior
- A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation... ...models. You will design distributed training systems and optimize GPU utilization while...Senior
- Scribe is seeking a Sr. Software Engineer, Backend to aid in building backend systems for their product. The role focuses on large-scale data ingestion, workflow processing, and AI capabilities using Python, Typescript, and Go. Candidates should have 8+ years of experience...SeniorFlexible hours
- United States Digital Space LLC is hiring for a role in AI Reliability Engineering in San Francisco, CA. This position requires expertise in reliability-focused roles with experience in distributed systems and communication skills. The responsibilities include developing...Senior
- ...technology company is seeking a skilled Software Engineer with a backend focus to develop and... ...-services for its cutting-edge data and AI platform. This role requires extensive... ...alongside a strong grasp of distributed systems and cloud technologies. As part of a diverse...Senior
- OutSystems, Inc. is looking for a Site Reliability Engineer to join their team in San Francisco, CA. The ideal candidate will lead the onboarding of services and teams to reliability tenets while establishing SLOs and SLAs. Proficiency in Python and experience with Kubernetes...SeniorFlexible hours
- ...of a traditional space mission. As a Senior Product Systems Engineer at Loft, you will own the... ...Help ensure solutions are reusable, scalable, and understandable rather than tailored... ...observation, IoT connectivity, on‑orbit AI, national security missions, and more...SeniorTemporary workWork at officeRelocation packageFlexible hours
- A leading financial services company is seeking a Sr. Lead AI Engineer in San Francisco. This role involves building AI systems, collaborating with engineers and scientists, and driving innovation in financial services. The ideal candidate should have extensive experience...Senior
$200k - $240k
...blockchain analytics and AI solutions to help law enforcement... ...financial crime. Our AI engineering team focuses on next‑... ...language models and agentic systems, building robust pipelines... ...for rapid, safe, and scalable AI deployments. Senior or Staff ML Systems Engineer...Senior- Salesforce is seeking a Senior Member of Technical Staff (SMTS) - AI Software Engineer to join the team driving the development of Agentforce in San Francisco. In this critical role, you will maintain core execution engines and tackle complex challenges with a focus on...Senior
$166.9k - $225.9k
...operates as both a central engineering function and an... ...software engineering and systems engineering. The best... ...building and maintaining scalable, resilient services... ...Experience with AIOps - using AI/ML-based tooling for... ...services (e.g., LLM inference latency, non-...SeniorWork at officeImmediate startWorldwideMonday to FridayFlexible hours$102k - $182.71k
...20 Position Overview We’re seeking a Senior Search Systems Engineer to build the intelligence and automation... ...sits on top of our marketing and AI visibility data. This role focuses on... ...engineers, and BI teams to operationalize scalable datasets, transformation logic,...SeniorShift work$279.2k - $390.9k
...recommendations. We design and maintain systems for ML data ingestion, low-... ...performance, reliability, and scalability, we enable real-time access to... ...ML Indexing & Retrieval engine, integrating capabilities... ...summarized by artificial intelligence (AI). You will have the...SeniorFor contractorsWork experience placementFlexible hours$174k - $215k
...they love. With proprietary AI built on over a decade of real... ...Hover wants you Hover's GTM Systems team owns the full technical... ...This is a net new role for a senior engineer who wants breadth and ownership... ...priorities and translate them into scalable, maintainable system designs....SeniorFull timeFor contractorsWork at officeLocal areaFlexible hours- ...Francisco is looking for its first Finance Systems Engineer to implement and improve financial... ...business. This role focuses on creating scalable and reliable finance processes in Order... ...and partner with various teams, driving AI-forward automation and efficiency. #J-1...
$195k - $225k
The Role As the Senior Software Engineer - Backend (Systems / Infrastructure) you’ll architect... ...Vizcom fast, reliable, and scalable as our workload and... ...collaborating with frontend and AI teams to enable magical... ...to integrate GPU inference pipelines into user workflows...Senior$166.9k - $225.9k
...operates as both a central engineering function and an... ...software engineering and systems engineering. The best... ...building and maintaining scalable, resilient services.... ...with AIOps—using AI/ML‑based tooling for anomaly... ...services (e.g., LLM inference latency, non‑determinism...SeniorFlexible hours- Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco... ...quietly building the systems, network, and orchestration... ...routes training and inference jobs across global supply... ...infrastructure backbone for reliable, scalable AI compute. You’ll...SeniorFull timeRemote work
- AI Chopping Block, Inc. is seeking a Machine Learning Engineer to design and build scalable machine learning systems. Responsibilities involve developing end-to-end ML pipelines, optimizing AI models for mobile environments, and integrating AI-driven solutions into applications...
- ...Member of Technical Staff focused on ML systems and inference in San Francisco. You will design and... ..., ensuring fast, predictable, and scalable performance. Key responsibilities include... ...have strong foundations in software engineering, experience with ML inference systems...
$150k - $190k
...developed an artificial intelligence (AI) powered technology stack purpose-... ...the U.S. Department of Defense. The Systems and Safety Engineering team at Kodiak is seeking an experienced... ...to progressing towards achieving a scalable driverless deployment and will work...SeniorTemporary workWork at officeVisa sponsorshipFlexible hours- ...LLC is looking for a Software Engineer to join the Launch Engineering... ...for continuous and unattended inference deployment. The ideal candidate... ...of experience in deployment systems, strong software engineering skills... ...and efficient deployments for AI systems. #J-18808-Ljbffr...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Systems Engineer for Scalable AI. Be the first to apply!
- systems engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- unix linux systems engineer San Francisco, CA
- space systems engineer San Francisco, CA
- systems security engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA
- mission system engineer San Francisco, CA
- active directory systems engineer San Francisco, CA
- director systems engineering San Francisco, CA
- operating system engineer San Francisco, CA

