Software Engineering SMTS - LLM Gateway
$148.5k - $223.9kSalesforce
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
Job CategorySoftware Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce. Agents and LLMs are a fast evolving technology. Einstein GPT Team within AI Platform is building platform services needed to spearhead LLM technology to support Agentforce and AI apps within Salesforce CRM clouds. As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who enjoys a fast-paced environment, can deliver incrementally, and think creatively. You will work on cutting edge LLM technologies from different vendors, deliver CRM and Salesforce integration features. Your impact:
- Build, scale and maintain critical features of the Einstein platform to provide scale and efficiency.
- Develop high-quality, production-ready code that can be used by millions of users of our cloud platform.
- Make design decisions on the basis of performance, scalability, and future expansion.
- Work in a Hybrid Engineering model and contribute to all phases of SDLC including design, implementation, code reviews, automation, and testing of the features.
- Build efficient components/algorithms on a microservice multi-tenant SaaS cloud environment
- Code review, mentoring junior engineers, and providing technical guidance to the team (depending on the seniority level)
- Make/Participate in critical decisions that attribute to the success of the platform
- 5+ years of development experience as a software engineer.
- Strong experience with backend development in preferably Java, or at least one object-oriented compiled, statically-typed language (C++, C#)
- Experience using AI tools (e.g., Claude Code, GitHub Copilot, Codex, Cursor, etc.) in development workflows
- Distributed systems and cross-service designs
- Experience with cloud infrastructure (e.g., AWS, GCP) and scalable system architecture.
- Proficiency in data processing and working with APIs eg REST
- Bachelors (or) Masters degree in Computer Science, Software Engineering, or related STEM field with strong competencies in algorithms and data structures.
- Strong verbal and written communication skills
- Experience in test-driven development with focus on unit testing, integration testing and end-to-end automation
- Ability to support/resolve production customer issues with debugging and problem solving skills
- Experience with developer tools such as Git, Kubenetes, Terraform, Spinnaker a plus
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineering SMTS - LLM Gateway in San Francisco, CA vacancy
$148.5k - $223.9k
...Senior Member of Technical Staff (SMTS) - Site Reliability Engineer (Cloud Automation) Location: New York, NY; San Francisco, CA About Salesforce... ...'s degree in Computer Science, Computer Engineering, Software Engineering or relevant work experience ~7+ years of...SuggestedWork experience placementShift work$202.5k - $247.5k
...solve every networking problem with one gateway. Doesn’t matter if they’re sharing localhost... ...they are vital to our success! We like software that’s serious and culture that’s not... ...Tech Stack ngrok runs entirely on AWS. Engineers develop by using remote development...SuggestedPermanent employmentFull timeWork at officeLocal areaRemote workHome officeFlexible hours- ...with hands-on support from AMD engineers the team is scaling rapidly... ...APIs : Building secure API gateways and implementing low latency... ...experience) ~3+ years of software engineering experience, with... ...engine like vLLM, Sglang, or TRT-LLM Streaming Expertise: You...SuggestedWork at officeFlexible hours
$196k - $294k
...Software Engineer, AI Gateway Hybrid - San Francisco, New York City About Vercel: Vercel is the agentic infrastructure company. We free people and agents to ship what's next. For more than a decade, Vercel has shaped how the web is built. As the team behind Next...SuggestedRemote workWork from homeWorldwideFlexible hours- ...Senior Software Engineer At Lilly, we unite caring with discovery to make life better for people... ...pillars–Lilly Ventures, Lilly Gateway Labs, Lilly ExploR&D, and Lilly TuneLab–... ...for you. Hands-on experience building LLM-powered features. You understand the practical...SuggestedFull timeVisa sponsorshipWork visaFlexible hours
- ...Description: Job Number 2 Software Engineer (focus on Web development ) - SFCC / SFRA Storage... ...• Working knowledge of backend payment gateways, OMS flows, and third-party services. • Experience leveraging AI / LLM-based tools for development productivity,...FreelanceLocal areaRemote work
$140.4k - $372.3k
...the world's leading platform for agentic software development - powered by Copilot to... ...you to help lead this effort. The API Gateway plays a critical role in GitHub's scalability... ...at global scale, and to ensure internal engineering teams have the tools and processes...Ongoing contractRemote workWorldwide$196k - $294k
...Nerdleveltech seeks a Senior Software Engineer to join their Trust & Safety team. Based in San Francisco, you'll protect millions of developers... ...internet scale, using your skills in JavaScript, Python, and LLM methodologies. Responsibilities include analyzing threat actor...Flexible hours$175k - $225k
...About the job AI / LLM Software Engineer - onsite in San Francisco AI/LLM Systems Software Engineer Location: San Francisco, CA Work Type: In-person Employment: Full-time Experience Required: 2+ years Salary Range: $175,000 - $225,000 per year...Full time$142.2k - $204.6k
...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that... ...research and production, ensuring our large language model (LLM) serving systems are fast, scalable, and efficient. Your work...Local areaWorldwide$180k - $250k
Fluency in San Francisco is hiring a full-time AI Engineer to create LLM-powered features and improve AI output quality. You will build new features... ...in TypeScript or Python and a strong foundation in software engineering, as well as hands-on experiences with LLM implementations...Full time- ...legacy systems with adaptive, learning software. Founded in early 2024, Serval is already... ...across IT, HR, Finance, Security, Legal, and Engineering. Our mission is to eliminate repetitive,... ...Experience building or deploying AI/LLM-powered features or agent-based systems....
$150k - $250k
...them - with teams spanning hardware and software. Speed and scale are our key differentiators... ...the frontier forward. The Software Engineering Team Examples of key exciting problems... ...research. You're fluent with AI tooling. LLM APIs, MCP servers, and agentic...Local area- ...Senior AI Engineer Disney Entertainment and ESPN Product & Technology is a global organization... ...This role blends backend engineering, LLM orchestration, and developer enablement.... ..., drift detection. Knowledge of AI gateway patterns (e.g., routing, usage throttling...
- ...hardware, by developing the first AI Hardware Engineer. Our goal is to democratize the ability... ...the world's first AI Hardware Engineer, software that can design real, manufacturable... ...in production. ~ Experience integrating LLM-based systems into complex user-facing web...Local areaRemote workShift work
$130k - $200k
...the supply chain integrations space is looking for a Founding Software Engineer to help shape the architecture, culture, and product direction... ...TypeScript, React), backend (Node.js), infrastructure (AWS), and LLM/agentic workflows. Own projects end-to-end, from initial...Work at officeVisa sponsorship$500 per month
...OPPORTUNITY You'll join a small, high-output engineering team working directly alongside our VP... ...workflows — you'll be writing against LLM APIs, not just using chat products... ...curiosity WHAT WE'RE LOOKING FOR 2+ years of software engineering experience with real...Work at officeRelocation$175k - $285k
...Vertical Agent Core Development & Delivery : Engineer and deliver vertical Agent workflows for... .... Minimum Qualifications Strong Software Engineering Execution 3-5 years of hands... ...Agent Productization Strong interest in LLM applications, AI Agents, or workflow automation...Full timeWork at office- ..., and backed by top-tier VCs. About You You are a passionate Software Engineer eager to develop and scale our multi-tenant SaaS applications... ...in AWS services including networking, security, Route53, API Gateway, ECS/Fargate, RDS, DynamoDB. Excellent collaboration and communication...Immediate startRemote workHome officeFlexible hours
$170k - $220k
...thousands of third‑party tools; and Merge Gateway, the control plane for running AI in... ...sales, reduce customer churn, and save engineering resources—allowing them to focus on their... ...candidate will have: 3‑7+ years of full‑time software engineering experience (open to multiple...Full timeWork at officeHome office- ...Serval's AI agent deployments. The org has two tracks: Deployed Software Engineers operate as technical leads on our most strategic engagements,... ...automation domains Experience building or deploying AI/LLM-powered features or agent-based systems Interest in founding...
$140k - $170k
...and autonomous vehicles. About the role We’re hiring a Software Engineer, Backend to help build and scale our autonomous agent. This... ...problems Nice to have Exposure to AI/ML systems or LLM-based products Experience with distributed systems or cloud...$126k
...and content extraction for downstream ML/LLM use cases Evolving content formats to... ...processing workflows, with guidance from senior engineers and the EM on scope and trade-offs.... ...Who You Are ~4+ years of professional software engineering experience, including...For contractorsLocal areaHome officeFlexible hours$150k - $250k
...Full Stack Software Engineer Piq Energy is helping leading developers connect to the grid faster by automating the technical power system... ...Piq's technical stack includes: Backend: Python, FastAPI, LLM agents, Postgres, Temporal, AWS Frontend: Typescript, Svelte...Remote work2 days per week3 days per week- ...Senior Full Stack Software Engineer Mariana Minerals is looking for an experienced Senior Full Stack Software Engineer to lead critical technical... ...to design and implement production-ready ML, RL, and LLM-powered features, ensuring robust error handling and scalable...
$110k - $170k
...aim to leave a positive mark on culture. Job Title : Senior Software Engineer - AI Tooling & Quality Engineering Platforms Team : Global... ...• Build and optimize RAG pipelines, embeddings systems, and LLM‑powered utilities. • Develop intelligent automation accelerators...$300k - $405k
...growing group of committed researchers, engineers, policy experts, and business leaders working... .... About the Role As a Full-Stack Software Engineer in RL, you'll build the... ...and CI/CD pipelines Familiarity with LLM training, fine-tuning, or evaluation workflows...Work at officeVisa sponsorshipFlexible hoursShift work$300k - $400k
Noon is looking for a Lead AI Engineer to scale AI infrastructure and product capabilities. You will build LLM-powered features, and define the technical direction of AI systems... ...should have over 5 years experience in software engineering and 2 years of hands-on experience...- A leading tech recruiting firm in San Francisco is seeking a Founding Software Engineer for an early-stage AI & LLM startup. You will contribute to innovative technology development using Python and web frameworks like Django. The ideal candidate should have over 3 years...
$130k - $175k
Thank you for your interest in Uncountable Engineering! Description Uncountable is seeking... ...discovery through Generative AI. As an LLM Applications Engineer, you will be the architect... ...75K + Equity Requirements 2+ years of software development experience with a focus on...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering SMTS - LLM Gateway. Be the first to apply!
Related searches
- software developer internship no experience San Francisco, CA
- federal - software developer San Francisco, CA
- research software engineer San Francisco, CA
- software engineer contract San Francisco, CA
- part time software developer San Francisco, CA
- software engineer healthcare San Francisco, CA
- network software engineer San Francisco, CA
- ngo software engineer San Francisco, CA
- software development engineer aws San Francisco, CA
- software developer internship San Francisco, CA


