Software Engineering SMTS - LLM Gateway
$148.5k - $223.9kSalesforce
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
Job CategorySoftware Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce. Agents and LLMs are a fast evolving technology. Einstein GPT Team within AI Platform is building platform services needed to spearhead LLM technology to support Agentforce and AI apps within Salesforce CRM clouds. As a team deeply embedded in LLM infrastructure, we are looking for backend Software engineer, who enjoys a fast-paced environment, can deliver incrementally, and think creatively. You will work on cutting edge LLM technologies from different vendors, deliver CRM and Salesforce integration features. Your impact:
- Build, scale and maintain critical features of the Einstein platform to provide scale and efficiency.
- Develop high-quality, production-ready code that can be used by millions of users of our cloud platform.
- Make design decisions on the basis of performance, scalability, and future expansion.
- Work in a Hybrid Engineering model and contribute to all phases of SDLC including design, implementation, code reviews, automation, and testing of the features.
- Build efficient components/algorithms on a microservice multi-tenant SaaS cloud environment
- Code review, mentoring junior engineers, and providing technical guidance to the team (depending on the seniority level)
- Make/Participate in critical decisions that attribute to the success of the platform
- 5+ years of development experience as a software engineer.
- Strong experience with backend development in preferably Java, or at least one object-oriented compiled, statically-typed language (C++, C#)
- Experience using AI tools (e.g., Claude Code, GitHub Copilot, Codex, Cursor, etc.) in development workflows
- Distributed systems and cross-service designs
- Experience with cloud infrastructure (e.g., AWS, GCP) and scalable system architecture.
- Proficiency in data processing and working with APIs eg REST
- Bachelors (or) Masters degree in Computer Science, Software Engineering, or related STEM field with strong competencies in algorithms and data structures.
- Strong verbal and written communication skills
- Experience in test-driven development with focus on unit testing, integration testing and end-to-end automation
- Ability to support/resolve production customer issues with debugging and problem solving skills
- Experience with developer tools such as Git, Kubenetes, Terraform, Spinnaker a plus
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineering SMTS - LLM Gateway in San Francisco, CA vacancy
- B Capital is seeking a backend Software Engineer to join the Einstein GPT Team in San Francisco. You will be building platform services for LLM technology supporting CRM cloud applications, focusing on performance, scalability, and efficiency. Ideal candidates have over...Suggested
$148.5k - $260.1k
...exceptional Senior Member of Technical Staff (SMTS) to serve as a lead and contributor for... ...technical guidance to peers, set engineering standards, and help envision the transition... ...*** Industry Expertise: 10+ years in software development, with a deep focus on SaaS,...Suggested$130k - $220k
...trust, and impact matter, you'll fit right in As a Full-Stack Software Engineer for AI Voice Agent, you will be responsible for the design,... ...proficiency in Python or Typescript/Node.js and AWS ~ Exposure to LLM development, including but not limited to side projects or...SuggestedFull timeWorldwide$148.5k - $223.9k
...Senior Member of Technical Staff (SMTS) - Site Reliability Engineer (Cloud Automation) Location: New York, NY; San Francisco, CA About Salesforce... ...'s degree in Computer Science, Computer Engineering, Software Engineering or relevant work experience ~7+ years of...SuggestedWork experience placementShift work- ...Senior AI/ML Engineer — LLM & Agent Stack Every production AI system, whether it's powering... ...two products to solve this: AI Gateway is the control plane, five composable components... ...abstracts ML workloads as standard software primitives, so everything runs on...Suggested
- ...Description: Job Number 2 Software Engineer (focus on Web development ) - SFCC / SFRA Storage... ...• Working knowledge of backend payment gateways, OMS flows, and third-party services. • Experience leveraging AI / LLM-based tools for development productivity,...FreelanceLocal areaRemote work
- ...Senior Software Engineer, LLM Performance SF Bay Area (Hybrid) Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed network of GPUs, optimizing for cost, performance, and flexibility. Our mission is to empower AI developers...
- ...with hands-on support from AMD engineers the team is scaling rapidly... ...APIs : Building secure API gateways and implementing low latency... ...experience) ~3+ years of software engineering experience, with... ...engine like vLLM, Sglang, or TRT-LLM Streaming Expertise: You...Work at officeFlexible hours
$202.5k - $247.5k
...solve every networking problem with one gateway. Doesn’t matter if they’re sharing localhost... ...they are vital to our success! We like software that’s serious and culture that’s not... ...Tech Stack ngrok runs entirely on AWS. Engineers develop by using remote development...Permanent employmentFull timeWork at officeLocal areaRemote workHome officeFlexible hours$196k - $294k
...Software Engineer, AI Gateway Hybrid - San Francisco, New York City About Vercel: Vercel is the agentic infrastructure company. We free people and agents to ship what's next. For more than a decade, Vercel has shaped how the web is built. As the team behind Next...Remote workWork from homeWorldwideFlexible hours$148.5k - $223.9k
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job CategorySoftware EngineeringJob DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive customer...Flexible hours$175k - $225k
...About the job AI / LLM Software Engineer - onsite in San Francisco AI/LLM Systems Software Engineer Location: San Francisco, CA Work Type: In-person Employment: Full-time Experience Required: 2+ years Salary Range: $175,000 - $225,000 per year...Full time$138.4k - $173k
...the AppFolio Property Manager: web-based software for managers of apartment buildings to schedule... ...featured AI leasing agent - LISA, a LLM backed chat interface to support property... ...-experience designer, quality-assurance engineer, and 3-6 software engineers.We work closely...Full timeInternshipRemote workFlexible hours$160k - $250k
...Come and be one of them. About the Role We are hiring a Software Engineer to build the technical foundation of Fluidstack's hiring and... ...models. Experience building AI-assisted productivity tools - LLM-backed summarization, classification, or recommendation...Immediate start$269.1k - $307.2k
...Distinguished Software Engineer - IFX As a Distinguished Engineer at Capital One, you will be a part of a community of technical experts working... ...compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data...Full timePart timeLocal area- ...hardware, by developing the first AI Hardware Engineer. Our goal is to democratize the ability... ...the world’s first AI Hardware Engineer, software that can design real, manufacturable... ...in production. ~ Experience integrating LLM-based systems into complex user-facing web...Remote workShift work
$500 per month
...Software Engineer II San Francisco, California (In-Office) Banking is being reimagined—and customers expect every interaction to be easy... ...Integrate and extend AI-driven workflows—you'll be writing against LLM APIs, not just using chat products Collaborate daily with...Work at officeRelocation- ...legacy systems with adaptive, learning software. Founded in early 2024, Serval is already... ...across IT, HR, Finance, Security, Legal, and Engineering. Our mission is to eliminate... ...Experience building or deploying AI/LLM-powered features or agent-based systems...
$142.2k - $204.6k
...P-1284 About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that... ...research and production, ensuring our large language model (LLM) serving systems are fast, scalable, and efficient. Your work...Local areaWorldwide- ...Senior AI Engineer Disney Entertainment and ESPN Product & Technology Technology is... ...This role blends backend engineering, LLM orchestration, and developer enablement.... ...dashboards, drift detection. Knowledge of AI gateway patterns (e.g., routing, usage throttling...
$165k - $247k
..., NetSuite, and more). As our Senior AI Software Engineer, you will be the primary technical builder... ...applications on AWS (Lambda, S3, API Gateway, RDS, or similar). Strong understanding... ...personal data. Experience with AI/ML APIs and LLM integrations (OpenAI, Anthropic, or...Work at officeHome officeFlexible hoursShift work$196k - $294k
Nerdleveltech seeks a Senior Software Engineer to join their Trust & Safety team. Based in San Francisco, you'll protect millions of developers... ...internet scale, using your skills in JavaScript, Python, and LLM methodologies. Responsibilities include analyzing threat actor...Flexible hours- ...Overview We are looking for a scrappy, high quality AI Full Stack Engineer to build and maintain executive level AI demos and proofs of... ...Hands on experience with GenAI / agentic AI concepts oe.g., LLM integrations, prompt driven workflows, chat or widget based AI...
- ...Pro + peripherals We are hiring an AI Engineer to own the intelligence layer. This is... ...production You should already have built LLM-powered systems that operate beyond the... ...loops Must-Have Requirements 3+ years software engineering experience 2+ years...Full time
$180k - $250k
Fluency in San Francisco is hiring a full-time AI Engineer to create LLM-powered features and improve AI output quality. You will build new features... ...in TypeScript or Python and a strong foundation in software engineering, as well as hands-on experiences with LLM implementations...Full time- ...latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to... ...retrieval systems to more effectively ground LLM responses in Whatnot's business context... ...work experience. ~3+ years of software engineering experience building and maintaining...Work experience placementWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
$100k - $130k
...consulting services within the architecture, engineering and construction industries focusing on... ...Job Description We're hiring a Software Engineer to join our US engineering team... ...engineering, agent workflows, RAG pipelines, and LLM integrations Participate in...Full time$175k - $285k
...Vertical Agent Core Development & Delivery : Engineer and deliver vertical Agent workflows for... .... Minimum Qualifications Strong Software Engineering Execution 3-5 years of hands... ...Agent Productization Strong interest in LLM applications, AI Agents, or workflow automation...Full timeWork at office- ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE... ...and operate AI products at scale: API gateways, auth/keys, quotas and metering, multi‑... ...workflows. Experience with inference platforms, LLM runtimes, or performance‑sensitive...Flexible hours
- ...text and voice communication with patients LLM-based workflows that integrate directly... ...systems About the role As a founding engineer, you will get a front seat into building... ...Experience: 1 - 10+ years of experience in software engineering, with a strong background in...Work at office3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering SMTS - LLM Gateway. Be the first to apply!
Related searches
- graduate software developer San Francisco, CA
- rust software engineer San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer student San Francisco, CA
- software engineer amazon San Francisco, CA
- software developer positions San Francisco, CA
- software engineer full time San Francisco, CA
- software qa engineer San Francisco, CA
- new graduate software engineer San Francisco, CA
- junior software developer San Francisco, CA



