Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Backend Engineer

$97k - $137k
Full-time

Parallel Partners Inc

Salary: $97,000 - 137,000 per year Requirements:

  • We need strong backend engineering experience in production environments.
  • We need experience building or running high-throughput, low-latency services.
  • We need familiarity with AI systems such as LLMs, embeddings, or AI workflows.
  • We need experience with distributed systems and production troubleshooting.
  • We need a solid grasp of APIs, data flows, and system design principles.
  • We need experience using observability tools such as logging, monitoring, and tracing.
  • We value a strong sense of ownership and a bias toward shipping.
  • We need someone comfortable working in fast-paced, globally distributed teams.
  • We expect familiarity with our tech stack, including Anthropic, AI, distributed systems tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, observability tools, OpenAI, open-source models, Python, and SQL.
Responsibilities:
  • We will have you build and run backend systems that support AI-powered insurance workflows in production.
  • We will have you design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.
  • We will have you develop inference pipelines for LLM-based and AI-assisted automation systems.
  • We will have you improve latency, throughput, and cost across AI services through caching, batching, streaming, and routing.
  • We will have you define stable service boundaries between backend systems, ML components, and product APIs.
  • We will have you implement observability through logging, metrics, tracing, alerting, and incident response workflows.
  • We will have you investigate production issues across distributed AI systems and address root causes.
  • We will have you collaborate closely with frontend, product, operations, and ML teams to deliver end-to-end features.
  • We will have you continuously strengthen system reliability, scalability, and performance.
Technologies:
  • AI
  • Backend
  • Docker
  • Frontend
  • Support
  • Kubernetes
  • LLM
  • NoSQL
  • Python
  • SQL
  • NodeJS

More:

We are hiring multiple AI Backend Engineers for a fully remote role on our global engineering team. You will work at the center of our AI stack, connecting models, backend systems, and real users to deliver reliable, scalable AI-driven decisioning, automation, and orchestration. This is a 100% remote position with benefits including medical, dental, and vision insurance, savings plan options, and paid time off. We keep all information confidential in line with EEO guidelines.

last updated 33 week of 2026

Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the AI Backend Engineer in San Francisco, CA vacancy
  •  ...About Reducto Reducto helps AI teams ingest real world enterprise data with state of the art accuracy. The vast majority...  ...z, Benchmark, and First Round Capital, and are looking for a Backend/AI Engineer. The Opportunity As a Backend/AI Engineer, you'll work... 
    Suggested
    Full time
    Work at office
    Local area

    Reducto

    San Francisco, CA
    23 hours ago
  • Salesforce, a leader in AI-driven CRM, seeks a Senior Member of Technical Staff to shape the Agentforce backend and platform capabilities. You will drive architecture, set...  ...AI boundaries. You will lead high-impact engineering initiatives, mentor teams, and ensure scalable... 
    Suggested

    salesforce.com, inc.

    San Francisco, CA
    5 days ago
  • Day One Partners is seeking a backend developer in San Francisco to build and scale AI-powered systems. Join a venture-backed startup creating technology to navigate chronic health conditions. You will have significant ownership over architecture and product direction,... 
    Suggested

    Day One Partners

    San Francisco, CA
    2 days ago
  •  ...Job Description Job Description Job Description AI Backend Engineer, Work From Home   We are looking for talented AI Backend Engineers to build systems that power AI-driven decisioning, automation, and orchestration across our platform.  This role sits at... 
    Suggested
    Remote work
    Work from home

    Parallel Partners

    San Francisco, CA
    a month ago
  •  ...As a Backend/AI Engineer at Emanate, you'll work on the core infrastructure that powers our AI revenue engine for industrial materials companies. You'll integrate cutting-edge LLMs, optimize data pipelines, and build the systems that make autonomous revenue workflows possible... 
    Suggested
    Full time

    Emanate Inc.

    San Francisco, CA
    23 hours ago
  • LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation...  ...be working on Skills: Python, LLM APIs, FastAPI As the Backend LLM Engineer, you'll be responsible for ensuring LiteLLM unifies the... 
    Full time
    Immediate start

    Litellm

    San Francisco, CA
    23 hours ago
  •  ...onboard expert contractors who help train AI models in a wide variety of domains. Our...  ...About the Role As a Senior Software Engineer at Mercor, you’ll take end-to-end ownership...  ...Design, build, and scale production-grade backend APIs, services, and infrastructure.... 
    Full time
    For contractors
    Immediate start

    Mercor

    San Francisco, CA
    23 hours ago
  •  ...Infrastructure for the World’s Largest Dataset You'll be our seventh engineering hire. You'll have full ownership over major features, play a...  .../20 solutions. You’re great at “figuring it out”: Recall.ai is a low-structure, high-trust environment. There’s minimal... 
    Full time
    Immediate start

    Recall

    San Francisco, CA
    23 hours ago
  •  ...Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed...  ...We’re looking for a hungry, creative engineer who thrives in a high-trust, high-...  ...Familiarity working on AI infrastructure or backend systems, such as LLM pipelines, APIs, cloud... 
    Full time

    Parasail

    San Francisco, CA
    23 hours ago
  • $180k - $220k

     ...HockeyStack is building the AI system that runs B2B sales and marketing. We integrate...  ...Mine every won and lost deal to reverse-engineer the patterns that drive revenue, then...  ...ll Do Own and continuously improve the backend systems that power all agentic AI features... 
    Full time
    Immediate start

    Hockeystack

    San Francisco, CA
    23 hours ago
  • $171k - $240k

     ..., and control spend effortlessly. Brex’s AI-native automation and world-class service...  ...to grow your career. AI at Brex AI Engineering at Brex is redefining how businesses run...  ...better over time. You'll move fluidly between backend and frontend as the work demands, picking... 
    Full time
    Work at office
    Remote work
    Work from home

    Brex Inc.

    San Francisco, CA
    23 hours ago
  • $200k - $350k

     ...across multiple systems and platforms. We are seeking a Senior AI Engineer to develop, deploy, and optimize production AI systems....  ...culture. This role offers the opportunity to tackle challenging backend problems, work with modern technologies, and grow alongside an... 
    Remote job
    Full time
    Immediate start

    Pragmatike

    San Francisco, CA
    23 hours ago
  •  ...is a scalable, data science-first growth engine that gives B2C teams predictive clarity into...  ...We're also co-building alongside leading AI companies. We're looking for an AI Engineer...  ...to drive iteration on AI systems Backend software engineering experience — building... 
    Full time
    Shift work
    Night shift
    Weekend work

    Hilbert's Ai

    San Francisco, CA
    23 hours ago
  •  ...About the Team OpenAI’s Applications Engineering organization builds and operates the products...  ...scale. About the Role We’re hiring Backend Software Engineers to design and...  ...done. About OpenAI OpenAI is an AI research and deployment company dedicated... 
    Full time
    Worldwide

    OpenAI

    San Francisco, CA
    23 hours ago
  • $180k - $300k

     ...systems and infrastructure at scale. We are seeking a Senior Backend Software Engineer with experience in YC-backed or Venture backed start-ups...  ...Microservices. High-volume transactional systems. AI/ML infrastructure. Startup or scale-up experience. Why... 
    Full time
    Immediate start

    Pragmatike

    San Francisco, CA
    23 hours ago
  •  ...About the role We’re seeking an experienced engineer to deploy enterprise-grade AI solutions, focusing on Retrieval-Augmented Generation (RAG) pipelines...  ...feedback into platform improvements across the Python backend and React/Next.js TypeScript frontend. Forecast and... 
    Full time

    StackAI

    San Francisco, CA
    23 hours ago
  •  .... About the role: We’re looking for a Foundational AI Engineer who thrives in ambiguity, enjoys building real-world AI systems...  ..., and external model providers. Build and evolve scalable backend services and APIs that power automated workflows and customer-... 
    Full time
    Work at office

    Numeral

    San Francisco, CA
    23 hours ago
  • $163k - $246.5k

     ...Semgrep gets smarter as you build, with AI that learns your context to cut false positives...  ....dev . About the role As an AI engineer, you’ll apply LLM technologies throughout...  ..., Python, Flask and SQLAlchemy on the Backend, is deployed via Kubernetes and hosted on... 
    Full time
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep, Inc.

    San Francisco, CA
    23 hours ago
  •  ...of our technology. About the Role We’re looking for backend software engineers with a product mindset to join the GTM Innovation team....  ...and motivated to make an outsized impact at the frontier of AI About OpenAI OpenAI is an AI research and deployment... 
    Full time

    OpenAI

    San Francisco, CA
    23 hours ago
  •  ...fast-growing startup that is building the AI backbone for the next generation of...  ...not data or raw compute, but a full-stack backend for fine-tuning, reinforcement learning,...  ...They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build... 
    Full time

    Rockstar

    San Francisco, CA
    23 hours ago
  •  ...the economy and knowledge work. We build AI products for financial institutions and the...  ...across research, product, design, engineering, and go-to-market to bring new capabilities...  ...About the Role We're looking for backend engineers to build the systems that make... 
    Full time

    OpenAI

    San Francisco, CA
    23 hours ago
  •  ...About David AI David AI is the first audio data research company. We bring an R&D approach...  ...in 2024 by a team of former Scale AI engineers and operators. In less than a year, we've...  ...audio models. About this role As a Backend Engineer at David AI, you'll build the... 
    Full time
    Work at office

    David AI

    San Francisco, CA
    23 hours ago
  •  ...capabilities. About the Role We are looking for an exceptional backend software engineer to help define and ship the enterprise capabilities our API...  ...simple and dependable. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that... 
    Full time
    Internship

    OpenAI

    San Francisco, CA
    23 hours ago
  • $160k - $207k

     ...control, and confidence. Semgrep gets smarter as you build, with AI that learns your context to cut false positives and prioritize...  .... Learn more at semgrep.dev . About the role As a Backend Engineer, you’ll work on our backend and infrastructure systems to... 
    Full time
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep

    San Francisco, CA
    23 hours ago
  • $100k - $130k

     ...technology empowers businesses and software engineers with a deploy-once, comply-and-secure-...  ...Ketch  We are looking for a highly skilled backend engineer who is comfortable with building...  .... We may use artificial intelligence (AI) tools to support parts of the hiring... 
    Full time

    Ketch

    San Francisco, CA
    23 hours ago
  •  ...New Lantern is building an AI radiology resident-think Cursor for radiologists. Our application integrates the three software...  ...reading images and finding disease. This role As a backend software engineer working on our radiology platform, you'll be responsible for... 
    Full time

    New Lantern

    San Francisco, CA
    23 hours ago
  •  ...Join SignalFire’s Talent Network for Staff Backend Engineer Roles at VC-Backed Startups This is not an application for a specific job. Instead...  .... Our portfolio spans 200+ innovative companies across AI, cybersecurity, healthtech, fintech, developer tools, and enterprise... 
    Full time

    Signal Fire Inc

    San Francisco, CA
    23 hours ago
  •  ...is at the forefront of integrating modern AI and LLMs into the Oura experience,...  ...over months and years. As a Senior AI Engineer, you will design, build, and operate the...  ...engineering, with a multi-year background in backend engineering, applied ML, or related roles... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Ura Corp

    San Francisco, CA
    23 hours ago
  • $200k - $350k

     ...across multiple systems and platforms. We are seeking a Staff AI Engineer to lead the design and deployment of production AI systems at...  .... This role offers the opportunity to tackle challenging backend problems, work with modern technologies, and grow alongside an... 
    Remote job
    Full time
    Immediate start

    Pragmatike

    San Francisco, CA
    23 hours ago
  • $200k - $350k

     ...across multiple systems and platforms. We are seeking a Lead AI Engineer to lead the company's AI engineering organization and...  ...culture. This role offers the opportunity to tackle challenging backend problems, work with modern technologies, and grow alongside an... 
    Remote job
    Full time
    Immediate start

    Pragmatike

    San Francisco, CA
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Backend Engineer. Be the first to apply!