Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Back End Engineer (AI)

Full-time

OnHires

Role Description

As a Backend Engineer, you'll build the systems that make AI-native productivity experiences possible. You'll own the backend services that power AI interactions in production, ensuring they remain fast, reliable, and scalable as the platform grows.

  • Designing and building backend services for AI-powered product features
  • Developing inference pipelines and orchestration layers around LLMs
  • Creating reliable APIs used by web, desktop, and mobile applications
  • Optimizing latency, throughput, caching, batching, and streaming
  • Building monitoring, logging, alerting, and observability across production services
  • Debugging distributed systems and improving platform reliability
  • Working closely with product, infrastructure, and AI engineers to continuously improve performance

Qualifications

  • Strong backend engineering experience in production environments
  • Experience building high-throughput, low-latency distributed systems
  • Excellent Python skills (Node.js is a plus)
  • Hands-on experience deploying and operating services on Kubernetes and Docker
  • Experience with SQL and NoSQL databases
  • Familiarity with modern AI infrastructure, including LLM inference, embeddings, or multimodal models
  • A pragmatic engineering mindset focused on shipping reliable software

Requirements

  • Experience with OpenAI, Anthropic, or open-source LLMs (nice to have)
  • Experience building AI orchestration or agent workflows (nice to have)
  • Knowledge of inference optimization techniques (nice to have)
  • Experience operating AI services at scale (nice to have)

Tech Stack

  • Python
  • Node.js
  • PyTorch
  • OpenAI, Anthropic, open-source LLMs
  • SQL & NoSQL
  • Kubernetes
  • Docker

Why this role is interesting

This isn't a traditional backend position. You'll be working on the infrastructure layer that connects cutting-edge AI models with real users. Your work will directly impact how quickly, reliably, and intelligently the product behaves in production.

If you enjoy solving problems around distributed systems, AI infrastructure, performance, and reliability—and want to build technology used by millions of people—this is an opportunity to work on one of the most technically challenging parts of an AI-native product.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Back End Engineer (AI) in Remote vacancy
  • $200k - $250k

     ...Senior Back End Engineer San Francisco (Remote) About Us At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real... 
    Suggested
    Full time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Y.O.U.

    United States
    2 days ago
  • $175k - $195k

     ...Troveo builds the data platform that AI labs and model builders need to train the...  ...tuning, evaluation, and agentic use cases. Backed by top investors, we're a small, high-impact...  ...We are hiring a Senior Backend Software Engineer with deep expertise in building scalable... 
    Suggested
    Remote work
    Flexible hours

    Troveo AI Inc

    United States
    1 day ago
  • $167k - $230k

     ...delivery headaches. What You’ll Do As a Software Engineer on the Otter Marketing/Boost team, you’ll build an AI‑powered platform that automates marketing across delivery...  ..., retries, and reconciliation. Own your services end‑to‑end: develop, instrument, debug, and improve... 
    Suggested
    Full time
    Temporary work
    Worldwide
    Flexible hours

    Otter.ai

    Seattle, WA
    10 hours ago
  •  ...About Ironflow AI We are building the world’s first AI-native ERP for defense tech...  ...defense tech revolution. Built by veterans, engineers, and operators who’ve lived the pain of legacy...  ...~ A track record of owning features end to end — from design to deployment ~ Comfort... 
    Suggested
    Full time

    Ironflow Ai

    Remote
    10 hours ago
  •  ...About Us At South Geeks, we connect top LATAM engineering talent with innovative companies building...  ...startup redefining medical device innovation with an AI platform that automates research, documentation, and workflows end-to-end, helping deliver lifesaving devices... 
    Suggested
    Full time
    Remote work
    Work from home
    Worldwide

    South Geeks

    United States
    10 hours ago
  •  ...About candidate.fyi candidate.fyi is the AI execution layer for talent operations. We build the infrastructure that powers interview...  ...The Role We're looking for a backend-focused full stack engineer who thinks in systems, cares about product quality, and is genuinely... 
    Remote job
    Full time

    Candidate.fyi

    United States
    10 hours ago
  • $10k

     ...this role you'll be a foundational and versatile member of our engineering team, focused on building a simpler, smarter, and more intuitive...  ...payment system for processing ACH and check payments; AI-powered system for recording payments made outside of Castle environment... 
    Full time

    Castle

    Remote
    10 hours ago
  •  ...We're looking for a Senior Full Stack Engineer to help build the AI-driven products at the core of our platform...  ...our AI-driven products Develop end-to-end features across AI agent...  ...applications — agents, orchestration, or LLM-backed systems ~ Proven track record in... 
    Full time
    Summer work
    Work at office
    Remote work

    Proxima

    New York, NY
    10 hours ago
  • $140k

     ...Remote-First Places to Work." TeamSnap is seeking a Software Engineer (Fullstack) interested in working across the stack to join our engineering...  ...Opportunity Employer. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing... 
    Permanent employment
    Full time
    Local area
    Remote work
    Home office
    3 days per week

    Teamsnap

    Los Angeles, CA
    10 hours ago
  •  ...About Reacher Reacher is a YC backed AI SaaS platform building the operating system for...  ...We build with AI, not around it. Our engineering team uses Claude Code and agentic coding...  ...'ll Do Own and lead product features end-to-end : research, design, implement, test... 
    Remote job
    Full time

    Reacher

    Remote
    10 hours ago
  •  ...exclusive few. If you're this person, we'd love to talk to you.   The Role We are looking for backend engineers to build the core systems behind BJAK's AI Neobank app. This role is for engineers who can build reliable APIs, workflows and financial product... 
    Remote job
    Full time

    Bjak

    United States
    10 hours ago
  •  ...multiple systems and platforms. We are seeking a Backend Software Engineer with strong TypeScript and NestJS expertise to help design,...  ...discussions and influence long-term platform strategy. Leverage modern AI-assisted development tools to improve engineering productivity... 
    Remote job
    Full time
    Immediate start
    Worldwide

    Pragmatike

    Los Angeles, CA
    10 hours ago
  •  ...top-notch technology and design. Our client is building the AI backbone for the next generation of intelligent products. They help...  ...your AI system better. They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build, and scale the core... 
    Full time
    Remote work

    Rockstar

    San Francisco, CA
    10 hours ago
  •  ...compound solution that enables this. Our AI-powered sales platform helps B2B companies...  ...thanks to our advanced lead generation engine, hyper-personalized sequencing, omnichannel...  ...outreach, and AI-powered smart actions. We are backed by Y Combinator, and we are powering the... 
    Remote job
    Full time

    Amplemarket

    Remote
    10 hours ago
  • $160k - $207k

     ...gets smarter as you build, with AI that learns your context to...  ...Founded in San Francisco and backed by Menlo Ventures, Felicis Ventures...  ...the role As a Backend Engineer, you’ll work on our backend and...  ...of the hiring process. To that end, we generate internal compensation... 
    Full time
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep

    San Francisco, CA
    10 hours ago
  • $165k - $195k

     ...mission to revolutionize facility management with cutting-edge AI solutions that empower enterprise customers to operate more efficiently...  ...is seeking a thoughtful and versatile Senior Backend Software Engineer to help build and evolve SITE's platform and related customer... 
    Remote job
    Full time
    Temporary work

    Site Technologies

    Chicago, IL
    10 hours ago
  • $107k - $168k

     ...Who We Are Addepar is a global data and AI platform empowering investment...  ...software, data and consulting partners to power end-to-end investment operations across firms...  ...The Role We are seeking a Software Engineer to join the Precompute team within our Core... 
    Full time
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa
    Flexible hours

    Addepar

    New York, NY
    10 hours ago
  •  ...and insurance infrastructure to AI-powered workflow automation....  ...Gifford and has raised a Series A backed by top investors, as well as...  ...looking for a senior backend engineer to help build and scale the...  ...you’re familiar with driving end to end execution, including QAing... 
    Full time
    Live in
    Work at office
    Night shift

    Corner Health

    Remote
    10 hours ago
  • $90k

     ...the helpers" you've come to the right place. Backend Software Engineer: Compensation: $90,000 base, and a bonus potential of up to 1...  ...one of: Elasticsearch, MongoDB, or Redis ~ Proficiency with AI-assisted development tools (e.g., Claude Code, GitHub Copilot, Cursor... 
    Remote job
    Full time
    Work experience placement
    Home office
    Shift work

    Feathr

    Remote
    10 hours ago
  • $107k - $168k

     ...Who We Are Addepar is a global data and AI platform empowering investment...  ...software, data and consulting partners to power end-to-end investment operations across firms...  ...We are currently seeking a Software Engineer to join the Calculation Engines team which... 
    Full time
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Who We Are Addepar

    New York, NY
    10 hours ago
  • $135k - $200k

     ...the world. Backend Software Engineers at Palantir build software at...  ...and empowering developers and end-users to do their work optimally...  ...underpin our our operational data and AI systems Maintaining high...  ...for new parents and subsidized back-up care for all parents •... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package

    Palantir Technologies

    Palo Alto, CA
    10 hours ago
  • $175k - $210k

     ...LinkedIn page! Job details: 100% remote role working at a Series A AI startup! This Jobot Job is hosted by: Brandon Bays Salary:...  ...by enterprise customers Join a senior, collaborative engineering team focused on pragmatic execution Chance to work in a Series... 
    Remote work

    Jobot

    Chicago, IL
    4 days ago
  •  ...Cape  Title: BackEnd Software Engineer (2+ years - Senior Level)...  ...Customer, we will likely not get back to you. It is a REQUIREMENT of...  ...analysis tools, and integrating AI/ML capabilities for federal government...  ...have frequent interaction with end users to produce and deploy... 
    Full time
    For subcontractor

    Black Cape

    Remote
    10 hours ago
  •  ...Title: Backend Engineer Location: remote positions require an assessment, please do not sent me candidates who cannot take the...  ...have education from the USA **MUST have FHIR experience and AI knowledge Core skills: Python, SQL, AWS, Kafka, Databricks,... 
    Remote work

    RIT Solutions, Inc.

    United States
    1 day ago
  • $170k - $180k

     ...looking for a highly skilled Backend Software Engineer IV to design, build, and scale the...  ...You will own complex technical initiatives end-to-end, working deeply with Python, Django...  ...build highly responsive, personalized, and AI-driven member features. You will be a key... 
    Permanent employment
    Full time
    Local area
    Remote work
    Visa sponsorship
    Work visa

    Vida Health

    Remote
    10 hours ago
  •  ...Remote or Hybrid 2 rounds of interview. Candidate may be asked to share screen to mitigate AI use. Required Skills More than 7 years of backend software engineering experience Strong Java development experience in enterprise applications Hands-on... 
    Remote work

    Info Way Solutions

    Minneapolis, MN
    4 days ago
  • $145k - $165k

     ...working alongside global innovators to build AI-powered solutions that solve hoteliers'...  ...ll Make an Impact:  As a Senior Backend Engineer on the Distribution Team, you'll be instrumental...  ...test coverage (unit, integration, end-to-end) to maintain high quality standards... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide
    Home office
    Weekend work

    Third-Party Job Posts

    United States
    10 hours ago
  •  ...data to drive better decisions and we believe with Generative AI, there is an opportunity to bring a disruptive change in how employees...  ...early enough that you will get to define a lot of the product/engineering roadmap.   Role We are looking for a backend/... 
    Full time

    WisdomAI

    Remote
    10 hours ago
  •  ...decisions of their lives. The Content & Industry Services team is the engine behind that data — we ingest, process, and publish content from...  ...millions of records daily. This role will involve investing in AI-driven solutions to improve content quality and developer... 
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    Realtor.com Careers

    Austin, TX
    10 hours ago
  • $140k - $290k

     ...United States to help them hire. Backend Engineer Location: San Francisco, CA (On-site...  ...layer for modern recruiting, creating an AI-powered marketplace that helps companies...  ...Strong startup growth trajectory Backed by top-tier investors including Scale, Felicis... 
    Work at office
    Remote work

    Recruiting from Scratch

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Back End Engineer (AI). Be the first to apply!