Back End Engineer (AI)
OnHires
Role Description
As a Backend Engineer, you'll build the systems that make AI-native productivity experiences possible. You'll own the backend services that power AI interactions in production, ensuring they remain fast, reliable, and scalable as the platform grows.
- Designing and building backend services for AI-powered product features
- Developing inference pipelines and orchestration layers around LLMs
- Creating reliable APIs used by web, desktop, and mobile applications
- Optimizing latency, throughput, caching, batching, and streaming
- Building monitoring, logging, alerting, and observability across production services
- Debugging distributed systems and improving platform reliability
- Working closely with product, infrastructure, and AI engineers to continuously improve performance
Qualifications
- Strong backend engineering experience in production environments
- Experience building high-throughput, low-latency distributed systems
- Excellent Python skills (Node.js is a plus)
- Hands-on experience deploying and operating services on Kubernetes and Docker
- Experience with SQL and NoSQL databases
- Familiarity with modern AI infrastructure, including LLM inference, embeddings, or multimodal models
- A pragmatic engineering mindset focused on shipping reliable software
Requirements
- Experience with OpenAI, Anthropic, or open-source LLMs (nice to have)
- Experience building AI orchestration or agent workflows (nice to have)
- Knowledge of inference optimization techniques (nice to have)
- Experience operating AI services at scale (nice to have)
Tech Stack
- Python
- Node.js
- PyTorch
- OpenAI, Anthropic, open-source LLMs
- SQL & NoSQL
- Kubernetes
- Docker
Why this role is interesting
This isn't a traditional backend position. You'll be working on the infrastructure layer that connects cutting-edge AI models with real users. Your work will directly impact how quickly, reliably, and intelligently the product behaves in production.
If you enjoy solving problems around distributed systems, AI infrastructure, performance, and reliability—and want to build technology used by millions of people—this is an opportunity to work on one of the most technically challenging parts of an AI-native product.
$200k - $250k
...Senior Back End Engineer San Francisco (Remote) About Us At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real...SuggestedFull timeImmediate startRemote workWork from homeFlexible hours$175k - $195k
...Troveo builds the data platform that AI labs and model builders need to train the... ...tuning, evaluation, and agentic use cases. Backed by top investors, we're a small, high-impact... ...We are hiring a Senior Backend Software Engineer with deep expertise in building scalable...SuggestedRemote workFlexible hours$167k - $230k
...delivery headaches. What You’ll Do As a Software Engineer on the Otter Marketing/Boost team, you’ll build an AI‑powered platform that automates marketing across delivery... ..., retries, and reconciliation. Own your services end‑to‑end: develop, instrument, debug, and improve...SuggestedFull timeTemporary workWorldwideFlexible hours- ...About Ironflow AI We are building the world’s first AI-native ERP for defense tech... ...defense tech revolution. Built by veterans, engineers, and operators who’ve lived the pain of legacy... ...~ A track record of owning features end to end — from design to deployment ~ Comfort...SuggestedFull time
- ...About Us At South Geeks, we connect top LATAM engineering talent with innovative companies building... ...startup redefining medical device innovation with an AI platform that automates research, documentation, and workflows end-to-end, helping deliver lifesaving devices...SuggestedFull timeRemote workWork from homeWorldwide
- ...About candidate.fyi candidate.fyi is the AI execution layer for talent operations. We build the infrastructure that powers interview... ...The Role We're looking for a backend-focused full stack engineer who thinks in systems, cares about product quality, and is genuinely...Remote jobFull time
$10k
...this role you'll be a foundational and versatile member of our engineering team, focused on building a simpler, smarter, and more intuitive... ...payment system for processing ACH and check payments; AI-powered system for recording payments made outside of Castle environment...Full time- ...We're looking for a Senior Full Stack Engineer to help build the AI-driven products at the core of our platform... ...our AI-driven products Develop end-to-end features across AI agent... ...applications — agents, orchestration, or LLM-backed systems ~ Proven track record in...Full timeSummer workWork at officeRemote work
$140k
...Remote-First Places to Work." TeamSnap is seeking a Software Engineer (Fullstack) interested in working across the stack to join our engineering... ...Opportunity Employer. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...Permanent employmentFull timeLocal areaRemote workHome office3 days per week- ...About Reacher Reacher is a YC backed AI SaaS platform building the operating system for... ...We build with AI, not around it. Our engineering team uses Claude Code and agentic coding... ...'ll Do Own and lead product features end-to-end : research, design, implement, test...Remote jobFull time
- ...exclusive few. If you're this person, we'd love to talk to you. The Role We are looking for backend engineers to build the core systems behind BJAK's AI Neobank app. This role is for engineers who can build reliable APIs, workflows and financial product...Remote jobFull time
- ...multiple systems and platforms. We are seeking a Backend Software Engineer with strong TypeScript and NestJS expertise to help design,... ...discussions and influence long-term platform strategy. Leverage modern AI-assisted development tools to improve engineering productivity...Remote jobFull timeImmediate startWorldwide
- ...top-notch technology and design. Our client is building the AI backbone for the next generation of intelligent products. They help... ...your AI system better. They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build, and scale the core...Full timeRemote work
- ...compound solution that enables this. Our AI-powered sales platform helps B2B companies... ...thanks to our advanced lead generation engine, hyper-personalized sequencing, omnichannel... ...outreach, and AI-powered smart actions. We are backed by Y Combinator, and we are powering the...Remote jobFull time
$160k - $207k
...gets smarter as you build, with AI that learns your context to... ...Founded in San Francisco and backed by Menlo Ventures, Felicis Ventures... ...the role As a Backend Engineer, you’ll work on our backend and... ...of the hiring process. To that end, we generate internal compensation...Full timeCurrently hiringLocal areaRemote workWeekend work3 days per week$165k - $195k
...mission to revolutionize facility management with cutting-edge AI solutions that empower enterprise customers to operate more efficiently... ...is seeking a thoughtful and versatile Senior Backend Software Engineer to help build and evolve SITE's platform and related customer...Remote jobFull timeTemporary work$107k - $168k
...Who We Are Addepar is a global data and AI platform empowering investment... ...software, data and consulting partners to power end-to-end investment operations across firms... ...The Role We are seeking a Software Engineer to join the Precompute team within our Core...Full timeH1bRemote workWorldwideVisa sponsorshipWork visaFlexible hours- ...and insurance infrastructure to AI-powered workflow automation.... ...Gifford and has raised a Series A backed by top investors, as well as... ...looking for a senior backend engineer to help build and scale the... ...you’re familiar with driving end to end execution, including QAing...Full timeLive inWork at officeNight shift
$90k
...the helpers" you've come to the right place. Backend Software Engineer: Compensation: $90,000 base, and a bonus potential of up to 1... ...one of: Elasticsearch, MongoDB, or Redis ~ Proficiency with AI-assisted development tools (e.g., Claude Code, GitHub Copilot, Cursor...Remote jobFull timeWork experience placementHome officeShift work$107k - $168k
...Who We Are Addepar is a global data and AI platform empowering investment... ...software, data and consulting partners to power end-to-end investment operations across firms... ...We are currently seeking a Software Engineer to join the Calculation Engines team which...Full timeH1bRemote workWorldwideVisa sponsorshipWork visa$135k - $200k
...the world. Backend Software Engineers at Palantir build software at... ...and empowering developers and end-users to do their work optimally... ...underpin our our operational data and AI systems Maintaining high... ...for new parents and subsidized back-up care for all parents •...Full timeWork experience placementWork at officeRemote workWork from homeRelocation package$175k - $210k
...LinkedIn page! Job details: 100% remote role working at a Series A AI startup! This Jobot Job is hosted by: Brandon Bays Salary:... ...by enterprise customers Join a senior, collaborative engineering team focused on pragmatic execution Chance to work in a Series...Remote work- ...Cape Title: BackEnd Software Engineer (2+ years - Senior Level)... ...Customer, we will likely not get back to you. It is a REQUIREMENT of... ...analysis tools, and integrating AI/ML capabilities for federal government... ...have frequent interaction with end users to produce and deploy...Full timeFor subcontractor
- ...Title: Backend Engineer Location: remote positions require an assessment, please do not sent me candidates who cannot take the... ...have education from the USA **MUST have FHIR experience and AI knowledge Core skills: Python, SQL, AWS, Kafka, Databricks,...Remote work
$170k - $180k
...looking for a highly skilled Backend Software Engineer IV to design, build, and scale the... ...You will own complex technical initiatives end-to-end, working deeply with Python, Django... ...build highly responsive, personalized, and AI-driven member features. You will be a key...Permanent employmentFull timeLocal areaRemote workVisa sponsorshipWork visa- ...Remote or Hybrid 2 rounds of interview. Candidate may be asked to share screen to mitigate AI use. Required Skills More than 7 years of backend software engineering experience Strong Java development experience in enterprise applications Hands-on...Remote work
$145k - $165k
...working alongside global innovators to build AI-powered solutions that solve hoteliers'... ...ll Make an Impact: As a Senior Backend Engineer on the Distribution Team, you'll be instrumental... ...test coverage (unit, integration, end-to-end) to maintain high quality standards...Full timeWork at officeLocal areaRemote workWork from homeWorldwideHome officeWeekend work- ...data to drive better decisions and we believe with Generative AI, there is an opportunity to bring a disruptive change in how employees... ...early enough that you will get to define a lot of the product/engineering roadmap. Role We are looking for a backend/...Full time
- ...decisions of their lives. The Content & Industry Services team is the engine behind that data — we ingest, process, and publish content from... ...millions of records daily. This role will involve investing in AI-driven solutions to improve content quality and developer...Full timeWork at officeLocal areaImmediate startFlexible hours
$140k - $290k
...United States to help them hire. Backend Engineer Location: San Francisco, CA (On-site... ...layer for modern recruiting, creating an AI-powered marketplace that helps companies... ...Strong startup growth trajectory Backed by top-tier investors including Scale, Felicis...Work at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Back End Engineer (AI). Be the first to apply!


