Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend AI Engineer

Full-time

Nexxa.ai

Nexxa is building the best AI systems for heavy industries — enabling machines, systems and operations to think, decide and act autonomously across manufacturing, large-scale infrastructure, logistics and legacy environments.
Our mission is to translate deep technical breakthroughs into operational reality, solving some of the hardest systems-level problems in industry.

Role Overview

We're looking for Backend AI Engineers to design, build, and own the core AI infrastructure and services that power Nexxa's products in production. Where our Forward Deployed Engineers embed with customers to deliver solutions on the ground, this role builds the systems that make those solutions possible at scale: model-serving pipelines, inference and orchestration layers, data pipelines, and the APIs and microservices that connect Generative AI, Computer Vision, and Machine Learning models to real enterprise environments.

This role is a blend of backend software engineering, ML infrastructure, and systems architecture. You'll design distributed systems, integrate and serve models in production, and build the reusable platform capabilities that our customer-facing and product teams depend on.

Key Responsibilities

  • Design, build, and maintain backend services and APIs that power GenAI, LLM, and Computer Vision model integrations across Nexxa's products.

  • Build and own core AI/ML infrastructure: model-serving pipelines, inference services, data pipelines, and embedding/vector stores.

  • Architect scalable, production-grade systems for real-time and batch AI workloads across manufacturing, infrastructure, and logistics domains.

  • Implement and optimize RAG systems, prompt/context pipelines, and orchestration layers connecting models to enterprise and operational data sources.

  • Build robust APIs, microservices, and integration layers connecting AI systems to customer data, legacy systems, and existing infrastructure.

  • Own the reliability, performance, and observability of backend AI systems — logging, monitoring, testing, and CI/CD for ML services.

  • Collaborate closely with Forward Deployed Engineers, ML engineers, and product teams to translate customer and field requirements into reusable, hardened backend capabilities.

  • Evaluate and integrate ML/CV/LLM models into production backend systems; manage model versioning, rollout, and deployment pipelines.

  • Produce clear technical documentation: architecture diagrams, API specs, and runbooks for internal and customer-facing teams.

  • Mentor engineers and contribute to internal backend engineering best practices.

Qualifications

  • 4–8+ years of experience in backend software engineering, ML/platform engineering, or similar roles.

  • Strong proficiency in TypeScript/Node.js (our primary backend language), with strong API and microservice design skills. Working proficiency in Python is a plus for ML/model integration work.

  • Hands-on experience building and operating production backend systems at scale — distributed systems, databases, message queues.

  • Experience integrating ML or Generative AI models (LLMs, multimodal models) into backend services — inference, orchestration, and evaluation.

  • Solid understanding of cloud infrastructure (AWS, GCP, or Azure) and containerization (Docker, Kubernetes).

  • Experience designing and operating data pipelines (batch and/or streaming) across structured and unstructured data.

  • Hands-on experience building retrieval-augmented generation (RAG) systems and AI memory architectures — retrieval pipelines, vector stores, context management, and long-term/session memory for LLM applications.

  • Strong grasp of system design fundamentals: scalability, reliability, security, and observability.

  • Comfortable working cross-functionally with ML engineers, product, and customer-facing teams.

  • Bachelor's degree (or higher) in Computer Science or a related field.

Preferred

  • Familiarity with ML frameworks (PyTorch, TensorFlow, OpenCV) sufficient to integrate, serve, or evaluate models, even without training them yourself.

  • Experience with MLOps tooling: model registries, feature stores, CI/CD for ML, and monitoring/observability for ML systems.

  • Background in event-driven or real-time systems (Kafka, gRPC, WebSockets).

  • Experience in industrial, IoT, or operational technology (OT) environments.

  • Experience in startup or high-growth environments.

What We're Looking For

  • A backend engineer who wants to build the infrastructure powering real-world autonomous AI systems.

  • Someone who can architect for scale and reliability while still moving fast.

  • A systems thinker who enjoys turning ambiguous AI capabilities into dependable, production-grade backend services.

  • A strong collaborator who partners well with ML engineers, Forward Deployed teams, and product.

Why Join Nexxa.AI ?

Innovative Environment: Build the foundational systems behind groundbreaking AI and automation technologies transforming heavy industries.

Collaborative Culture: Be part of a team that values innovation, discipline, and continuous improvement.

Professional Growth: Benefit from significant opportunities for career development and advancement.

Competitive Compensation: Enjoy a comprehensive salary and equity package reflective of your expertise and contributions.

If you're passionate about backend engineering and eager to build the infrastructure powering advanced AI solutions, we'd love to connect.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Backend AI Engineer in Sunnyvale, CA vacancy
  •  ...seeking a candidate to enhance LLM security by architecting monitoring and filtering systems. This role requires expertise in deploying AI systems, managing prompts, and safeguarding against emerging threats. The ideal candidate will have strong skills in application... 
    Suggested

    Jobleads-US

    Sunnyvale, CA
    1 day ago
  • $150k - $200k

     ...together to advance human health for tomorrow.Learn about the Danaher Business System which makes everything possible.The Backend & AI Platform Engineer is responsible for creating the backend platform that powers intelligent automation across scientific workflows. By... 
    Suggested
    Full time
    Part time

    Danaher Corporation

    San Jose, CA
    3 hours ago
  •  ...Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion...  ...commitments. Meet our software engineers! Meet some of our software engineers who...  ...~ Comfort working across the stack, from backend infrastructure to APIs to frontend work.... 
    Suggested
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    1 day ago
  • $209.6k - $314.4k

     ...customer's factory staying online, up to date, and in perfect two-way conversation with our cloud. We are looking for a Staff Backend Engineer to own the services that live on that seam between our cloud and our global fleet of printers. You will design and build the... 
    Suggested
    Permanent employment
    Full time
    For contractors
    Work at office
    Remote work

    Carbon

    Sunnyvale, CA
    1 day ago
  • $104.9k - $218.55k

     ...organization, apply now.We are currently seeking a Full Stack AI Engineer/Developer - Onsite to join our team in Santa Clara, California...  ...requires deep expertise across modern frontend frameworks, scalable backend systems, real-time streaming interfaces, and LLM-powered... 
    Suggested
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...technology powers everything from generative AI to autonomous systems, and we continue to...  ..., and tools that enable researchers and engineers to develop the next generation of AI/ML...  ...environmentsBuild high-performance backend services for telemetry ingestion, processing... 
    Full time

    Nvidia

    Santa Clara, CA
    3 hours ago
  • $161k - $194k

     ...team within Alphabet working to build the AI-powered electric grid. We are tackling...  ...together experts in energy, AI, software, engineering, and product to build tools that help the...  ...practical experience.5+ years of experience in backend programming languages such as Python, Go,... 
    Full time
    Work at office
    Local area
    Flexible hours

    X Company

    Mountain View, CA
    3 days ago
  • $161k - $194k

     ...group within Google working to build the AI-powered electric grid. We are tackling one...  ...together experts in energy, AI, software engineering, and products to build tools that help...  ...our mission here.About the roleAs a senior backend software engineer you will work across the... 
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    3 hours ago
  •  ...next-generation computing experiences—from AI and data centers, to PCs, gaming and...  ...a human in the loop. You will be a core engineer on this system, designing and building the...  ...LLM agent framework, RAG pipelines, MCP backend, and developer tooling that make it work.... 
    Flexible hours

    AMD

    Santa Clara, CA
    22 hours ago
  • $264.51k - $310.9k

     ...DescriptionDUTIES: Design, develop, and maintain large-scale backend systems and APIs that support business-critical applications and...  ...to local office.REQUIREMENTS: Bachelor's degree in Computer Engineering, Computer Science, Software Engineering, or related field of study... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home

    General Motors

    Sunnyvale, CA
    3 days ago
  •  ...Backend Engineer Our client, an IT Services and Consultant company, is looking for a Backend Engineer for their Mountain View, CA/Hybrid location. Responsibilities include: Develop and maintain Java-based applications using Spring Boot and Microservices architecture... 

    ICONMA

    Mountain View, CA
    4 days ago
  • $152k - $241.5k

    NVIDIA's Silicon Co-Design Group is seeking an Applied AI Engineer to innovate, develop, and integrate innovative AI solutions into the...  ...experience building and deploying ML/AI systems or data-intensive backend services.2+ years of direct Applied AI experience... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 hours ago
  • $120k - $160k

     ...news and information powered by advanced AI, recommendation systems, and adtech.Recognized...  ...for a Senior Technical Recruiter, AI & Engineering to help build the teams behind our AI-...  ...network and talent pipeline across AI/ML, backend, infrastructure, and platform engineering... 
    Full time
    Work at office
    Local area
    Work from home
    Monday to Friday

    News Break

    Mountain View, CA
    1 day ago
  •  ...the discovery phase of medium to large projects to come up with high-level design.Leads the work of other small groups of 3 to 4 engineers for assigned Engineering projects.Leads and participates in end-to-end service implementations, data feeds ingestion, and orchestration... 

    Samprasoft

    Sunnyvale, CA
    13 hours ago
  • $200k - $400k

     ...decided by those who field intelligent machines at scale. At Scout AI, we’re developing Fury, the first robotic foundation model for...  ...work. The Role We're looking for a Senior or Staff AI Engineer to join the Fury Orchestration Team with a deep passion for developing... 
    Full time
    Relocation package

    Scout Ai

    Sunnyvale, CA
    1 day ago
  • $25k

     ...We are looking for a Marketing AI Engineer to sit at the intersection of marketing strategy and cutting-edge AI technology. This 4-month contract role is responsible for accelerating adoption of AI within the marketing team by building, managing, and optimizing AI-powered... 
    Remote job
    Full time
    Contract work
    Temporary work
    Work at office
    Worldwide

    Azul

    Sunnyvale, CA
    1 day ago
  •  ...the discovery phase of medium to large projects to come up with high level design. Leads the work of other small group of 3 to 4 engineers for assigned Engineering projects. Leads and participates in end to end service implementations, data feeds ingestion, and orchestration... 
    Work at office
    Remote work

    Samprasoft

    Sunnyvale, CA
    11 hours ago
  • $50k - $120k

     ...Who are we? Mission Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through...  ..., we're positioned at the forefront of the AI-powered data engineering revolution. You can read more about us in a recently published... 
    Full time
    Worldwide

    Pa Early Stage Partners

    Sunnyvale, CA
    1 day ago
  • $170.6k - $261.3k

     ...products designed to meet the unique demands of AI and ML innovation, supporting a wide...  ..., enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML...  ...everything from user-facing interfaces to backend services and cloud infrastructure. You will... 
    Full time
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $105k - $115k

     ...Quest Global delivers world-class end-to-end engineering solutions by leveraging our deep industry...  ...struggles with by utilizing Gen AI or other machine learning techniques Experience...  ...data between teamsExperience as a backend or full stack dev preferably in Python or... 
    Temporary work

    Quest Global Services

    Sunnyvale, CA
    3 days ago
  • $60 - $65 per hour

     ...Job Summary: We are seeking an experienced Python Backend Engineer to design, develop, and maintain scalable backend systems and APIs. The...  ...modern backend frameworks, cloud infrastructure, databases, and AI-powered application development. This role offers the... 
    Hourly pay
    Shift work

    ClinDCast

    Sunnyvale, CA
    5 days ago
  •  ...View is seeking an experienced full-stack engineering leader to head the Early Bets team. You...  ...retention and revenue. You will embed AI-native practices, mentor engineers, and collaborate...  ...across product, analytics, and mobile/backend groups to deliver high-impact features at... 

    Jobleads-US

    Mountain View, CA
    1 day ago
  •  ...Sr Backend Engineer Sunnyvale, California, United States About The Job Sr Backend Engineer Job title: BE Engineer Location: Sunnyvale, CA (on-site/hybrid) Visa: USC/GC Managers Notes: Java, Springboot, microservices, Kubernetes, CI/CD, Jenkins, ETC... 

    Interaction24 LLC

    Sunnyvale, CA
    10 hours ago
  •  ...exposure.Coding and developing solutions, trouble shooting, engaging with team on day to day operations.Marketing Technology - SEO.7 engineers located in US and 16 in India.Remote.Extend yes possibly.. FTE no.Himself and his team.No, they are flexible.Yes.Experience,... 
    Remote work
    Flexible hours

    Kaav Inc.

    Sunnyvale, CA
    1 day ago
  • $164k - $282k

     ...are looking for a visionary Staff Software Engineer to lead the architectural design and...  ...5-6 nines availability while leveraging AI to automate complex system behaviors and...  ...closely related field6 years of experience in backend software development Proficiency in Java... 
    Temporary work

    Coupang

    Mountain View, CA
    2 days ago
  • $166k - $220k

    A leading technology company in Mountain View is seeking an experienced backend or infrastructure engineer to join their ML/AI Environments team. The ideal candidate will have 5+ years of experience and strong programming skills in Python, Scala, or Java. You will be responsible... 

    Jobleads-US

    Mountain View, CA
    1 day ago
  • $174k - $299k

     ...Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world.About the TeamOur eCommerce Engineering group aims to reshape our customers' shopping experience, ultimately making them say, "How did I ever live without Coupang?"... 
    Temporary work
    Flexible hours
    Shift work

    Coupang

    Mountain View, CA
    2 days ago
  • $100k - $150k

     ...Join to apply for the Backend Engineer role at Peppr AI (YC W25) This range is provided by Peppr AI (YC W25). Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $100,000.00/yr - $149,998.00/yr What You’ll... 
    Full time

    Peppr AI (YC W25)

    Cupertino, CA
    4 days ago
  •  ...will they contribute to the project? Implement Pickup and Delivery for MarketplaceWhat is the makeup of the team? It is team of backend engineers. Lead provides the guidance what is daily task and backend engineers will understand the requirement and deliver and... 
    Contract work
    Work at office
    Remote work

    Samprasoft

    Sunnyvale, CA
    13 hours ago
  •  ...challenges confidently with agile, high-impact workforce strategies tailored to modern global business demands.Job DescriptionJava Backend Engineer Need a hands-on Java Backend Engineer who has hands on experience with Java core & Java Reactive, Springboot, Docker &... 
    Worldwide

    YD Talent Solutions

    Sunnyvale, CA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend AI Engineer. Be the first to apply!