Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer - Backend & AI Infra

MLabs

Staff Software Engineer - Backend & AI Infra

Remote | Full-time

Location:
Based in US to GMT timezones

Compensation: Competitive Compensation Package

Our client is a high-growth technology firm. They are seeking a Staff Software Engineer to spearhead two critical domains: the core agent runtime and backend infrastructure powering a high-frequency trading fleet, and the comprehensive migration of model hosting and agent deployment to in-house, proprietary infrastructure.

This is a foundational, high-impact building role. The successful candidate will design and implement the backend services, runtime engines, and deployment systems that enable a fleet of autonomous agents to operate with superior speed, reliability, and intelligence. By moving away from third-party LLM providers and hosted platforms, this role will establish the sovereign infrastructure necessary for the next generation of autonomous financial software.

Key Responsibilities

Agent Runtime & Backend Development

  • Plugin Runtime Ownership: Lead the evolution of the per-agent process, migrating from a distributed Go/Python hybrid to a centralized, high-performance Go service utilizing Postgres state and real-time websocket price feeds.
  • Rules Engine Engineering: Build a YAML-configurable "Scanner Gateway" to bridge signal production and execution, allowing for complex scoring and filtering without direct code manipulation.
  • Advanced Execution Systems: Develop and maintain the RatchetStop Backend , a centralized profit-trailing service capable of sub-second evaluation and websocket-based order execution to protect capital even when agents are offline.
  • Data & Connectivity: Manage the Model Context Protocol (MCP) server bridging agents to platform tools, and oversee a high-throughput data pipeline (Redis, Postgres, ClickHouse) for real-time market intelligence ingestion.

Model & Agent Hosting Migration

  • Infrastructure Sovereignty: Lead the technical execution of migrating agents from third-party platforms to a custom-built, Senpi-hosted environment featuring isolated workspaces and state persistence.
  • Model Serving: Evaluate and implement the transition from external LLM APIs (Anthropic, Google) to self-hosted inference, optimizing for telemetry capture and performance.
  • Telemetry & Feedback Loops: Architect systems to capture every agent decision and score, creating a self-reinforcing loop where the fleet learns and improves from collective performance data.
  • Deployment Pipelines: Build robust CI/CD pipelines for zero-downtime rollouts, ensuring that updates to scanner logic or runtime patches do not interrupt active market positions.

Infrastructure & Operations

  • System Reliability: Design monitoring and alerting frameworks to detect agent failures, state corruption, or authentication expirations before they impact financial performance.
  • Cloud Orchestration: Manage AWS/EKS environments using Infrastructure-as-Code (IaC).
  • Incident Response: Own the operational health of the fleet, acting as the primary responder for high-stakes trading system incidents.

I Interview Process

  1. Founder / CEO Interview: Introduction to the vision and strategic goals.
  2. Take-Home Test: A practical assessment of technical design and coding capabilities.
  3. Technical Interview: A deep dive into systems architecture and engineering expertise.
  4. Final Interview: Cultural alignment and final technical synthesis.

Requirements

  • Technical Essentials
    • Expert Backend Engineering: Proficiency in writing production-grade code in Go , Python , and Node.js/TypeScript (Go is strongly preferred for runtime services).
    • Startup Experience: A proven track record of building complex backend services (APIs, job scheduling, distributed systems) from scratch in a fast-paced environment.
    • Real-Time Systems: Deep understanding of low-latency environments, websocket management, and sub-second condition evaluation.
    • Database Mastery: Production experience with Postgres , Redis , and at least one analytical database (e.g., ClickHouse , TimescaleDB, or BigQuery).
    • Orchestration: Hands-on experience deploying, scaling, and debugging production workloads on Kubernetes (AWS EKS) .
    • End-to-End Ownership: Demonstrated ability to design, build, deploy, and maintain systems throughout their entire lifecycle.
  • Preferred Qualifications
    • LLM Infrastructure: Experience with model serving and optimizing inference (e.g., vLLM, TGI, or TensorRT-LLM).
    • FinTech/Trading: Background in exchange APIs, wallet operations, or on-chain infrastructure where uptime has direct financial consequences.
    • Agentic Frameworks: Familiarity with Model Context Protocol (MCP) or orchestrating multi-agent platforms.

Benefits

  • Competitive compensation and equity packages.
  • The opportunity to build foundational infrastructure in a new category of autonomous software.
  • High-autonomy environment with a focus on engineering excellence.
  • Collaborative culture working alongside industry-leading founders and engineers.

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.

Commitment to Equality and Accessibility:

At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing View email address on click.appcast.io.

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting View email address on click.appcast.io.

Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer - Backend & AI Infra in United States vacancy
  •  ...About the job Staff Software Engineer (Backend & AI Infra) About Senpi Senpi is building an AI-powered crypto wallet that trades and protects alongside users. The platform already supports autonomous agents, real-time trading, and a growing ecosystem of strategies... 
    Suggested

    TechChain Talent

    Los Angeles, CA
    2 days ago
  •  ...Staff Software Engineer - Backend & AI Infra - Trading Career Renew is recruiting for one of its clients a Staff Software Engineer - Backend & AI Infra - Trading - this is a fully remote role for US/UK based candidates. We are building the Hyperliquid Agent Runtime... 
    Suggested
    Contract work
    Immediate start
    Remote work
    Night shift

    Career Renew

    United States
    1 day ago
  • $225k

    Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications by haizing them - i.e. rigorously, proactively, and continuously fuzz-testing... 
    Suggested
    Work at office
    Visa sponsorship

    Enboarder

    New York, NY
    1 day ago
  •  ...Staff Software Engineer - App Infra Remote - IND Come build at the intersection of AI and fintech. At Ocrolus, we're on a mission to help lenders automate workflows with confidence—streamlining how financial institutions evaluate borrowers and enabling faster, more... 
    Suggested
    Remote work

    Ocrolus

    United States
    1 day ago
  • $175k - $250k

     ...Overview ~ Role: Lead Software Engineer - DevOps and Infra ~5 days a week in NYC HQ ~ Base salary: $175k-250k ~ Equity: Competitive Initial...  ...T physical economy. We combine real-time marketdata with AI-powered exposure modeling and automated trade generation... 
    Suggested
    Flexible hours

    Pillar

    New York, NY
    2 days ago
  • $320k - $405k

     ...interpretable, and steerable AI systems. We want AI to be...  ...committed researchers, engineers, policy experts, and...  ...beneficial AI systems. Staff Infrastructure Engineer, Node Infra About the role...  ...qualifications ~8+ years of software engineering experience,... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    12 days ago
  • $262k - $365k

    Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing...  ...stack as we continue to push technology forward. Applied AI builds conversational agents deployed at a large... 
    Full time

    Google Inc.

    Sunnyvale, CA
    23 hours ago
  • $160k - $230k

     ...Backend Engineer (Infra) Title of Role: Backend Engineer (Infra) Location: New York, hybrid Company Stage of Funding: Seed - Artificial Intelligence (AI) Office Type: Hybrid Salary: $160K-$230K Company Description We're representing a dynamic... 
    Work at office

    Recruiting from Scratch

    New York, NY
    1 day ago
  •  ...Conversion is the AI-native marketing automation...  ...automation platform for modern software companies. Our platform...  ...Francisco and includes engineers, designers, and...  ...our customers. The best infra work here is measured in...  ...tech stack: Go for backend services Kafka for... 

    Conversion Services

    San Francisco, CA
    4 days ago
  •  ...Spur Is Every Company's Ai Qa Engineer Spur builds fundamental technology for the future of QA: autonomous browser agents that think...  ...that big companies can't touch. The Role As our founding infra/backend engineer, you'll architect the backbone of Spur's core... 
    Live in
    Work at office
    Local area
    Flexible hours

    Pear VC

    New York, NY
    16 days ago
  • $250k - $400k

     ...Founding Engineer Opportunity Location: San Francisco, CA...  ...designed to give inboxes to AI agents and be the sole identity...  ...founding engineer with strong backend and infra instincts to help build the...  ...experience shipping production software by real users as a software... 
    Full time
    Work experience placement

    AgentMail (YC S25)

    San Francisco, CA
    3 days ago
  •  ...intersection. We are looking for a Backend Infrastructure Engineer who is equal parts software engineer and infrastructure...  ...infrastructure. You don't see "backend" and "infra" as separate disciplines. An...  ...is built to support large-scale AI-driven clinical systems and... 
    Local area
    Immediate start
    Remote work

    Counsel Health

    Utica, NY
    4 days ago
  • $190k - $261.25k

     ...passionate about enabling data and AI teams to solve the world's...  ...their business. Founded by engineers - and customer obsessed - we leap...  ...Collaborate with platform, infra, and ML teams to deliver seamless...  ...~8+ years of experience in backend or infrastructure engineering... 
    Local area
    Worldwide

    Databricks

    New York, NY
    2 days ago
  •  ...About Resolve AI Software maintenance and production...  ...become a massive tax of engineering velocity. Resolve AI...  ..., incident response, infra changes, on-call grind...  ...build, and scale the backend services and APIs...  ...years operating at a Staff or equivalent technical... 
    Work at office
    Visa sponsorship
    Flexible hours

    Resolve AI

    San Francisco, CA
    4 days ago
  • $192k - $260k

     ...world's best data and AI infrastructure platform...  ...companies in the world. Our engineering teams build highly...  ...of the largest scale software platforms. The fleet consists...  ...engineer with a backend focus, you will work closely...  ...environments. Core Infra: Build the core... 
    Work at office
    Local area
    Worldwide
    Flexible hours

    Databricks

    Mountain View, CA
    3 days ago
  • $171k

     ...Role Fable Core is the backend, infrastructure, and platform...  ...Book Apps list. As a Staff Software Engineer on the Fable Core team, you...  ...Experience leading a platform or infra function through a migration...  ...access to leading AI tools Get to Know Scribd... 
    Local area
    Home office
    Flexible hours

    Scribd

    San Francisco, CA
    2 days ago
  • A tech startup in New York City is looking for a dedicated infra/backend engineer to architect and scale its core platform. You will build the infrastructure to launch thousands of web agents daily and collaborate directly with the founders. Ideal candidates should have... 

    Pear VC

    New York, NY
    23 hours ago
  • Company Overview Aida is a B2B enterprise AI company founded by Piyush Prahladka,...  ...Atish Das Sarma, former head of growth engineering at Patreon and head of AI at Apple Cloud...  ...and India. We are seeking a strong Backend and Infra Engineer who is comfortable working in... 

    Getaida

    Palo Alto, CA
    2 days ago
  • $182.4k - $247k

    Databricks is building the world’s best data and AI infrastructure platform. We are looking for a backend software engineer to design, build, and operate micro‑services...  ...Platform Observability Service Platform Core Infra Qualifications BS/MS/PhD in Computer Science... 
    Local area

    Menlo Ventures

    Bellevue, WA
    1 day ago
  •  ...Job Title 50% Infrastructure Generalist and 50% Backend-focused Software Engineer! Infra Help run our core infrastructure including: Kubernetes...  ...secure Action & Agent building platform for sticky, custom AI workflows. Use cases span countless domains, including:... 
    Live in
    Work at office
    Immediate start

    Credal

    Brooklyn, NY
    1 day ago
  •  ...Opportunity Our mission at Credal is to harness frontier AI for everyone building a better future. We accelerate...  ...About the Role 50% Infrastructure generalist and 50% Backend-focused software engineer! Infra Help run our core infrastructure including:... 
    Live in
    Work at office
    Immediate start

    Credal.ai

    New York, NY
    1 day ago
  • $50k

    Not Diamond is a multi -model AI infrastructure platform that helps enterprise...  ...Fortune 100s save tens of thousands of engineering hours and improve output accuracy up to...  .... 6+ years of IC experience with backend, data, and infra with strong familiarity of Python Experience... 
    Work at office
    Remote work
    Shift work

    Myriad Venture Partners, LLC

    New York, NY
    2 days ago
  • $192k - $260k

     ...the world’s best data and AI infrastructure platform, so...  ...companies in the world. Our engineering teams build highly...  ...platform. Responsibilities As a software engineer with a backend focus, you will work closely...  ...clouds and environments. Core Infra : Build the core... 
    For contractors
    For subcontractor
    Work at office
    Local area
    Worldwide
    Flexible hours

    Databricks Inc.

    Mountain View, CA
    2 days ago
  • Senior Software Engineer, Infrastructure & Agents About Reacher We're the #1...  ...YC. We're making a big bet on AI agents and what they can do...  ...are two main buckets of work: Infra Re-architect our jobs infrastructure...  ...-demand workers on GKE. Own backend systems end-to-end: design,... 
    Flexible hours

    Reacher

    San Francisco, CA
    2 days ago
  • $132k - $150k

     ...mission is to bring real time economic optimization and AI prediction to every energy and manufacturing plant. Industrial...  ...industrial environments. Role Overview As a Senior Software Engineer - Backend & AI Infra focus, you will play a critical role in evolving CVector... 
    Work experience placement
    Live in
    Work at office
    Visa sponsorship
    Flexible hours

    CVector - Industrial AI

    New York, NY
    a month ago
  • $220k - $405k

     ...is looking for an experienced Backend Engineer to join our small team...  ...and premium Max Tier. We build AI-powered features such as personalized...  ...analysis, and more. Senior/Staff Platform The Platform team is...  ...company. Senior/Staff Cloud Infra The Cloud Infra team... 
    Full time
    Local area
    Worldwide

    Pantera Capital

    San Francisco, CA
    1 day ago
  • $405k

    An AI-focused technology company in New York is seeking a Senior Software Engineer to develop and maintain large-scale developer infrastructure. The role involves owning the technical strategy, ensuring infrastructure reliability, and defining ecosystem standards. The ideal... 

    Menlo Ventures

    New York, NY
    1 day ago
  • $210k - $275k

    Insider, Inc. is seeking experienced software engineers to join a dynamic team in developing an AI-native operating system for regulated finance. The position involves designing robust infrastructure while ensuring regulatory compliance, and ideal candidates will have 7... 
    Remote work

    Insider, Inc.

    San Francisco, CA
    3 days ago
  • Cerebras Systems in Sunnyvale, CA is seeking a Member of Technical Staff (Software Engineer) to implement infrastructure for high-performance, low-latency inference services. Applicants should have a Master’s degree in Computer Science or a related field and at least one... 

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • Google Inc. is looking for a Staff Software Engineer in Sunnyvale, CA, to develop next-generation technologies and lead high-impact projects and...  ...with bonuses and equity. Join Google's mission to empower users through innovative AI solutions. #J-18808-Ljbffr Google Inc.

    Google Inc.

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer - Backend & AI Infra. Be the first to apply!