Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

RL Infrastructure Engineer: Data Pipelines & Agent Eval

Xai

Requirements Experience building and maintaining frameworks that are used by many engineers , Experience in building high-performance sandboxes, virtual machines, and simulations , Experience building full-stack apps for automating workflows and data visualization , Experience in rapid iteration of research to production cycles , Experience in test automation, CI/CD What the job involves XAI is seeking experienced software engineers to create robust data pipelines, comprehensive evaluations for benchmarking LLMs, and automation frameworks to increase the productivity of researchers and engineers , Creating and maintaining frameworks for agent, data, and model evaluation tasks , Building environments for AI agents , Tools for automating common workflows , Improving alerts, metrics and error handling on large scale RL jobs , Refactoring existing agent, data, eval, training frameworks for better modularity , Designing operation procedures and coding standards to streamline the transition from small scale experimentation to large scale RL training , Writing unit tests, CI/CD frameworks to support rapid development cycles , Tech Stack: , Python / Rust / C++ , Typescript / React #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the RL Infrastructure Engineer: Data Pipelines & Agent Eval in San Francisco, CA vacancy
  •  ...Xterraai is looking for an ML Software Engineer to help build innovative AI agents capable of tackling complex scientific challenges. The position involves designing and developing systems that support cutting-edge research in geospatial and geophysics intelligence. The... 
    Pipeline

    Xterraai

    San Francisco, CA
    5 days ago
  •  ...United States Digital Space LLC is looking for a Product Infrastructure Engineer to build data pipelines and migration systems for financial data accuracy. In this role, you will work on migrating legacy systems to new domain models while ensuring production workflows... 
    Pipeline

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  •  ...Product Infrastructure Engineer Truewind is building AI agents that help accounting teams close books faster and more...  ...infrastructure engineer who can build the data foundation and execution systems...  ...Building and maintaining data pipelines that ingest, normalize,... 
    Pipeline

    Truewind

    San Francisco, CA
    3 days ago
  • $180.6k - $315k

     ...has been the leading AI data foundry, helping fuel the...  ...necessary for complex agents in enterprises around the...  ...agent-building from an eval set. This will involve creating...  ...: Build synthetic data pipelines to generate enterprise environments to use for RL post-training Create... 
    Pipeline
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  •  ...Backend Engineer – Data & Agent Platform Location: San Francisco (Hybrid) TensorStax is building...  ...and optimize mission-critical data infrastructure. Our platform integrates agentic AI...  ...intelligent orchestration, automated pipeline management, and self-healing infrastructure... 
    Pipeline

    Tensorstax

    San Francisco, CA
    2 days ago
  •  ...'ll join a full-stack data team building the systems making our AI agents measurably smarter with...  ...the real-time pipelines, analytics products, and...  ...our real-time eventing infrastructure, streaming and batch ETL...  ...these areas: Platform Engineering You have... 
    Pipeline
    Full time
    Flexible hours

    Colorwave Inc

    San Francisco, CA
    4 days ago
  • $150k - $300k

     ...Intellect builds the infrastructure that frontier AI...  ...scale, from RL and SFT to tool use, agent workflows, and...  ...Prototype agents and eval harnesses...  ...training/inference pipelines, ensuring scalability...  ...learning engineering, with experience...  ...and/or synthetic data generation.... 
    Pipeline
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Prime Intellect

    San Francisco, CA
    1 day ago
  •  ...Neura Market in San Francisco is seeking skilled engineers to join a full-stack data team. You will architect and develop systems that enhance AI agents’ effectiveness by building real-time data pipelines and scalable platforms. The role requires at least 4-7 years of... 
    Pipeline
    Flexible hours

    Neura Market

    San Francisco, CA
    1 day ago
  • $300k

     ...A rare infrastructure role in a frontier RL research operation. Compensation: $300K–$500K base + equity....  ..., well‑funded AI company, a small engineering team works with top researchers to...  ...orchestration, inference, evaluation, data pipelines, observability, and reliability.... 
    Pipeline
    H1b

    Aionia Group

    San Francisco, CA
    1 day ago
  • Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML...  ...products (e.g., assistive agents, issue resolution, and tooling...  ...Develop and productionize pipelines for dataset creation, model...  ...for evaluation and data infrastructure, balancing speed, rigor, cost... 
    Pipeline
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    airbnb, Inc.

    San Francisco, CA
    6 days ago
  • $320k - $405k

     ...Software Engineer, Research Data Platform San Francisco, CA | New York City...  ...researchers rely on to monitor RL runs, explore finetuning...  ...data products — the pipelines that move data out of training...  ...workflow than a typical data infrastructure position: you'll often embed... 
    Pipeline
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    5 days ago
  • $320k

     ...Anthropic Rl Data Engineer Anthropic's mission is to create reliable, interpretable, and...  ...learning data for Claude: data collection pipelines, human feedback tooling, the execution...  ...weeks you'll be deep in pipeline or infrastructure engineering; others you'll be tuning prompts... 
    Pipeline
    Work at office
    Visa sponsorship
    Flexible hours

    Colorwave Inc

    San Francisco, CA
    4 days ago
  •  ...Group in San Francisco is seeking a Senior Software Engineer to build core infrastructure for petabyte-scale data collection for leading robotics companies. You...  ...for real-time sensor data and own critical data pipeline systems. The ideal candidate has over 5 years of... 
    Pipeline

    Gerra Group

    San Francisco, CA
    5 days ago
  • 53 Stations is seeking a Network Engineer to work onsite in the Bay Area. In...  ...expertise in networking with data science to support autonomous infrastructure. Your responsibilities include reviewing...  ...and defining structures for data pipelines. A strong candidate will have... 
    Pipeline
    Contract work

    53 Stations

    San Francisco, CA
    1 day ago
  •  ...Obsidian is seeking a Level 3 / Tier 3 network support engineer to work on data science and autonomous infrastructure projects. In this role, you will troubleshoot and...  ...-on position blends incident response with data pipeline definition, requiring strong experience in... 
    Pipeline
    Night shift

    Obsidian

    San Francisco, CA
    4 days ago
  • $180k

    Member of Technical Staff - RL Infrastructure About xAI xAI’s mission is...  ...motivated, and focused on engineering excellence. This organization...  ...engineers to create robust data pipelines, comprehensive evaluations...  ...robust environment for the agent to perform actions in? Evaluations... 
    Pipeline
    Temporary work

    xAI

    San Francisco, CA
    4 days ago
  •  ...seeking a Level 3 / Tier 3 network support engineer in San Francisco, CA. This role...  ...responsibilities of ensuring existing infrastructure stability with scripting to automate operations...  ..., influencing intelligent systems and data pipelines. The ideal candidate will have hands-... 
    Pipeline
    Full time

    Obsidian

    San Francisco, CA
    5 days ago
  • $50 - $70 per hour

    Mercor is seeking a Network Engineer for Data for Autonomous Systems annotation. This remote...  ...defining schemas for large-scale data pipelines. Candidates should possess strong...  ...networks and a curiosity about transforming infrastructure data into machine learning input.... 
    Pipeline
    Remote job
    Hourly pay

    Mercor

    San Francisco, CA
    3 days ago
  • $50 - $80 per hour

     ...(based on experience) Are you a network engineer who’s curious about data science and wants to work at the intersection of infrastructure and intelligence? At Meter, we’re building...  ...a growing understanding of how data pipelines are built and used in AI systems. In this... 
    Pipeline
    Hourly pay
    Contract work

    53 Stations

    San Francisco, CA
    4 days ago
  •  ...Menlo Ventures is hiring a Compute Intelligence Engineer in San Francisco to build the data infrastructure for compute supply management. This hands-on role focuses on designing pipelines, maintaining data warehouses, and creating dashboards that visualize the company'... 
    Pipeline

    Menlo Ventures

    San Francisco, CA
    4 days ago
  •  ...A fast-growing SaaS startup in San Francisco is hiring a Data Engineer to manage and scale their data infrastructure. This hybrid role involves designing efficient data systems, building ETL pipelines, and ensuring data quality. Candidates must have at least 3 years of... 
    Pipeline

    Arcadia

    San Francisco, CA
    5 days ago
  • $200k - $350k

     ...Clera, an AI/ML data analytics startup, seeks a Senior Software Engineer to help build a robust platform and data lakehouse. This role involves designing systems...  ...enable AI-driven analytics and architecting ETL pipelines. Requirements include 4+ years of experience,... 
    Pipeline

    CLERA

    San Francisco, CA
    4 days ago
  • $140k - $180k

     ...Consulting Ltd is seeking a Founding Engineer in San Francisco to design and build a...  ...platform. The role involves developing data pipelines, a robust connector framework, and managing...  ...experience in production-grade data infrastructure, strong expertise in ETL/ELT pipelines... 
    Pipeline

    Alldus International Consulting Ltd

    San Francisco, CA
    4 days ago
  •  ...Strava is looking for a Senior Engineer to join the Activities Platform team in San Francisco. You will...  ...and evolve critical systems that power activity data, design backend services, and improve production infrastructure. The role requires 4+ years of software development... 
    Pipeline
    3 days per week

    Alumni Ventures

    San Francisco, CA
    5 days ago
  • $300k - $400k

     ...AI Talent Now in San Francisco is looking for an Engineering Manager to lead a team of engineers building core infrastructure for AI labs. In this role, you will manage engineering operations, mentor teams, and work closely with the CTO. Ideal candidates have 6-10 years... 
    Pipeline

    AI Talent Now

    San Francisco, CA
    1 day ago
  •  ...F2 AI is seeking a knowledgeable Infrastructure Engineer to design and secure infrastructure for our AI data platform in San Francisco. The role requires 6+ years of experience...  ...include building data ingestion pipelines, implementing security-first architectures, and... 
    Pipeline

    F2 AI

    San Francisco, CA
    4 days ago
  •  ...A leading SaaS company in San Francisco is seeking a Senior Data Engineer to architect and scale their data infrastructure. You'll build data pipelines and models to drive smarter decisions across the organization. The ideal candidate will have 5+ years of experience in... 
    Pipeline

    Roller

    San Francisco, CA
    5 days ago
  •  ...startup in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential for developing... 
    Pipeline

    Echo Neurotechnologies

    San Francisco, CA
    4 days ago
  •  ...Salesforce is looking for a Lead AI Engineer to drive the development of AI and ML systems, enhancing customer success through intelligent...  ...skills and a proven track record in model deployment and data pipeline construction. This role promises a fast-paced environment... 
    Pipeline

    Salesforce.Com Inc

    San Francisco, CA
    4 days ago
  • $142.6k - $176k

     ...Octave is hiring a Sr. Data Engineer in San Francisco to evolve their data platform for AI and ML applications. The role requires extensive...  ...collaborating with data scientists to ensure reliable data pipelines. The compensation ranges from $142,600 to $176,000, depending... 
    Pipeline

    Octave

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to RL Infrastructure Engineer: Data Pipelines & Agent Eval. Be the first to apply!