RL Infrastructure Engineer: Data Pipelines & Agent Eval
Xai
Requirements Experience building and maintaining frameworks that are used by many engineers
- Experience in building high-performance sandboxes, virtual machines, and simulations
- Experience building full-stack apps for automating workflows and data visualization
- Experience in rapid iteration of research to production cycles
- Experience in test automation, CI/CD
- Creating and maintaining frameworks for agent, data, and model evaluation tasks
- Building environments for AI agents
- Tools for automating common workflows
- Improving alerts, metrics and error handling on large scale RL jobs
- Refactoring existing agent, data, eval, training frameworks for better modularity
- Designing operation procedures and coding standards to streamline the transition from small scale experimentation to large scale RL training
- Writing unit tests, CI/CD frameworks to support rapid development cycles
- Python / Rust / C++
- Typescript / React
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the RL Infrastructure Engineer: Data Pipelines & Agent Eval in San Francisco, CA vacancy
$180.6k - $315k
...has been the leading AI data foundry, helping fuel the... ...necessary for complex agents in enterprises around the... ...agent-building from an eval set. This will involve creating... ...: Build synthetic data pipelines to generate enterprise environments to use for RL post-training Create...PipelineFull time- ...’ll join a full‑stack data team building the systems making our AI agents measurably smarter with... ...the real‑time pipelines, analytics products, and... ...our real‑time eventing infrastructure, streaming and batch ETL... ...these areas: Platform Engineering You have designed, built...PipelineFull timeFlexible hours
- Neura Market in San Francisco is seeking skilled engineers to join a full-stack data team. You will architect and develop systems that enhance AI agents’ effectiveness by building real-time data pipelines and scalable platforms. The role requires at least 4-7 years of software...PipelineFlexible hours
- Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML... ...products (e.g., assistive agents, issue resolution, and tooling... ...Develop and productionize pipelines for dataset creation, model... ...for evaluation and data infrastructure, balancing speed, rigor, cost...PipelineWork experience placementCasual workLive inWork at officeRemote work
$300k
A rare infrastructure role in a frontier RL research operation. Compensation: $300K-$500K base + equity.... ..., well‑funded AI company, a small engineering team works with top researchers to... ...orchestration, inference, evaluation, data pipelines, observability, and reliability....PipelineH1b- hillclimb is seeking a research engineer to work on synthetic data generation and maintain quality pipelines for RL environments. The ideal candidate will possess a strong understanding of NLP and RL techniques, alongside a solid grasp of data structures and modern programming...Pipeline
$320k
Principal Engineer, AI And Data Platform Engineering (r4941) Own the AI data... ...organization responsible for the infrastructure that underpins autonomy... ...(supervised learning, RL/MARL, foundation models) and... ...Operational Feedback: Own the pipeline from training to deployment...PipelineFull timeTemporary workPart time- Droyd in San Francisco is seeking a Staff Software Engineer focused on data infrastructure. You will own data pipelines that convert robot telemetry into valuable training signals. Collaborate directly with a small, senior team across robotics and machine learning to improve...Pipeline
- ...Group in San Francisco is seeking a Senior Software Engineer to build core infrastructure for petabyte-scale data collection for leading robotics companies. You... ...for real-time sensor data and own critical data pipeline systems. The ideal candidate has over 5 years of...Pipeline
- Netic, based in San Francisco, is seeking an Agent Infrastructure Engineer to architect and scale AI infrastructure. The role involves designing... ...systems that host AI agents and creating automated deployment pipelines for seamless operations. The ideal candidate has over 4...Pipeline
$50 - $70 per hour
Mercor is seeking a Network Engineer for Data for Autonomous Systems annotation. This remote... ...defining schemas for large-scale data pipelines. Candidates should possess strong... ...networks and a curiosity about transforming infrastructure data into machine learning input....PipelineRemote jobHourly pay- 53 Stations is seeking a Network Engineer to work onsite in the Bay Area. In... ...expertise in networking with data science to support autonomous infrastructure. Your responsibilities include reviewing... ...and defining structures for data pipelines. A strong candidate will have...PipelineContract work
- Obsidian is seeking a Level 3 / Tier 3 network support engineer to work on data science and autonomous infrastructure projects. In this role, you will troubleshoot and... ...-on position blends incident response with data pipeline definition, requiring strong experience in...PipelineNight shift
$50 - $80 per hour
...based on experience) Are you a network engineer who’s curious about data science and wants to work at the intersection of infrastructure and intelligence? At Meter, we’re building... ...a growing understanding of how data pipelines are built and used in AI systems. In this...PipelineHourly payContract work$50 - $70 per hour
Mercor is seeking a Network Engineer for Data for Autonomous Systems annotation to work remotely. This role involves reviewing real-world... ...labeling key behaviors and anomalies, while also defining data pipelines. The ideal candidate will have experience in network...PipelineRemote jobHourly pay- A fast-growing SaaS startup in San Francisco is hiring a Data Engineer to manage and scale their data infrastructure. This hybrid role involves designing efficient data systems, building ETL pipelines, and ensuring data quality. Candidates must have at least 3 years of...Pipeline
- F2 AI is seeking a knowledgeable Infrastructure Engineer to design and secure infrastructure for our AI data platform in San Francisco. The role requires 6+ years of experience... ...include building data ingestion pipelines, implementing security-first architectures, and...Pipeline
- ...Global Inc. is seeking an experienced Data Engineer in San Francisco. This role involves designing... ...and maintaining large-scale data pipelines for their programmatic Demand-Side... ...ad tech solutions and high-performance data infrastructure. #J-18808-Ljbffr RZR Global Inc.Pipeline
$200k - $350k
Clera, an AI/ML data analytics startup, seeks a Senior Software Engineer to help build a robust platform and data lakehouse. This role involves designing systems... ...enable AI-driven analytics and architecting ETL pipelines. Requirements include 4+ years of experience,...Pipeline- Salesforce is looking for a Lead AI Engineer to drive the development of AI and ML systems, enhancing customer success through intelligent... ...skills and a proven track record in model deployment and data pipeline construction. This role promises a fast-paced environment...Pipeline
$142.6k - $176k
Octave is hiring a Sr. Data Engineer in San Francisco to evolve their data platform for AI and ML applications. The role requires extensive... ...collaborating with data scientists to ensure reliable data pipelines. The compensation ranges from $142,600 to $176,000, depending...Pipeline- Strava is looking for a Senior Engineer for the Activities Platform team. You'll design and manage systems that support millions of activity uploads, ensuring efficiency and performance. With a hybrid working model in San Francisco, this role focuses on collaborating with...Pipeline
- ...combination of proprietary infrastructure and software, we... ...heart of our company’s data and AI strategy. We are... ...—into a fully AI agent‑ready infrastructure;... ...level architect (staff engineer), you will oversee the... ...multi‑geographical data pipelines at scale. Familiarity...PipelineWork at officeWorldwide
$140k - $180k
...Consulting Ltd is seeking a Founding Engineer in San Francisco to design and build a... ...platform. The role involves developing data pipelines, a robust connector framework, and managing... ...experience in production-grade data infrastructure, strong expertise in ETL/ELT pipelines...Pipeline- The City and County of San Francisco is hiring a Senior Data Engineer for the DataSF team to ensure robust data infrastructure. This role includes managing Snowflake, developing data pipelines, and collaborating with cross-functional teams. The ideal candidate will have...Pipeline
- A technology startup in San Francisco is seeking an experienced engineer to design and build foundational architecture for AI agents operating over complex enterprise data. The role entails developing automation editors and engineering systems for efficient data reasoning...Pipeline
$300k - $400k
AI Talent Now in San Francisco is looking for an Engineering Manager to lead a team of engineers building core infrastructure for AI labs. In this role, you will manage engineering operations, mentor teams, and work closely with the CTO. Ideal candidates have 6-10 years...Pipeline- ...prominent fintech company is seeking an Engineering Manager for their Data Platform team. This remote role involves building and scaling data infrastructure crucial for decision-making.... ...vision, and designing efficient data pipelines. The ideal candidate will have 2-5+...PipelineRemote workFlexible hours
$195k - $280k
A dynamic tech company is seeking a Senior Backend Engineer to build and enhance critical services that power their insurance solutions... ...have strong experience in Go and knowledge of cloud-based infrastructure, among other tools. This position offers a competitive salary...PipelineRemote job- ...startup in neurotechnology is seeking a Senior Machine Learning Infrastructure Engineer to design and scale critical infrastructure powering ML applications. This role involves creating robust data pipelines and optimizing modeling processes, essential for developing...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to RL Infrastructure Engineer: Data Pipelines & Agent Eval. Be the first to apply!
Related searches
- security infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- principal infrastructure engineer San Francisco, CA

