RL Infrastructure Engineer: Data Pipelines & Agent Eval
xAI
Requirements Experience building and maintaining frameworks that are used by many engineers
- Experience in building high-performance sandboxes, virtual machines, and simulations
- Experience building full-stack apps for automating workflows and data visualization
- Experience in rapid iteration of research to production cycles
- Experience in test automation, CI/CD
- Creating and maintaining frameworks for agent, data, and model evaluation tasks
- Building environments for AI agents
- Tools for automating common workflows
- Improving alerts, metrics and error handling on large scale RL jobs
- Refactoring existing agent, data, eval, training frameworks for better modularity
- Designing operation procedures and coding standards to streamline the transition from small scale experimentation to large scale RL training
- Writing unit tests, CI/CD frameworks to support rapid development cycles
- Python / Rust / C++
- Typescript / React
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the RL Infrastructure Engineer: Data Pipelines & Agent Eval in San Francisco, CA vacancy
- ...Product Infrastructure Engineer Truewind is building AI agents that help accounting teams close books faster and more... ...infrastructure engineer who can build the data foundation and execution systems... ...Building and maintaining data pipelines that ingest, normalize,...Pipeline
Truewind
San Francisco, CA2 days ago $250k - $350k
...has been the leading AI data foundry, helping fuel the... ...necessary for complex agents in enterprises around the... ...agent-building from an eval set. This will involve creating... ...Build synthetic data pipelines to generate enterprise environments to use for RL post-training Create...PipelineFull timeScale AI
San Francisco, CA2 days ago- ...'ll join a full-stack data team building the systems making our AI agents measurably smarter with... ...the real-time pipelines, analytics products, and... ...our real-time eventing infrastructure, streaming and batch ETL... ...these areas: Platform Engineering You have...PipelineFull timeFlexible hours
Sierra
San Francisco, CA1 day ago $150k - $300k
...Intellect builds the infrastructure that frontier AI... ...scale, from RL and SFT to tool use, agent workflows, and... ...Prototype agents and eval harnesses... ...training/inference pipelines, ensuring scalability... ...learning engineering, with experience... ...and/or synthetic data generation....PipelineRemote workVisa sponsorshipRelocation packageFlexible hoursPrime Intellect
San Francisco, CA5 days ago- ...role: Most teams have the data they need but can’t... .... We’re hiring a senior engineer to build an internal data agent: a system that lets anyone... ...across AI systems , data infrastructure , and product engineering... ...Build and maintain data pipelines Own the reliability of...PipelineSelf employmentWork at officeRemote workFlexible hours
$320k - $405k
...Software Engineer, Research Data Platform San Francisco, CA | New York City... ...researchers rely on to monitor RL runs, explore finetuning... ...data products — the pipelines that move data out of training... ...workflow than a typical data infrastructure position: you'll often embed...PipelineWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA4 days ago- Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML... ...products (e.g., assistive agents, issue resolution, and tooling... ...Develop and productionize pipelines for dataset creation, model... ...for evaluation and data infrastructure, balancing speed, rigor, cost...PipelineWork experience placementCasual workLive inWork at officeRemote work
$180k
Member of Technical Staff - RL Infrastructure About xAI xAI’s mission is... ...motivated, and focused on engineering excellence. This organization... ...engineers to create robust data pipelines, comprehensive evaluations... ...robust environment for the agent to perform actions in? Evaluations...PipelineTemporary work$320k
Principal Engineer, AI And Data Platform Engineering (r4941) Own the AI data... ...organization responsible for the infrastructure that underpins autonomy... ...(supervised learning, RL/MARL, foundation models) and... ...Operational Feedback: Own the pipeline from training to deployment...PipelineFull timeTemporary workPart time- Netic, based in San Francisco, is seeking an Agent Infrastructure Engineer to architect and scale AI infrastructure. The role involves designing... ...systems that host AI agents and creating automated deployment pipelines for seamless operations. The ideal candidate has over 4...Pipeline
- ...seeking a Level 3 / Tier 3 network support engineer in San Francisco, CA. This role... ...responsibilities of ensuring existing infrastructure stability with scripting to automate operations... ..., influencing intelligent systems and data pipelines.The ideal candidate will have hands-on...PipelineFull time
Obsidian
San Francisco, CA4 days ago - ...Group in San Francisco is seeking a Senior Software Engineer to build core infrastructure for petabyte-scale data collection for leading robotics companies. You... ...for real-time sensor data and own critical data pipeline systems. The ideal candidate has over 5 years of...Pipeline
$50 - $70 per hour
Mercor is seeking a Network Engineer for Data for Autonomous Systems annotation. This remote... ...defining schemas for large-scale data pipelines. Candidates should possess strong... ...networks and a curiosity about transforming infrastructure data into machine learning input....PipelineRemote jobHourly pay- Obsidian is seeking a Level 3 / Tier 3 network support engineer to work on data science and autonomous infrastructure projects. In this role, you will troubleshoot and... ...-on position blends incident response with data pipeline definition, requiring strong experience in...PipelineNight shift
$195k - $280k
A dynamic tech company is seeking a Senior Backend Engineer to build and enhance critical services that power their insurance solutions... ...have strong experience in Go and knowledge of cloud-based infrastructure, among other tools. This position offers a competitive salary...PipelineRemote workQuanata, LLC
San Francisco, CA4 days ago$50 - $100 per hour
...based on experience). Are you a network engineer who’s curious about data science and wants to work at the intersection of infrastructure and intelligence? At Meter, we’re... ...with a growing understanding of how data pipelines are built and used in AI systems. Responsibilities...PipelineHourly payContract work$50 - $70 per hour
Mercor is seeking a Network Engineer for Data for Autonomous Systems annotation to work remotely. This role involves reviewing real-world... ...labeling key behaviors and anomalies, while also defining data pipelines. The ideal candidate will have experience in network...PipelineRemote jobHourly pay- Salesforce is looking for a Lead AI Engineer to drive the development of AI and ML systems, enhancing customer success through intelligent... ...skills and a proven track record in model deployment and data pipeline construction. This role promises a fast-paced environment...Pipeline
- A fast-growing SaaS startup in San Francisco is hiring a Data Engineer to manage and scale their data infrastructure. This hybrid role involves designing efficient data systems, building ETL pipelines, and ensuring data quality. Candidates must have at least 3 years of...Pipeline
- F2 AI is seeking a knowledgeable Infrastructure Engineer to design and secure infrastructure for our AI data platform in San Francisco. The role requires 6+ years of experience... ...include building data ingestion pipelines, implementing security-first architectures, and...Pipeline
- ...Global Inc. is seeking an experienced Data Engineer in San Francisco. This role involves designing... ...and maintaining large-scale data pipelines for their programmatic Demand-Side... ...ad tech solutions and high-performance data infrastructure. #J-18808-Ljbffr RZR Global Inc.Pipeline
- ...customer base is expanding, the data challenges we're solving are... ...match. As a Distinguished Engineer on the Data Engineering team... ...'ll own some of the hardest infrastructure problems at CloudZero:... ...CloudZero from batch-oriented pipelines toward a streaming-first architecture...PipelineDay shift
CloudZero
San Francisco, CA2 days ago $153.69k - $193.39k
A governmental agency in San Francisco seeks a Senior Data Engineer to design and maintain robust data infrastructure. You will manage the Snowflake data warehouse, build scalable data pipelines, and collaborate with stakeholders to optimize data accessibility. Strong...Pipeline- A leading streaming platform in San Francisco is looking for a Data Engineer to transform and manage extensive data sets. Responsibilities include developing scalable data pipelines, collaborating with data scientists, and implementing data quality measures. The ideal...PipelineFlexible hours
$220k - $250k
...Senior / Staff Software Engineer, Data Platform Title of Role: Senior / Staff Software Engineer, Data Platform Location: San Francisco... ...What You Will Do Design and implement scalable data pipelines that support both real-time and batch processing. Collaborate...PipelineWork at officeRecruiting from Scratch
San Francisco, CA1 day ago$140k - $180k
...Consulting Ltd is seeking a Founding Engineer in San Francisco to design and build a... ...platform. The role involves developing data pipelines, a robust connector framework, and managing... ...experience in production-grade data infrastructure, strong expertise in ETL/ELT pipelines...Pipeline- A technology startup in San Francisco is seeking an experienced engineer to design and build foundational architecture for AI agents operating over complex enterprise data. The role entails developing automation editors and engineering systems for efficient data reasoning...Pipeline
$142.6k - $176k
Octave is hiring a Sr. Data Engineer in San Francisco to evolve their data platform for AI and ML applications. The role requires extensive... ...collaborating with data scientists to ensure reliable data pipelines. The compensation ranges from $142,600 to $176,000, depending...Pipeline$160k - $180k
...every Quest completed, there's data, petabytes of it, telling... ...excited about building data infrastructure at massive scale and cares deeply... ...Discord users and Discord engineers. We’re building the next... ...Experience with the data ecosystem: pipelines, ETL, modeling, or...PipelineFull timeWorldwideRelocationRelocation packageDiscord
San Francisco, CA1 day ago$200k - $236k
...Software Engineer, Data Platform Hybrid - SF Bay Area About GlossGenius GlossGenius... ...of this role is to reimagine the data infrastructure to support our AI platform. This... ...drive the design of core data models and pipelines in our Snowflake and Clickhouse lakehouse...PipelineWork at officeHome officeFlexible hours3 days per weekGlossGenius
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to RL Infrastructure Engineer: Data Pipelines & Agent Eval. Be the first to apply!
Related searches
- principal infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA