Research Engineer - Data and Evaluation
PrimeIntellect
Own Your Intelligence
Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.
Our platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment into one full-stack system for post-training at frontier scale - from SFT and RL to tool use, agent workflows, and continuously improving production models. We are building open frontier AI: open-source models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to build them. The next generation of AI companies, enterprises, and research teams do not just need more GPUs. They need the ability to turn their own workflows, tools, data, and feedback loops into superintelligence they own.
Prime Intellect has raised $150M in total funding from Founders Fund, Radical Ventures, NVIDIA, and exceptional AI, infrastructure, and enterprise operators, including Andrej Karpathy, Dwarkesh Patel, and leaders and founders from Ramp, Perplexity, Harvey, Mercor, Zapier, Datadog, Cognition, OpenAI, Thinking Machines, Together AI, SemiAnalysis, LangChain, Browserbase, Cloudflare, Sierra, Databricks, Airbnb, OpenRouter, Standard Intelligence, Fleet, Core Auto, and more. We are looking for people who want to build at the intersection of frontier research, real infrastructure, and go-to-market for a category that does not fully exist yet.
Role Impact
Build the tasks and environments that train Prime Intellect’s models through RL, and the evaluations that show what they can actually do. You’ll work directly with researchers to investigate model failures, from how a task is implemented to how success is scored.
Responsibilities
Design and build challenging evaluations for coding and long-horizon agents.
Build executable environments in Verifiers, with realistic task setup and clear success criteria.
Develop and test scoring logic and verifiers, investigating reward hacks and misleading measures of progress.
Trace failures through model outputs and harness code to distinguish model limitations from problems in the environment or scoring.
Build and scale RL data pipelines that generate and curate challenging coding and agentic tasks.
Work with RL researchers to test whether changes to tasks and training data improve performance on held-out tasks.
Requirements
Strong software engineering skills in Python and experience building data pipelines, evaluation systems, or ML workflows used by others.
Hands-on experience working with language models or agents, with an understanding of how training data and evaluation choices affect model behavior.
Ability to inspect complex data and model outputs, identify failure modes, and turn an ambiguous quality question into a testable measurement.
A record of owning technical projects through experimentation, implementation, and validation, while collaborating closely with researchers and engineers.
Hands-on experience building technical evaluations or agent environments, with the engineering depth to inspect model traces and debug harness and scoring code.
Relevant experience may include:
Large-scale synthetic data generation, dataset curation, or distributed processing for model training.
Evaluation methodology, executable coding tasks, agent environments, verifiers, or reward design.
Experiment analysis, statistical testing, contamination detection, and reproducible research tooling.
Nice to have
Experience with RL or post-training data, including task difficulty selection and analysis of rollout or reward distributions.
Contributions to Verifiers, Prime-RL, or comparable environment and evaluation frameworks.
Work on model-based grading, long-horizon coding agents, or diagnosing reward exploitation.
We welcome depth in data generation, environments and rewards, or evaluation systems. You don’t need to have worked across every area.
Work Arrangement
Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco.
Benefits and Perks
Cash Compensation Range of $150-350k, including equity incentives, aligning your success with the growth and impact of Prime Intellect.
Full medical, dental and vision coverage for employees and dependents.
Flexible PTO.
$200/month health and wellness benefit.
Visa sponsorship and relocation assistance for international candidates.
Professional development budget for courses and conferences.
Quarterly team off-sites, hackathons, conferences and learning opportunities.
Company-covered meals when working from our San Francisco office.
If you're excited about the opportunity to build the foundation for the future of decentralized AI and create a platform that empowers developers and researchers to push the boundaries of what's possible, we'd love to hear from you.
- ...all daily U.S. X-rays. Our research team brings experience from DeepMind... ...by real-world clinical data. Together, we're building a future... ...for an exceptional Research Engineer or Research Scientist to advance how we curate data and evaluate frontier AI models for medical...SuggestedFull time
$250k - $400k
...learning environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,... ...largest and longest-running data provider in the category.... ...deployment signals into better data, evaluations, and more capable models....Suggested- ...frontier AI labs and enterprises to train, evaluate, and improve AI on real-world... ...and London. About the Role As a Research Engineer at Mercor, you’ll work at the intersection... ...directly to post-training and RLVR, synthetic data generation, and large-scale evaluation...SuggestedInternshipRemote workRelocation package
$150k - $250k
...global social organizations.We research and deploy technologies that... ...ForAt Distyl, Research Engineers build the bridge between frontier... ...understand system behavior, build evaluation frameworks, and collaborate... ...and build data systems that power reliable AI...SuggestedWork at office3 days per week$136.44k - $166.75k
...clean, structured scientific data and AI are built into how science... ....You’ll build the datasets, evaluations, and systems that help close... ...the intersection of software engineering, biology, and frontier AI:... ...engineers, scientists, and external research partners.Desire to work in a...SuggestedWork at officeLocal areaMonday to FridayShift work- ...Phinity is an AI research lab focused on solving chip design. The bottleneck to AGI... ...environments, agent infrastructure, and evaluation systems to accomplish this. Our team... ...others. We are hiring a Research Engineer to develop data in order to train and evaluate agents...Full timeWork at office
- ...frontier AI labs and enterprises to train, evaluate, and improve AI on real-world... ...and London. About the Role As a Research Engineer at Mercor, you’ll work at the intersection... ...directly to post-training and RLVR, synthetic data generation, and large-scale evaluation...InternshipLocal areaRemote workRelocation package
- ...platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance... ...for long-horizon tasks like autonomous research, and the full-stack platform our own research... ...to turn their own workflows, tools, data, and feedback loops into...Full timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
- ...Job Description Job Description Research Engineer, Post-Training Data Location: San Fran Employment Type: Full-time Focus: Post-Training... ...environments, long-horizon tasks, and domain-specific evaluation workflows for some of the most advanced AI systems in...Full time
- ...behavior. Eventual is building data curation for Physical AI. We... ..., computer vision and ML research, and it ships directly into... ...Your Role As a Research Engineer on the Visual Understanding team... ...scale. Train, fine-tune, and evaluate VLMs, VQA models, embedding...Hourly payFull timeWork at officeFlexible hoursNight shift
- ...model innovation and systems engineering paired with a design-minded product... ...AI. About the Role Data is the lifeblood of our models, and we are looking for a Research Engineer, Data Infrastructure... ...with building and evaluating datasets for generative models...Full timeWork at officeVisa sponsorshipFlexible hours
$230k
...this role, you'll build the data and measurement systems that... ...own synthetic data pipelines, evaluation design, the tasks and grading... ...measuring quality is a core research challenge. You’ll join a small, high-bar team of hands-on engineers and researchers, where each person...Remote jobFull time- ...Staff+ Research Engineer, RL Data Platform San Francisco, CA | New York City, NY About Anthropic Anthropic’s mission is to create reliable... ...qualifications Experience building annotation, labelling, evaluation, or other human-in-the-loop data tooling. Experience...Full timeContract workFor contractorsFor subcontractorWork at officeVisa sponsorshipFlexible hours
$119k - $299.93k
...Summary The Opportunity As part of the AI Engineering team within the Digital Assurance &... ...play a pivotal role in transforming raw data into actionable insights, enabling informed... ...work streams and teams for testing and evaluation of AI-enabled systems, technical evidence...Full timeH1b- ...sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering... ...real-time applications. About the role As a Research Engineer focused on Model Evaluation & MLOps, you will build the tools and infrastructure...Full timeFlexible hours
- ...a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build... .... In this role you will lead the science of how we evaluate production training runs. You'll work out which measurements...Work at officeLocal areaVisa sponsorshipFlexible hours
$205k - $249k
...Senior Analytics Engineer/Data ScientistLaurel is on a mission to return time. As the leading AI Time platform for professional services firms, we're transforming how organizations capture, analyze, and optimize their most valuable resource: time. Our proprietary machine...Work at office3 days per week- ...Francisco hire a founding machine learning and research engineer. The company builds AI systems that... ...and agents can practice that work, be evaluated on it, and get better at it. You would... ..., including evaluations, grading, data pipelines, and the infrastructure the models...Permanent employmentFull timeWork at office3 days per week
- ...powered by high-quality human data. We’re a fast-growing Series... .... The Impact You'll Make Our research team is expanding to keep pace... ...of the field. As a Research Engineer, you'll take a research direction... ..., including annotating, evaluating, or sourcing data. Turn research...Full time
- ...team includes ex-founders and engineers who have built and scaled... ...We are hiring a Founding Research Engineer to design, prototype... .... You will turn messy health data into accurate, cited, and actionable... ...curation, model training and evaluation, retrieval and tool use, safety...
- ...change that, apply below.About The RoleAs a Research Engineer, you'll be responsible for building... ...developed by our customersDesign evaluation protocols and benchmarks that measure model... ...tooling (training, evaluation, inference, data pipelines)Track record of taking...Work at office
- ...have become a massive tax of engineering velocity. Resolve AI is solving... ...end-to-end, balancing research and engineering to create production... ...AI modelsBuild and optimize data pipelines to process high-... ...evaluationDesign and execute benchmarks to evaluate AI models, improve...Work at office
- ...Example: you might study multi-agent architectures, prototype and evaluate a multi-agent code review workflow, and then work with a team... ...into production systems Stay on top of the latest research across LLMs, information retrieval, and developer tooling Qualifications...Work at office
- ...years Machine Learning We’re hiring a Founding ML Research Engineer to work work through the full stack across data, pre-training, post-training & evals for... ...filtering, mixing, tokenization/feature pipelines, evaluation harnesses. Look at lots of data & hear lots of audio...Full time
- ...Description Job Description We are Genmo, a research lab developing the world’s most... ...We're seeking an exceptional Software Engineer to join our research team in advancing the... ...Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color,...Work at office
$122k - $215k
...in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying... ...to apply. You will... - Prototype, evaluate, and iterate on solutions, using real-world data and simulations, to improve the accuracy,...Full timeWork at officeWork from homeFlexible hours$200k - $400k
...Research EngineerDecagon is the leading conversational AI platform... ....About the RoleAs a Research Engineer, you'll be responsible for building... ...approaches for training, evaluation, and orchestration across the... ...(training, evaluation, data pipelines)Track record of taking...Full timeWork at officeLocal area- ...Research EngineerWe believe that software is the foundation of modern... ...includes deep expertise in data, infrastructure, security and... ...seeking an experienced Research Engineer to join our effort in... ...intuition, experience in model evaluation, and benchmarks. Reinforcement...Full timeWork at office
- ...Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models ,... ...across the full model lifecycle, from data collection and preprocessing to designing... ...-scale EEG model training runs and evaluation Architecture and training methodology...Work at officeRelocation package
- ...Research EngineerSesame believes in a future where computers are lifelike... ...product goals. As a Research engineer at Sesame, you are a research... ...at hand.Responsibilities:Own evaluation pipelines — design, build,... ...in production.Harness the data — create tooling for safe, versioned...Full timeContract workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer - Data and Evaluation. Be the first to apply!
- ai research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- research software engineer San Francisco, CA
- research programmer San Francisco, CA
- research engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior research engineer San Francisco, CA
- staff data engineer San Francisco, CA
- senior cloud data engineer San Francisco, CA





