Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineering Manager, STEM

$260k - $350k

Turing

Job Description

Job Description

About Turing

Turing's mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work, and advanced STEM reasoning. In software engineering, Turing is the largest and longest-running data provider in the category. Turing also works with Fortune 500 enterprises across financial services, life sciences, healthcare, retail, automotive, and CPG to build and deploy end-to-end agentic AI systems inside mission-critical workflows. By operating on both sides, Turing closes the loop between frontier research and enterprise deployment, turning real-world deployment signals into better data, evaluations, and more capable models. Learn more at

The Role

Turing builds large-scale datasets and reinforcement learning (RL) environments that power post-training for the world's leading AI labs and enterprises.

The STEM Horizontal team produces the high-signal coding and STEM data frontier labs train on. We're looking for a Research Engineering Manager to lead the research engineering behind its next layer: synthetic data that measurably improves models, and new benchmarks that measure what today's evals miss.

You'll lead a team of research engineers, work side by side with research scientists, and stay close enough to the code to review an eval harness line by line or prototype a generator yourself when the team needs it. You'll also build the team : hiring research engineers is a core part of this role, not a side task. Ideally you've been on the other side, at a frontier lab, and know what makes a lab trust a dataset or a benchmark result.

  • Synthetic data that earns its place. Generation, verification, and filtering pipelines where every sample is checked, and where we can show which properties of the data drive downstream gains, not just how much of it we made.
  • Benchmarks that stay meaningful. New evaluations for capabilities current benchmarks miss, built with calibrated difficulty, contamination controls, and statistics strong enough that a lab can make a decision on the result.

Quality failures here are quiet. A subtle bug in a verifier doesn't crash anything; it ships thousands of wrong labels into someone's training run and costs weeks. If you want to build the team and the systems that catch that early, this is the seat.

What You'll Do 1. Build and Lead the Team
  • Build the team: define the profiles you need, run hiring, and grow research engineers selected for research taste as much as engineering rigor.
  • Run the team's operating rhythm: project selection, planning, experiment reviews, design docs, and clear ownership.
  • Coach engineers on experimental design, code quality, and presenting results; give direct, regular feedback and run fair performance cycles.
  • Define the standards the team works to: eval methodology, data quality bars, and reproducibility — every dataset and result can be regenerated from a commit, a config, and a seed.
2. Partner with Research Scientists
  • Turn hypotheses into experiment plans together: what we're testing, the baseline, the ablations, and the result that would change our minds.
  • Set the agenda with research scientists. You're expected to bring your own hypotheses, not only implement theirs.
  • Take research prototypes to production scale without losing the scientific intent.
3. Build Synthetic Data Systems at Scale
  • Own synthetic data pipelines that generate, verify, filter, deduplicate, and version data, combining programmatic generators, LLM-based generation, automated verifiers, and targeted expert review.
  • Judge data by its effect on models : ablations and fine-tuning or RL experiments that show which attributes (difficulty, diversity, correctness, coverage) drive gains.
  • Build quality systems that hold up at volume: gold sets, LLM-judge calibration against expert labels, sampling audits, and agreement metrics.
4. Create New Benchmarks and Evaluations
  • Find where frontier models fail and where existing benchmarks have saturated, and design evaluations that measure what's missing .
  • Own benchmark methodology end to end: task taxonomy, difficulty calibration, graders and verifiers, contamination controls, held-out splits, and confidence intervals.
  • Ship eval harnesses , including agentic and sandboxed-execution evals, that are deterministic, reproducible, and trusted by internal teams and partner labs.
  • Make the call on whether a result holds up: partner labs and internal teams act on your sign-off.
  • Publish benchmarks, datasets, and findings with our research scientists at venues such as NeurIPS, ICML, and ICLR.
5. Stay Hands-On and Work with Frontier Labs
  • Write code every week on the hardest, highest-leverage parts: core verifier logic, eval statistics, the pipeline component everything else depends on. Expect a third or more of your time on direct technical work.
  • Be the person the team brings its hardest debugging and methodology questions to: why a judge disagrees with experts, why an eval number moved, whether a gain is real or noise.
  • Act as a technical counterpart to researchers at frontier AI labs: scope requests, set acceptance criteria, and explain results and trade-offs plainly.
  • Partner with Strategic Project Leads, delivery, and engineering teams so research advances land in client work and in the platforms the team builds.
Sample Projects
  • Identify a capability gap, design and ship a benchmark for it, and see it adopted by partner labs.
  • Stand up a synthetic data pipeline for long-horizon coding tasks with execution-based verifiers, and run the ablations that show which task properties drive RL gains.
  • Calibrate an LLM-judge grading system against expert labels, map where it fails, and decide where humans stay in the loop.
  • Design the experiment that tells a partner lab whether a two-point gain on their eval is real.
  • Decide which of three competing synthetic data approaches the team should bet on, and design the experiments that settle it.
Tech Stack
  • Research: Python · PyTorch or JAX · SFT · DPO · PPO / GRPO · RL with verifiable rewards
  • Evals & data: LLM-as-judge · programmatic verifiers · sandboxed execution · gold sets · contamination checks
  • Platform: Python services (Django / FastAPI) · PostgreSQL · Docker · Terraform · AWS or GCP
What We're Looking For
  • Experience: 8+ years of hands-on ML or research engineering, at least 5 in industry, including 3+ years directly managing research engineers, ML engineers, or researchers (hiring and performance management included).
  • Synthetic data at scale: you've owned synthetic or curated data pipelines in production whose output drove training decisions , and can show how you measured their quality and downstream impact.
  • Evaluation rigor: you've designed and shipped LLM evals or benchmarks that others used to make model decisions, and understand contamination, saturation, judge bias, inter-annotator agreement, variance, and confidence intervals.
  • Experimental judgment: you plan ablations up front, choose baselines honestly, and can tell a real effect from noise.
  • Technical depth: strong Python; production experience with PyTorch or JAX; working knowledge of the post-training stack (SFT, DPO, PPO/GRPO, RL with verifiable rewards).
  • Technical direction: a track record of setting direction for a team, not only executing a roadmap handed to you.
  • Scale: distributed data processing and large evaluation or training jobs (e.g., Ray, Spark, Kubernetes) on AWS or GCP.
  • Communication: clear written communication for scientists and non-specialists alike; comfortable presenting results to researchers at partner labs.
  • AI-forward: daily use of LLM coding tools (Claude Code, Cursor, Copilot) as part of how you ship, with the judgment to review their output critically. This is a must-have.
  • Education: PhD or Master's degree in AI, machine learning, computer science, statistics, or a closely related field; PhD preferred. Exceptional equivalent research experience will also be considered. We weigh industry outcomes most heavily.
Strongly Preferred
  • Frontier AI lab experience: post-training data, evals, or reward modeling at a frontier lab (e.g., OpenAI, Anthropic, Google DeepMind, Meta, xAI) or a top industry research group.
  • Built or contributed to a public benchmark or dataset the community uses.
Nice to Have
  • First-author papers at NeurIPS, ICML, ICLR, ACL, EMNLP, or similar.
  • RL environment and verifier design for agentic tasks: coding agents, tool use, computer use, long-horizon workflows.
  • Data valuation or attribution: measuring what each slice of data contributes to a model.
  • Depth in a STEM domain such as math, physics, chemistry, or biology (not required).
  • Experience managing tech leads or managers, or running several concurrent programs.
  • Directing large expert networks through specs, rubrics, and fast feedback loops.
A note from our CTO, Ece Kamar

Some of the most important questions in AI can't be answered from inside a single lab: how to evaluate frontier models, how data and RL truly drive capability, and what happens when AI meets the real world. At Turing, we work directly with frontier labs, the academic community, and enterprises deploying AI at scale. That creates a feedback loop where deployment shapes our research and our research shapes the field, and we publish our findings, datasets, and benchmarks openly. Join our talented team at Turing to push the frontier of AI with rigorous science that matters.

Why Turing
  • Work directly with leading AI labs and enterprises at the frontier of post-training, evaluation, and synthetic data.
  • Build the datasets and benchmarks that improve and measure the capabilities of advanced AI systems.
  • Shape how frontier labs measure progress on coding and STEM reasoning.
  • Operate with high autonomy, rapid iteration, and meaningful commercial impact.
  • Collaborate with exceptional colleagues from organizations including Google, Meta, Amazon, and other leading technology companies.
  • Contribute to research that may be shared through technical publications and leading conferences such as ICLR, ICML, and NeurIPS.
Compensation

$260,000 to $350,000 + Equity

Don't meet every single requirement?

Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. Turing is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability, protected veteran status, or any other legally protected characteristics. At Turing we are dedicated to building a diverse, inclusive, and authentic workplace and celebrate authenticity, so if you're excited about this role but your past experience doesn't align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

For applicants from the European Union, please review Turing's GDPR notice here.

Values

  • We are client first: We put our clients at the center of everything we do, because their success is the ultimate measure of our value.

  • We work at Start-Up Speed: We move fast, stay agile and favor action because momentum is the foundation of perfection

  • We are AI forward: We help our clients build the future of Al and implement it in our own roles and workflow to amplify productivity.
Advantages of joining Turing
  • Work at the frontier of AI , helping the world's leading AI labs improve their most advanced models by building expert datasets, RL environments, and first-of-a-kind benchmarks.

  • Contribute to leading-edge AI research and showcase your work at top conferences such as ICLR, ICML, and NeurIPS.

  • Bring frontier AI innovation to the enterprise , applying lessons learned from leading AI labs to solve real-world business challenges.

  • Collaborate with and learn from exceptional colleagues with deep AI experience from Google, Meta, Amazon, and other leading technology companies.

  • Move at the pace of AI innovation , with the speed, ownership, and impact of a startup.

 

Turing is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability, protected veteran status, or any other legally protected characteristics. At Turing we are dedicated to building a diverse, inclusive and authentic workplace and celebrate authenticity, so if you're excited about this role but your past experience doesn't align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

For applicants from the European Union, please review Turing's GDPR notice here.

 

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Engineering Manager, STEM in San Francisco, CA vacancy
  • $250k - $400k

     ...high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work, and advanced STEM reasoning. In software engineering, Turing is the largest and longest-running... 
    Suggested

    Turing

    San Francisco, CA
    23 days ago
  • $207k - $300k

     ...and introspection probes.Collaborate with safety engineering to develop new capabilities based on adversarial research.Contribute to increasing Gemini’s capabilities...  ...agentic tools.2 years of experience as a people manager.Preferred qualifications:2 years of experience in... 
    Suggested

    Google

    San Francisco, CA
    4 days ago
  •  ...simple methods across video games, real-world video, and our own fleet of affordable, durable robots. We're looking for a research engineer to help us train increasingly capable models across enormous and diverse datasets. You’ll work across the boundary between... 
    Suggested

    Pantograph

    San Francisco, CA
    5 days ago
  •  ...Outset invented a better way to do research: AI-powered user interviews. Global brands...  ...sectional levels of analysis. The Research Engineer reports to the Head Scientist and builds...  ...for production‑stage costs Manage repositories, code review, documentation... 
    Suggested

    Outset

    San Francisco, CA
    3 days ago
  •  ...Research EngineerSesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in...  ...are needed to realize all of our product goals. As a Research engineer at Sesame, you are a research-oriented person with experience in... 
    Suggested
    Full time
    Contract work
    Shift work

    SESAME

    San Francisco, CA
    1 day ago
  • $155k - $269k

     ...autonomous-driving stack is powered by Waabi World, which delivers realistic, scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and productionize the next generation of World Models that can reason... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    18 days ago
  •  ...robotic systems that increase the speed and capacity of buildout, starting with data centers. About the Role At Watney, research engineers decide what our models learn to do next, and a live fleet of robots is the only test that counts. The plan is a staged path... 

    Watney

    San Francisco, CA
    1 day ago
  • $134k - $235k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer in Neural Rendering, you will create the next generation of multi-sensor rendering systems for autonomous driving. You will... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    28 days ago
  •  ...In just months, we’ve gone from our first line of code to deploying real humanoid capabilities. The role As our VLA/WAM Research Engineer, you'll develop the foundation models that power our humanoid robots, spanning model architecture, large-scale pre-training, adaptation... 
    Work at office
    Relocation

    Flexion Robotics

    San Francisco, CA
    14 days ago
  •  ...is a startup company developing technology on the frontier of engineering and biology. Our first product is a smart microinvasive needle...  ...Ideal BS candidates are juniors or seniors with experience in a research lab and/or prior internships. Ideal MS candidates have prior... 
    Summer work
    Internship

    Current Surgical Inc.

    San Francisco, CA
    9 days ago
  •  ...network of expert specialists, scalable managed operations, precise talent matching, and...  ...including 2025. The Impact You'll Make Our research team is expanding to keep pace with a...  ...cutting edge of the field. As a Research Engineer, you'll take a research direction and... 
    Full time

    SuperAnnotate AI

    San Francisco, CA
    5 days ago
  •  ...healthcare and prescriptions. Our team includes ex-founders and engineers who have built and scaled consumer apps to millions of users,...  ...and Stanford. Role Overview We are hiring a Founding Research Engineer to design, prototype, and ship the core reasoning and... 

    Lotus

    San Francisco, CA
    5 days ago
  •  ...spends $1.1 trillion a year on administration instead of care. If you want to help change that, apply below.About The RoleAs a Research Engineer, you'll be responsible for building industry-leading healthcare AI models and model pipelines that power Assort's voice agents... 
    Work at office

    Assort Health

    San Francisco, CA
    5 days ago
  • $200k - $375k

     ...runtime that understands complex enterprise systems, the tooling experience developers use every day, and the analysis and planning engine that transforms legacy code. You will work directly with customers on high-leverage projects and help define our culture, our... 
    Visa sponsorship

    FlowGen Labs

    San Francisco, CA
    7 days ago
  •  ...San Francisco, CA, US Full-time Will sponsor 3+ years Machine Learning We’re hiring a Founding ML Research Engineer to work work through the full stack across data, pre-training, post-training & evals for training Generalist Audio Models. You’ll work through the entire... 
    Full time

    Kalpa Labs

    San Francisco, CA
    4 days ago
  •  ...maintenance and production troubleshooting have become a massive tax of engineering velocity. Resolve AI is solving this by building a...  ...What You'll DoDevelop AI-powered workflows end-to-end, balancing research and engineering to create production-ready AI modelsBuild and... 
    Work at office

    Resolve AI

    San Francisco, CA
    5 days ago
  •  ...review workflow, and then work with a team to integrate successful prototypes into production systems Stay on top of the latest research across LLMs, information retrieval, and developer tooling Qualifications B.S. in Computer Science or equivalent Research... 
    Work at office

    Greptile

    San Francisco, CA
    2 days ago
  •  ...run, and build and operate businesses of their own through their subsidiaries.Kovari is a small team of builders, operators, and researchers. They deploy on-site alongside the businesses they serve and iterate in the field. The company has raised over $6M from leading investors... 

    Rethink recruit

    San Francisco, CA
    4 days ago
  •  ...Research EngineerNew York - Hybrid; San Francisco Bay Area - HybridAbout InvisibleInvisible...  ...and enterprise clients. As a Research Engineer, you'll work on how frontier models are...  ...enables us to be efficient by providing a manageable list of possible candidates that meet... 
    Full time
    Work at office
    Local area
    Remote work

    Invisible Technologies Inc. Defunct

    San Francisco, CA
    1 day ago
  • $180k - $300k

    Graphon Labs is building the multimodal memory layer to enable easy search and analysis of documents, images, video, and audio. We do this by using our proprietary technology to automatically build a graph over your data that extracts out the key structure needed to deliver...

    Graphon AI Inc.

    San Francisco, CA
    1 day ago
  • $125k - $400k

     ...About idler idler is a frontier data research lab. We build the evals and environments...  ...here: About the role As a Research Engineer at idler, you’ll build the systems and...  ...we expand beyond coding environments Manage our security posture and compliance... 
    Work at office
    Relocation package

    Idler

    San Francisco, CA
    5 days ago
  • $140k - $250k

     ...This is the company's top hiring priority and a genuinely hard research problem. Because data flows through a decentralized marketplace...  ...scale is the single biggest bottleneck to growth. As a Research Engineer, you will build the automated systems that verify and assure... 
    Full time
    Work at office

    talentpluto

    San Francisco, CA
    6 days ago
  •  ...Description Bridge the gap between cutting-edge research and production systems. Build and...  ...communication between research and engineering teams What We're Looking For ~3+ years...  ...learning ~ Ability to work independently and manage research projects ~ Strong problem-... 

    Engramme

    San Francisco, CA
    18 days ago
  • $130k - $225k

     ...Job Description Job Description About the Role Join a research and engineering team building privacy and anonymization systems for sensitive data used in AI training. You will help protect personal and confidential information while preserving the structure and utility... 
    Visa sponsorship

    Clera

    San Francisco, CA
    4 days ago
  • $9.7k - $19k

     ...Research Engineer InternThe Center for AI Safety (CAIS) is a leading research and advocacy organization focused on mitigating societal-scale risks from AI. Some of our past achievements include: releasing the most widely used measure of AI capabilities used by all major... 
    Full time
    Internship
    Local area

    Center for AI Safety

    San Francisco, CA
    1 day ago
  • $122k - $215k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles. You... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    4 days ago
  •  ...Job Description Job Description We are Genmo, a research lab developing the world’s most sophisticated video world models to understand...  .... About the Role We're seeking an exceptional Software Engineer to join our research team in advancing the frontiers of visual... 
    Work at office

    Genmo

    San Francisco, CA
    22 days ago
  • $100k - $300k

     ...individuals who are eager to explore uncharted waters and contribute to our innovative projects. Position Overview We are hiring Research Engineers to develop scalable robotic systems aimed at achieving general-purpose robotic intelligence. In this role, you'll work with... 

    Skild AI

    San Francisco, CA
    5 days ago
  •  ...Research EngineerWe believe that software is the foundation of modern civilization - yet vulnerabilities threaten its integrity, security...  ..., and Infrastructure.We're seeking an experienced Research Engineer to join our effort in building and training AI agents for vulnerability... 
    Full time
    Work at office

    DepthFirst

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...Research EngineerDecagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our...  ...how we work and grow as a team.About the RoleAs a Research Engineer, you'll be responsible for building industry-leading conversational... 
    Full time
    Work at office
    Local area

    Decagon

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineering Manager, STEM. Be the first to apply!