Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff (Evals & Post-Training)

$165k - $325k

Ambral Labs

What we do Ambral Labs helps enterprises own the intelligence behind their most important workflows. Every company has years of historical evidence showing how work gets done: the context people had, the decisions they made, the actions they took, and the outcomes that followed. Today, most of that history is inert. It isn’t structured in a way that companies can use to evaluate models and improve agent behavior. Ambral turns this history into replayable environments and eval sets grounded in real workflows and observed outcomes. We use those environments to improve model performance through reinforcement learning and other post-training techniques, alongside context engineering, harness design, and agent engineering. The result is better, more cost-efficient AI for each enterprise’s specific work, powered by open-weight models that the company owns and controls. This allows each company to retain ownership of its core intelligence instead of outsourcing it to a model provider. We graduated from YC S2025, raised millions in funding, and are already deployed within multi-billion dollar enterprises. Now we're growing the founding team What You’ll Do At the center of Ambral Labs is a replayable environment engine for the enterprise. The system reconstructs a company’s world as it existed at a particular moment in the past then exposes that state through the same tools an agent would use in production. This lets us place new policies and agent configurations inside real historical environments, observe how they reason and act, and grade their performance against real outcomes. Building an environment factory that converts recorded enterprise data and task definitions into runnable environments Designing graders that turn ambiguous business objectives into verifiable rewards Developing methods for mining useful tasks, trajectories, and evaluation cases from historical workflows Creating eval sets that are representative, reproducible, and resistant to overfitting Finding the right combinations of models, tools, context, and policies to maximize performance while reducing inference cost Training and evaluating agents that operate over long horizons, incomplete information, and large tool spaces Building replay and observability systems that make agent behavior explainable and measurable Scaling from individual environments to thousands of concurrent training and evaluation runs These problems are wide open. You’ll have significant ownership over both the research direction and the production systems that make it real. You’ll work directly with the CTO, deploy into real enterprise workflows, and see your research tested against consequential problems and observable outcomes. Who you are You have 1-7 years of experience building production software or machine-learning systems (we're hiring at multiple levels for this role). Bonus points for working on reinforcement-learning environments, LLM post-training, evaluation infrastructure, agent harnesses, or closely related systems You understand how environment design, reward design, context, tooling, and policy behavior interact You’re comfortable turning fuzzy business objectives into tasks and signals that can be evaluated reliably You can diagnose whether a model’s limitations come from the model itself, its context, its tools, its harness, or its training You can move between research questions and production implementation without treating them as separate jobs You write strong software and can build systems that process large, messy datasets at scale You care about reproducibility, observability, and understanding why a model behaves the way it does You’re looking to do the best work of your life and build something you’ll be proud of for decades We care much more about what you’ve built and how you think than credentials or conventional career paths. Benefits Significant equity and ownership Equinox membership Free meals, coffee, and snacks Health insurance Unlimited PTO Compensation Range: $165K - $325K #J-18808-Ljbffr Ambral Labs

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff (Evals & Post-Training) in New York, NY vacancy
  •  ...Member Of Technical Staff, Machine Learning Drug discovery is a prediction problem. Scientists design molecules that they predict will be...  ...industry Build and optimize scalable infrastructure for model training, deployment, and monitoring Engage directly with our... 
    Training

    Inductive Bio

    New York, NY
    1 day ago
  •  ...As a Member of Technical Staff at Quadrillion Labs, you'll build the systems that power Qualia, our research agent. This is a mix of exciting...  ...knowledge. Scale environments for agent experiments and training. Help us build the sandboxed compute where agents run... 
    Training
    Work at office
    Local area

    Quadrillion Labs, Inc

    New York, NY
    4 days ago
  •  ...reliability Wall Street demands is one of the hardest applied AI problems out there. Our technical staff works across the stack: agent architecture, evals, model post-training, and new product surfaces. You'll ship to the largest financial firms in the world.... 
    Training
    Full time
    Shift work

    Endex Inc

    New York, NY
    3 days ago
  •  ...the field and shape what comes next. Member of the Technical Staff, Molecular Generation Location Employment...  ...spans the full arc from research to trained model: you design architectures,...  ...or a related field with 2+ years of post-doctoral or industry research experience... 
    Training
    Full time

    Outputbiosciences

    New York, NY
    4 days ago
  •  ...and acted upon by intelligent systems. Role Summary: As a Member of Technical Staff, you’ll help bridge the gap between cutting‑edge research...  ...deployments Own the full stack of ML workflows: data ingestion, training, evaluation, deployment, and monitoring Improve platform... 
    Training

    People In AI

    New York, NY
    1 day ago
  •  ...financial investors, distils our deep technical research and knowledge into key...  ...We are looking for a highly motivated member of technical staff to join our engineering team to work...  ...chip projects across both frontier LLM training & inference models Implement modern... 
    Training
    Full time
    Work at office
    Remote work
    Worldwide

    S27a

    New York, NY
    4 days ago
  •  ..., and actionable. In this role, you will build and improve the technical foundations that support Answer Quality across Perplexity. This...  ...shared evaluation infrastructure that helps teams run reliable evals, analyze results, and make product and model decisions Develop... 

    Perplexity AI

    New York, NY
    3 days ago
  •  ...Position Overview: The Member of Technical Staff - Atlas role focuses on building autonomous AI agents and zero-human loops to pioneer...  ...teams, learn their workflows deeply, and design better agent training and system architecture. Ownership : Operate under... 
    Training
    Full time
    Work experience placement

    Connvertex Technologies Inc.

    New York, NY
    1 day ago
  • Member of Technical Staff - Computational Biologist Valthos | Posted Mar 3 Full-time Negotiable Advanced (5-10 yrs) Computational Biologist Valthos Inc. Valthos...  ...large-scale biological datasets appropriate for training frontier biological models, and build workflows... 
    Training
    Full time
    Work at office

    Valthos

    New York, NY
    4 days ago
  •  ...platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and...  ...'ll architect scalable, resilient backend infrastructure, lead technical design discussions, mentor engineers, and establish best... 
    Training

    Fireworks AI

    New York, NY
    1 day ago
  •  ...companies of the AI era. The Role We're looking for a Member of Technical Staff to help build the core product and infrastructure behind...  ...human-in-the-loop interactions on top of Temporal. Develop evals, traces, and internal tooling to measure and improve agent... 
    Work at office

    Melius AI, Inc

    New York, NY
    4 days ago
  •  ...DoorDash, and Ramp. About the Role Members of Technical Staff (MTS) are the senior engineers who...  ...same primitive. Observability and evals. The harness that tells us whether the...  ...around a model someone else trained, and have an informed opinion on where... 

    BEACON SOFTWARE COMPANY

    New York, NY
    15 hours ago
  •  ...The role As a Member of Technical Staff focused on Applied AI, you'll own our AI stack end to end. One framing we keep coming back to: agents...  .... Evaluations that work for financial services. Most evals are built for tasks with a single right answer. Financial advice... 
    Work at office
    1 day per week

    NxT Level

    New York, NY
    15 hours ago
  • About Us Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures... 
    Training

    Fireworks AI

    New York, NY
    4 days ago
  •  ...usage into rigorous evaluations, targeted training data, and measurable improvements in...  ...generations of models. This is a hands-on technical role at the intersection of research and...  ...human and synthetic data, infrastructure, post-training, and live deployments. You'll collaborate... 
    Training
    Work at office
    Visa sponsorship

    Reflection

    New York, NY
    4 days ago
  • $150k - $350k

     ...generation for practical chemistry. You will continue developing and training models that incorporate knowledge of chemical synthesis routes...  ...chemistry, cheminformatics, or a related field with 2+ years of post-doctoral or industry research experience, or a Master's degree... 
    Training

    Output Biosciences

    New York, NY
    23 days ago
  •  ...platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and...  ...Master's degree in Computer Science, Engineering, or a related technical field, completed within the last 6 months or before the end of... 
    Training
    Summer work
    Internship

    Fireworks AI

    New York, NY
    2 days ago
  • $150k - $350k

     ...what it implies, and what is missing. The quality and coverage of training data determines what our models can learn, and the biological...  ...chemistry, biochemistry, or a related biological field with 2+ years of post-doctoral or industry research experience, or equivalent depth... 
    Training

    Output Biosciences

    New York, NY
    28 days ago
  • $140k - $270k

     ...resonates, mention it in your application. About The Role Members of Technical Staff at Anterior own problems end-to-end — from system design through...  ...to frontend — to ship complete solutions Writing evals to identify weaknesses and drive improvements in our LLM-powered... 
    Apprenticeship
    Flexible hours

    SupportFinity™

    New York, NY
    3 days ago
  •  ...drowning in repetitive tasks, paper-based bottlenecks, and fragmented data. We're building the software to fix it. As a Member of the Technical Staff at Finch, you'll own critical features end-to-end, ship fast, and work directly alongside product, ops, and design in a... 
    Work at office
    Remote work
    Flexible hours
    1 day per week

    Finch Services

    New York, NY
    1 day ago
  • $200k

     ...development stipend Benefits vary by country and employment type. We train action policies and world models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds. Each MTS is not... 

    Gamedevsofcolorexpo

    New York, NY
    2 days ago
  •  ...discover the next generation of real-world intelligence. The Role We train action policies and world models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds. Each MTS is not... 

    Medal

    New York, NY
    4 days ago
  •  ...transactions and has delivered numerous life-changing exits to our clients - and we're just getting started. The Role As a Member of Technical Staff, you'll work directly with the CTO to build the AI-native platform that empowers our investment bankers to be 10x more... 
    Work experience placement
    Relocation package

    The Ask

    New York, NY
    1 day ago
  •  ...Member of Technical Staff Shared Context is building adaptive personal AI that understands the texture of real life: our relationships, routines, responsibilities, and goals. We are building technology that adapts to each and every individual person to help them navigate... 

    Shared Context Lab

    New York, NY
    2 days ago
  • $300 per month

     ...Clem Delangue and many other operators/technical leaders. _"Basis is on the frontier...  ...Lead, OpenAI_ The Work Being a Member of Technical Staff at Basis means you'll face changing...  ...what lets you design better systems, train better agents, and make better product... 
    Work at office
    Shift work

    Basis

    New York, NY
    2 days ago
  •  ...Member of Technical Staff Location: NYC (onsite only – not remote) Alliance is the leading accelerator for crypto & AI founders. Since 2020 we've backed 300+ startups (Rain, Pump, Synthetix, Pendle, and many more), now collectively valued at $15B+. We're hiring... 
    Temporary work
    Relocation

    Alliance

    New York, NY
    3 days ago
  •  ...About the job Member of Technical Staff Position Overview: Our client is seeking a highly motivated and skilled Member of Technical Staff to join our team in New York, NY. In this role, you will work closely with our engineering team to design, develop, and... 

    UpCore Solutions

    New York, NY
    2 days ago
  •  ...here to change that working side-by-side with some of the largest companies in the world. Role We're looking for a Member of Technical Staff who will partner with our team on product. Three high priority areas are: 1) Backend engineer to own our extraction... 

    Pace

    New York, NY
    2 days ago
  • $160k - $320k

     ...Member Of Technical Staff Liquid is a trading platform to trade anything, anytime, and anywhere. Our team is small, highly efficient, motivated, and focused on engineering excellence. We cultivate individuals that enjoy ownership and thrive off of agency. We operate... 
    Work at office

    Liquid

    New York, NY
    1 day ago
  • Member of Technical Staff, Machine Learning Pace is an AI-native business process outsourcer for insurers. We combine the speed of AI agents with expert review by our insurance operations team to automate insurance tasks. Almost $400bn per year is spent on outsourcing in... 

    Pace

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff (Evals & Post-Training). Be the first to apply!