Member of Technical Staff (Evals & Post-Training)
$165k - $325kAmbral Labs
What we do Ambral Labs helps enterprises own the intelligence behind their most important workflows. Every company has years of historical evidence showing how work gets done: the context people had, the decisions they made, the actions they took, and the outcomes that followed. Today, most of that history is inert. It isn’t structured in a way that companies can use to evaluate models and improve agent behavior. Ambral turns this history into replayable environments and eval sets grounded in real workflows and observed outcomes. We use those environments to improve model performance through reinforcement learning and other post-training techniques, alongside context engineering, harness design, and agent engineering. The result is better, more cost-efficient AI for each enterprise’s specific work, powered by open-weight models that the company owns and controls. This allows each company to retain ownership of its core intelligence instead of outsourcing it to a model provider. We graduated from YC S2025, raised millions in funding, and are already deployed within multi-billion dollar enterprises. Now we're growing the founding team What You’ll Do At the center of Ambral Labs is a replayable environment engine for the enterprise. The system reconstructs a company’s world as it existed at a particular moment in the past then exposes that state through the same tools an agent would use in production. This lets us place new policies and agent configurations inside real historical environments, observe how they reason and act, and grade their performance against real outcomes. Building an environment factory that converts recorded enterprise data and task definitions into runnable environments Designing graders that turn ambiguous business objectives into verifiable rewards Developing methods for mining useful tasks, trajectories, and evaluation cases from historical workflows Creating eval sets that are representative, reproducible, and resistant to overfitting Finding the right combinations of models, tools, context, and policies to maximize performance while reducing inference cost Training and evaluating agents that operate over long horizons, incomplete information, and large tool spaces Building replay and observability systems that make agent behavior explainable and measurable Scaling from individual environments to thousands of concurrent training and evaluation runs These problems are wide open. You’ll have significant ownership over both the research direction and the production systems that make it real. You’ll work directly with the CTO, deploy into real enterprise workflows, and see your research tested against consequential problems and observable outcomes. Who you are You have 1-7 years of experience building production software or machine-learning systems (we're hiring at multiple levels for this role). Bonus points for working on reinforcement-learning environments, LLM post-training, evaluation infrastructure, agent harnesses, or closely related systems You understand how environment design, reward design, context, tooling, and policy behavior interact You’re comfortable turning fuzzy business objectives into tasks and signals that can be evaluated reliably You can diagnose whether a model’s limitations come from the model itself, its context, its tools, its harness, or its training You can move between research questions and production implementation without treating them as separate jobs You write strong software and can build systems that process large, messy datasets at scale You care about reproducibility, observability, and understanding why a model behaves the way it does You’re looking to do the best work of your life and build something you’ll be proud of for decades We care much more about what you’ve built and how you think than credentials or conventional career paths. Benefits Significant equity and ownership Equinox membership Free meals, coffee, and snacks Health insurance Unlimited PTO Compensation Range: $165K - $325K #J-18808-Ljbffr Ambral Labs
- ...Member Of Technical Staff, Machine Learning Drug discovery is a prediction problem. Scientists design molecules that they predict will be... ...industry Build and optimize scalable infrastructure for model training, deployment, and monitoring Engage directly with our...Training
- ...As a Member of Technical Staff at Quadrillion Labs, you'll build the systems that power Qualia, our research agent. This is a mix of exciting... ...knowledge. Scale environments for agent experiments and training. Help us build the sandboxed compute where agents run...TrainingWork at officeLocal area
- ...reliability Wall Street demands is one of the hardest applied AI problems out there. Our technical staff works across the stack: agent architecture, evals, model post-training, and new product surfaces. You'll ship to the largest financial firms in the world....TrainingFull timeShift work
- ...the field and shape what comes next. Member of the Technical Staff, Molecular Generation Location Employment... ...spans the full arc from research to trained model: you design architectures,... ...or a related field with 2+ years of post-doctoral or industry research experience...TrainingFull time
- ...and acted upon by intelligent systems. Role Summary: As a Member of Technical Staff, you’ll help bridge the gap between cutting‑edge research... ...deployments Own the full stack of ML workflows: data ingestion, training, evaluation, deployment, and monitoring Improve platform...Training
- ...financial investors, distils our deep technical research and knowledge into key... ...We are looking for a highly motivated member of technical staff to join our engineering team to work... ...chip projects across both frontier LLM training & inference models Implement modern...TrainingFull timeWork at officeRemote workWorldwide
- ..., and actionable. In this role, you will build and improve the technical foundations that support Answer Quality across Perplexity. This... ...shared evaluation infrastructure that helps teams run reliable evals, analyze results, and make product and model decisions Develop...
- ...Position Overview: The Member of Technical Staff - Atlas role focuses on building autonomous AI agents and zero-human loops to pioneer... ...teams, learn their workflows deeply, and design better agent training and system architecture. Ownership : Operate under...TrainingFull timeWork experience placement
- Member of Technical Staff - Computational Biologist Valthos | Posted Mar 3 Full-time Negotiable Advanced (5-10 yrs) Computational Biologist Valthos Inc. Valthos... ...large-scale biological datasets appropriate for training frontier biological models, and build workflows...TrainingFull timeWork at office
- ...platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and... ...'ll architect scalable, resilient backend infrastructure, lead technical design discussions, mentor engineers, and establish best...Training
- ...companies of the AI era. The Role We're looking for a Member of Technical Staff to help build the core product and infrastructure behind... ...human-in-the-loop interactions on top of Temporal. Develop evals, traces, and internal tooling to measure and improve agent...Work at office
- ...DoorDash, and Ramp. About the Role Members of Technical Staff (MTS) are the senior engineers who... ...same primitive. Observability and evals. The harness that tells us whether the... ...around a model someone else trained, and have an informed opinion on where...
- ...The role As a Member of Technical Staff focused on Applied AI, you'll own our AI stack end to end. One framing we keep coming back to: agents... .... Evaluations that work for financial services. Most evals are built for tasks with a single right answer. Financial advice...Work at office1 day per week
- About Us Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures...Training
- ...usage into rigorous evaluations, targeted training data, and measurable improvements in... ...generations of models. This is a hands-on technical role at the intersection of research and... ...human and synthetic data, infrastructure, post-training, and live deployments. You'll collaborate...TrainingWork at officeVisa sponsorship
$150k - $350k
...generation for practical chemistry. You will continue developing and training models that incorporate knowledge of chemical synthesis routes... ...chemistry, cheminformatics, or a related field with 2+ years of post-doctoral or industry research experience, or a Master's degree...Training- ...platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and... ...Master's degree in Computer Science, Engineering, or a related technical field, completed within the last 6 months or before the end of...TrainingSummer workInternship
$150k - $350k
...what it implies, and what is missing. The quality and coverage of training data determines what our models can learn, and the biological... ...chemistry, biochemistry, or a related biological field with 2+ years of post-doctoral or industry research experience, or equivalent depth...Training$140k - $270k
...resonates, mention it in your application. About The Role Members of Technical Staff at Anterior own problems end-to-end — from system design through... ...to frontend — to ship complete solutions Writing evals to identify weaknesses and drive improvements in our LLM-powered...ApprenticeshipFlexible hours- ...drowning in repetitive tasks, paper-based bottlenecks, and fragmented data. We're building the software to fix it. As a Member of the Technical Staff at Finch, you'll own critical features end-to-end, ship fast, and work directly alongside product, ops, and design in a...Work at officeRemote workFlexible hours1 day per week
$200k
...development stipend Benefits vary by country and employment type. We train action policies and world models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds. Each MTS is not...- ...discover the next generation of real-world intelligence. The Role We train action policies and world models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds. Each MTS is not...
- ...transactions and has delivered numerous life-changing exits to our clients - and we're just getting started. The Role As a Member of Technical Staff, you'll work directly with the CTO to build the AI-native platform that empowers our investment bankers to be 10x more...Work experience placementRelocation package
- ...Member of Technical Staff Shared Context is building adaptive personal AI that understands the texture of real life: our relationships, routines, responsibilities, and goals. We are building technology that adapts to each and every individual person to help them navigate...
$300 per month
...Clem Delangue and many other operators/technical leaders. _"Basis is on the frontier... ...Lead, OpenAI_ The Work Being a Member of Technical Staff at Basis means you'll face changing... ...what lets you design better systems, train better agents, and make better product...Work at officeShift work- ...Member of Technical Staff Location: NYC (onsite only – not remote) Alliance is the leading accelerator for crypto & AI founders. Since 2020 we've backed 300+ startups (Rain, Pump, Synthetix, Pendle, and many more), now collectively valued at $15B+. We're hiring...Temporary workRelocation
- ...About the job Member of Technical Staff Position Overview: Our client is seeking a highly motivated and skilled Member of Technical Staff to join our team in New York, NY. In this role, you will work closely with our engineering team to design, develop, and...
- ...here to change that working side-by-side with some of the largest companies in the world. Role We're looking for a Member of Technical Staff who will partner with our team on product. Three high priority areas are: 1) Backend engineer to own our extraction...
$160k - $320k
...Member Of Technical Staff Liquid is a trading platform to trade anything, anytime, and anywhere. Our team is small, highly efficient, motivated, and focused on engineering excellence. We cultivate individuals that enjoy ownership and thrive off of agency. We operate...Work at office- Member of Technical Staff, Machine Learning Pace is an AI-native business process outsourcer for insurers. We combine the speed of AI agents with expert review by our insurance operations team to automate insurance tasks. Almost $400bn per year is spent on outsourcing in...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff (Evals & Post-Training). Be the first to apply!
- sharepoint support analyst New York, NY
- technical solutions specialist New York, NY
- life support technician New York, NY
- service desk analyst New York, NY
- user support analyst New York, NY
- mri tech aide New York, NY
- customer support technician New York, NY
- work from home technical support specialist New York, NY
- end user support technician New York, NY
- help desk administrator New York, NY


