Member of Technical Staff (Evals)
Nitrode
Frontier AI research to advance game development Member of Technical Staff (Evals) Job type Full-time Role Engineering, Data science Experience Any (new grads ok) Visa US citizen/visa only Skills Amazon Web Services (AWS) C++ Java Python Torch/PyTorch Machine Learning Reinforcement learning (RL) Connect directly with founders of the best YC-funded startups. Send us what you’ve built and any cool research you’ve done! Game development experience is a bonus. About Nitrode To advance game development, we believe AI models firstly need to be judged against robust evaluation frameworks that reflect the actual complexity of the field. Over the coming months, Nitrode will open‑source a suite of benchmarks designed to measure where AI models truly stand in game development. Our first benchmark, GameEngineBench, evaluates agentic coding performance on C++ game engine tasks in real runtime environments. #J-18808-Ljbffr Nitrode
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff (Evals) in San Francisco, CA vacancy
$200k
...inference-time compute to achieve this goal. About The Role Evals builds the internal platform that teams across Magic use to... ...of many of the company's most important decisions. As a Member of Technical Staff on Evals, you will build both the platform and the evaluations...SuggestedVisa sponsorshipRelocation package$200k - $400k
..., Adam D'Angelo, and Guillermo Rauch. About the Role As a Member of Technical Staff, Model Evaluations at Simile, you will build the measurement... ...decisions. Evaluation at Simile brings together model evals, statistics, behavioral science, research methodology, product...SuggestedFlexible hours$150k - $300k
...environments, secure sandboxes, verifiable evals, and our async RL trainer. We enable... ...systems into our RL training stack. Core Technical Responsibilities LLM Serving Multi‑tenant... ...believe in open development and encourage team members to contribute to the broader AI community...SuggestedWork at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work- ...requirements, and very few precedents to copy from. About the Role Members of Technical Staff (MTS) are the senior engineers who build the platform that... ...as variations of the same primitive. Observability and evals. The harness that tells us whether the system is working:...Suggested
$300k
Member of Technical Staff - RL Infrastructure About V max V max is an applied research lab developing AI capable of open-ended learning. We are... ...: distributed rollouts, training orchestration, inference, evals, data pipelines, observability, and reliability. You will create...SuggestedWork at officeLocal area$185k - $255k
Member of Technical Staff - Reinforcement Learning Optimized deploys AI agents into the most critical supply chains in the world: the operations... ...looks like. • Evaluate long-horizon behavior: You'll build evals that measure agent reliability across long, high-stakes workflows...$300k
Member of Technical Staff - RL Algorithms About V max V max is an applied research lab developing AI capable of open-ended learning. We are building... .... Collaborate with researchers working on environments, evals, interpretability, reward modeling, and infrastructure to...Work at officeLocal areaShift work- About the Role We're hiring our founding Members of Technical Staff - the engineers who build the AI agents at the heart of everything we do. You... ...building agent workflows, wiring up retrieval, and writing evals to keep quality honest High agency and comfort with ambiguity...
- ...cover our use cases. In this role, you will build specialized evals to improve answer quality across Perplexity, covering search-based... ...directly shape product changes, collaborating closely with technical leadership to measure and improve Answer Quality Qualifications...
$176k - $253k
Senior Member of Technical Staff, AI Quality Harper is an AI-native commercial insurance company in San Francisco. We're not bolting AI onto insurance... ...means the work is scrutinized and the bar is high — your evals are what let everyone else ship fast without flying blind....Permanent employmentWork at officeRelocation$150k - $300k
...environments, secure sandboxes, verifiable evals, and our async RL trainer. We enable... ...fast, robust, and reliable at scale. Core Technical Responsibilities Infrastructure Development... ...in open development and encourage team members to contribute to the broader AI community...Work at officeRemote workVisa sponsorshipRelocation packageFlexible hours$150k - $300k
...environments, secure sandboxes, verifiable evals, and our async RL trainer. We enable... ...infrastructure that runs the jobs. Core Technical Responsibilities Hosted Training Infrastructure... ...in open development and encourage team members to contribute to the broader AI community...Work at officeLocal areaRemote workVisa sponsorshipRelocation packageFlexible hours$150k - $300k
...Member of Technical Staff – Full-Stack AI/Software Engineer Location: San Francisco, CA (Preferred) or New York City, NY. Working arrangement: On‑Site. Employment: Full‑Time. Salary: $150,000 – $300,000 + Competitive Equity. About the opportunity: We are looking for a...Permanent employmentFull timeImmediate startOccupation Elevation
San Francisco, CA3 days ago- ...most capable AI models are being pointed at B2B SaaS. We are pointing ours at the frontier of science. Role Overview As a Member of Technical Staff you will shape Conductor's core offerings: AI software that controls quantum hardware. From agentic quantum algorithm discovery...
Conductor Quantum
San Francisco, CA2 days ago - ...Activant, 1984 Ventures and Page One. The Role We’re hiring a Member of Technical Staff - AI/ML to design, build, and deploy AI-powered systems... ..., evaluation, calibration Have strong opinions on AI/ML evals — golden datasets, offline + online evaluation, statistical...Full timeFlexible hours
$140k - $225k
Member of Technical Staff — SketchPro.ai Location: San Francisco, CA (Onsite, 5 days/week — office next to Salesforce Tower) Compensation: $140,000 - $225,000 base + 0.5% - 1.0% equity Visa Sponsorship: H-1B available Experience Level: 0-6 years Employment Type: Full-Time...Full timeH1bWork at officeVisa sponsorship- ...ON Turn large enterprise APIs into agent-usable tool surfaces: tool granularity, composite tools, descriptions, scopes, auth, and evals. Productize repeated FDE work into self-service patching, QA harnesses, deployment paths, admin controls, docs, and guardrails. Make...
$110k - $350k
...of domains. Clients range from early-stage startups to some of the largest companies in the world. About the role As a Member of the Technical Staff, you will join a team with deep expertise in machine learning, optimization, data science, and software engineering. You...Work at officeRelocation package- ...native companies to power real production workloads built to scale to gigawatt-class AI datacenters. Gimlet Labs is seeking a Member of Technical Staff focused on distributed systems. In this role, you will build the core platform that schedules, routes, and operates AI...
- Pixeltable Inc. Member of Technical Staff San Francisco, CA·Full time Apply for Member of Technical Staff As a founding member of the engineering team, you will impact the design and direction of Pixeltable at a formative stage, contributing to some of our most foundational...Full timePart timeWork at officeWork from homeFlexible hours2 days per week
- Member of Technical Staff Jobs in USA 2026 Member of Technical Staff Jobs in USA 2026 This Member of Technical Staff (MTS) position is based in San Francisco and focuses on building enterprise-grade AI systems and agent-based platforms designed to transform knowledge work...
- Member of Technical Staff — Kernels & GPU Performance Employment Type: Full-time Workplace: On-site About the Company We are building the execution layer for the next era of AI infrastructure. As AI workloads scale and hardware architectures diversify, the bottleneck is...Full time
$160k - $240k
Full-time San Francisco · In person $160k - $240k + Equity Member of Technical Staff, Forward Deployed About the Role As a forward deployed engineer, you are the person who lands inside a customer, learns their operational data and their hardest decisions, and turns Reific...Full time- ...humans within a native office suite, and deploys them in secure environments for Fortune 500 companies. About the Role As a Member of Technical Staff, you will be part of the team responsible for the work platform. You will think end-to-end about what it means to build...Work experience placementH1bWork at officeVisa sponsorship
$150k - $350k
Mission Gimlet Labs is seeking a Member of Technical Staff focused on distributed systems. In this role, you will build the core platform that schedules, routes, and operates AI workloads reliably at production scale. You will work on systems that coordinate execution across...- ...ups and enterprises that integrate LLMs into their products. The team is 5 people with a research and product focus. As a Member of Technical Staff on our infrastructure team, you'll own the cloud systems that serve our compression API end-to-end. You'd get to build...Visa sponsorship
- ...workloads in the world. About the Role Every early hire changes the company. As an early member of the engineering team, you will help define the systems, standards, and technical culture behind a new class of AI infrastructure. This is a high-ownership role for...
- ...agentic care model, where we empower clinicians with agents to deliver continuous care. We’ve already served tens of thousands of members and have raised over $10M from some of the top-tier VC firms. Why we need you As a founding engineer, you’ll be responsible for building...Full timeWork at officeRelocation
- Job Title Member of Technical Staff Salary Not Disclosed Company Description Crucibl.ai is a profitable, San Francisco-based startup that raised a $10M seed from Khosla Ventures, Bessemer, and Coatue to build an AI-native consulting platform. Led by former Google and...
$180k
...analysis, empowering over 5,000 scientists across 150+ R&D labs to handle data from instrument-to-insights. We're seeking a Member of Technical Staff for Genomics to lead our genomics bench, pushing its capabilities to the frontier of what artificial intelligence can...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff (Evals). Be the first to apply!
Related searches
- technical support analyst San Francisco, CA
- senior technical associate San Francisco, CA
- trade support analyst San Francisco, CA
- salesforce technical analyst San Francisco, CA
- user support analyst San Francisco, CA
- tech assistant San Francisco, CA
- technical support specialist San Francisco, CA
- help desk assistant San Francisco, CA
- systems support technician San Francisco, CA
- senior IT support technician San Francisco, CA