Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff — Research Engineering, Evaluation

Uncover

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it. To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather. Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN. We look for research engineers who are excited to tackle unsolved problems. Progress is only as trustworthy as its measurement. As our model, data, and reasoning efforts multiply, every team needs to know, precisely and comparably, whether a change made the model better. Your mission is to build the central evaluation framework that the entire research organization runs on: the pipelines, the metrics, and the tools that turn results into shared understanding. Responsibilities Design and build a central, reusable evaluation framework that every model and every team runs through Implement evaluation pipelines, benchmark suites, and baselines that make model quality measurable and comparable across efforts Build the visualization and dashboard tools that turn raw results into shared, actionable understanding for the whole team Establish sound statistical methodology for evaluation, so teams can distinguish real improvements from noise Partner with research and domain teams to translate what "good" means in each domain into standardized, automated metrics What we’re looking for We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains. Strong software engineering skills and experience building data or evaluation pipelines at scale Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on Solid grasp of probability and statistics, with the judgment to design evaluations that measure what they claim to Full-stack range: comfortable building both backend pipelines and the frontend tools people read results in Owns deliverables end-to-end, from collecting requirements to autonomously driving execution #J-18808-Ljbffr Uncover

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff — Research Engineering, Evaluation in Brooklyn, NY vacancy
  •  ...They’ve now brought together a world-class research team from DeepMind, Tesla, Waymo, Meta,...  ..., architecture, training, inference, evaluation, rather than as six specialties, and go...  ...frameworks that Odyssey researchers and product engineers alike rely on. Who you are 2+ years of... 
    Suggested

    Odyssey

    Brooklyn, NY
    4 days ago
  • Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build...  ...our understanding of model capabilities Build and refine evaluation systems and processes that create tight feedback loops between... 
    Suggested
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    3 days ago
  •  ...Anthropic is looking for a Member of Technical Staff to join our Applied AI...  ...enterprise customers and research partners to deploy Claude...  ...closely with research and engineering teams to identify product...  ...model training. Build robust evaluation pipelines, guardrails, and... 
    Suggested
    Remote work
    Flexible hours

    AI Breaking Wire

    Brooklyn, NY
    2 days ago
  • $227.5k - $401k

     ...everything we do is engineered for ambition. We create...  ...who tackle unique technical challenges at scale...  ...of cutting-edge AI research within the financial...  ...technology sector. As a Member of Technical Staff , you will operate...  ...(DABStep) , which evaluates AI agents on real-world... 
    Suggested
    Work at office
    Immediate start
    Relocation
    Flexible hours

    Adyen

    Brooklyn, NY
    4 days ago
  •  ...everything we do is engineered for ambition. We create...  ...who tackle unique technical challenges at scale...  ...of cutting-edge AI research within the financial...  ...technology sector. As a Member of Technical Staff , you will operate...  ...(DABStep), which evaluates AI agents on real-world... 
    Suggested
    Flexible hours

    EngineersOfAI

    Brooklyn, NY
    11 hours ago
  • $140k - $185k

    Building LLM evaluation benchmarks and AI dev tools tied to vibe...  ...Vals AI as a platform engineer responsible for building and...  ...based in San Francisco. Role Member of Technical Staff - Platform responsible for...  ...Collaborate closely with research to ensure infrastructure... 
    Full time
    Relocation
    Relocation package

    Vibehackers

    Brooklyn, NY
    4 days ago
  • $140k - $185k

    Directly builds and evaluates LLM benchmarks; mentions a \"vibe-coding\" benchmark...  ...language models (LLMs). Lead research and engineering efforts to create rigorous, publishable...  ...measured. Job Description Role Member of Technical Staff - Research responsible for... 
    Full time
    Relocation package

    Vibehackers

    Brooklyn, NY
    4 days ago
  •  ...training, and product engineering. We believe the...  ...environments, rigorous evaluations, efficient training,...  ...will join as a full member of the technical team—not as an observer...  ...personal projects, research, internships,...  ...Member of Technical Staff, Research — Early Career... 
    Full time
    Internship
    Work at office
    Visa sponsorship
    Flexible hours
    3 days per week

    Goaly

    Brooklyn, NY
    11 hours ago
  • $91k - $232k

     ...opportunity to be a part of something great? Want to join a 17,000-member team that works on the technology that powers the world around...  ...Inc is seeking an experienced and innovative verification engineer for our team in Chandler, Arizona to work on the verification of... 

    FHLB Des Moines

    Brooklyn, NY
    4 days ago
  • $200k

     ...largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds. Each...  ...- we help you find the most important problem across research, engineering, and infrastructure that aligns with our team's... 

    Gamedevsofcolorexpo

    Brooklyn, NY
    2 days ago
  •  ...Member of Technical Staff - ML Systems & Inference Bay Area, CA | Onsite Join a well-funded AI infrastructure startup building the orchestration...  ...systems, inference, distributed systems, and performance engineering. You'll build production inference systems, optimize... 

    Acceler8 Talent

    Brooklyn, NY
    11 hours ago
  • Our Mission Reflection is a research lab making intelligence open and accessible for everyone...  ...operates the foundational layer every engineering team depends on — cloud and multi-cloud...  ...of infrastructure engineers, guide the technical and architectural decisions across... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    11 hours ago
  •  ...frameworks, contractual obligations — into an evaluation that is deterministic, explainable, and...  ...we look for Experience building rules engines, policy systems, query planners,...  ...hardware budget. Time and budget to publish research derived from your work. #J-18808-Ljbffr... 

    Dipp AI Technologies

    Brooklyn, NY
    2 days ago
  • $150k - $350k

    Member of Technical Staff | Distributed Systems San Francisco - Onsite $150k-$350k base + equity I'm working with a small, deeply technical...  .... The team is looking for a hands on Distributed Systems Engineer/MTS to help build the foundational infrastructure underneath... 

    Acceler8 Talent

    Brooklyn, NY
    1 day ago
  • $180k - $280k

     ...fragmented data - and we're building the software to fix it. As a Member of the Technical Staff at Finch, you'll own critical features end-to-end, ship...  ...at a company where the product is evolving quickly and engineers have real ownership - expect the scope to grow as we do.... 
    Work at office
    Remote work
    Flexible hours
    1 day per week

    Finchlegal

    Brooklyn, NY
    4 days ago
  •  ...training, and product engineering. We believe the...  ...environments, rigorous evaluations, efficient training,...  ...production models. This is a research-engineering role. The...  ...contributions, technically ambitious independent...  ...currently expect all staff to work from one of our... 
    Work at office
    Visa sponsorship
    Flexible hours
    3 days per week

    Goaly

    Brooklyn, NY
    11 hours ago
  • Member of Technical Staff: DataMonk is an AI-native accounts receivable platform for B2B companies. We automate billing, collections, and payments so finance teams can turn outstanding invoices into cash, faster. We believe the AR stack is broken and the finance function... 
    Immediate start

    Uncover

    Brooklyn, NY
    4 days ago
  •  ...organizations need. We are a small, engineering-led team working directly...  ...problems into clear technical designs, working software, and...  ...tests, coding agents, traces, evaluations, and production feedback as...  ...engineering team. It is not an ML research role focused on training... 
    Immediate start

    Sycamore

    Brooklyn, NY
    3 days ago
  •  ...Ray-Ban glasses) and the fashion industry. We're looking for a engineering talents to build Nirva's intelligence layer: the systems that...  ..., reasons over memory, structures personal data, calls tools, evaluates outputs, and turns messy real-world signals into experiences that... 

    Nirva

    Brooklyn, NY
    4 days ago
  •  ...Bio, and CERN.We look for infrastructure engineers who are excited to tackle unsolved problems. Everything we do — training, evaluation, serving — runs on our GPU fleet. Your mission...  ..., and cost-efficient compute to ensure research is able to iterate rapidly at scale.... 

    Uncover

    Brooklyn, NY
    2 days ago
  • Our Mission Reflection is a research lab making intelligence open and accessible for...  ...Reflection.AI is looking for a Member of Technical Staff - Infrastructure Security to secure our...  ...to jump head first into the hands‑on engineering work of building infrastructure security... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    3 days ago
  • Member of Technical Staff - Simulation About Us Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most challenging problems... 

    Veeda Innovation

    Brooklyn, NY
    1 day ago
  •  ...real. You will build task classification, capability profiles, evaluation harnesses, and the cost governor that enforces spend ceilings...  ...construct better ones. Experience 7+ years in software or ML engineering, including 2+ years shipping LLM-backed systems in production... 

    Dipp AI Technologies

    Brooklyn, NY
    2 days ago
  • $160k - $200k

    Member of Technical Staff, Agent Delivery Full time · Remote · San Francisco or New York Important:...  ...We’re hiring Forward Deployed Product Engineers to deploy production AI agents inside...  ...You’re primarily interested in model research or pure ML experimentation. You... 
    Full time
    Work at office
    Local area
    Remote work

    Talanto

    Brooklyn, NY
    4 days ago
  •  ...to take your software engineering career to the next level...  ...Management (AM) Fundamental Research Technology, you serve as a seasoned member of an agile team to...  ...across multiple technical areas within various business...  ...ability to critically evaluate, validate, and refine AI... 
    Work experience placement

    JP Morgan Chase

    Jersey City, NJ
    11 hours ago
  • $55k - $70k

     ...team of advisory, environmental/engineering, and regulatory professionals...  ...of over 30 advisory, technical environmental, and engineering...  ...seeking a skilled and experienced Staff Air Quality Engineer or...  .... Interact with project team members to steward preparation and submittal... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Relocation

    SLR Consulting

    Brooklyn, NY
    2 days ago
  •  ...Veeda AI is seeking a Member of Technical Staff - Simulation to join a small, fast-moving team building physical AI world models. You will integrate...  ...pipelines, asset authoring in OpenUSD, variability, and evaluating fidelity between simulators and hardware traces to drive... 

    Veeda Innovation

    Brooklyn, NY
    11 hours ago
  •  ...and retrieval. You will make these systems observable and dependable across cloud and self-hosted environments while helping the engineering team ship quickly. WHAT WE ARE LOOKING FOR Strong systems fundamentals: You reason clearly about reliability, performance, security... 
    Immediate start

    Valkai, Inc.

    Brooklyn, NY
    5 days ago
  •  ...The Role As one of our first front-end engineers, you'llship new features. What you'll do...  ...end-to-end. Contribute to key technical and product decisions as part of the founding...  ..., filmmakers, game studios, designers, researchers, and VFX houses, including teams at OpenAI... 

    Comfyui

    Brooklyn, NY
    2 days ago
  •  ...Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff — Research Engineering, Evaluation. Be the first to apply!