Model Behavior Engineer, Reasoning and Decision Making [Remote]
$1,000 per monthelicit
- Remote job
About Elicit
Elicit helps research and business teams investigate hard questions and make high-stakes decisions grounded in evidence.
Our ambition is to make high-quality reasoning under uncertainty available at a much greater scale in contexts where stakes are high and feedback is sparse. We're building AI systems whose work people can inspect, question, and improve, so that increasingly capable AI also makes us more wise.
Why we're hiring for this role
Some of the most valuable questions people face are also the hardest to answer well. Which research program should a team advance? What evidence would change its priorities? Which uncertainty is worth resolving before committing to a multi-year, $100 million dollar trial?
Today's models can contribute to these decisions, but they often miss a crucial consideration, make an assumption they should have checked, or reverse a recommendation too readily when presented with new information. Further, because they can perform increasing amounts of work autonomously, their process and reasoning is often poorly legible, so decision makers are wary to trust their outputs. Helping with these problems requires a deep understanding of model behaviors, what matters for different types of decisions, the environments and cultures in which decisions are made, and how to evaluate complex, multiplayer systems with many human and agent interactions.
We're looking for someone to own that work: understand where our systems fall short, develop ways to evaluate them, and build improvements that help users make better decisions. You'll start with concrete problems in scientific R&D and commercial strategy, and develop approaches that apply across different kinds of decisions.
About the role
You'll join our engineering team and report to an Engineering Manager. You'll work on a cross-functional engineering team, collaborating closely with other engineers, product, design, and domain experts, taking problems from investigation and experimental design through implementation and use in the product.
The work combines careful reasoning, the ability to dive into domain specifics, and software design. You'll design agent environments and how agents represent problems, gather evidence, use tools, retain context, revise their conclusions, and coordinate with each other. You'll also make the engineering decisions that let us inspect those processes, test changes, and build on what works.
Most of the initial work will involve systems built around existing frontier models. Training or finetuning may be useful for particular problems, but the direction of the work will follow what helps users reason better.
What you'll own
Understand the decisions we're helping people make. Work through real cases with users and domain experts. Identify their objectives, constraints, available evidence, and important unknowns. Learn enough about an unfamiliar problem to recognize when an answer misses the point.
Define and measure good reasoning. Build evaluations for problems where success is initially underspecified. Combine close inspection of examples, expert judgment, and quantitative analysis. Investigate whether a better score reflects a meaningful improvement, and whether that improvement holds on new cases.
Improve the system's behavior. Turn observed failures into hypotheses you can test. Experiment with problem decomposition, context, tools, and ways for agents to seek information or check their work. Follow promising results through to changes users can benefit from.
Design the software that makes this work reliable. Choose useful abstractions, data structures, and component boundaries for reasoning workflows and evaluations. Make deliberate tradeoffs among simplicity, flexibility, reliability, latency, and cost. Build systems whose failures you and your teammates can diagnose.
Own the quality of what you ship. Write maintainable code, participate in design and code reviews, and test and monitor your changes. Work with other engineers to integrate your systems into the product and improve them as you learn from real use.
Example projects
Build and evaluate a workflow that helps a research team compare potential protein targets they could nominate for drug development, works in light of their goals and decision frameworks, performs legible research against detailed and stress-tested theories of success, and stays up to date in light of new findings.
Investigate why an agent overreacts to newly introduced evidence when forecasting clinical trial readouts. Create an evaluation that distinguishes justified changes in judgment from inconsistent ones, then implement and test an improvement.
Design a representation of evidence, assumptions, and unresolved questions that an agent can update as a decision to acquire a new asset evolves, while preserving the information needed to inspect its work.
Improve an agent's ability to notice missing context and ask useful questions before making a recommendation.
Test whether an approach that improves R&D prioritization decisions transfers to business development strategy, and use the result to decide what belongs in a shared component.
What you bring to the role
Rigorous thinking about ambiguous problems. You can make a vague question precise, identify hidden assumptions, weigh conflicting evidence, and explain what would change your mind. You can make progress while remaining clear about what you don't know. This might come from a range of backgrounds such as original research in economics or developing quantitative trading approaches under adversarial conditions.
Curiosity across domains and clear communication. You enjoy getting to grips with unfamiliar subjects, learning from specialists, and explaining your reasoning to people with different expertise. A good sign is having leveraged domain expertise across multiple scientific domains or business specialities.
Good experimental instincts. You can devise a useful test when there isn't an established benchmark, distinguish evidence from noise, and recognize when your evaluation is rewarding the wrong behavior. You're willing to inspect individual failures in detail.
The ability to implement your ideas. You can independently write and debug code, work with data and model APIs, and take an experiment into a maintained codebase. You're comfortable with Python or a comparable language and willing to work across the relevant parts of our stack.
Practical familiarity with language models. You've explored their capabilities and limitations enough to have informed ideas about how to improve them. You can choose an approach based on the problem and update it as models change.
Strong engineering and architectural judgment. You can design a coherent system, explain your choices, and recognize when an abstraction helps or adds unnecessary complexity. You've built software that others can understand, use, and extend. Experience may come from products, research systems, or other substantial technical projects; a full-stack engineering background is not required.
Effective use of coding assistants. You use AI tools to increase what you can build while taking responsibility for understanding the design and verifying the result.
We care about evidence of these abilities. Substantial projects, thoughtful experiments, and clear explanations of technical decisions are useful ways to show us how you work.
Am I a good fit?
You might enjoy this role if you find yourself wanting to work through questions like these:
A model's recommendation sounds convincing to non-experts, but an expert thinks it is supported by slop. How would you investigate the disagreement and turn what you learn into a useful evaluation?
An agent has acquired new evidence. How should the agent identify which conclusions need revisiting, and how would you test that it does so correctly? How does this scale as the amount of evidence grows to tens of thousands of documents?
A workflow succeeds on a handful of simple examples. What would you need to learn before using it for customers, and which parts of the implementation would you change first?
You don't need a rehearsed answer. We'd like to understand how you approach problems like these, what you would build, and how you would learn whether it worked.
Location and travel
We have a great office in Oakland, CA, and we'd love to see you there if you're local. That said, we're just as happy for you to work remotely. We do get the whole team together for a quarterly retreat somewhere fun, because in-person time matters to us.
Benefits and perks
In addition to working on important problems as part of a productive and positive team, we also offer great benefits (with some variation based on location):
Flexible work environment - work from our office in Oakland or remotely as long as you can travel to work in-person for retreats and coworking events
Fully covered health, dental, vision, and life insurance for you, generous coverage for the rest of your family (FSA/HSA, too)
Flexible vacation policy, with a recommendation of 20 days / year and plenty of company holidays
Every Elician receives a $200 monthly wellbeing stipend to spend on whatever supports your health and wellbeing.
401K with a 6% employer match
A new Mac + $1,000 budget to set up your workstation or home office in your first year, then $500 every year thereafter
$1,000 quarterly AI Experimentation & Learning budget, so you can freely experiment with new AI tools to incorporate into your workflow, take courses, purchase educational resources, or attend AI-focused conferences and events
A team administrative assistant who can help you with personal and work tasks
You can find more reasons to work with us in this thread !
Compensation
For all roles at Elicit, we use a data-backed compensation framework to make sure our salaries are market-competitive, equitable, and simple. For this role, we're targeting starting ranges of:
Career (L3): $185-220K + equity
Senior (L4): $220-260K + equity
Expert/Staff (L5): $250-320K + significant equity
We're optimizing for a hire who can contribute at a L4/senior-level or above. We'd love to meet staff/principal level contributors as well.
We also offer above-market equity for all roles at Elicit, as well as employee-friendly equity terms.
$204k - $216k
...owns the quality of the models at the core of... ...models into systems that reason well over a community... ...research, data, and engineering meet: training and fine... ...them toward the behavior communities need, and... ...reproducibility practices that make training decisions defensible and...Suggested- ...communities. Join us and make an impact that... ...Senior Design Engineers report to the Vice... ...defensible engineering decisions, perform senior... .../prestressed behavior, reinforced concrete... ...AutoCAD, or other BIM/modeling platforms.... ...law and require a reasonable accommodation to complete...SuggestedFull timeTemporary workFor contractorsLocal area
$85k - $105k
...Job Description Quality Engineer 2 - Mechanical Testing... ...work instructions. Make suggestions for improvements. Make decisions on issues that are not... ...determined by skills and behaviors, not personal identities... ...disabilities , we will provide reasonable accommodations upon...SuggestedWork at office$204k - $216k
...that AI learns from and reasons over. You design the data models, schemas, and representations... ...You are the person who makes sure the data foundation... ...evidence into clear, durable decisions. What this role is not... ...models, partnering with engineers who build the pipelines....SuggestedLocal area$90 - $105 per hour
...solve complex systems engineering and integration challenges... ..., values, and behaviors. Human Exploration... ...development of and briefing of decision packages and complex... ...belief that we can make a difference. This core... ...application tools or need reasonable accommodation to...SuggestedHourly payPart timeCasual workWork at officeImmediate startRemote workRelocation packageFlexible hours- ...candidates, our recruiters will make their best efforts to... ...employment upon graduation. The decision regarding full-time employment... ...following tasks, with or without reasonable accommodation: • Willing... ...RME (Reliability Maintenance & Engineering), Central Teams, Human...Full timeSummer workInternshipWork at officeLocal areaRelocationRelocation packageShift workNight shiftWeekend work
- ...an ambitious and extraordinarily hardworking Mixed-Signal Behavioral Modeling Engineer. As a member of our dynamic group, you will have the... ...Learn about accessibility in Apple’s workplaceLearn about reasonable accommodations for job applicantsApplication DeadlineApple...
$204k - $216k
...role focused on the models at the foundation... ..., knowledge, and reasoning. You work where... ...Partner with data engineering on the datasets that... ...base that makes model claims defensible... ...Turn research into behavior the platform can rely... ...clear, durable decisions. What this role...- ...Description:The Project Engineer serves as liaison... ...and Subcontractors to make sure a construction project... .... All jobs require behaviors consistent with our Core... ...and, if requested, reasonable accommodations could be... ...of making employment decisions without regards to race...Full timeContract workFor subcontractor
- ...mechanical, electrical, packaging, or other engineering disciplines. Scope/Supervision and... ...modify the work assignments and/or to make reasonable accommodations so that qualified... ...applicants and employees. Employment decisions are based upon job related reasons regardless...Permanent employmentFor contractorsInternship
$50 per hour
...Trusted by 10,000+ software engineers worldwide MIN EXP... ...train Large Language Models (LLMs) to function as... ...on complex system behaviors. ~ Nice to have... ...acquisition leads to reasoned output. Hands-on experience... ...contributors on Outlier makes the experience even...Weekly payExtra incomeContract workFreelanceInternshipRemote workWorldwide- ...and preserves the context behind access decisions, making them auditable and defensible. It... ...Position Summary: The Customer Success Engineer (CSE) serves as the technical backbone... ...core values are STRONG and guide our behaviors and success: Spirited - We bring energy...
- ...challenges. Partner with reliability engineers to identify and address equipment... ...or state law. The company will provide reasonable accommodations to allow an applicant to... ...skills with a focus on data-driven decision making. Comfortable identifying and challenging...
$70k - $95k
...improve their businesses and make them more productive. We are... ...Why This Role Matters: This Engineer role is critical to Alpine’s... ...recognized, your ideas help shape decisions, and your work has visible... ...range is provided as a reasonable estimate of the current salary...Full timeLocal area- ...by our company values, modeling our culture of respect... ...an experienced Design Engineer with a Civil or... ...COMPETENCIES Customer Focus Decision Quality Business Insight... ...of projects and making sound engineering decisions... ...equal opportunity and reasonable accommodation for...Temporary workFor contractorsRemote work
$71.62k - $87.54k
...Supplier Quality EngineerThe Supplier Quality Engineer is responsible for monitoring,... ...scorecards, and performance reviews to support decision-making and continuous improvement initiatives.... ...position satisfactorily. If requested, reasonable accommodations may be made to enable...Full timeWork at office- ...Description The Senior Professional Civil Engineer for Municipal & Public Works is... ...of Oregon or ability to obtain within a reasonable timeframe). Minimum of seven to ten... ...Competencies: Sound engineering judgment and decision making. Strong organizational and...Contract workWork at officeLocal area
$80k - $100k
...Description Description: Ascentec Engineering is seeking a Quality Engineer to support... ...for Supplier Quality Management Makes the final decision on acceptability of product Other... ...satisfactorily and, if requested, reasonable accommodations will be made to enable...Permanent employmentTemporary workWork at officeLocal areaFlexible hours- ...services and provides customers with engineering expertise relative to specific... ...client representatives responsible for making purchasing decisions. Interact with relevant parties to negotiate... ..., skill, and/or ability required. Reasonable accommodations may be made to enable...Remote work
- ...problems. Lead by example and model behaviors that are consistent with... ...information and standard practices to make informed recommendations.... ...(AI) tools to make hiring decisions, and we ask that candidates... ...’s success. CBRE provides reasonable accommodations in job...Work at officeVisa sponsorship
- ...This job is related to the Engineering and Technical Services job... .... Lead by example and model behaviors that are consistent with CBRE... ...intelligence (AI) tools to make hiring decisions, and we ask that... ...’s success. CBRE provides reasonable accommodations in job application...Work at officeVisa sponsorship
- ...! Summary: The Environmental Engineer administers the plant environmental... ...data acquisition system and makes necessary changes.... ...regulatory agencies Ability to make decisions and to exercise sound... ...positions in this classification. Reasonable accommodations may be made to...Local area
$90k - $130k
...Mechanical Design Engineer Opportunity An established design and... ...practical engineering culture, reasonable work hours, and direct... ...Engineers here are trusted to make decisions and contribute meaningfully... ...Proficiency with SolidWorks and solid modeling for large assemblies Working...Full timeMonday to Friday$175k - $225k
...seeking a Principal Sales Engineer — the client-facing... ...AI-native cloud and model providers. Sitting in... ...technical risks, and open decisions to the CTO and the SVP... ...level and role. When making hiring and... ...overall business needs. The reasonable compensation range for...Contract workImmediate startRemote workFlexible hours$94.7k - $110k
...EngineerWe’re looking for a Senior Electrical Engineer to join Curtiss-Wright Williams... ...components, equipment and machinery.Ability to make decisions or suggestions based on rules or... ...Talent Acquisition and we will make all reasonable efforts to accommodate your request....Full time$155k - $200k
...software that empowers organizations to make informed decisions across every stage of the asset... ...The Public Safety Pre-Sales Solutions Engineer is a technical member of the Octave Federal... ...the essential functions of this job. Reasonable accommodations may be made to enable...Work at officeRemote workHome office$97k - $175k
...About the Role: CrowdStrike is seeking an experienced Engineer II to join our Systems Integration team. In an effort to reduce... ...assigned. Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and...Permanent employmentWork experience placementWork at officeLocal area$63.89k - $85.19k
...is seeking an ambitious Field Service Engineer eager to learn Veeco’s technology and drive... ...and commitment to resolve problems and make decisions based on the priority of the problem in... ...to working with and providing reasonable accommodations to individuals with disabilities...Full timeWork at officeRemote workFlexible hours$53k - $89k
...Manufacturing Engineer 1Ascentec Engineering LLC is growing and it's an exciting time... ...analyze complex data and reports to make effective decisions.Adaptability, including the ability... ...position satisfactorily and, if requested, reasonable accommodations will be made to enable...Permanent employmentWork at officeFlexible hours$155k - $200k
...for a Senior Thermal Engineer who will own the end-to... ...and select appropriate modeling approaches, ranging... ...using first-principles reasoning. Validate simulation... ...thermal margins, flow behavior, hot spots, pressure losses... ...with design decisions. CFD results are trusted...Full timeWork at officeRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Model Behavior Engineer, Reasoning and Decision Making [Remote]. Be the first to apply!
- remote document review Oregon State
- remote recruiter Oregon State
- remote infrastructure engineer Oregon State
- remote video game Oregon State
- global remote customer service jobs Oregon State
- software engineer internship remote Oregon State
- remote banking Oregon State
- junior designer remote Oregon State
- remote tasks Oregon State
- remote analyst Oregon State







