Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Model Behavior Engineer, Reasoning and Decision Making [Remote]

$1,000 per month
Full-time

elicit

Oregon State
  • Remote job

About Elicit

Elicit helps research and business teams investigate hard questions and make high-stakes decisions grounded in evidence.

Our ambition is to make high-quality reasoning under uncertainty available at a much greater scale in contexts where stakes are high and feedback is sparse. We're building AI systems whose work people can inspect, question, and improve, so that increasingly capable AI also makes us more wise.

Why we're hiring for this role

Some of the most valuable questions people face are also the hardest to answer well. Which research program should a team advance? What evidence would change its priorities? Which uncertainty is worth resolving before committing to a multi-year, $100 million dollar trial?

Today's models can contribute to these decisions, but they often miss a crucial consideration, make an assumption they should have checked, or reverse a recommendation too readily when presented with new information. Further, because they can perform increasing amounts of work autonomously, their process and reasoning is often poorly legible, so decision makers are wary to trust their outputs. Helping with these problems requires a deep understanding of model behaviors, what matters for different types of decisions, the environments and cultures in which decisions are made, and how to evaluate complex, multiplayer systems with many human and agent interactions.

We're looking for someone to own that work: understand where our systems fall short, develop ways to evaluate them, and build improvements that help users make better decisions. You'll start with concrete problems in scientific R&D and commercial strategy, and develop approaches that apply across different kinds of decisions.

About the role

You'll join our engineering team and report to an Engineering Manager. You'll work on a cross-functional engineering team, collaborating closely with other engineers, product, design, and domain experts, taking problems from investigation and experimental design through implementation and use in the product.

The work combines careful reasoning, the ability to dive into domain specifics, and software design. You'll design agent environments and how agents represent problems, gather evidence, use tools, retain context, revise their conclusions, and coordinate with each other. You'll also make the engineering decisions that let us inspect those processes, test changes, and build on what works.

Most of the initial work will involve systems built around existing frontier models. Training or finetuning may be useful for particular problems, but the direction of the work will follow what helps users reason better.

What you'll own

  • Understand the decisions we're helping people make. Work through real cases with users and domain experts. Identify their objectives, constraints, available evidence, and important unknowns. Learn enough about an unfamiliar problem to recognize when an answer misses the point.

  • Define and measure good reasoning. Build evaluations for problems where success is initially underspecified. Combine close inspection of examples, expert judgment, and quantitative analysis. Investigate whether a better score reflects a meaningful improvement, and whether that improvement holds on new cases.

  • Improve the system's behavior. Turn observed failures into hypotheses you can test. Experiment with problem decomposition, context, tools, and ways for agents to seek information or check their work. Follow promising results through to changes users can benefit from.

  • Design the software that makes this work reliable. Choose useful abstractions, data structures, and component boundaries for reasoning workflows and evaluations. Make deliberate tradeoffs among simplicity, flexibility, reliability, latency, and cost. Build systems whose failures you and your teammates can diagnose.

  • Own the quality of what you ship. Write maintainable code, participate in design and code reviews, and test and monitor your changes. Work with other engineers to integrate your systems into the product and improve them as you learn from real use.

Example projects

  • Build and evaluate a workflow that helps a research team compare potential protein targets they could nominate for drug development, works in light of their goals and decision frameworks, performs legible research against detailed and stress-tested theories of success, and stays up to date in light of new findings.

  • Investigate why an agent overreacts to newly introduced evidence when forecasting clinical trial readouts. Create an evaluation that distinguishes justified changes in judgment from inconsistent ones, then implement and test an improvement.

  • Design a representation of evidence, assumptions, and unresolved questions that an agent can update as a decision to acquire a new asset evolves, while preserving the information needed to inspect its work.

  • Improve an agent's ability to notice missing context and ask useful questions before making a recommendation.

  • Test whether an approach that improves R&D prioritization decisions transfers to business development strategy, and use the result to decide what belongs in a shared component.

What you bring to the role

  • Rigorous thinking about ambiguous problems. You can make a vague question precise, identify hidden assumptions, weigh conflicting evidence, and explain what would change your mind. You can make progress while remaining clear about what you don't know. This might come from a range of backgrounds such as original research in economics or developing quantitative trading approaches under adversarial conditions.

  • Curiosity across domains and clear communication. You enjoy getting to grips with unfamiliar subjects, learning from specialists, and explaining your reasoning to people with different expertise. A good sign is having leveraged domain expertise across multiple scientific domains or business specialities.

  • Good experimental instincts. You can devise a useful test when there isn't an established benchmark, distinguish evidence from noise, and recognize when your evaluation is rewarding the wrong behavior. You're willing to inspect individual failures in detail.

  • The ability to implement your ideas. You can independently write and debug code, work with data and model APIs, and take an experiment into a maintained codebase. You're comfortable with Python or a comparable language and willing to work across the relevant parts of our stack.

  • Practical familiarity with language models. You've explored their capabilities and limitations enough to have informed ideas about how to improve them. You can choose an approach based on the problem and update it as models change.

  • Strong engineering and architectural judgment. You can design a coherent system, explain your choices, and recognize when an abstraction helps or adds unnecessary complexity. You've built software that others can understand, use, and extend. Experience may come from products, research systems, or other substantial technical projects; a full-stack engineering background is not required.

  • Effective use of coding assistants. You use AI tools to increase what you can build while taking responsibility for understanding the design and verifying the result.

We care about evidence of these abilities. Substantial projects, thoughtful experiments, and clear explanations of technical decisions are useful ways to show us how you work.

Am I a good fit?

You might enjoy this role if you find yourself wanting to work through questions like these:

  • A model's recommendation sounds convincing to non-experts, but an expert thinks it is supported by slop. How would you investigate the disagreement and turn what you learn into a useful evaluation?

  • An agent has acquired new evidence. How should the agent identify which conclusions need revisiting, and how would you test that it does so correctly? How does this scale as the amount of evidence grows to tens of thousands of documents?

  • A workflow succeeds on a handful of simple examples. What would you need to learn before using it for customers, and which parts of the implementation would you change first?

You don't need a rehearsed answer. We'd like to understand how you approach problems like these, what you would build, and how you would learn whether it worked.

Location and travel

We have a great office in Oakland, CA, and we'd love to see you there if you're local. That said, we're just as happy for you to work remotely. We do get the whole team together for a quarterly retreat somewhere fun, because in-person time matters to us.

 

Benefits and perks

In addition to working on important problems as part of a productive and positive team, we also offer great benefits (with some variation based on location):

  • Flexible work environment - work from our office in Oakland or remotely as long as you can travel to work in-person for retreats and coworking events

  • Fully covered health, dental, vision, and life insurance for you, generous coverage for the rest of your family (FSA/HSA, too)

  • Flexible vacation policy, with a recommendation of 20 days / year and plenty of company holidays

  • Every Elician receives a $200 monthly wellbeing stipend to spend on whatever supports your health and wellbeing.

  • 401K with a 6% employer match

  • A new Mac + $1,000 budget to set up your workstation or home office in your first year, then $500 every year thereafter

  • $1,000 quarterly AI Experimentation & Learning budget, so you can freely experiment with new AI tools to incorporate into your workflow, take courses, purchase educational resources, or attend AI-focused conferences and events

  • A team administrative assistant who can help you with personal and work tasks

  • You can find more reasons to work with us in this thread !

Compensation

For all roles at Elicit, we use a data-backed compensation framework to make sure our salaries are market-competitive, equitable, and simple. For this role, we're targeting starting ranges of:

  • Career (L3): $185-220K + equity

  • Senior (L4): $220-260K + equity

  • Expert/Staff (L5): $250-320K + significant equity

We're optimizing for a hire who can contribute at a L4/senior-level or above. We'd love to meet staff/principal level contributors as well.

We also offer above-market equity for all roles at Elicit, as well as employee-friendly equity terms.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Model Behavior Engineer, Reasoning and Decision Making [Remote] in Oregon State vacancy
  • $204k - $216k

     ...owns the quality of the models at the core of...  ...models into systems that reason well over a community...  ...research, data, and engineering meet: training and fine...  ...them toward the behavior communities need, and...  ...reproducibility practices that make training decisions defensible and... 
    Suggested

    Sapience AI Corporation

    Portland, OR
    12 days ago
  •  ...communities. Join us and make an impact that...  ...Senior Design Engineers report to the Vice...  ...defensible engineering decisions, perform senior...  .../prestressed behavior, reinforced concrete...  ...AutoCAD, or other BIM/modeling platforms....  ...law and require a reasonable accommodation to complete... 
    Suggested
    Full time
    Temporary work
    For contractors
    Local area

    Knife River

    Harrisburg, OR
    13 hours ago
  • $85k - $105k

     ...Job Description Quality Engineer 2 - Mechanical Testing...  ...work instructions.  Make suggestions for improvements. Make decisions on issues that are not...  ...determined by skills and behaviors, not personal identities...  ...disabilities , we will provide reasonable accommodations upon... 
    Suggested
    Work at office

    Leupold + Stevens, Inc.

    Beaverton, OR
    28 days ago
  • $204k - $216k

     ...that AI learns from and reasons over. You design the data models, schemas, and representations...  ...You are the person who makes sure the data foundation...  ...evidence into clear, durable decisions. What this role is not...  ...models, partnering with engineers who build the pipelines.... 
    Suggested
    Local area

    Sapience AI Corporation

    Portland, OR
    8 days ago
  • $90 - $105 per hour

     ...solve complex systems engineering and integration challenges...  ..., values, and behaviors. Human Exploration...  ...development of and briefing of decision packages and complex...  ...belief that we can make a difference. This core...  ...application tools or need reasonable accommodation to... 
    Suggested
    Hourly pay
    Part time
    Casual work
    Work at office
    Immediate start
    Remote work
    Relocation package
    Flexible hours

    The Aerospace Corporation

    Gresham, OR
    13 hours ago
  •  ...candidates, our recruiters will make their best efforts to...  ...employment upon graduation. The decision regarding full-time employment...  ...following tasks, with or without reasonable accommodation: • Willing...  ...RME (Reliability Maintenance & Engineering), Central Teams, Human... 
    Full time
    Summer work
    Internship
    Work at office
    Local area
    Relocation
    Relocation package
    Shift work
    Night shift
    Weekend work

    Amazon

    Portland, OR
    13 hours ago
  •  ...an ambitious and extraordinarily hardworking Mixed-Signal Behavioral Modeling Engineer. As a member of our dynamic group, you will have the...  ...Learn about accessibility in Apple’s workplaceLearn about reasonable accommodations for job applicantsApplication DeadlineApple... 

    Apple

    Beaverton, OR
    2 days ago
  • $204k - $216k

     ...role focused on the models at the foundation...  ..., knowledge, and reasoning. You work where...  ...Partner with data engineering on the datasets that...  ...base that makes model claims defensible...  ...Turn research into behavior the platform can rely...  ...clear, durable decisions. What this role... 

    Sapience AI Corporation

    Portland, OR
    12 days ago
  •  ...Description:The Project Engineer serves as liaison...  ...and Subcontractors to make sure a construction project...  .... All jobs require behaviors consistent with our Core...  ...and, if requested, reasonable accommodations could be...  ...of making employment decisions without regards to race... 
    Full time
    Contract work
    For subcontractor

    Fortis Construction

    Portland, OR
    4 days ago
  •  ...mechanical, electrical, packaging, or other engineering disciplines. Scope/Supervision and...  ...modify the work assignments and/or to make reasonable accommodations so that qualified...  ...applicants and employees. Employment decisions are based upon job related reasons regardless... 
    Permanent employment
    For contractors
    Internship

    Parker Hannifin Corporation

    Mcminnville, OR
    2 days ago
  • $50 per hour

     ...Trusted by 10,000+ software engineers worldwide MIN EXP...  ...train Large Language Models (LLMs) to function as...  ...on complex system behaviors. ~ Nice to have...  ...acquisition leads to reasoned output. Hands-on experience...  ...contributors on Outlier makes the experience even... 
    Weekly pay
    Extra income
    Contract work
    Freelance
    Internship
    Remote work
    Worldwide

    Outlier

    Portland, OR
    2 days ago
  •  ...and preserves the context behind access decisions, making them auditable and defensible. It...  ...Position Summary: The Customer Success Engineer (CSE) serves as the technical backbone...  ...core values are STRONG and guide our behaviors and success: Spirited - We bring energy... 

    Delinea

    Salem, OR
    1 day ago
  •  ...challenges. Partner with reliability engineers to identify and address equipment...  ...or state law. The company will provide reasonable accommodations to allow an applicant to...  ...skills with a focus on data-driven decision making. Comfortable identifying and challenging... 

    ati

    Albany, OR
    1 day ago
  • $70k - $95k

     ...improve their businesses and make them more productive. We are...  ...Why This Role Matters: This Engineer role is critical to Alpine’s...  ...recognized, your ideas help shape decisions, and your work has visible...  ...range is provided as a reasonable estimate of the current salary... 
    Full time
    Local area

    ITW

    Oregon State
    3 days ago
  •  ...by our company values, modeling our culture of respect...  ...an experienced Design Engineer with a Civil or...  ...COMPETENCIES Customer Focus Decision Quality Business Insight...  ...of projects and making sound engineering decisions...  ...equal opportunity and reasonable accommodation for... 
    Temporary work
    For contractors
    Remote work

    Crest Industries

    Salem, OR
    3 days ago
  • $71.62k - $87.54k

     ...Supplier Quality EngineerThe Supplier Quality Engineer is responsible for monitoring,...  ...scorecards, and performance reviews to support decision-making and continuous improvement initiatives....  ...position satisfactorily. If requested, reasonable accommodations may be made to enable... 
    Full time
    Work at office

    AAON

    Redmond, OR
    3 days ago
  •  ...Description The Senior Professional Civil Engineer for Municipal & Public Works is...  ...of Oregon or ability to obtain within a reasonable timeframe). Minimum of seven to ten...  ...Competencies: Sound engineering judgment and decision making. Strong organizational and... 
    Contract work
    Work at office
    Local area

    The Dyer Partnership Engineers & Planners, Inc.

    Roseburg, OR
    17 days ago
  • $80k - $100k

     ...Description Description: Ascentec Engineering is seeking a Quality Engineer to support...  ...for Supplier Quality Management Makes the final decision on acceptability of product Other...  ...satisfactorily and, if requested, reasonable accommodations will be made to enable... 
    Permanent employment
    Temporary work
    Work at office
    Local area
    Flexible hours

    Ascentec Engineering, LLC

    Tualatin, OR
    18 days ago
  •  ...services and provides customers with engineering expertise relative to specific...  ...client representatives responsible for making purchasing decisions. Interact with relevant parties to negotiate...  ..., skill, and/or ability required. Reasonable accommodations may be made to enable... 
    Remote work

    Pemco International

    Salem, OR
    1 day ago
  •  ...problems. Lead by example and model behaviors that are consistent with...  ...information and standard practices to make informed recommendations....  ...(AI) tools to make hiring decisions, and we ask that candidates...  ...’s success. CBRE provides reasonable accommodations in job... 
    Work at office
    Visa sponsorship

    CBRE, Inc.

    Beaverton, OR
    3 days ago
  •  ...This job is related to the Engineering and Technical Services job...  .... Lead by example and model behaviors that are consistent with CBRE...  ...intelligence (AI) tools to make hiring decisions, and we ask that...  ...’s success. CBRE provides reasonable accommodations in job application... 
    Work at office
    Visa sponsorship

    CBRE

    Salem, OR
    3 days ago
  •  ...! Summary: The Environmental Engineer administers the plant environmental...  ...data acquisition system and makes necessary changes....  ...regulatory agencies Ability to make decisions and to exercise sound...  ...positions in this classification. Reasonable accommodations may be made to... 
    Local area

    Oldcastle

    Baker City, OR
    3 days ago
  • $90k - $130k

     ...Mechanical Design Engineer Opportunity An established design and...  ...practical engineering culture, reasonable work hours, and direct...  ...Engineers here are trusted to make decisions and contribute meaningfully...  ...Proficiency with SolidWorks and solid modeling for large assemblies Working... 
    Full time
    Monday to Friday

    TERRA Staffing Group

    Clackamas, OR
    2 days ago
  • $175k - $225k

     ...seeking a Principal Sales Engineer — the client-facing...  ...AI-native cloud and model providers. Sitting in...  ...technical risks, and open decisions to the CTO and the SVP...  ...level and role. When making hiring and...  ...overall business needs. The reasonable compensation range for... 
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Montera

    Salem, OR
    13 hours ago
  • $94.7k - $110k

     ...EngineerWe’re looking for a Senior Electrical Engineer to join Curtiss-Wright Williams...  ...components, equipment and machinery.Ability to make decisions or suggestions based on rules or...  ...Talent Acquisition and we will make all reasonable efforts to accommodate your request.... 
    Full time

    Curtiss-Wright

    Portland, OR
    5 days ago
  • $155k - $200k

     ...software that empowers organizations to make informed decisions across every stage of the asset...  ...The Public Safety Pre-Sales Solutions Engineer is a technical member of the Octave Federal...  ...the essential functions of this job. Reasonable accommodations may be made to enable... 
    Work at office
    Remote work
    Home office

    Octave Federal

    Beaverton, OR
    2 days ago
  • $97k - $175k

     ...About the Role: CrowdStrike is seeking an experienced Engineer II to join our Systems Integration team. In an effort to reduce...  ...assigned. Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Bend, OR
    7 days ago
  • $63.89k - $85.19k

     ...is seeking an ambitious Field Service Engineer eager to learn Veeco’s technology and drive...  ...and commitment to resolve problems and make decisions based on the priority of the problem in...  ...to working with and providing reasonable accommodations to individuals with disabilities... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Veeco

    Oregon State
    11 days ago
  • $53k - $89k

     ...Manufacturing Engineer 1Ascentec Engineering LLC is growing and it's an exciting time...  ...analyze complex data and reports to make effective decisions.Adaptability, including the ability...  ...position satisfactorily and, if requested, reasonable accommodations will be made to enable... 
    Permanent employment
    Work at office
    Flexible hours

    Ascentec Engineering

    Dallas, OR
    13 hours ago
  • $155k - $200k

     ...for a Senior Thermal Engineer who will own the end-to...  ...and select appropriate modeling approaches, ranging...  ...using first-principles reasoning. Validate simulation...  ...thermal margins, flow behavior, hot spots, pressure losses...  ...with design decisions. CFD results are trusted... 
    Full time
    Work at office
    Relocation package
    Flexible hours

    Panthalassa

    Portland, OR
    28 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Model Behavior Engineer, Reasoning and Decision Making [Remote]. Be the first to apply!