Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer, RL & Evals

$175k - $275k

Raydar

About the company Our client is a seed-stage AI company building the data and infrastructure layer that improves model quality in subjective, creative domains, starting with design. It has raised $18.5M and has revenue-generating partnerships with frontier AI labs and application-layer companies. Its products support post-training, reinforcement learning, context and verification. The role As AI Engineer, RL & Evals, you will build reinforcement learning environments, evaluation frameworks and production infrastructure for creative domains. You will combine backend or full-stack product engineering with applied ML and own systems from design through delivery. What you’ll do Build and scale RL environments and evaluation frameworks for creative, non-verifiable domains. Design tasks and grading rubrics that capture design quality and taste. Build agent harnesses, context layers and supporting product infrastructure. Collaborate with internal research teams and frontier labs to improve model output quality. Ship production code end to end and build reliable backend systems and data pipelines. What we’re looking for 2-7 years of relevant AI or reinforcement learning engineering experience, with depth building RL environments, evaluation systems or ML post-training systems. Strong full-stack or backend engineering skills and demonstrated production shipping experience. Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs. Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable. A computer science degree and fluent English communication. Ability to work in the San Francisco office five days per week. Bonus points Experience at creative technology, generative AI, crawling, indexing or data companies. Building agentic frameworks or evaluations for non-verifiable domains. Experience connecting research work to practical products and infrastructure. Compensation and benefits $175,000-$275,000 annual base salary. Competitive equity. Location and work model Full-time, on-site five days per week in Levi’s Plaza, San Francisco, California. Visa transfers, including OPT and H1B transfers, are supported. #J-18808-Ljbffr Raydar

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Engineer, RL & Evals in San Francisco, CA vacancy
  • HUD is seeking an Applied Research Engineer to own implementation, troubleshooting, and evaluation tasks for frontier AI collaborations. You will diagnose ambiguous problems, run evals, and clean data at scale. The right candidate is a strong generalist AI engineer who... 
    Suggested

    HUD

    San Francisco, CA
    2 days ago
  • Raydar is a seed-stage AI company in San Francisco building the data and infrastructure layer to improve model quality in creative domains. You will join as AI Engineer, RL & Evals to design, implement, and scale RL environments, evaluation systems, and production-grade... 
    Suggested

    Raydar Inc

    San Francisco, CA
    4 days ago
  •  ...About Town Town (town.com) is AI that starts from who you are. We build a persistent...  ...That's what you'll own. You'll build the evals and quality systems that turn assistant...  ...breaking what works. Partner with engineers across the product to instrument quality... 
    Suggested
    Work at office

    Town

    San Francisco, CA
    2 days ago
  • Moonlake, based in San Francisco, is building AI infrastructure for interactive digital worlds. We are hiring a Member of Technical Staff to lead RL training and post-training for multimodal agents. You'll work with the research team to scale training, design rewards,... 
    Suggested

    Moonlake

    San Francisco, CA
    2 days ago
  • $150k - $250k

     ...Moore's law going by building AI agents that automate large swaths...  ...the Role As a Founding AI Engineer, you will own the core...  ...training data, reward signals, and evals that measure real agent capability...  ...frontier research in LLM reasoning, RL for agents, and tool use - and... 
    Suggested

    Bronco

    San Francisco, CA
    3 days ago
  • Verita AI is seeking an “AI-native” Machine Learning Engineer to join our core engineering team in San Francisco. This role blends research and product work, building robust RL environments and iterating on automation to scale with high quality standards. You will collaborate... 

    Verita Ai

    San Francisco, CA
    1 day ago
  •  ...Foundation Agents team in San Francisco. You will own and evolve AI agents, focusing on long-horizon capabilities that perform...  ...role emphasizes hands-on AI product development, robust evals, and backend engineering to ensure quality and platform stability. Competitive... 

    Fieldguide

    San Francisco, CA
    2 days ago
  • $350k

     ...for understanding and debugging AI systems. We build world-class,...  ...for an exceptional AI systems engineer to lead the design and development...  ...-concurrency container-based evals with quick ability to iterate...  ...Behavior elicitation: Distributed RL training and roll-outs allowing... 
    Visa sponsorship
    Flexible hours

    Transluce

    San Francisco, CA
    2 days ago
  •  ...iterate on, and innovate on the AI brains behind The Path's AI...  ...Combine research, data science, and engineering to create models,...  ...training data curation, building RL environments, new model architectures...  ...benchmarks. Can look at evals, transcripts, and metrics and... 

    The Path

    San Francisco, CA
    1 day ago
  • $290k

     ...and applications that power today's AI stack using sustainable technology solutions...  ...is looking for a Principal AI Engineer (Specialised) to lead the inference...  ...cache and serving architecture, the evals that prove model quality, and RL loops where inference and training... 
    Flexible hours

    Nscale

    San Francisco, CA
    2 days ago
  •  ...Known - Founding Machine Learning Engineer ~ San Francisco, CA (In-Person...  ...average, our new users talk to our AI voice agent for 27 minutes ,...  ...recommendation engine Designing evals to assess recommendation ability and RL systems to learn from results data... 

    Known, Inc

    San Francisco, CA
    3 days ago
  • $200k - $280k

     ...About Glean: Glean is the Work AI platform that helps everyone...  ..., quality, and product engineering to make those systems better....  ...That means hill-climbing with evals, evolving evalsets and agentic...  ...data for training. Build RL environments for simulating enterprise... 
    Full time
    Work at office
    Home office
    Flexible hours

    Glean

    San Francisco, CA
    1 day ago
  • $175k - $215k

     ...RoleMost companies are experimenting with AI in their GTM motion. We are not...  ...continuous improvementDesign and run structured evals across all production AI systems: measure...  ...best practices, MCP architecture, prompt engineering standards, and enablementWrite documentation... 
    Full time

    Samba TV

    San Francisco, CA
    2 days ago
  • $180k - $230k

     ...AI & Machine Learning Generative Systems Hybrid · San Francisco, CA Full-Time $180,0...  ...with research teams on dataset filtering and RL feedback. What We Are Looking For ~4+...  ...& Mental Health Days Annual Company Engineering Retreats $2,000 / Year Continuous Learning... 
    Full time
    Remote work
    Flexible hours

    Themeframer

    San Francisco, CA
    2 days ago
  • $180k - $250k

     ...We’re hiring a full‑time AI Engineer to own the prompts, agents, evals, and pipelines behind user‑facing features that ship to users. You’ll take product requirements and turn them into working prompts, agents, and pipelines. You’ll evaluate them rigorously, iterate... 
    Full time
    Work at office
    Relocation

    Fluency

    San Francisco, CA
    2 days ago
  • $230k

     ...Everyone's building AI agents, but almost nobody gets them to production. Building...  ...authorization, governance, and trust become the real engineering challenge. Arcade is the MCP runtime...  ...it out. A testing mindset - tests and evals that catch real failures, not just green... 
    Shift work

    Arcade

    San Francisco, CA
    2 days ago
  • $250k - $350k

     ...Spectral Labs is building foundation models for engineering physical systems. We're looking for an AI engineer to build the systems that put those models to...  ...connect LLMs to our geometry models, and the task-level evals that decide what's ready to ship. You bring 3–5... 
    Work at office
    Visa sponsorship

    Spectral Labs

    San Francisco, CA
    1 day ago
  •  ...Chief AI is building the intelligence platform to power the world's leaders. The relationships...  ...The Role We are hiring a Founding AI Engineer to build the systems that define a new...  ...weeks Ship core agent features and evals that executive teams rely on day-to-day... 

    Chief Software Inc.

    San Francisco, CA
    5 days ago
  •  ...We are hiring an AI Engineer to join Proteus in San Francisco. We are building a Biological Intelligence Platform for the autonomous discovery...  ..., tool use, and orchestration Has built the benchmarks and evals to know whether any of it actually works Has worked with... 
    Full time

    Proteus Bio

    San Francisco, CA
    2 days ago
  •  ...Who we are: Cooper is an AI coworker for the insurance industry. Getting a business...  ...the role: We're hiring the Founding Engineering team for a new hyper-growth AI business unit...  ...ASR / TTS, vector stores, orchestration, evals). You're pragmatic about trade-offs... 

    Cooper AI

    San Francisco, CA
    3 days ago
  •  ...Francisco Bay Area, CA · Hybrid · Full-time We are looking for an AI System Engineer who builds the core AI systems that generate and optimize chip...  ...GPUs/TPUs. Reinforcement Learning : Familiarity with RL concepts. Bonus Points (Preferred) Experience at AI labs... 
    Full time
    Shift work

    TenX Semi

    San Francisco, CA
    2 days ago
  • $175k - $215k

     ...Samba TV AI Revenue Architect Samba is a media intelligence company. We know what...  ...and account records with live signals Evals, reliability, and continuous improvement...  ...best practices, MCP architecture, prompt engineering standards, and enablement Write documentation... 

    Samba TV

    San Francisco, CA
    2 days ago
  •  ...You'll Do Build and experiment with AI systems for code understanding, vulnerability...  ...Work closely with product and engineering teams to integrate AI capabilities into Corridor...  ...model fine-tuning, evaluation pipelines, or RL-style environments ~ Self-directed and curious... 

    Corridor Security Inc

    San Francisco, CA
    3 days ago
  • $225k - $255k

     ...a small, product-focused team building an AI-powered B2B pricing platform that helps companies...  ...discount governance. As our Founding AI Engineer , you'll own the evaluation systems,...  .... ~ Direct hands-on experience building evals and observability for LLM systems. ~... 
    Relocation

    Clera

    San Francisco, CA
    3 days ago
  •  ...AI ENGINEER AT CYVL Cyvl has one of the largest proprietary datasets of US infrastructure: LiDAR and imagery from hundreds of cities....  ...vision, 3D perception, or LLM applications (RAG, tool use, agents, evals) ~ Solid software engineering fundamentals: testing, code... 
    Work at office
    Remote work

    CYVL

    San Francisco, CA
    3 days ago
  • $157.5k - $210k

     ...Position Summary: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy org and a major contributor...  ...integrations, and workflow automation. Experience with LLM evals, observability, and optimization (Langfuse, Weights & Biases).... 
    Contract work
    Work from home
    Flexible hours

    Walden Robotics

    San Francisco, CA
    1 day ago
  • $7.5k

     ...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high...  ...standards a regulated fintech product demands Create robust evals: build evaluation frameworks that make AI behaviour measurable... 
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    EQL Tech

    San Francisco, CA
    2 days ago
  • $180k - $300k

     ...About the role You'll own the core AI systems that power Gamma: the models, prompts...  ...our AI stack. You'll work closely with engineering and product to ship improvements that...  ...Strong data instincts: experience writing evals, designing metrics, and translating qualitative... 
    Full time
    Work at office
    Immediate start
    Work from home

    Gamma

    San Francisco, CA
    4 days ago
  •  ...is partnering with a fast-moving technology company to find an AI Engineer to build and ship LLM-powered applications. Our client is looking...  ...and ship features. Applied-AI literacy. Can reason about evals, statistics, and the non-determinism of LLM systems. Familiarity... 
    Full time
    Work experience placement
    Work at office
    Remote work

    twenty80.io

    San Francisco, CA
    4 days ago
  • A pioneering technology company in San Francisco is hiring an AI/ML Engineer to develop and implement advanced models using deep reinforcement learning. The successful candidate will work on real-world systems, conducting experiments and analysis to improve model performance... 

    FLUIX

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer, RL & Evals. Be the first to apply!