AI Engineer, RL & Evals
$175k - $275kRaydar
About the company Our client is a seed-stage AI company building the data and infrastructure layer that improves model quality in subjective, creative domains, starting with design. It has raised $18.5M and has revenue-generating partnerships with frontier AI labs and application-layer companies. Its products support post-training, reinforcement learning, context and verification. The role As AI Engineer, RL & Evals, you will build reinforcement learning environments, evaluation frameworks and production infrastructure for creative domains. You will combine backend or full-stack product engineering with applied ML and own systems from design through delivery. What you’ll do Build and scale RL environments and evaluation frameworks for creative, non-verifiable domains. Design tasks and grading rubrics that capture design quality and taste. Build agent harnesses, context layers and supporting product infrastructure. Collaborate with internal research teams and frontier labs to improve model output quality. Ship production code end to end and build reliable backend systems and data pipelines. What we’re looking for 2-7 years of relevant AI or reinforcement learning engineering experience, with depth building RL environments, evaluation systems or ML post-training systems. Strong full-stack or backend engineering skills and demonstrated production shipping experience. Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs. Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable. A computer science degree and fluent English communication. Ability to work in the San Francisco office five days per week. Bonus points Experience at creative technology, generative AI, crawling, indexing or data companies. Building agentic frameworks or evaluations for non-verifiable domains. Experience connecting research work to practical products and infrastructure. Compensation and benefits $175,000-$275,000 annual base salary. Competitive equity. Location and work model Full-time, on-site five days per week in Levi’s Plaza, San Francisco, California. Visa transfers, including OPT and H1B transfers, are supported. #J-18808-Ljbffr Raydar
- HUD is seeking an Applied Research Engineer to own implementation, troubleshooting, and evaluation tasks for frontier AI collaborations. You will diagnose ambiguous problems, run evals, and clean data at scale. The right candidate is a strong generalist AI engineer who...Suggested
- Raydar is a seed-stage AI company in San Francisco building the data and infrastructure layer to improve model quality in creative domains. You will join as AI Engineer, RL & Evals to design, implement, and scale RL environments, evaluation systems, and production-grade...Suggested
- ...About Town Town (town.com) is AI that starts from who you are. We build a persistent... ...That's what you'll own. You'll build the evals and quality systems that turn assistant... ...breaking what works. Partner with engineers across the product to instrument quality...SuggestedWork at office
- Moonlake, based in San Francisco, is building AI infrastructure for interactive digital worlds. We are hiring a Member of Technical Staff to lead RL training and post-training for multimodal agents. You'll work with the research team to scale training, design rewards,...Suggested
$150k - $250k
...Moore's law going by building AI agents that automate large swaths... ...the Role As a Founding AI Engineer, you will own the core... ...training data, reward signals, and evals that measure real agent capability... ...frontier research in LLM reasoning, RL for agents, and tool use - and...Suggested- Verita AI is seeking an “AI-native” Machine Learning Engineer to join our core engineering team in San Francisco. This role blends research and product work, building robust RL environments and iterating on automation to scale with high quality standards. You will collaborate...
- ...Foundation Agents team in San Francisco. You will own and evolve AI agents, focusing on long-horizon capabilities that perform... ...role emphasizes hands-on AI product development, robust evals, and backend engineering to ensure quality and platform stability. Competitive...
$350k
...for understanding and debugging AI systems. We build world-class,... ...for an exceptional AI systems engineer to lead the design and development... ...-concurrency container-based evals with quick ability to iterate... ...Behavior elicitation: Distributed RL training and roll-outs allowing...Visa sponsorshipFlexible hours- ...iterate on, and innovate on the AI brains behind The Path's AI... ...Combine research, data science, and engineering to create models,... ...training data curation, building RL environments, new model architectures... ...benchmarks. Can look at evals, transcripts, and metrics and...
$290k
...and applications that power today's AI stack using sustainable technology solutions... ...is looking for a Principal AI Engineer (Specialised) to lead the inference... ...cache and serving architecture, the evals that prove model quality, and RL loops where inference and training...Flexible hours- ...Known - Founding Machine Learning Engineer ~ San Francisco, CA (In-Person... ...average, our new users talk to our AI voice agent for 27 minutes ,... ...recommendation engine Designing evals to assess recommendation ability and RL systems to learn from results data...
$200k - $280k
...About Glean: Glean is the Work AI platform that helps everyone... ..., quality, and product engineering to make those systems better.... ...That means hill-climbing with evals, evolving evalsets and agentic... ...data for training. Build RL environments for simulating enterprise...Full timeWork at officeHome officeFlexible hours$175k - $215k
...RoleMost companies are experimenting with AI in their GTM motion. We are not... ...continuous improvementDesign and run structured evals across all production AI systems: measure... ...best practices, MCP architecture, prompt engineering standards, and enablementWrite documentation...Full time$180k - $230k
...AI & Machine Learning Generative Systems Hybrid · San Francisco, CA Full-Time $180,0... ...with research teams on dataset filtering and RL feedback. What We Are Looking For ~4+... ...& Mental Health Days Annual Company Engineering Retreats $2,000 / Year Continuous Learning...Full timeRemote workFlexible hours$180k - $250k
...We’re hiring a full‑time AI Engineer to own the prompts, agents, evals, and pipelines behind user‑facing features that ship to users. You’ll take product requirements and turn them into working prompts, agents, and pipelines. You’ll evaluate them rigorously, iterate...Full timeWork at officeRelocation$230k
...Everyone's building AI agents, but almost nobody gets them to production. Building... ...authorization, governance, and trust become the real engineering challenge. Arcade is the MCP runtime... ...it out. A testing mindset - tests and evals that catch real failures, not just green...Shift work$250k - $350k
...Spectral Labs is building foundation models for engineering physical systems. We're looking for an AI engineer to build the systems that put those models to... ...connect LLMs to our geometry models, and the task-level evals that decide what's ready to ship. You bring 3–5...Work at officeVisa sponsorship- ...Chief AI is building the intelligence platform to power the world's leaders. The relationships... ...The Role We are hiring a Founding AI Engineer to build the systems that define a new... ...weeks Ship core agent features and evals that executive teams rely on day-to-day...
- ...We are hiring an AI Engineer to join Proteus in San Francisco. We are building a Biological Intelligence Platform for the autonomous discovery... ..., tool use, and orchestration Has built the benchmarks and evals to know whether any of it actually works Has worked with...Full time
- ...Who we are: Cooper is an AI coworker for the insurance industry. Getting a business... ...the role: We're hiring the Founding Engineering team for a new hyper-growth AI business unit... ...ASR / TTS, vector stores, orchestration, evals). You're pragmatic about trade-offs...
- ...Francisco Bay Area, CA · Hybrid · Full-time We are looking for an AI System Engineer who builds the core AI systems that generate and optimize chip... ...GPUs/TPUs. Reinforcement Learning : Familiarity with RL concepts. Bonus Points (Preferred) Experience at AI labs...Full timeShift work
$175k - $215k
...Samba TV AI Revenue Architect Samba is a media intelligence company. We know what... ...and account records with live signals Evals, reliability, and continuous improvement... ...best practices, MCP architecture, prompt engineering standards, and enablement Write documentation...- ...You'll Do Build and experiment with AI systems for code understanding, vulnerability... ...Work closely with product and engineering teams to integrate AI capabilities into Corridor... ...model fine-tuning, evaluation pipelines, or RL-style environments ~ Self-directed and curious...
$225k - $255k
...a small, product-focused team building an AI-powered B2B pricing platform that helps companies... ...discount governance. As our Founding AI Engineer , you'll own the evaluation systems,... .... ~ Direct hands-on experience building evals and observability for LLM systems. ~...Relocation- ...AI ENGINEER AT CYVL Cyvl has one of the largest proprietary datasets of US infrastructure: LiDAR and imagery from hundreds of cities.... ...vision, 3D perception, or LLM applications (RAG, tool use, agents, evals) ~ Solid software engineering fundamentals: testing, code...Work at officeRemote work
$157.5k - $210k
...Position Summary: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy org and a major contributor... ...integrations, and workflow automation. Experience with LLM evals, observability, and optimization (Langfuse, Weights & Biases)....Contract workWork from homeFlexible hours$7.5k
...AI Engineer Location: San Francisco, CA or Phoenix, AZ (In-Office) Partnership: EQL Tech has been exclusively retained by a high... ...standards a regulated fintech product demands Create robust evals: build evaluation frameworks that make AI behaviour measurable...Work at officeRelocationVisa sponsorshipRelocation package$180k - $300k
...About the role You'll own the core AI systems that power Gamma: the models, prompts... ...our AI stack. You'll work closely with engineering and product to ship improvements that... ...Strong data instincts: experience writing evals, designing metrics, and translating qualitative...Full timeWork at officeImmediate startWork from home- ...is partnering with a fast-moving technology company to find an AI Engineer to build and ship LLM-powered applications. Our client is looking... ...and ship features. Applied-AI literacy. Can reason about evals, statistics, and the non-determinism of LLM systems. Familiarity...Full timeWork experience placementWork at officeRemote work
- A pioneering technology company in San Francisco is hiring an AI/ML Engineer to develop and implement advanced models using deep reinforcement learning. The successful candidate will work on real-world systems, conducting experiments and analysis to improve model performance...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer, RL & Evals. Be the first to apply!
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer San Francisco, CA
- azure ai engineer
- machine learning ai engineer



