AI Engineer, RL & Evaluations for Creative Domains
Raydar
Raydar is a seed-stage AI company in San Francisco building the data and infrastructure layer to improve model quality in creative domains. You will join as AI Engineer, RL & Evals to design, implement, and scale RL environments, evaluation systems, and production-grade backend pipelines. The role blends back-end and ML work, requiring shipping production code end to end and collaborating with research teams to push model quality in design-oriented tasks. #J-18808-Ljbffr Raydar
$175k - $275k
...the United States to help them hire. AI Engineer RL & Evals Location San Francisco... ...performance in subjective and difficult-to-evaluate domains. The company works directly with... ...evaluation is difficult including creative and subjective domains where quality cannot...CreativeFull timeH1bWork at officeRemote work$175k - $275k
...Our client is a seed-stage AI company building the data and... ...model quality in subjective, creative domains, starting with design. It... ...The role As AI Engineer, RL & Evals, you will build reinforcement... ...reinforcement learning environments, evaluation frameworks and production...CreativeFull timeH1bWork at office$252k - $315k
...is to develop reliable AI systems for the world'... ...the training and evaluation data that frontier labs... ...agentic tool use, and domain expertise. Reinforcement... ...ResponsibilitiesAs a Staff Software Engineer, RL Environments, you'll... ...when the agent is creative about breaking it....CreativeFull timeRemote work- ...millions. Innovation and creative problem solving thrive... ....As part of Schwab’s AI Strategy &... ...brings together product, engineering, strategy, and risk specialists... ...writing and running evaluations for quality and consistency... ...Demonstrated business domain knowledge relevant to...CreativeFull timeWork at office
- ...management, design, and engineering together with the... ...You are an exceptional AI-native software engineer... ..., establish tests and evaluations, and review generated... ...designers, customers, and domain experts. The ability... ...innovative and more creative, which helps us better...CreativePermanent employmentFull timeWork experience placementLive inWork at officeLocal area
$147k - $202k
...comes next.Job Title:Lead AI EngineerCompany:... ...in the lifeThe Lead AI Engineer builds production AI platform... ...orchestration, evaluation, and human review.Build... ...iteration with users or domain teams.Ability to apply... ...Exercises sound judgment, creative thinking, and accountability...CreativeFull timeWork at office$70 - $90 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San... ...Role Responsibilities Evaluate answers from enterprise search and... ...demonstrated expertise in a specific HR domain . ~ Currently in an HR...CreativeFull timeContract workSummer workRemote work- ...Careers Voice & Digital AI 10X Senior AI Engineer San Francisco, CA Hybrid... ...rewards great craftsmanship, creativity and ambition Create... ...design and development of domain‑specific LLMs for targeted... ...LLM training, fine‑tuning, evaluation, and safety ~ Experience...CreativeFull time
$65 - $105 per hour
...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Engineering & Software Domain Expert Type: Contract... ...week Role Responsibilities Evaluate the quality of engineering knowledge...CreativeContract workSummer work$220k - $259k
...leading enterprises orchestrate AI-powered work. Our vision is... ...AI. About the roleAs an AI engineer at WRITER, you'll be at the forefront... ...to the research and evaluation of emerging AI technologies,... ...complex technical challenges with creative AI solutions.You Connect by...CreativeFull timeWork at officeLocal area$122k - $240.5k
Position Summary Join our AI & Engineering team in transforming technology platforms,... ...and implementing both technology and creative business solutions for large companiesManaging... ...Bedrock (foundation models, model evaluation, and agent orchestration); Knowledge...CreativeLocal areaVisa sponsorship$146.37k - $246k
...Finance’s data foundation and AI systems. Our team drives... ...bridge with systems owners, data engineers and the business. You'll design... ...best efforts to bring forth creative, ambitious ideas for our... ...orchestration frameworks, tool use, and evaluation techniques beyond prompt...CreativeFull timeRemote workFlexible hours$180k - $300k
...role You'll own the core AI systems that power Gamma: the... ...job is to elevate quality, evaluate new frontier models, and push... ...stack. You'll work closely with engineering and product to ship... ...love working together to stay creative and connected, with flexibility...CreativeFull timeWork at officeImmediate startWork from home$73.5k - $212.28k
...people in data and analytics engineering focus on leveraging advanced... ...functional teams to incorporate AI into various applications-... ...enhance project outcomes through creative strategies- Identify and... ...closely with team members. We evaluate these factors thoughtfully to...CreativeFull timeH1b$130k - $220k
...** Artificial Analysis is the leading independent AI benchmarking and insights company. They help engineers, enterprises, investors, media, and policymakers understand... ...Is** This role is best described as an AI Evaluation Engineer / Technical Generalist. It is not a...Full timeWorldwide$157.5k - $210k
...: We're looking for an exceptional AI Engineer to be a force multiplier for the Strategy... .... Preferred Qualifications: Domain knowledge in robotics, autonomous vehicles... ...combine world-class technical skills with creative vision, grounded in humility and...CreativeContract workWork from homeFlexible hours- ...Description About JazzX AI: Vision:... ...execution at scale—in domains where getting it wrong... ...seeking an experienced AI Engineer with deep expertise in... ...Reinforcement Learning (RL) to join our team as a... ...production systems. Evaluation & Monitoring: Define frameworks...Full timeWorldwide
$60 - $70 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San... ...Role Responsibilities Evaluate AI-generated responses for safety... ...biosecurity, and other sensitive domains. Apply and refine evaluation rubrics...CreativeContract workSummer workRemote work- ...Job Description Job Description San Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the environments, evaluation systems, and supporting infrastructure used to train and assess long...
$80 - $120 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San... ...management / reliability / SRE Evaluator Type: Contract Compensation... ...Evaluate AI-generated artifacts against domain-specific quality rubrics....CreativeContract workSummer workWork at officeRemote work$159.2k - $301.6k
...Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build... ..., service integration layers, evaluation systems, and reliability mechanisms that... ...engineering organizations. Background in creative tools, productivity applications, developer...CreativeFull timeTemporary workLocal areaRemote workWorldwide- ...Job Description AI Talent Now job # Senior AI Product Engineer (ZR_95_JOB) Our San Franisco based client is... ...them on their journey to democratize creative tools and invent the future stack... ...and generative models to evaluate quality, revise prompts, and improve...CreativeWork experience placement
- Obsidian seeks a senior engineering and software domain expert to join a leading AI lab's research and program management teams in the Bay Area. You will work on how frontier AI models reason about real engineering and software development work, reviewing and defining high...
- ...Origin is building Physical AI for the built world - starting... ...detection. Design offline evaluation metrics that predict real-world... ...least two of: imitation learning, RL, vision-language models, robot... ..., or contact-rich industrial domains. Publications at CoRL, RSS,...
$200k - $250k
...Senior AI Product Engineer Location: San Francisco, CA Company Stage of Funding: Series A AI... ...the next generation of prompt-to-edit creative software and is seeking an experienced... ...content through natural language. Design evaluation frameworks for non-deterministic AI...CreativeWork at office3 days per week$124k - $171k
...comes next.Job Title:Senior AI Automation EngineerCompany:PrologisA... ...lifeThe Senior AI Automation Engineer accelerates the delivery and... ...models, agent workflows, evaluation, guardrails, human review,... ...speed. Exercises sound judgment, creative thinking, and accountability...CreativeFull timeContract workFor contractors- ...Job Description Job Description Benefits: ~ Employee discounts ~ Health insurance ~ Paid time off ~401(k) AI Domain Knowledge Engineer Create enterprise knowledge foundations using ingestion pipelines, vector databases, semantic retrieval, and...
- AI Solutions Architecture & Engineering Managing ConsultantAt Capgemini Invent, we believe difference drives change... ..., we blend our strategic, creative and scientific capabilities, collaborating... ...across operations and customer domains, redefining what enterprise AI advisory...Creative
$100k - $175k
...Back to jobs Applied AI Engineer Remote (San Francisco) Apply About Arize AI is rapidly transforming... ...& Agent Engineering observability and evaluation platform , empowering AI engineers to... ...Reddit, LinkedIn, etc. - A data-driven creative who thrives in ideating and delivering...CreativeFull timeWork at officeRemote workShift workAfternoon shift- Verita AI is seeking an “AI-native” Machine Learning Engineer to join our core engineering team in San Francisco. This role blends research and product work, building robust RL environments and iterating on automation to scale with high quality standards. You will collaborate...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer, RL & Evaluations for Creative Domains. Be the first to apply!
- senior ai engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai prompt engineer San Francisco, CA
- sports creative San Francisco, CA
- creative specialist San Francisco, CA





