Remote AI Engineer, Quality & Evaluation at Enterprise Scale

Fieldguide

Remote job

A pioneering AI technology firm based in San Francisco is seeking an AI Engineer to own the evaluation infrastructure for AI agents. This role requires designing automated pipelines and building observability systems, ensuring agent performance meets enterprise standards. Ideal candidates have experience in production software and familiarity with TypeScript, React, and Python. The firm values collaboration, inclusivity, and personal growth, offering competitive compensation and flexible work arrangements. #J-18808-Ljbffr Fieldguide

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Remote AI Engineer, Quality & Evaluation at Enterprise Scale in San Francisco, CA vacancy

Senior Applied AI Engineer, Handshake AI Enterprise
...started Handshake AI and built the... ...to create evaluations, publish benchmarks... ...economy, at global scale, with impact... ...together with engineers, scientists, operators... ...Handshake AI Enterprise, you'll embed... ...sacrificing quality Surface insights... ...Remote & Office: Internet...
Remote work
Quality
Full time
Work at office
Flexible hours
Handshake
San Francisco, CA
4 days ago
US Tech - AI Evaluation Engineer (QA) Senior Associate
$55k - $151.47k
...data and analytics engineering focus on... ...clients, and to deliver quality. Embracing increased... ...the People Tech & AI team you will develop... ...Understanding enterprise data patterns and... ...Executing LLM evaluation frameworks using defined... ...application deadlines: #LI-Remote #LI-Hybrid...
Remote work
Quality
Full time
Work experience placement
H1b
PwC
Jacksonville, FL
9 hours ago
Scaled AI Success Engineer
AI Success - San Francisco, New York City, and Remote - US OpenAI’s AI Success Engineer team partners with the world’s most ambitious organizations... ...first deployment through scaled enterprise adoption. Our work spans... ...such as latency, cost, quality, prompting, routing, rate...
Remote work
Quality
OpenAI
Los Angeles, CA
3 days ago
Remote AI Training Engineer - Code, Evaluate & Shape AI
$60 per hour
A leading AI development company is seeking proficient programmers to contribute... ...-edge AI systems. Join a fully remote team and enjoy the flexibility of selecting... ...tasks for AI training, writing high-quality code snippets, and evaluating AI-generated code. Ideal candidates...
Remote work
Quality
DataAnnotation
Santa Fe, NM
1 day ago
AI Engineer, Evaluation
$150k - $250k
...About Distyl AI Distyl is an applied... ...one of the few enterprise AI companies to run... ...AI systems using Evaluation-Driven Development... ...AI Evaluation Engineers focus on designing... ...Define how system quality is measured in each... ...and graders that scale ~ Systems-Oriented...
Quality
3 days per week
Distyl AI
New York, NY
9 hours ago
Senior AI Engineer - Enterprise Applications
...Overview: Senior AI Engineer - Enterprise Applications About the Role... ...responsibly deployed at enterprise scale. What You'll Do... ...metrics (e.g., efficiency gains, quality improvement, risk reduction... ...and sustainable. Model Evaluation, Quality, & Governance...
Quality
SCIGON Solutions
New York, NY
9 hours ago
AI Software Engineering Lead
$140k - $160k
...AI Software Engineering Lead Location: Columbus, Ohio / Remote Duration: Fulltime Salary... ...productivity and quality. Success means moving... ...that can be scaled beyond the pilot... ...standards. Enterprise delivery experience... ...will be evaluated solely on the basis...
Remote work
Quality
Full time
Diverse Lynx
United States
1 day ago
Remote AI DevOps Engineer Model QA & Evaluation
$40 per hour
...A technology company is seeking a DevOps Engineer to evaluate AI models and improve their performance. The position is remote, offering flexibility in scheduling and project... ...competitive pay starting at $40+ per hour along with bonuses for high-quality work. #J-18808-Ljbffr...
Remote work
Quality
Hourly pay
DataAnnotation
Raleigh, NC
9 hours ago
AI Native Software Engineer (All Levels)
...AI Native Software Engineer (All Levels) Bay Area | In-Office... ...for AI in the enterprise. As companies... ...observe adoption, evaluate proficiency, and... ...(speed, quality, absorption, and... ...be redesigned to scale impact. We're not... ...move forward Remote-only candidates...
Remote work
Quality
Work at office
Larridin
San Francisco, CA
2 days ago
Principle AI Engineer
...experience in software engineering, with... ...Experience with Vertex AI, Gemini APIs,... ...APIs, or similar enterprise AI platforms.***... ...with model evaluation pipelines and AI quality metrics.***** **... ...how F5 builds and scales agentic AI across... ...****@*****.***.**Remote**: Primarily...
Remote work
Quality
Work at office
Local area
Work from home
F5 Networks
Seattle, WA
9 hours ago
Senior AI Engineer
...CA, and built remote-first. We're backed... ...is building AI agents for the... ...As a Senior AI Engineer, you'll own meaningful... ..., building evaluation systems, and... ...harden systems for enterprise-grade... ...that perform at scale Drive Product... ...Raise the quality bar through code...
Remote work
Quality
Flexible hours
Fieldguide.ai
San Francisco, CA
2 days ago
AI Software Engineer
...Suites is seeking AI Software Engineers to join our... ...to deliver high-quality solutions independently... ...someone who is fully remote regardless of... ...AI services and enterprise systems. Prepare... ...Focus Areas: Evaluate solution performance... ...streamline and scale their IT products...
Remote work
Quality
Work at office
Immediate start
Work from home
Home office
ERP Suites
United States
4 days ago
Remote AI Web Engineer Train & Evaluate Chatbots
$40 per hour
A technology company is seeking a Web Engineer to train AI models remotely, offering either full-time or part-time options. The role involves evaluating AI chatbots' coding challenges and assessing the quality of AI outputs. Applicants should be fluent in English and detail...
Remote work
Quality
Hourly pay
Full time
Part time
DataAnnotation
New York, NY
1 day ago
Staff AI Engineer
$200k - $230k
...Emergence AI is building next-generation... ...As a Staff AI Engineer at Emergence,... ...in high-stakes enterprise environments... .... Evaluation Infrastructure.... ...and improve AI quality systematically... ...frameworks at scale. ~ Track record... ...recharge ~ Flexible remote work environment...
Remote work
Quality
Work from home
Home office
Flexible hours
Emergence
Irvine, CA
2 days ago
Senior AI Software Engineer - Level II
...Senior Software Engineer - AI II Recruiter:... ...engineering with the scale and stability of a large enterprise, focused on delivering... ...Ensure system quality, reliability, and compliance... ...concepts (POCs) to evaluate emerging... ...combination of in-office and remote work Work-Life...
Remote work
Quality
Work at office
Flexible hours
Symbiotic Corp.
Saint Paul, MN
2 days ago
Applied AI / Evaluation Engineer
$155k
As an Applied AI / Evaluation Engineer, you will own the quality, measurement, and behavioral assurance of the NAVEX... ...evaluation. If you want to ensure enterprise agentic AI systems are trustworthy... ...and protect their people—at a scale few companies can match. High-Performance...
Quality
NAVEX Global, Inc.
Charlotte, NC
1 day ago
Senior AI Software Engineer - Level I
...Senior Software Engineer - AI I Recruiter:... ...solving with the scale and stability of an established enterprise, focusing on AI-powered... ...to ensure system quality, reliability, and... ...innovative AI use cases Evaluate existing systems... ...of in-office and remote work...
Remote work
Quality
Work at office
Flexible hours
Symbiotic Corp.
New York, NY
2 days ago
Senior AI Software Engineer
...isn't just another engineering role. You'll be... ...are an experienced AI engineer who... ...about reliability, evaluation, and scale—not just whether... ...Integrate with Enterprise-Grade Infrastructure... ...Francisco Bay Area; remote-first with... ...deliver the highest quality of work for our clients...
Remote work
Quality
Work at office
Local area
Work from home
Hyperproof
San Francisco, CA
9 hours ago
Senior Generative AI Engineer US Remote
$125k - $156.3k
...The Senior Generative AI Engineer is responsible for... ...learning engineering at scale, with a passion for... ...role, you will develop enterprise‑grade AI/ML solutions... ...when appropriate Set quality, evaluation, and reliability... ...., HIPAA, CLIA, FDA) Remote USA $125,000 - $156,3...
Remote work
Quality
Immediate start
Worldwide
Natera
New York, NY
9 hours ago
Remote AI Backend Engineer Train & Evaluate Chatbots
$40 per hour
A technology firm is seeking a Back End Developer to train AI models and evaluate their performance. Ideal candidates should be proficient in... ...Responsibilities include assessing outputs from AI chatbots and ensuring quality. This independent contract position offers flexibility and...
Remote work
Quality
Hourly pay
Contract work
DataAnnotation
Charleston, WV
9 hours ago
AI Assurance Engineer
$114.6k - $190.2k
...AI Assurance Engineer Unlock the secrets of intelligence with... ...and sustainment of enterprise-scale AI, data, and... ...Support AI testing, evaluation, verification, and validation... ...in AI testing, quality assurance, or model... ...geographic location (For Remote Opportunities),...
Remote work
Quality
Hourly pay
Contract work
Temporary work
Work experience placement
Work at office
Local area
ManTech
Washington DC
9 hours ago
Senior AI Engineer
$150k - $160k
...is a frontier AI data foundry that... ...diverse, high-quality data, using our... ...Seven and our enterprise clients with safe... ...and engineers. We harness the... ...deploying GenAI at scale, helping to ensure... .../ Palo Alto / Remote Job Description... ...pipelines, evaluation, and deployment...
Remote work
Quality
Centific
Redmond, WA
4 days ago
Senior AI Engineer
...Founded in 2012, H2O.ai is on a mission... ...AI to help enterprises and public... ...for a Senior AI Engineer who builds things... ...seen, used, and evaluated by real... ...maintainability at scale. Develop ML... ...cohesive, high-quality solutions. What... ...total rewards Remote-friendly...
Remote work
Quality
Worldwide
Flexible hours
H2O.ai
Charlotte, NC
9 hours ago
Senior Staff AI Engineer - Enterprise AI (Agentic AI)
$191k - $315k
...Overview: LinkedIn's Enterprise AI team creates... ...LLM-as-a-judge, prompt engineering, embedding-based retrieval... ...acquisition. Build and scale production-grade LLM... ..., improve signal quality, and reduce time-to-interview... ...environments. Evaluate and drive key engineering...
Quality
For contractors
Work at office
Flexible hours
LinkedIn
Mountain View, CA
1 day ago
Remote AI DevOps Engineer: Model Evaluation & Training
$40 per hour
...A technology company is seeking a remote DevOps Engineer to train AI models by giving coding challenges, evaluating outputs, and improving model quality. Proficiency in a programming language, especially Python or JavaScript, is essential. This independent contract job...
Remote work
Quality
Hourly pay
Contract work
Flexible hours
DataAnnotation
Vermont
9 hours ago
Distinguished AI Engineer (Remote)
$244.7k - $279.2k
...Distinguished AI Engineer (Remote) Job Description Overview:... ...at the forefront of enterprises leveraging AI. From informing... ..., guardrails, model evaluation, experimentation,... ...throughput — of large scale production AI systems... ..., take pride in the quality of your work, and also...
Remote work
Quality
Full time
Part time
Local area
Capital One Financial Corp
United States
4 days ago
Marketing Software and AI Marketing Engineer (REMOTE)
$95 per hour
...Marketing Software & AI Marketing Engineer serves as a hands... ...developing, and scaling AI-powered... ...ensuring compliance, quality, and performance. Location: Remote EST time zone... ...success metrics to evaluate agent performance... ...user workflows, and enterprise security best...
Remote work
Quality
Contract work
Local area
TeamPeople
United States
4 days ago
Founding AI Engineer (US)
$250k
...building the first AI-powered... ...a Founding AI Engineer at Fiska, you'll... ...while maintaining enterprise‑grade reliability... ...iteration Evaluation Infrastructure:... ...speed, and output quality for optimal performance... ..., and scaling Proficiency in... ...and your family Remote First Work from...
Remote work
Quality
Home office
Flexible hours
Fiska
New York, NY
3 days ago
Sr. Staff AI Engineer, Enterprise Applied AI
$265k - $331.3k
...contributor to build and scale our Enterprise Applied AI solutions driving impact... ...internal teams. As an Staff AI Engineer (Staff or Senior Staff) ,... ...Chain, Procurement, Quality), Product, Sales, Customer... ...retrieval-augmented generation, evaluation frameworks, and scalable...
Quality
Full time
Contract work
Temporary work
Part time
Local area
Shift work
Rivian
Palo Alto, CA
9 hours ago
AI Engineer - Insurance Domain - HYBRID
$87.12k - $181.5k
...currently seeking a AI Engineer - Insurance Domain... ...LLM outputs in enterprise knowledge bases.... ...frameworks and systematic evaluation pipelines to ensure LLM output quality, consistency, and... ...range for this remote role is $87,120 -... ...capabilities in enterprise-scale AI, cloud,...
Remote work
Quality
Work at office
Flexible hours
NTT Data Americas, Inc.
Warren, NJ
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Engineer, Quality & Evaluation at Enterprise Scale. Be the first to apply!