Remote AI Engineer, Quality & Evaluation at Enterprise Scale
Fieldguide
San Francisco, CA
- Remote job
A pioneering AI technology firm based in San Francisco is seeking an AI Engineer to own the evaluation infrastructure for AI agents. This role requires designing automated pipelines and building observability systems, ensuring agent performance meets enterprise standards. Ideal candidates have experience in production software and familiarity with TypeScript, React, and Python. The firm values collaboration, inclusivity, and personal growth, offering competitive compensation and flexible work arrangements. #J-18808-Ljbffr Fieldguide
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote AI Engineer, Quality & Evaluation at Enterprise Scale in San Francisco, CA vacancy
$136k - $265.7k
...looking for a Staff Enterprise AI Engineer – Agentic Workflows &... ...focused on building and scaling enterprise AI... ...alignment on scope, quality, and execution standards... ...agents, RAG pipelines, or evaluation frameworks. ~ Deep... ...compensation. Fully remote work flexibility...Remote jobQualityFull timejobgether
United States2 days ago- ...started Handshake AI and built the... ...to create evaluations, publish benchmarks... ...economy, at global scale, with impact... ...together with engineers, scientists, operators... ...Handshake AI Enterprise, you'll be part... ..., or AI quality measurement Domain... ...development Remote & Office: Internet...Remote workQualityFull timeWork at officeFlexible hours
Handshake
San Francisco, CA11 hours ago $180k
...professionals towards their dream careers AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate about... ...deployed safely, reliably, and at scale? This is a rare opportunity to join... ...analysis and validating data quality/performance Bonus: experience with...Remote workQualityFull time$109.6k - $164.4k
...Senior AI Engineer The Enterprise AI team, part of the Chief Data and Analytics Office, is at the forefront... ...drive measurable business impact at scale. As the Senior AI Engineer, you will... ...Finance, Commercial, Supply Chain, Quality, Operational Excellence and Lean,...Remote workQualityWork at officeVisa sponsorshipWork visaRelocation packageGE
United States12 days ago$142.8k - $196.35k
...veteran. Job Description: Senior AI Engineer, Enterprise Agentic Solutions 3M Health... ...Performance Optimization & Evaluation: Design and execute prompt... .... Establish code quality standards, write comprehensive... ...deliverables. Work location: Remote Travel: May include up to 1...Remote workQualityFull timeH1bFlexible hours- ...Description: Sr. Data Engineer -AI-ready-enterprise-scale data platforms seattle WA visa -any rate... ...foundations -ensuring data is high-quality, governed, and optimized for... ...needs to be approved by SCSC) : No Remote work possibility : (No Value) Global...Remote workQualityFreelanceLocal areaFlexible hours
Hallmark Global Solutions Ltd
Bellevue, WA11 hours ago - ...AI Native Software Engineer (All Levels) Bay Area | In-Office... ...for AI in the enterprise. As companies... ...observe adoption, evaluate proficiency, and... ...(speed, quality, absorption, and... ...be redesigned to scale impact. We're not... ...move forward Remote-only candidates...Remote workQualityWork at office
Larridin
San Francisco, CA3 days ago $156.4k - $265.7k
...One — our cloud-first, AI-powered platform —... ...We are standing up an enterprise AI capability across... ...and standards, mentor engineers, and steer external delivery... ...problems. This is a remote-based position... ...productivity gains. Establish evaluation, quality, and monitoring...Remote workQualityFull time- ...AI Engineer - GenAI | Gemini Enterprise | Vertex AI 3 Roles Location: New... ...opportunity to work on enterprise-scale AI initiatives focused on... ...delivery ensuring quality and timely execution... ...AI implementations Evaluate AI system performance and...QualityContract work
United Software Group
Edison, NJ11 hours ago - ...Senior AI Engineer Remote RegScale is a continuous controls... ...automate and scale their security, risk,... ...execution to a disciplined, enterprise ready engineering organization... ...fine tuning and evaluation, agent design and... ...depend on, ensuring quality and traceability from...Remote workQuality
RegScale
United States3 days ago - ...CA, and built remote-first. We're backed... ...is building AI agents for the... ...As a Senior AI Engineer, you'll own meaningful... ..., building evaluation systems, and... ...harden systems for enterprise-grade... ...that perform at scale Drive Product... ...Raise the quality bar through code...Remote workQualityFlexible hours
Fieldguide.ai
San Francisco, CA4 days ago - ...HPC & AI Senior Performance Engineer This role has been designated as 'Remote/Teleworker', which means... ...Hewlett Packard Enterprise is the global edge... ...and direction Evaluate emerging... ...to deliver high-quality benchmark results... ...Experience with large-scale HPC systems and...Remote workQualityWork from homeWorldwide
Hewlett Packard Enterprise
United States3 days ago - ...Senior AI Engineer Location: This position... ...following area(s): US (remote) with 20% Travel.... ...integrate into enterprise operations and... ...how our AI work scales over time. Why... ...Cursor to ship higher-quality work at pace... ...Experience with evaluation frameworks, and observability...Remote workQuality
Robots & Pencils
United States2 days ago - ...Senior AI Engineer - Agentic Solutions Candidates... ...agentic systems with enterprise data sources, internal... ...data grounding, output quality, reliability, and graceful... ...monitoring and evaluation. • Working knowledge... ...and agentic patterns scale across DBS. • Grow from...Remote workQualityFull time3 days per week
Apolis
United States11 hours ago $60 per hour
A leading AI development firm is seeking proficient programmers to contribute... ...systems. Enjoy the flexibility of remote work and choose projects that... ...designing coding problems for AI, evaluating AI-generated code, and writing high-quality code. Ideal candidates have...Remote jobQuality- David Joseph & Company is seeking an AI Engineer to design and deploy machine learning models for enterprise users. This fully remote role requires 5+ years of experience and advanced... ...of model deployment and ensure high-quality data management while actively participating...Remote jobQuality
- ...Suites is seeking AI Software Engineers to join our... ...to deliver high-quality solutions independently... ...someone who is fully remote regardless of... ...AI services and enterprise systems. Prepare... ...Focus Areas: Evaluate solution performance... ...streamline and scale their IT products...Remote workQualityWork at officeImmediate startWork from homeHome office
ERP Suites
United States11 hours ago $60 per hour
A leading AI development company seeks proficient programmers to contribute to... ...-edge AI systems while enjoying fully remote work and a flexible schedule. Responsibilities... ...solving coding problems, writing high-quality code, and evaluating AI-generated code. Ideal candidates...Remote jobQualityHourly payFlexible hours- ...Senior AI Engineer We're looking for a Senior AI Engineer to build and scale production-grade AI systems that... ...workflows Implement evaluation, monitoring, and... ...Ability to balance speed, quality, cost, and... ...legal, healthcare, or enterprise data models Familiarity...Remote workQualityFlexible hours
Venturefizz Product Management Community
United States1 day ago $40 per hour
DataAnnotation is seeking a Chemical Engineer to assist in training AI models related to chemistry. Responsibilities include evaluating AI outputs and ensuring the quality of the models. Ideal candidates... ...Master's and/or PhD. This is a remote independent contractor position...Remote jobQualityHourly payFor contractors- ...Senior Software Engineer - AI II Recruiter:... ...engineering with the scale and stability of a large enterprise, focused on delivering... ...Ensure system quality, reliability, and compliance... ...concepts (POCs) to evaluate emerging... ...combination of in-office and remote work Work-Life...Remote workQualityWork at officeFlexible hours
Symbiotic Corp.
Frisco, TX3 days ago $150k - $250k
...About Distyl AI Distyl is an applied... ...one of the few enterprise AI companies to run... ...AI systems using Evaluation-Driven Development... ...AI Evaluation Engineers focus on designing... ...Define how system quality is measured in each... ...and graders that scale ~ Systems-Oriented...Quality3 days per weekDistyl AI
New York, NY1 day ago$160k
...About the job AI Engineer Job Title:... ...Systems Location: Remote Department:... ...(RAG), evaluation frameworks, and AI... ...to ground LLMs in enterprise or domain-specific... ...offs , retrieval quality , context window... ...profiling for large-scale AI systems....Remote workQualityInizio Partners
New York, NY4 days ago- ...AI Engineer Fieldguide is building AI agents for the most... ...workflows, architectures, and evaluation systems that power enterprise-grade agents. You'll... ...pipelines that perform at scale Contribute to Product... ...to detail: You care about quality in code and customer-...Remote workQualityFlexible hours
Fieldguide.ai
United States3 days ago - ...AI Engineer (R&D) NTT DATA Services strives... ...bar for technical quality through strong code... ...quality checks Evaluate third-party AI platforms... ...generated code to enterprise standards... ...capabilities in enterprise-scale AI, cloud,... ...many positions offer remote or hybrid work options...Remote workQualityFor subcontractorWork at officeFlexible hours
Sierra Systems, An Ntt Data Company
Dallas, TX3 days ago - ...AI LLM Engineer Join us in pioneering breakthroughs... ...RAG pipelines, enterprise copilots, and... ...service analytics at scale. This role is... ...Georgia with some remote/hybrid flexibility... ...systems Develop evaluation frameworks for... ...performance, answer quality, hallucination...Remote workQuality
Siemens Healthineers
Atlanta, GA11 hours ago - ...builds, deploys, and scales AI-driven identity solutions... ...Head of New Product Engineering, you'll join a new... ...decision-making across the enterprise. What You'll Do... ...to enhance reasoning quality and task reliability.... ...- Leverage the evaluation harness and tracing substrate...Remote workQuality
Socure Inc
United States11 hours ago $142.65k - $213.98k
...from the office for the remote option.) Job Summary The Agent Evaluation team is responsible for testing whether AI agents return the correct... ...benchmarks for conversational AI quality (accuracy, relevance, CX,... ...quality Partner with engineering, and product teams to...Remote workQualityWork experience placementWork at officeWorldwideComcast Corporation
Washington DC4 days ago$85 - $95 per hour
...Marketing Software & AI Marketing Engineer serves as a hands... ...developing, and scaling AI-powered... ...ensuring compliance, quality, and performance. Location: Remote EST time zone... ...success metrics to evaluate agent performance... ...user workflows, and enterprise security best...Remote workQualityHourly payContract workTemporary workLocal areaSystem One
Pawtucket, RI11 hours ago- ...Senior Agentic AI Engineer Revolutionize the future... ...increase productivity, quality, safety, and sustainability... ...-built products to enterprise-level solutions, our... ...and advanced retrieval evaluators. Lead the integration... ...of developing and scaling high-quality code....Remote workQualityLocal areaWorldwide
Trimble
United States3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Engineer, Quality & Evaluation at Enterprise Scale. Be the first to apply!
Related searches
- ai engineer remote San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- remote quality assurance San Francisco, CA
- remote accounts payable San Francisco, CA